Anyone who acts like your reserved/carved out time for basic health takes you away from
them, who is not a dependent or your child, is someone you need to likely get away from. Whoever thinks they come before your life's priorities and boundaries is the one with the issues. Run!
You shouldn't have to explain to anyone (outside your household or dependents) why the conditions to your survival come before them and why they are not as important as your wellness. The right people encourage your unique health requirements first. They don't personalize lines.
"No" is a complete sentence (especially to people who aren't that close to you or do not deserve to be based on delusional entitlement as they clearly want something from you if they think they're above your time limits and schedule limits as they likely could not manage two businesses and a disability yet want to manage the time of others somehow), firm directness doesn't bother people with maturity and explaining the basics (your basic survival needs) isn't required with aligned souls.
The wrong ones will distort anything you say or do no matter what. Protect your health, do not try to appease trolls (they're not worth your investment).