You Are Enough, You Do Enough
Limits are to be respected, only muscles are to be pushed.
If it's not a dependent or a life obligation, and it does not fit seamlessly around your health conditions, then you don't have time for it and that's the bottom line.
Managing your obligations first is you being a responsible person, it's not taking anything away from anyone else. This should repel entitled takers at the onset.