One thought pattern that's helped me with that kind of dread-feedback is to say "No problem, I can just lie here awake all night. At least I'll rest my body, and I can handle an occasional day without sleep."

I do often fall asleep shortly afterwards as a result, but it requires actually not stressing over in the odd case that I don't.