I don't notice falling asleep, either, unless I'm interrupted in the process. I definitely notice waking up, though given the intensity of my dreams, I don't really feel like time is vanishing. The line between dream and consciousness is often thin for me.