I don't remember my father reading to me, but I remember him telling me bedtime stories. I got to pick what was in them, and then he'd make them up.
In many ways spiritual exercise is like physical exercise. If you stop exercising physically, your body may not show the results of inactivity for a while. But one day you wake up and find everything is sagging in all the wrong places.