If you got up on the bandstand at Minton's and couldn't play, you were not only going to be embarrassed by the people ignoring you or booing you, you might get your ass kicked.
If my attention is wandering, there is somewhere it wants to go, so obviously it does not want to be where I am holding it in the name of some self-styled obligation.