Fiction is very greedy. It will take all you know and then some. The first novel I tried to write, I was struck by this - the appetite of the blank page for ever more information, ever more data. An empty book is a greedy thing. You are right: You wind up using everything you know, and often more than once.
Poker has the feeling of a sport, but you don't have to do push-ups.