Taxes are the flip side of expenditures. The same issues apply on both sides. There are questions of fairness and justice as much in the way you take money away as in the way you disburse it.
It's nice to collect stamps, but if it becomes obsessive, and you start stealing for your stamps, it becomes too much.