It does not. Spending money you borrow at an interest rate that's as low as it currently is, is way, way, way cheaper than going "Oops, sorry, there's currently no money for roads / bridges / hospitals / Kitas /..." and waiting until they've fallen into complete unrepairability, at t which point you'll have to rebuild for way more money.
And speaking of Kitas: we currently have far too few. This forces some parents to stay at home even though they want to work. Borrow money, build Kita, a sizeable portion of the population returns to the workplace.
Better infrastructure allows people to earn more. More earnings is more taxes collected, without raising them on the individual.
Oh wow, this is literally what I've been waiting for.
Edit: OK, it's not quite there yet.