Not true. The money they receive from loan repayments is factored into the national budget, so forgiving loans means that the government has less money for other programs.
It’s true that they’re not literally spending money here, but it’s the same end result.