In houses, yes. But public fountains I’ve found in Germany have often the sign Kein Drinkwasser on them. Meanwhile in Switzerland, almost every public fountain is 100% safe to drink.
Things maybe have changed in the recent years, I see you’re on a German instance and I guess you’re German, so I trust your statement more than mine as a foreigner.