Connecting to a switch/router doesn’t change anything, that’s just how the Internet works. The fiber from the street is almost certainly connected to switches before it gets to your house as well.
If anything would break the “fiber to the desktop” meme, it’s the fact that most residential ISP ONTs I’m aware of do not support SFP, which means that you’d have to get copper out of the ONT, then convert it back into fiber. You’d have to get lucky with an ISP that has compatible options.