I disagree on your expectations for improvement, though agree on the rest.
There are lots of markets with natural barriers to entry were there isn’t any realistic chance for a new competitor to arrise and even if one did thanks to, say, some new technology, they’ll almost certainly only “disrupt” until they became well established and then do the same as all the rest because that maximizes profitability (just look at Uber a decade ago and look at Uber now).
Then there are lots of markets were crooked politcians (which nowadys seems to be most of the ones in the mainstream parties) make sure there are artificial barriers to entry so that well-connected companies are protected from competition - pretty much any market were an operating license is required, such as Banking and Mobile works like that - and that too means no costumer-friendly competitors will arrise in such markets, ever, because the gatekeeping which is in the hands of said crooked politians stops them before they even start, and said political gatekeepers couldn’t care less about consumer-friendliness of market participants and they’ll only change their ways if forced to politically and that’s not going to happen in countries with voting systems designed to maintain a political duopoly such as the US were the politicians rarelly fear losing their positions, especially on complex hard to explain things like how consumers suffer from them “maintaing high artifical market barriers to entry”
In the old days, before neoliberalism got entrenched, you might have such natural or artificial monopoly or cartel markets occupied by a Public company, which due to the lack of competition quickly grew inneficient (in my professional experience the same happens in Private companies in such a situation, by the way), though cheap, and on which there was often political pressure to improve. Now you have them occupied by Private companies who are driven solely by profit-seeking, so it’s still shit (because they cut costs) only it’s also expensive for customers rather than cheap (because they try to squeeze costumers with high prices) and suffers zero political pressure because the politicians hide behind the “It’s a Free Market” to refuse to regulate whilst secretly waiting for their Non-executive board memberships as rewards for being “friends of business” - a wonderful example of all this are Railways in the UK.