If you have the ability then self hosting is the best option
Otherwise I think instances with less users and content will be quicker, but then the all feed will probably be smaller.
I will also recommend my own instance endlesstalk.org. It is very small(10 users) and the server is located in Germany. Hopefully that is close to where you live, so the latency is low.