Yeah, I am Australian. Honestly the dangers are overblown, but there are still a few spiders that make me go a bit wobbly inside.
Orb-weavers (different genus though) are one of them to a tiny degree, not because they're dangerous, or even fast. It's because they have thick webs that they spin every single damn night and you accidentally walk through them. And then they freak out while you're freaking out... and they can really grip on to you.
I don't go walking through gardens at night in some areas anymore, I'm happy to appreciate them from a distance. But I still feel that instinctive "do not want" deep down.