Just one thing to add, people freaking out is extremely uncommon. I haven’t even heard about a case IRL, even for trans people it isn’t something that tends to happen.
Don’t be afraid to just guess when you are unsure, you can always ask though and at least for younger generations it isn’t seen as weird or unpolite to do so