I definitely get that. Have you ever heard of The Four Agreements? Don Miguel Ruiz.
One of the agreements is "Don't Take Anything Personally", and it specifically says that other people's reactions to us is their issue. They see us through the filter of their own issues.