They won't go away, but you will eventually learn and see where they are. Sometimes you'll have to engage them, a lot of the time you can get around them.
They're not in all areas, but you will be able to understand how to deal with them and once you can fight back you can handle them.
I was terrified by them in the beginning and didn't want to have to deal with them, but now I really think they're cool and enjoy taking them down. You really go from helpless and confused to knowledgeable and prepared.