For me, whenever traders come around I get notified they're in my area then get notified that they cannot find anything and leave. I'm paraphrasing what it said, but that's the general gist. I have considered building a sort of above ground fort then the real place is all underground. Or go for the classic door in the mountain approach.