I think he’s saying that you might not be able to attribute success to self promotion but you can definitely attribute failure to a lack thereof.
And in doing so, acknowledges your point about not getting big positive responses when you’re a nobody. He is saying to be proud of your work and to stand by it even if others don’t.