@Bendersmember, yeah, I'm pretty sure doing it like this is what causes that. I've gone back to previous threads that had numerous responses to my comments, but I never received any notification.
Edit: I'm wrong. Look in your Settings --> Notifications. It's right there. Thanks @insomniac_lemon!