I’d recommend giving Sleep by Matthew Walker a read. It dives into many topics including how caffeine negatively affects sleep, which it does regardless if people feel it does or not.
Similarly, as an example, a lot of people think alcohol doesn’t affect their sleep (or makes it better), but research shows even 1 drink hurts the effectiveness of sleep by interrupting the sleep cycles.