Difference is definitely noticeable on modern phones. But the biggest issue is it will do this on desktop and tablets as well, where you will really notice the difference.
And like you said, YouTube 480p mode doesn’t have 60fps. That’s noticeable regardless of screen size.