I don’t use an mp3 player. It is inconvenient to carry two devices in your pocket at once. But phones tend to lack physical buttons to control music, and that’s inconvenient.
I remember the times of push-button phones and special models for music: nokia music, sony walkman.