That causes problems with culture/language/communication.
Like the saying “from 9 to 5” could not be applied to other timezones anymore. Or when reading direct speech in a book, “Let’s meet at 15:00”, you wouldn’t be able to tell anymore what time of the day that means.
Since both approaches have pros and cons, I think we would need overwhelmingly good arguments to justify a change.