Words. Stupid little things defined by cultural-historical precedent. And when politicised they can be weaponized and bastardised for the sake of political advantage.
Jews are technically not the only Semites, but get the distinction through many decades of nationalistic propaganda to continue colonization and genocide.