Storage of easily enriched material to prevent theft is a concern, especially given the number of incidents with jokers photographing themselves inside nuclear facilities and the results of FBI testing of nuclear site security protocols.
Additionally, given the ridiculously long half life of the products, you get into conversations about what happens on the thousands of years time scale in which it’s not reasonable to think that any given state remains politically stable.