The last bit is not strictly true - if you delete a post/comment it will federate the deletion so it will (should) delete everywhere. Any hosts which are off-line or later defederated might still keep a copy of it though, or a user client may have it cached. "Be careful with what you write" is always good advice regardless!