it's not an irrelevant comparison. there are rules to joining the EU, and it's entirely voluntary to join.
and obviously there would be repercussions of leaving. the longer you stay in and the more you integrate, the more leaving will affect your country. do you think if we just cast out one of our states they would have an easy time?