Change your username as well as your avatar/profile photo. Nothing should be revealed to anyone. For a few hours (probably a day, depending on the size of the group chat/server), go invisible. Leave! After a while, people will still ask you why you left.