In response to your issue, it's possible that unmuting your buddy requires approval from the Enforcement team, which would explain why it takes so long. If your friend is still muted, I recommend contacting our Xbox Support staff so that they may look into the matter further for you.