You may access the Party Chat menu by pressing and holding the PS button until it appears. After that, go to the Party tab. (Because you are able to personalise the configuration of this sidebar, the placement of the Party tab may differ based on the configuration that you are using.) Choose Audio > Adjust Mix from the menu. This will either lower or raise the loudness of the Party Chat.