You'd have to use a switch, on a new page when the character is needed. Then just fade out the character a little bit. On the event that removes all members from party (if you have that option), make a fork condition preconditioned with the switch you just activated.
In the Else option, make it remove the character. Do that for all characters in your party.