re: Glitch elaboration, mostly spoiler-free
The only method the game has of changing party members goes through two steps: talk to the party member you want to join, then select one of your existing party members to replace. It's not possible to skip the replacement step, so even though the lost character does return to the place you go to change party members, you can never again have a four-member party.