I'm not sure if anyone suggested this before, I think not, forgive me if I'm wrong.
I'll make this simple.
I think that, just like in RL, party president should be able to remove people from the party, just like commanders can remove people from their unit.
This will prevent PTO's and if you think that PP will go wild and crazy with this option, be carefull and choose your PP wisely.