It all depends on how you do it. If your other active affiliate wants to take the challenge of working with the inactive ones to activate them , then go ahead . So I would say communicate first, tell them the truth and if they accept then reassign the inactive ones to them.
If no one wants the inactive ones, then reassign the inactive ones to other inactive affiliates . This way you will clean up your lists of direct PSA-es and you get the 5 VP, where applicable, as well.