It depends on you, how you choose to see the things and how important is this to you.
If a PSA choose to rate you poorly have a reason to do that thing, so speak with that PSA and find what is the reason that he rate you poorly and try to resolve it.
You are the only person that can decide if that affiliate deserve you or not; you know the situation better than anyone and is up to you to take some action, or not.
It is up to you if you will keep them or not.