There's always a way
It wouldn't be nearly impossible to create secret pact with 40 other server owners to remove everyone who disobey them

Lol, I would actually be surprised something like that happened at all. Doubt admins would even risk themselves to be added to our Abuse List, nothing in the website report-wise is permanent and as people can filter their ban lists as they see fitting they won't affect a user as much as they wished to.
Anyway, the community would not pass those cases unseen, as there is a list of who has rated a user, we can see their messages, everything is public.
Without mentioning the chances of that happening are less than 5%, if you're not an admin, don't worry you won't be using it :) and if you are, you're free to set the filter to whatever you want/need ^^
All I see is that admins (who ban me because I'm simply too good for them) get to vote on my "rating"?
Here:
Do not add a user that has not cheated
This system is not meant to ban players that have a different language nickname.
This system is not meant to ban players that missbehave.
This system is not meant to ban players that broke your server's rules.
This system is not meant to ban players that cause drama in your server.
This system is not meant to ban players that killed you.
This system is not meant to ban players that killed someone with a headshot.
This system is not meant to ban players that killed 10 players with 10 bullets.
This system is meant to ban players that use hacks and glitches to obtain advantage in the game.
We know it is some times hard to detect a hacker, we know it will take time to detect, we know Valve will get the rest of the hackers/cheaters that will survive this ban list, we know we can't provide an ultimate tool to ban hackers/cheaters, but what we can do is, discuss and decide as a community. Do it so!
Source: http://rust.yamgames.com/code-of-conduct/