I've watched as ArbCom has made de-adminning decisions that were blatantly improper. I have zero faith that a group other than ArbCom is going to do any better of a job.
Admins have a thankless job. Many of them are regularly treated like crap by new and regular users alike. To have them do their jobs, and then have a sword hanging over their heads by a thread is against our purposes here.
If there's ever a need for a larger de-adminning process than that of ArbCom we can discuss it then. As is, there isn't any clear need in any respect.
-Durin