I don't think that's a good idea. On the Bambara Wikipedia I only added French to the Wikipedia: namespace. And my Babel template is bm-1. :)
When applying for Bambara Wikipedia administratorship I explicitely mentioned that I'll drop my administratorship as soon as there are some native speaking folks active as administrator. I think that should be a general policy for administrators who have only a very small knowledge of a language.
Not really necassary to drop it. Just do not use it, or barely use it. As long as you do not abuse it :) and stop others from growing I see nothing wrong with keeping it.
I once helped Thai wikipedia in a big vandalism attack. I got temp adminstatus for that from Angela. After it had had happened Angela took it away as per the rules. But the other admins were greatfull and put a vote on for adminship, for me and another user Ahoerstemeier. We are still admins there and keep an eye out sometimes on Thai wikipedia. No harm done.
Walter/Waerth