Search for carbide burr, or rotary file, plenty of options on ebay
A die grinder is best, but I don't always have compressed air available and have used them in a power drill at 2500 rpm without problems, any slower and you will probably struggle, a cordless definitely wont do it.
so do i a rotary oneAhh.. to "move" holes i use a round file.