The key word in the title of this article is "SAFELY." Anyone can descend a fireman's pole, much the same as anyone can "descend" a cliff face. Gravity will look after the downward motion, your job is to control it.
The Fireman's Pole is one of the obstacles that you really have to look out for at the Nut's Challenge (and a couple of other races). It can be quite intimidating at the top but, as long as you know what you're doing, there really is nothing to be afraid of. Check out this how-to video from one of Nut Challenge's official training sessions (which take place most weekends).
Find out more about Nuts Challenge training sessions here.