After seeing him this morning I have pretty much concluded that I am an idiot...
Watching him swim around I can see that pieces of substrate and other misc stuff get stuck to him and then later fall off from turbulance. At first glance it seems strange that things would just stick to a fish but in reading my Marine Fish's book it says that they have a special coating to deter others from eating them, so perhaps this is what the stuff is sticking to. Or, since he perches on everything and most corals, mushrooms, polyps secrete mucus type coatings, he is getting that on him and then stuff is sticking to that.
Here are some pics from this morning....
