I would use a skimmer also. FWIW, I run Poly-filter, Purigen and CPE in my sump - all before the water hits the protein skimmer in the return chamber and I still collect a fair amount of gunk.
Someone on the forums summed it up pretty well for me - fish stock add to the bioload, CUC reduces the bioload and corals are neutral. In other words, so long as your are stocking fish you need to balance out the bioload. Fish will probably be more tolerant of water quality issues than corals but they'll be healthier, happier and more active with pristine water.
PS, if the noise from the stock skimmer is a bother (it was for me). There are some skimmer options that are much quieter, I'll vouch for the Turboflotor 500 being nearly silent.