Hi Chris and Sarah,
Unfortunately, what I do, is babysit the skimmer and water level. I work from home so I am able to check on it many times a day. If I couldn't, I would definitely get another skimmer, and probably should anyway. I keep the "gate" almost all the way up, the neck all the way down, try my best to keep the water level constant, and make the tiniest of adjustments to the air valve. You are right, it is very easy to turn the tiniest bit too much and end up with major flow. I'm sorry I don't have better news for you. I don't have a chiller yet, if you do you will probably have less water evaporation (I run the cooling fans 24/7) and will be able to keep the water level more constant which should result in less water top-offs and skimmer adjustments (I would imagine).