My situation was much like yours. For about 8 years I lived in Sonora, California and ran a window and gutter cleaning business. Sonora has a population of 5,000. There are about 5 or 6 other smaller towns within 45 minutes. I also drove an hour and 15 minutes to Modesto to build up my business. Anyways, my business was great! For 3 years (before the recession hit) it grossed over $160K, with just me and one other guy. We built a business that was about 25% Gutter Cleaning and 75% window cleaning. Our window cleaning was about 50% commercial and 50% residential.
I think the key for me was to deliver on the goods when I went out to do a job. We really tried to do the job as if it were our own home, and were not happy until our customer was happy. Also, willingness to go the extra mile to solve and problems or complaints helps a ton.
I say, you might have a wonderful opportunity right where you are. You may have to drive a bit, but the benefits of building your own business far outweigh the negatives.