Check out the YW/YMCA, similar groups and community centres. They often take singles.
You should be aware that there are often more single woman than single men though.
Also, see if you can find a ballroom dance society or club in your area. Universities often have ballroom clubs and would have links to other local similar groups.
All of the above will get you started and won't rip you off.
OB