Definitely look around for some group lessons, as they are a good place to start and help you determine what style of dance you are most interested in; then you can start taking private lessons.
Costumes are only used in competitions or shows, and if you compete you are usually only allowed to wear costumes after you reach Silver level, which usually takes about a year or so. So you don't need one just yet!