What should I do with my Betta?

The bigger the tank, the better. I would not recommend anything smaller than a 5 gallon. Don't bother with medications unless he get sick. As for the swimming problems, I've found they go away after a few weeks of having enough room to move around.