i have a betta in a 2.5 gallon heavily planted tank. he's happier than a pig in mud in there.
small tanks are much better when planted, as the plants help to keep the water quality stable/good between water changes.
i would advise going no smaller than a 2.5.