Ah! Well fantastic, you have a nice budget there then.
Anyway, if you don't want a Kritter/Pet Keeper(which would be your cheapest option), then check and see what they've got on sale in the 2-2.5 gallon range(bigger is always better though of course....any particular reason for wanting the smaller tank?). I would go as close to 2 gallons as you can, 1 gallon is a little small as a long-term home with the exception of some special cases.
For something just at Petsmart, a Kritter/Pet Keeper is going to be the cheapest though.
Not sure what a standard glass 2.5 costs there, never looked myself...but though probably more expensive then a KK, I can't imagine is over $25 itself. xD If you're really against the KK, I'd go with that like FishyFishy suggested.
For a cheap cave or two, pick up some Terracotta/clay pots from your local craft store(I know, not Petsmart...but its really worth it. You can save several bucks here). Rinse them well under hot water, remove the tag, stuff a bit of filter sponge in he hold in the bottom or knock the bottom out completely and you have a nice cave or two for under a buck each.
You can also use coffee mugs for caves as well. Just rinse it VERY VERY well in hot water and scrub it with a plain paper towel, then let it soak in boiling/near boiling water for a bit, just to make sure there is no harmful residue on it if you're using a used one. For a new one, just rinse it really well, maybe let it soak.
If you have a Petco around, I'm a big fan of their silk plants. I would suggest heading there for that instead of Petsmart if you can. In comparison to others I've seen, they're the nicest and fullest and a bit on the cheaper end.
Oh! Also, substrate.....a bag of gravel doesn't cost much, but if you're going for an unfilered/uncycled tank(which I assume you are in that size) then glass marbles are the way to go.....you can get a couple bags for your tank for like....$3 each at your local craft store as well, generally a little cheaper then the ones at Petsmart/Petco, but really the same thing.
I know not all my suggestions are from Petsmart....but I figure I'd toss them our there anyway. Even if you have to make a couple extra stops, saving a few bucks can never hurt right?