Get ones that match your level of experience and ability to care for them. FOr example, if youre "short on funds" as you say, getting a plant that needs cO2 and fertilizer might not be a great idea.
Also, I really dont suggest the bottled water. My water smells much the same, but is not toxic. If its toxic, then it probably wouldnt be provided from the water company. If its a well, then youd be sick. The conditioner will take it out.
For the fry, if you do the bottled thing, they will become used to that and when you try to switch, it will be a longer and annoying process.
Btw- in order to not stunt their growth (Im not sure how old they are) your fry will need daily or every other day water changes...If that four bucks eludes you, you really might want to reconsider buying water. It also lacks (severely) the netrients, etc found in tap water that fish need.
Most conditioners will remove everything.