Don't let people make you feel that way. If you're doing your best, there's nothing they can complain about. Honestly, I know a little girl who has about 10 bettas, still in thier little cups. She keeps them on a shelf because they're 'pretty'. I've talked to her parents about them, but they don't understand. At least your bettas are taken care of!
As for the goldfish, talk to your parents about them. Don't wait till later, you'll probably forget. Explain that if you had a roomful of 12 dogs, you wouldn't let them starve & die, it's not fair to do that to fish either.