First you need to establish the pH and hardness of your water. For instance, if you have hard water, tetras are out, and if you have really soft water, livebearers aren't a good idea. Until you know that, any list of stocking is purely theoretical.
Originally Posted by AbbieZapp
6 Zebra Danio's
These are not a good idea. They are really active fish and will be much happier in 20 gallons at least.
6 Neon Tetra's
Fine if you have soft water, though I'd suggest Ember tetras instead as being smaller and less active.
12 Ghost Shrimp
These are fine.
1 Corydora Catfish
Again, if you have water on the softer side. However, one is not enough, as cories need schools of at least 4. Look at smaller species such as corydoras panda, pygmaues, hastatus or habrosus.
along with my 1 male Betta.
Is this too many fish?
Added together, yes, it is. A ten gallon, especially one that isn't planted, can support a betta + one school + shrimp, not three schools. So you'd have to choose either:
1) betta + 4-6 cories + shrimp
2) betta + 6-8 tetras + shrimp