Its quite possible to have a small filterless tank. Its not at all suggested if you need it heated though.
I have a 2.5g tank that is all plants and a single betta. The water parameters are flawless and I change it once a week, about 50%, and vacuum the tank every other time. Dirt is okay. Dirt breaks down from both detritus worms and bacteria. Plants eat the nitrates, and the cycle is complete with new water every week. It takes Way more time and care to set up a filterless tank, and expect more then three months of daily checking of water and water changes every other day. If you have a filter that works with the tank, keep it that way. You won't need to worry as much.
For the heater part: Hot water rises while cold water sink, so if you don't have circulation you can have a huge variation in temperature in just 10g. So no heater if their is no filter since it can cause temperature shock.