It takes time for them to go away. Try feeding once a day or every other day, it won't hurt your Betta. I wouldn't worry too much about them, to my knowledge they are harmless. All of my tanks went through this a some point, how old is the tank? Oh, have you checked your nitrAtes? I seem to recall there being a corelation with high nitrates but I'm not certain.