Okay, what brand of pellets, and are the blood worms frozen or dried? I'd stop with the peas, they're alright for a one-time treatment but they can cause damage long-term. Frozen blood worms are a good treat, but you will still want a high quality pellet as a staple- NLS or Omega One are the most recommended. Freeze-dried blood worms on the other hand, are about as nutritious as potato chips and can cause bloating easily. Since he looks skinny to me, I'm guessing he isn't getting enough nutrition. Start feeding him lots of small meals with a good pellet and see if that helps him at all.
Make sure you also do a large change once or twice a week in addition to the gallon a day, which is great by the way, so that nothing bad builds up. Even if you don't change the water use Prime daily when cycling, to make sure the ammonia is detoxified.
Does he have any other injuries on his body, or is any part of his fins turning gray?