Yes, if you suspect mites please see a vet. 'mite protectors' do nothing and the sprays they make have chemicals that are not only bad for you but are things you really shouldnt soak your bird in.
It sounds like you may actually be seeing a keratin. It's the casing of a feather and you will usually see a LOT of them when they are molting. The can be all different sizes, but they are usually small; look kind of like flakes of dandriff? They're white. However if your seeing brown or red things, you should get to a vet asap to get him tested/treated for mites.