I have not used a Hoya before. But you can consider B+W or Nikon CPL filters. More costly, not second rate in anyway. There are other brands out there but in general you pay for what you get in terms of color neutrality, sharpness ( degradation ) , construct, coatings.
Putting more glass in front of your lens will definitely degrade the image. It is a matter of the quality of glass u choose in front.
However most of the time it will not be too obvious i think. And if that is no priority i think most brands will do