To save cost yes. If you have 4-5 lenses all different filter size and you use CPLs on all of them, its a rather heavy investment if you buy different sizes. just get a 77mm and ust step up ring, you save quite a nice amount of money.
Would make sense for NDs and CPLs. Saves you space, weight and money. Alternatively, just get lens with 77mm filter. 10-22, 17-55, 17-40, 24-70, 24-105, 70-200 f/2.8, 100-400, etc on Canon are all 77mm. ;p
For CPL and ND filters, you'll probably won't keep them on all the time. Since you WILL be attaching & removing them from the lens anyway, it would be wiser to follow the step up adapter way.
Even if only 2 of your lens uses these filters, and they aren't 77mm (assuming you buy this size for future lenses sake) you will only spend extra $20 for two adapter rings which is cheaper than getting 2 sets of CPL and ND filters.