Only some lenses require that you stop down to achieve a sharper image. "Pro" lenses such as Canon's "L" lineup, in this case the Canon 70-200mm f/2.8L should produce a image as sharp as/sharper than a image taken with a 70-200mm f/4L.
Then again sharpness is how you perceive it to be.