How are you shooting your video? Handheld? Tripod?
Maybe the difference is there, but you don't notice it because you don't know what to look out for. Or if you are shooting video on a tripod, with a fixed shot, then you don't need VR in the first place, and it can be detrimental to your shot. On tripod, switch off VR.
It's also less noticeable at shorter focal lengths. More noticeable at longer focal lengths.