Frame jitter can occur with progressive frame rates, like the Scarlet uses, during quick pans. (which isn't an issue with interlaced frame rates of video cameras that you may be used to.)
The "jerky" frame will be much less apparent if your following a moving subject through the frame while panning.
See the link below for the ASC recommend panning speeds. For example... shooting 24fps on a 50mm lens should take no less then 23 seconds when panning the camera 90 degrees.
http://4.bp.blogspot.com/_P_2wATt-I1U/Syz7yx4iPHI/AAAAAAAAABs/-xuMAvRwRHo/s1600-h/panning.JPG