Joint Bundled Camera Paths for Stereoscopic Video Stabilization

This paper presents a method to stabilize shaky stereoscopic videos captured by hand-held devices. Directly applying traditional monocular video stabilization techniques to two views independently are problematic as it often brings undesirable vertical disparities and produces inaccurate horizontal disparities, which violate original stereoscopic disparity constraints, leading to erroneous depth perception. In this paper, we show that monocular video stabilization methods, such as the bundled camera paths stabilization, can be extended for stereoscopic videos by taking additional disparity constraints during the stabilization. In particular, we first estimate disparities between two views. Then, we compute camera motions as meshes of bundled paths for each view. Next, we smooth paths of two views separately and iteratively. During each iteration, we adjust the meshes of one view by our proposed ‘Joint Disparity and Stability mesh Warp (JDSW)’. The final result is generated after several iterations of paths smoothing and meshes adjusting, in which temporal stability and correct depth perception are achieved simultaneously. We evaluate our method by various challenging stereoscopic videos with different camera motions and scene types. The experiments demonstrate the effectiveness of our method.

Paper: [PDF]

Demo Video: [mp4(104Mb)]

Downloads:
Each example contains four videos, including input_l.avi, input_r.avi, output_l.avi and output_r.avi, where _l and _r stand for left and right views. Click here to download all the data.
Videos are with the codec of XVID.