Motion sensor based virtual tripod method for video stabilization
First Claim
Patent Images
1. A video stabilization method, comprising, for a frame within a video sequence:
- responsive to motion sensor data associated with the video sequence;
computing average motion of a camera, during a capture period about the frame;
determining a difference between actual camera motion for the frame and the average camera motion;
comparing the determined difference between the actual camera motion for the frame and the average camera motion to a plurality of thresholds;
setting a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the plurality of thresholds; and
performing video stabilization on the frame according to the frame'"'"'s strength parameter.
1 Assignment
0 Petitions
Accused Products
Abstract
An apparatus, method, and computer-readable medium for motion sensor-based video stabilization. A motion sensor may capture motion data of a video sequence. A controller may compute average motion data of the camera used to capture the video sequence based on motion data from the motion sensor. The controller may then determine the difference between the actual camera motion and the average camera motion to set a video stabilization strength parameter for the frames in the video sequence. A video stabilization unit may utilize the strength parameter to stabilize the frames in the video sequence.
14 Citations
60 Claims
-
1. A video stabilization method, comprising, for a frame within a video sequence:
responsive to motion sensor data associated with the video sequence; computing average motion of a camera, during a capture period about the frame; determining a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to a plurality of thresholds; setting a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the plurality of thresholds; and performing video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
9. A non-transitory machine-readable storage medium having program instructions, which when executed by a processor perform a method, the method comprising:
-
computing average motion of a camera from motion sensor data associated with a video sequence, wherein the average motion is computed during a capture period about a frame in the video sequence; determining a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to a plurality of thresholds; setting a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the plurality of thresholds; and performing video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. An apparatus comprising:
a processor for executing computer instructions, the computer instructions causing the processor to; responsive to motion sensor data associated with a video sequence; compute average motion of a camera, during a capture period about a frame within the video sequence; determine a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to a plurality of thresholds; set a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the plurality of thresholds; and perform video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
25. An apparatus comprising:
-
a camera to capture a video sequence; a motion sensor to capture motion data associated with the video sequence; a controller to; compute average motion of the camera, during a capture period about a frame within the video sequence, determine a difference between actual camera motion for the frame and the average camera motion, compare the determined difference between the actual camera motion for the frame and the average camera motion to a plurality of thresholds; and set a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the plurality of thresholds; and a video stabilization unit to perform video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (26, 27)
-
-
28. A non-transitory machine-readable storage medium storing video data generated according to a process, the process comprising:
-
capturing video data with a camera, capturing motion sensor data with a motion sensor, and processing the video data with a processor by; computing, from the motion sensor data, average motion of a camera during a capture period about a frame from the video data; determining a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to a plurality of thresholds; setting a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the plurality of thresholds; and performing video stabilization on the frame according to the frame'"'"'s strength parameter; and storing the stabilized video data on the storage medium.
-
-
29. A video stabilization method, comprising, for a frame within a video sequence:
responsive to motion sensor data associated with the video sequence; computing average motion of a camera, during a capture period about the frame; determining a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to at least one threshold; setting a video stabilization strength parameter for the frame based on whether the determined difference of the respective frame is above the at least one threshold; and performing video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (30, 31, 32, 33, 34, 35, 36, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52)
-
37. A non-transitory machine-readable storage medium having program instructions, which when executed by a processor perform a method, the method comprising:
-
computing average motion of a camera from motion sensor data associated with a video sequence, wherein the average motion is computed during a capture period about a frame in the video sequence; determining a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to at least one threshold; setting a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the at least one threshold; and performing video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (38, 53, 54, 55, 56)
-
-
39. An apparatus comprising:
a processor for executing computer instructions, the computer instructions causing the processor to; responsive to motion sensor data associated with a video sequence; compute average motion of a camera, during a capture period about a frame within the video sequence; determine a difference between actual camera motion for the frame and the average camera motion; comparing the determined difference between the actual camera motion for the frame and the average camera motion to at least one threshold; set a video stabilization strength parameter for the frame based on the comparison of the determined difference of the respective frame to the at least one threshold; and perform video stabilization on the frame according to the frame'"'"'s strength parameter. - View Dependent Claims (40, 57, 58, 59, 60)
Specification