Method of stabilizing a sequence of images
First Claim
1. A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device, comprising:
- using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of said sequence of images to provide a sequence of OIS corrected images;
using inertial measurement sensors, determining frame-to-frame movement of the device for each frame during which each OIS corrected image is captured;
obtaining at least an estimate of OIS controlled lens movement responsive to device movement during image acquisition with a lens system including an OIS controller providing, to a central processor of said image capture device, a record of OIS controlled lens movement applied during capture of each OIS corrected image;
removing said estimate from the frame-to-frame movement determined for the frame during which said OIS corrected image was captured to provide a residual measurement of movement for said frame wherein said removing comprises transforming said frame-to-frame movement according to a camera intrinsic matrix and multiplying an inverse of said record of OIS control with transformed frame-to-frame movement to provide said residual measurement of movement; and
performing electronic image stabilization (EIS) of each OIS corrected image based on said residual measurement to provide a stabilized sequence of images.
2 Assignments
0 Petitions
Accused Products
Abstract
A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device is disclosed. The method comprises, using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of the sequence of images to provide a sequence of OIS corrected images. Frame-to-frame movement of the device for each frame during which each OIS corrected image is captured is determined using inertial measurement sensors. At least an estimate of OIS control performed during acquisition of an image is obtained. The estimate is removed from the frame-to-frame movement determined for the frame during which the OIS corrected image was captured to provide a residual measurement of movement for the frame. Electronic image stabilization (EIS) of each OIS corrected image based on the residual measurement is performed to provide a stabilized sequence of images.
-
Citations
2 Claims
-
1. A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device, comprising:
-
using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of said sequence of images to provide a sequence of OIS corrected images; using inertial measurement sensors, determining frame-to-frame movement of the device for each frame during which each OIS corrected image is captured; obtaining at least an estimate of OIS controlled lens movement responsive to device movement during image acquisition with a lens system including an OIS controller providing, to a central processor of said image capture device, a record of OIS controlled lens movement applied during capture of each OIS corrected image; removing said estimate from the frame-to-frame movement determined for the frame during which said OIS corrected image was captured to provide a residual measurement of movement for said frame wherein said removing comprises transforming said frame-to-frame movement according to a camera intrinsic matrix and multiplying an inverse of said record of OIS control with transformed frame-to-frame movement to provide said residual measurement of movement; and performing electronic image stabilization (EIS) of each OIS corrected image based on said residual measurement to provide a stabilized sequence of images.
-
-
2. A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device, comprising:
-
using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of said sequence of images to provide a sequence of OIS corrected images; using inertial measurement sensors, determining frame-to-frame movement of the device for each frame during which each OIS corrected image is captured; obtaining at least an estimate of OIS controlled lens movement responsive to device movement during image acquisition said obtaining including comparing a pair of successively acquired OIS corrected images provided by an image sensor to provide an estimate of frame-to-frame movement between said OIS corrected images, and subtracting frame-to-frame movement of the device using inertial measurement sensors from said estimated frame-to-frame movement to provide said estimate of OIS controlled lens movement performed during acquisition of an image; removing said estimate from the frame-to-frame movement determined for the frame during which said OIS corrected image was captured to provide a residual measurement of movement for said frame; performing electronic image stabilization (EIS) of each OIS corrected image based on said residual measurement to provide a stabilized sequence of images; prior to removing said estimate, subtracting a measurement of frame-to-frame lens rotation from said estimate of frame-to-frame movement; and after removing said estimate, adding said measurement of frame-to-frame lens rotation to said residual measurement of movement for said frame.
-
Specification