Using Inertial Sensors To Provide Smoothed Exposure And White Balance Adjustments For Video And Photographic Applications
First Claim
1. A method comprising:
- gathering a first image frame;
storing in a memory buffer the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame;
sensing information from one or more inertial sensors in a camera;
gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame;
using the sensed information to determine a distance traversed by the camera from the gathering of the first image frame to the gathering of the second image frame and, in response to the distance exceeding a predetermined threshold, determining a second white balance value and a second exposure value for the second image frame; and
determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames.
2 Assignments
0 Petitions
Accused Products
Abstract
A first image frame is gathered. The first image frame, a first white balance value, and a first exposure value are stored. Information is sensed from an inertial sensor. A second image frame and intermediate image frames are gathered. A distance traversed by a camera is determined. In response to one or more of: the distance exceeding a predetermined threshold, or a new white balance value significantly differing from a previous white balance value, or a new exposure value significantly differing from a previous exposure value, a second white balance value and a second exposure value are determined for the second image frame. A smoothed white balance value and a smoothed exposure value are determined for the intermediate image frames.
9 Citations
24 Claims
-
1. A method comprising:
-
gathering a first image frame; storing in a memory buffer the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame; sensing information from one or more inertial sensors in a camera; gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame; using the sensed information to determine a distance traversed by the camera from the gathering of the first image frame to the gathering of the second image frame and, in response to the distance exceeding a predetermined threshold, determining a second white balance value and a second exposure value for the second image frame; and determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method comprising:
-
gathering a first image frame; storing in a memory buffer the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame; gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame; storing in a memory buffer the second image frame, a second white balance value for the second image frame, and a second exposure value for the second image frame; determining whether or not the first white balance value is within a first specified threshold of the second white balance value; and
determining whether or not the first exposure value is within a second specified threshold of the second exposure value; andin response to the first white balance value not being within the first specified threshold of the second white balance value, or in response to the first exposure value not being within the second specified threshold of the second exposure value, then determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames. - View Dependent Claims (9, 10, 11)
-
-
12. An apparatus comprising at least one processor, and at least one memory including computer program code, the at least one memory and the computer program code configured, with the at least one processor, to cause, at least in part, the apparatus to perform:
-
gathering a first image frame; storing in a memory buffer the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame; sensing information from one or more inertial sensors in a camera; gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame; using the sensed information to determine a distance traversed by the camera from the gathering of the first image frame to the gathering of the second image frame and, in response to the distance exceeding a predetermined threshold, determining a second white balance value and a second exposure value for the second image frame; and determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. An apparatus comprising at least one processor, and at least one memory including computer program code, the at least one memory and the computer program code configured, with the at least one processor, to cause, at least in part, the apparatus to perform:
-
gathering a first image frame; storing in a memory buffer a the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame; gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame; storing in a memory buffer the second image frame, a second white balance value for the second image frame, and a second exposure value for the second image frame; determining whether or not the first white balance value is within a first specified threshold of the second white balance value; and
determining whether or not the first exposure value is within a second specified threshold of the second exposure value;in response to the first white balance value not being within the first specified threshold of the second white balance value, or in response to the first exposure value not being within the second specified threshold of the second exposure value, then determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames. - View Dependent Claims (20, 21, 22)
-
-
23. A computer program product comprising code stored in a non-transitory computer readable memory for performing at least the following when executed on a computer device:
-
gathering a first image frame; storing in a memory buffer the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame; sensing information from one or more inertial sensors in a camera; gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame; using the sensed information to determine a distance traversed by the camera from the gathering of the first image frame to the gathering of the second image frame and, in response to the distance exceeding a predetermined threshold, determining a second white balance value and a second exposure value for the second image frame; and determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames.
-
-
24. A computer program product comprising code stored in a non-transitory computer readable memory for performing at least the following when executed on a computer device:
-
gathering a first image frame; storing in a memory buffer the first image frame, a first white balance value for the first image frame, and a first exposure value for the first image frame; gathering a second image frame and gathering one or more intermediate image frames after the gathering of the first image frame and prior to the gathering of the second image frame; storing in a memory buffer the second image frame, a second white balance value for the second image frame, and a second exposure value for the second image frame; determining whether or not the first white balance value is within a first specified threshold of the second white balance value; and
determining whether or not the first exposure value is within a second specified threshold of the second exposure value; andin response to the first white balance value not being within the first specified threshold of the second white balance value, or in response to the first exposure value not being within the second specified threshold of the second exposure value, then determining, estimating, or calculating a smoothed white balance value and a smoothed exposure value for the one or more intermediate image frames.
-
Specification