Method and adaptively deriving exposure time and frame rate from image motion
First Claim
1. A method of adaptively determining the exposure time and frame rate for each frame captured by an image capture system of the type having an image sensor, optics for forming an image of a scene on the image sensor, and an image processor for determining an exposure time for the image sensor, said method comprising the steps of:
- a) acquiring two time-separated image frames during an initial exposure time set for each of the image frames, wherein each image frame includes one or more moving objects from the scene;
b) spatially registering the two image frames;
c) measuring spatial displacements between the two image frames for the same moving objects;
d) determining a fastest moving object in the scene from the measured spatial displacements;
e) calculating a speed of the fastest moving object;
f) calculating object smear for the fastest moving object based on the initial exposure time;
g) if the object smear exceeds a maximum desired smear, calculating a new exposure time;
h) setting the exposure time for a subsequent image frame to the new exposure time;
i) if the measured spatial displacement of the fastest moving object exceeds a maximum desired displacement, calculating a new frame rate; and
j) setting the frame rate for a subsequent image frame to the new frame rate.
3 Assignments
0 Petitions
Accused Products
Abstract
In a method for determining the frame rate and exposure time for each frame of a video collection, an image capture system acquires at least two successive frames of a scene, separated in time. The two images are compared to determine if objects in the scene are in motion. If motion is detected, then the speed and displacement of the objects that are moving is determined. If the speed of the fastest moving object creates an unacceptable amount of image displacement, then the frame rate for the next frame is changed to one that produces an acceptable amount of image displacement. Also, if the speed of the fastest moving object creates an unacceptable amount of motion blur, then the exposure time for the next frame is changed to one that produces an acceptable amount of motion blur.
61 Citations
15 Claims
-
1. A method of adaptively determining the exposure time and frame rate for each frame captured by an image capture system of the type having an image sensor, optics for forming an image of a scene on the image sensor, and an image processor for determining an exposure time for the image sensor, said method comprising the steps of:
-
a) acquiring two time-separated image frames during an initial exposure time set for each of the image frames, wherein each image frame includes one or more moving objects from the scene;
b) spatially registering the two image frames;
c) measuring spatial displacements between the two image frames for the same moving objects;
d) determining a fastest moving object in the scene from the measured spatial displacements;
e) calculating a speed of the fastest moving object;
f) calculating object smear for the fastest moving object based on the initial exposure time;
g) if the object smear exceeds a maximum desired smear, calculating a new exposure time;
h) setting the exposure time for a subsequent image frame to the new exposure time;
i) if the measured spatial displacement of the fastest moving object exceeds a maximum desired displacement, calculating a new frame rate; and
j) setting the frame rate for a subsequent image frame to the new frame rate. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer program product for adaptively determining the exposure time and frame rate for each frame captured by an image capture system of the type that acquires two time-separated image frames during an initial exposure time set for each of the image frames, wherein each image frame includes one or more moving objects from a scene, said computer program product comprising:
- a computer readable storage medium having a computer program stored thereon for performing the steps of;
a) spatially registering the two image frames;
b) measuring spatial displacements between the two image frames for the same moving objects;
c) determining a fastest moving object in the scene from the measured spatial displacements;
d) calculating a speed of the fastest moving object;
e) calculating object smear for the fastest moving object based on the initial exposure time;
f) if the object smear exceeds a maximum desired smear, calculating a new exposure time;
g) if the measured spatial displacement of the fastest moving object exceeds a maximum desired displacement, calculating a new frame rate; and
h) setting the frame rate for a subsequent image frame to the new frame rate.
- a computer readable storage medium having a computer program stored thereon for performing the steps of;
-
7. A method of adaptively determining the frame rate for each frame captured by an image capture system of the type having an image sensor, optics for forming an image of a scene on the image sensor, and an image processor for determining a frame rate for the image sensor, said method comprising the steps of:
-
a) acquiring two image frames separated in time by an initial frame rate, wherein each image frame includes one or more moving objects from the scene;
b) spatially registering the two image frames;
c) measuring spatial displacements between the two image frames for the same moving objects;
d) determining a fastest moving object in the scene from the measured spatial displacements;
e) calculating a speed of the fastest moving object;
f) calculating the object displacement based on the initial frame rate;
g) if the object displacement exceeds a maximum desired displacement, calculating a new frame rate; and
h) setting the frame rate for a subsequent image frame to the new frame rate. - View Dependent Claims (8, 9, 10, 11)
-
-
12. A computer program product for adaptively determining the frame rate for each frame captured by an image capture system of the type that acquires two image frames separated in time by an initial frame rate, wherein each image frame includes one or more moving objects from a scene, said computer program product comprising:
- a computer readable storage medium having a computer program stored thereon for performing the steps of;
a) spatially registering the two image frames;
b) measuring spatial displacements between the two image frames for the same moving objects;
c) determining a fastest moving object in the scene from the measured spatial displacements;
d) calculating a speed of the fastest moving object;
e) calculating the object displacement based on the initial frame rate; and
f) if the object displacement exceeds a maximum desired displacement, calculating a new frame rate.
- a computer readable storage medium having a computer program stored thereon for performing the steps of;
-
13. A method of adaptively determining the exposure time and frame rate for each frame of an image capture system of the type having an image sensor, optics for forming an image of a scene on the image sensor, and an image processor for determining an exposure time and frame rate for the image sensor, said method comprising the steps of:
-
a) acquiring two time-separated image frames according to an initial exposure time and an initial frame rate, wherein each image frame includes one or more moving objects from the scene;
b) spatially registering the two image frames;
c) measuring spatial displacements between the two image frames for the same moving objects;
d) determining a fastest moving object in the scene from the measured spatial displacements;
e) calculating a speed of the fastest moving object;
f) calculating object smear for the fastest moving object based on the initial exposure time;
g) if the object smear exceeds a maximum desired smear, calculating a new exposure time;
h) calculating the object displacement based on the initial frame rate;
i) if the object displacement exceeds a maximum desired displacement, calculating a new frame rate; and
j) setting the exposure time and frame rate for the next image frame to the new exposure time and new frame rate. - View Dependent Claims (14)
-
-
15. A computer program product for adaptively determining the exposure time and frame rate for each frame captured by an image capture system of the type that acquires two time-separated image frames according to an initial exposure time and an initial frame rate, wherein each image frame includes one or more moving objects from a scene, said computer program comprising:
- a computer readable storage medium having a computer program stored thereon for performing the steps of;
a) measuring spatial displacements between the two image frames for the same moving objects;
b) calculating a speed of a fastest moving object;
c) calculating object smear for the fastest moving object based on the initial exposure time;
d) if the object smear exceeds a maximum desired smear, calculating a new exposure time;
e) calculating the object displacement based on the initial frame rate; and
f) if the object displacement exceeds a maximum desired displacement, calculating a new frame rate.
- a computer readable storage medium having a computer program stored thereon for performing the steps of;
Specification