Image capturing device having continuous image capture

• US 8,803,981 B2
• Filed: 10/10/2012
• Issued: 08/12/2014
• Est. Priority Date: 06/05/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Brunner, Ralph, Bhogal, Nikhil, Batson, James David
• Primary Examiner(s): LAM, HUNG H
• Application Number:
  US13/648,834
• Publication Number:
  US 20130038771A1
• Time in Patent Office: 671 Days
• Field of Search: 348/208.1, 348/221.2, 348/2, 348/229.1, 348/234, 348/362
• US Class Current: 348/208.1
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04N 1/2137 with temporary storage before final recording, e.g. in a frame buffer
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Methods, devices, and systems for continuous image capturing are described herein. In one embodiment, a method includes continuously capturing a sequence of images with an image capturing device. The method may further include storing a predetermined number of the sequence of images in a buffer. The method may further include receiving a user request to capture an image. In response to the user request, the method may further include automatically selecting one of the buffered images based on an exposure time of one of the buffered images. The sequence of images is captured prior to or concurrently with receiving the user request.

Claims

1. A method comprising:

continuously, after entering a mode, capturing a sequence of images with an image capturing device;

continuously, after entering the mode, storing a predetermined number of the sequence of images in a buffer;

receiving a user request to capture an image; and

in response to the user request, automatically selecting a most recently captured image when an exposure time of the most recently captured image meets a predetermined criteria and automatically selecting one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of the most recently captured image fails to meet the predetermined criteria, wherein the sequence of images were captured prior to receiving the user request.

2. The method of claim 1, further comprising:

displaying, after entering the mode, on a display of the image capturing device, the continuously captured images prior to receiving the user request;

automatically displaying the selected image on the display, wherein the continuously captured images and the selected image are displayed in full resolution, the selected image representing the image captured in response to the user request.

3. The method of claim 1, wherein the predetermined number of the sequence of images stored in the buffer comprises a sequence of three images captured by the image capturing device just prior to receiving the user request.

4. A method comprising:

continuously, after entering a mode, capturing a sequence of images with an image capturing device;

continuously, after entering the mode, storing a predetermined number of the sequence of images in a buffer;

receiving a user request to capture an image; and

in response to the user request, automatically selecting one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of one of the buffered images fails to meet a predetermined criteria, wherein the sequence of images were captured prior to receiving the user request, wherein automatically selecting one of the buffered images based on the image contrast parameter further comprises;

determining a focus score for a focus area of each buffered image, wherein determining a focus score for a focus area of each buffered image further comprises;

for each pixel in a previously calculated focus area, computing the absolute difference in RGB values horizontally and vertically between adjacent pixels;

combining the horizontal and vertical difference values into a single value for each pixel by either forming the sum or a maximum of those two values;

combining these pixel values into scan line values by forming a sum or a maximum of the pixel values; and

adding the scan line values over the entire focus area to generate a focus score for each buffered image.

5. An image capturing device, comprising:

a storage device to store a plurality of captured images;

a lens coupled to the storage device, the lens to receive light associated with the captured images; and

a processing system coupled to the storage device, the processing system is configured, after entry into a mode, to continuously capture images;

store a predetermined number of the sequence of images in a buffer;

to receive a user request to capture an image; and

in response to the user request, to automatically select a most recently captured image when an exposure time of the most recently captured image meets a predetermined criteria and to automatically select one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of the most recently captured image fails to meet the predetermined criteria, wherein the sequence of images were captured prior to receiving the user request.

6. The device of claim 5, wherein the sequence of images comprise only images captured just prior to receiving the user request.

7. The device of claim 5, wherein the processing system is further configured:

to display, after entering the mode, on a display of the image capturing device, the continuously captured images prior to receiving the user request;

to automatically display the selected image on the display, wherein the continuously captured images and the selected image are displayed in full resolution, the selected image representing the image captured in response to the user request.

8. The device of claim 5, wherein the processing system, to store a predetermine number of the sequence of images stored in the buffer, is configured:

to store a sequence of three images captured by the image capturing device just prior to receiving the user request.

9. An image capturing device, comprising:

a storage device to store a plurality of captured images;

a lens coupled to the storage device, the lens to receive light associated with the captured images; and

a processing system coupled to the storage device, the processing system is configured, after entry into a mode, to continuously capture images;

store a predetermined number of the sequence of images in a buffer;

to receive a user request to capture an image; and

in response to the user request, to automatically select one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of one of the buffered images fails to meet a predetermined criteria, wherein the sequence of images were captured prior to receiving the user request, wherein the processing system, to automatically select one of the buffered images based on the image contrast parameter, is further configured;

to determine a focus score for a focus area of each buffered image, wherein the processing system, to determine a focus score for a focus area of each buffered image, is further configured;

to compute the absolute difference in RGB values horizontally and vertically between adjacent pixels for each pixel in a previously calculated focus area;

to combine the horizontal and vertical difference values into a single value for each pixel by either forming the sum or a maximum of those two values;

to combine these pixel values into scan line values by forming a sum or a maximum of the pixel values;

to add the scan line values over the entire focus area to generate a focus score for each buffered image.

10. A machine readable non-transitory storage medium containing executable computer program instructions which when executed by a data processing system causes the system to perform a method, the method comprising:

continuously, after entering a mode, capturing a sequence of images with an image capturing device;

continuously, after entering the mode, storing a predetermined number of the sequence of images in a buffer;

receiving a user request to capture an image; and

in response to the user request, automatically selecting a most recently captured image when an exposure time of the most recently captured image meets a predetermined criteria and automatically selecting one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of the most recently captured image fails to meet the predetermined criteria, wherein the sequence of images were captured prior to receiving the user request.

11. The machine readable non-transitory storage medium of claim 10, the method further comprising:

displaying, after entering the mode, on a display of the image capturing device, the continuously captured images prior to receiving the user request;

automatically displaying the selected image on the display, wherein the continuously captured images and the selected image are displayed in full resolution, the selected image representing the image captured in response to the user request.

12. The machine readable non-transitory storage medium of claim 10, wherein:

the predetermined number of the sequence of images stored in the buffer comprises a sequence of three images captured by the image capturing device just prior to receiving the user request.

13. A machine readable non-transitory storage medium containing executable computer program instructions which when executed by a data processing system causes the system to perform a method, the method comprising:

continuously, after entering a mode, capturing a sequence of images with an image capturing device;

continuously, after entering the mode, storing a predetermined number of the sequence of images in a buffer;

receiving a user request to capture an image; and

in response to the user request, automatically selecting one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of one of the buffered images fails to meet a predetermined criteria, wherein the sequence of images were captured prior to receiving the user request, wherein automatically selecting one of the buffered images based on the image contrast parameter further comprises;

determining a focus score for a focus area of each buffered image, wherein automatically selecting one of the buffered images based on the image contrast parameter further comprises;

determining a focus score for a focus area of each buffered image, wherein determining a focus score for a focus area of each buffered image further comprises;

for each pixel in a previously calculated focus area, computing the absolute difference in RGB values horizontally and vertically between adjacent pixels;

combining the horizontal and vertical difference values into a single value for each pixel by either forming the sum or a maximum of those two values;

combining these pixel values into scan line values by forming a sum or a maximum of the pixel values;

adding the scan line values over the entire focus area to generate a focus score for each buffered image.

14. A machine readable non-transitory storage medium containing executable computer program instructions which when executed by a data processing system causes the system to perform a method, the method comprising:

continuously, after entering a mode, capturing a sequence of images with an image capturing device;

continuously, after entering the mode, storing a predetermined number of the sequence of images in a buffer;

receiving a user request to capture an image; and

in response to the user request, automatically selecting one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of one of the buffered images fails to meet a predetermined criteria, wherein the sequence of images were captured prior to receiving the user request, wherein automatically selecting one of the buffered images based on the image contrast parameter further comprises determining a focus score for a focus area of each buffered image, wherein automatically selecting one of the buffered images further comprises;

determining a weighted factor for each focus score;

determining a product of the focus score and each corresponding weighted factor for each of the buffered images; and

selecting one of the buffered images that has a highest product of the focus score and the corresponding weighted factor.

15. The machine readable non-transitory storage medium of claim 14, wherein a most recently captured image of the buffered images has a highest weighted factor.

16. A method comprising:

continuously, after entering a mode, capturing a sequence of images with an image capturing device;

continuously, after entering the mode, storing a predetermined number of the sequence of images in a buffer;

receiving a user request to capture an image; and

in response to the user request, automatically selecting one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of one of the buffered images fails to meet a predetermined criteria, wherein the sequence of images were captured prior to receiving the user request, wherein automatically selecting one of the buffered images based on the image contrast parameter further comprises;

determining a focus score for a focus area of each buffered image, wherein automatically selecting one of the buffered images further comprises;

determining a weighted factor for each focus score;

determining a product of the focus score and each corresponding weighted factor for each of the buffered images; and

selecting one of the buffered images that has a highest product of the focus score and the corresponding weighted factor.

17. The method of claim 16, wherein a most recently captured image of the buffered images has a highest weighted factor.

18. An image capturing device, comprising:

a storage device to store a plurality of captured images;

a lens coupled to the storage device, the lens to receive light associated with the captured images; and

a processing system coupled to the storage device, the processing system is configured, after entry into a mode, to continuously capture images;

store a predetermined number of the sequence of images in a buffer;

to receive a user request to capture an image; and

in response to the user request, to automatically select one of the buffered images based on an image contrast parameter that compares pixel values within each buffered image when an exposure time of one of the buffered images fails to meet a predetermined criteria, wherein the sequence of images were captured prior to receiving the user request, wherein the processing system, to automatically select one of the buffered images based on the image contrast parameter, is further configured;

to determine a focus score for a focus area of each buffered image, wherein the processing system, to automatically select one of the buffered images based on the image contrast parameter, is further configured;

to determine a weighted factor for each focus score;

to determine a product of the focus score and each corresponding weighted factor for each of the buffered images; and

to select one of the buffered images that has a highest product of the focus score and the corresponding weighted factor.

19. The device of claim 18, wherein a most recently captured image of the buffered images has a highest weighted factor.