Enhanced image capture

• US 9,774,779 B2
• Filed: 08/04/2014
• Issued: 09/26/2017
• Est. Priority Date: 05/21/2014
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Petrescu, Doina I., Lay, Thomas T., Petrie, Steven R., Ryan, Bill, Sinha, Snigdha, Vanhoof, Jeffrey S.
• Primary Examiner(s): Tran, Nhan T
• Application Number:
  US14/450,390
• Publication Number:
  US 20150341546A1
• Time in Patent Office: 1,149 Days
• Field of Search: 3482071, 34820711, 3482111, 3482112, 382116
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/212 Motion video recording combined with still video recording television signal recording H04N5/76
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

Disclosed are techniques that provide a “best” picture taken within a few seconds of the moment when a capture command is received (e.g., when the “shutter” button is pressed). In some situations, several still images are automatically (that is, without the user'"'"'s input) captured. These images are compared to find a “best” image that is presented to the photographer for consideration. Video is also captured automatically and analyzed to see if there is an action scene or other motion content around the time of the capture command. If the analysis reveals anything interesting, then the video clip is presented to the photographer. The video clip may be cropped to match the still-capture scene and to remove transitory parts. Higher-precision horizon detection may be provided based on motion analysis and on pixel-data analysis.

Claims

1. A method comprising:

outputting, by a processor and to an image-capture device, one or more instructions to capture an image before receiving an indication of a capture command;

storing, data representative of a plurality of still images captured in response to the one or more instructions to capture an image;

receiving, by the processor and at a first time, an indication of a capture command;

outputting, for display, data representative of a first still image of the plurality of still images, wherein the first still image is associated with an image-capture time closest in time to the first time;

determining, by the processor, a first image quality characteristic of the first still image and a second image quality characteristic of a second still image of the plurality of still images;

determining, by the processor, that the second image quality characteristic is greater than the first image quality characteristic; and

outputting, for display, an icon indicating that the second still image is available.

2. The method of claim 1 wherein a rate of capturing the plurality of still images is based, at least in part, on a level of resources available to the image-capture device.

3. The method of claim 1 wherein the first image quality characteristic and the second image quality characteristic each comprise at least one from among motion-sensor data, face-detection information, pixel-frame statistics, activity detection, camera-sensor metadata, camera-sensor state, or input from scene analysis.

4. The method of claim 1 wherein the first image quality characteristic and the second image quality characteristic is determined based on past behavior of the user of the image-capture device.

5. The method of claim 1 wherein determining that the second image quality characteristic is greater than the first image quality characteristic is based on a recommendation received from a server remote from the image-capture device, the recommendation based on data provided by a general population of image-capture devices.

6. The method of claim 5, wherein the data of the general population of image-capture devices includes:

other image data from other captured images;

metadata associated with the capturing of the other image data;

or

selection and interest scores.

7. The method of claim 1 wherein

the data representative of the plurality of captured still images is stored in a circular buffer, and

a latest captured still image replaces an oldest captured still image in the circular buffer.

8. The method of claim 7 further comprising:

copying the second still image to storage outside of the circular buffer; and

further processing the second still image.

9. The method of claim 1, where the capture command is received through a shutter button pressed by a user of the image-capture device.

10. The method of claim 1, wherein the icon is not derived from the second still image.

11. The method of claim 1, wherein the second still image is determined from among still images of the plurality of captured still images having respective image-capture times within a predetermined temporal proximity to the first time.

12. A device comprising:

an image-capture system configured to capture still images;

a user interface configured for receiving a capture command from a user of the image-capture device; and

a processing system operatively connected to the image-capture system and to the user interface and configured for;

outputting, to the image-capture system and before receiving an indication of the capture command from the user interface, one or more instructions to capture an image, the image-capture system capturing a plurality of still images in response to the one or more instructions to capture an image;

receiving, at a first time, an indication of the capture command from the user interface;

outputting, for display, data representative of a first still image of the plurality of still images, wherein the first still image is associated with an image-capture time closest in time to the first time;

determining a first image quality characteristic of the first still image and a second image quality characteristic of a second still image of the plurality of still images;

determining that the second image quality characteristic is greater than the first image quality characteristic; and

outputting, for display, an icon indicating that the second still image is available.

13. The device of claim 12 wherein the image-capture device is a camera, a cellphone, or a tablet computer.

14. The image capture device of claim 12 wherein a rate of capturing the plurality of still images is based, at least in part, on a level of resources available to the image-capture device.

15. The device of claim 12 wherein the first image quality characteristic and the second image quality characteristic each comprise at least one from among motion-sensor data, face-detection information, pixel-frame statistics, activity detection, camera-sensor metadata, camera-sensor state, or input from scene analysis.

16. The device of claim 12 wherein the first image quality characteristic and the second image quality characteristic is determined based on a stated preference of the user of the image-capture device, past behavior of the user of the image-capture device, or a privacy setting.

17. The device of claim 12 further comprising:

a communications interface operatively connected to the processing system and configured for receiving a recommendation from a server remote from the image-capture device, the recommendation based on data provided by a general population of image-capture devices, and wherein determining that the second image quality characteristic is greater than the first image quality characteristic is based on the recommendation received.

18. The device of claim 17 wherein the communications interface is further configured for sending metadata associated with the capturing to the server remote from the image-capture device.

19. The device of claim 12 further comprising:

a circular buffer configured for storing the plurality of captured still images;

wherein a latest captured still image replaces an oldest captured still image in the circular buffer.

20. The device of claim 19 further comprising:

storage outside of the circular buffer;

wherein the processing system is further configured for;

copying the second still image to the storage outside of the circular buffer; and

further processing the second still image.