Image capture using display device as light source

• US 9,871,963 B2
• Filed: 07/18/2016
• Issued: 01/16/2018
• Est. Priority Date: 06/15/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Ciudad, Jean-Pierre, Aybes, Alexandre, Westen, Peter, Christie, Gregory N., Forstall, Scott
• Primary Examiner(s): SELBY, GEVELL V
• Application Number:
  US15/213,086
• Publication Number:
  US 20160360102A1
• Time in Patent Office: 547 Days
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

A digital image capture system and method uses a display device to illuminate a target with light for improved image capture under poor lighting conditions. Various characteristics of the flash (e.g., brightness, color, duration, etc.) can be adjusted to improve image capture. Users are provided with feedback (e.g., live video feed, audio and/or visual countdowns, etc.) to assist them in preparing for image capture. The captured images are seamlessly integrated with existing applications (e.g., video conferencing, instant text messaging, etc.).

Claims

1. A method of capturing digital images, comprising:

illuminating, by an electronic device, an environment during a pre-flash phase;

measuring ambient light of the environment during the pre-flash phase;

determining, by the electronic device, a flash intensity based on the measured ambient light;

determining, by the electronic device, a flash duration during the pre-flash phase;

illuminating a target in the environment for the flash duration with light at the flash intensity; and

capturing a digital image of the illuminated target.

2. The method of claim 1, further comprising determining, by the electronic device, a flash brightness based on the measured ambient light.

3. The method of claim 1, wherein

the flash duration includes a rise time, a sustain time, and a fall time.

4. The method of claim 3, wherein capturing the digital image includes capturing the digital image at an image capture time, the image capture time determined based on the rise time, the sustain time, and a frame latency.

5. The method of claim 4, wherein the frame latency is determined by a difference between an image timestamp provided by an image capturing device and a time when a video image is displayed on a display device.

6. The method of claim 1, further comprising providing a countdown sequence prior to capturing the digital image.

7. The method of claim 6, wherein providing the countdown sequence includes simulating a cadence of the countdown sequence using a flashing lamp on a user interface displayed on a display device.

8. The method of claim 6, wherein providing the countdown sequence includes verbally announcing the countdown sequence using a synthetic speech generator.

9. A non-transitory computer readable medium having instructions stored thereon that when executed by a data processing apparatus cause the data processing apparatus to:

illuminate an environment during a pre-flash phase;

measure ambient light of the environment during the pre-flash phase;

determine a flash intensity based on the measured ambient light;

determine a flash duration during the pre-flash phase;

illuminate a target in the environment with light at the flash intensity; and

capture a digital image of the illuminated target during the flash duration.

10. The non-transitory computer readable medium of claim 9, further comprising instructions to determine a flash brightness based on the measured ambient light.

11. The non-transitory computer readable medium of claim 9, wherein the

flash duration includes a rise time, a sustain time, and a fall time.

12. The non-transitory computer readable medium of claim 11, wherein the instructions that cause the data processing apparatus to capture the digital image further comprise instructions to:

capture the digital image at an image capture time, the image capture time determined based on the rise time, the sustain time, and a frame latency.

13. The non-transitory computer readable medium of claim 12, wherein the frame latency is determined by a difference between an image timestamp provided by an image capturing device and a time when a video image is displayed on a display device.

14. The non-transitory computer readable medium of claim 9, further comprising instructions that when executed by a data processing apparatus cause the data processing apparatus to:

provide a countdown sequence prior to capturing the digital image.

15. The non-transitory computer readable medium of claim 14, wherein the instruction that cause the data processing apparatus to provide the countdown sequence include instructions that cause the data processing apparatus to simulate a cadence of the countdown sequence using a flashing lamp on a user interface displayed on a display device.

16. The non-transitory computer readable medium of claim 14, wherein the instructions that cause the data processing apparatus to provide the countdown sequence include instructions that cause the data processing apparatus to verbally announce the countdown sequence using a synthetic speech generator.

17. An electronic device, comprising:

a light source;

a memory;

a sensor; and

a processor configured to perform the operations of;

illuminating an environment during a pre-flash phase;

measuring ambient light of the environment during the pre-flash phase;

determining a flash intensity based on the measured ambient light;

determining a flash duration during the pre-flash phase;

illuminating a target in the environment during the flash duration with light at the flash intensity; and

capturing a digital image of the illuminated target.

18. The electronic device of claim 17, wherein the processor is further configured to perform the operation of:

determining a flash brightness based on the measured ambient light.

19. The electronic device of claim 17, wherein the flash duration includes a rise time, a sustain time, and a fall time;

and

wherein the processor is further configured to perform the operation of emitting the light for the flash duration.

20. The electronic device of claim 19, wherein capturing the digital image includes capturing the digital image at an image capture time, the image capture time determined based on the rise time, the sustain time, and a frame latency.