Image capture using display device as light source

• US 10,397,470 B2
• Filed: 01/14/2018
• Issued: 08/27/2019
• Est. Priority Date: 10/11/2005
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Ciudad, Jean-Pierre, Aybes, Alexandre, Westen, Peter, Christie, Gregory N., Forstall, Scott
• Primary Examiner(s): Selby, Gevell V
• Application Number:
  US15/870,976
• Publication Number:
  US 20180220067A1
• Time in Patent Office: Days
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

A digital image capture system and method uses a display device to illuminate a target with light for improved image capture under poor lighting conditions. Various characteristics of the flash (e.g., brightness, color, duration, etc.) can be adjusted to improve image capture. Users are provided with feedback (e.g., live video feed, audio and/or visual countdowns, etc.) to assist them in preparing for image capture. The captured images are seamlessly integrated with existing applications (e.g., video conferencing, instant text messaging, etc.).

Claims

1. A method of capturing digital images, comprising:

determining a frame latency for an image processing pipeline of an electronic device;

measuring, using the electronic device, ambient light in an environment during a pre-flash phase;

determining, using the electronic device, a flash intensity based on the measured ambient light during the pre-flash phase;

determining, using the electronic device, a sustain time for a flash phase during the pre-flash phase;

determining an image capture time based on the frame latency and the sustain time;

emitting light in the environment during the flash phase at the determined flash intensity for a period of time corresponding to the sustain time; and

capturing a digital image within the environment based on the determined image capture time.

2. The method of claim 1, wherein the determined image capture time occurs during the period of time corresponding to the sustain time.

3. The method of claim 1, further comprising providing a countdown sequence prior to capturing the digital image.

4. The method of claim 3, wherein providing the countdown sequence includes simulating a cadence of the countdown sequence using a flashing lamp.

5. The method of claim 3, wherein providing the countdown sequence includes audiotorally rendering the countdown sequence.

6. The method of claim 1, wherein the sustain time is between 0.020 and 0.030seconds.

7. The method of claim 1, wherein capturing a digital image based on the determined image capture time comprises initiating the capture of a digital image within the environment by a sensor of the electronic device at a first time, wherein the first time is calculated based on the determined image capture time.

8. A non-transitory computer-readable storage medium storing instructions executable by at least one processor, the instructions comprising instructions to:

determine a frame latency for an image processing pipeline of an electronic device;

measure, using the electronic device, ambient light in an environment during a pre-flash phase;

determine, using the electronic device, a flash intensity based on the measured ambient light during the pre-flash phase;

determine, using the electronic device, a sustain time for a flash phase during the pre-flash phase;

determine an image capture time based on the frame latency and the sustain time;

emit light in the environment during the flash phase at the determined flash intensity for a period of time corresponding to the sustain time; and

capture a digital image within the environment based on the determined image capture time.

9. The non-transitory computer-readable storage medium of claim 8, wherein the determined image capture time occurs during the period of time corresponding to the sustain time.

10. The non-transitory computer-readable storage medium of claim 8, the instructions further comprising instructions to provide a countdown sequence prior to capturing the digital image.

11. The non-transitory computer-readable storage medium of claim 10, wherein providing the countdown sequence includes simulating a cadence of the countdown sequence using a flashing lamp.

12. The non-transitory computer-readable storage medium of claim 10, wherein providing the countdown sequence includes audiotorally rendering the countdown sequence.

13. The non-transitory computer-readable storage medium of claim 8, wherein the sustain time is between 0.020 and 0.030 seconds.

14. A method of capturing digital images, comprising:

determining a frame latency for an image processing pipeline of an electronic device;

measuring, using the electronic device, ambient light in an environment during a pre-flash phase;

determining, using the electronic device, a flash intensity based on the measured ambient light during the pre-flash phase;

determining, using the electronic device, a sustain time for a flash phase during the pre-flash phase, the flash phase comprising a rise time, the sustain time, and a fall time;

determining an image capture time based on the frame latency and the sustain time;

emitting light in the environment during the flash phase at the determined flash intensity for a period of time corresponding to the sustain time; and

capturing a digital image within the environment based on the determined image capture time.

15. The method of claim 14, wherein capturing a digital image within the environment based on the determined image capture time comprises capturing a first digital image within the environment during the period of time corresponding to the sustain time.

16. The method of claim 14, further comprising providing a countdown sequence prior to capturing the first digital image.

17. The method of claim 16, wherein providing the countdown sequence includes simulating a cadence of the countdown sequence using a flashing lamp.

18. The method of claim 16, wherein providing the countdown sequence includes audiotorally rendering the countdown sequence.

19. The method of claim 14, wherein the rise time is between 0.03 and 0.05 seconds.

20. The method of claim 14, wherein the fall time is between 0.020 and 0.030 seconds.