TIME-OF-FLIGHT BASED IMAGING SYSTEM USING A DISPLAY AS ILLUMINATION SOURCE

• US 20110037849A1
• Filed: 10/08/2010
• Published: 02/17/2011
• Est. Priority Date: 04/11/2008
• Status: Active Grant

• Current Assignee: Ecole polytechnique fãdãrale de lausanne epfl (Schweizerische Eidgenossenschaft)
• Original Assignee: Ecole polytechnique fãdãrale de lausanne epfl (Schweizerische Eidgenossenschaft)
• Inventors: Charbon, Edoardo, Nolan, Julian, NICLASS, Cristiano
• Granted Patent: US 8,810,647 B2
• Time in Patent Office: Days
• US Class Current: 348/135
• CPC Class Codes: G01S 17/894 3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
• CPC Class Codes: G01S 7/4814 of transmitters alone
• CPC Class Codes: G01S 7/497 Means for monitoring or calibrating
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

The present invention concerns a time-of-flight based imaging system comprising a photon emitter used as an illumination source; a photon sensor (6); an electronic system for delivering a signal depending on the reception time of photons by said photon detector, characterized in that an electronic display (2) is used as said photonic source.

Claims

1. A time-of-flight based imaging system comprising:

a photon emitter used as an illumination source for illuminating a scene;

a photon sensor;

an electronic system for delivering a signal depending on the reception time of photons reflected by said scene onto said photon sensor,

a backlit display comprising a backlight assembly and an electronic display (2) placed in front of the backlight assembly (3)

said backlight assembly being used as said illumination source and for illuminating the electronic display.

2. The imaging system of claim 1, wherein said backlight assembly uses LEDs.

3. The imaging system of claim 2, wherein said backlight assembly comprises infrared LEDs, said photon sensor being associated with an infrared filter for improving sensitivity to the infrared light emitted by said infrared LEDs.

4. The imaging system of claim 2, wherein said backlight assembly uses white LEDs, said photon detector being associated with a filter for improving sensitivity to the blue light emitted by said white LEDs.

5. The imaging system of claim 1, comprising a backlighting driver for successively emitting light used by said photon sensor (6) from successive regions of said display.

6. The imaging system of claim 5, said backlighting driver being arranged for successively illuminating successive regions of said display.

7. The imaging system of claim 5, where the distances between each region successively lit and object are successively computed.

8. The imaging system of claim 5, said electronic display being arranged for modifying the video content displayed by said currently backlighted regions so as to increase the amount of light sent from said regions and received by said photon sensor.

9. The imaging system of claim 1, comprising a backlighting driver for successively illuminating said photon sensor from different regions of said display, and computing means for computing the position of a light reflecting object based on light received from the different regions and a triangulation method.

10. The imaging system of claim 2, comprising different LEDs of different colors illuminated and/or modulated at different times.

11. The imaging system of claim 1, wherein a video image is used as said illumination source.

12. The imaging system of claim 1, wherein said photon sensor is mounted on different device than said electronic display, so that the position between said display and said photon sensor is not fixed, the imaging system also comprising a clock recovery system for recovering the clock signal from said display in said different device.

13. The imaging system of claim 1, as part of a game console.

14. The imaging system of claim 1, as part of a personal digital assistant or mobile phone.

15. The imaging system of claim 1, which photon sensor comprises an array of single photon avalanche photodiodes elements.

20. The portable device of claim 19, further comprising computing means programmed for computing a 3D representation of said object based on said signal.

Computer program product containing a computer program which is capable of being executed by processing means in order to carry out the method of one of the claims 16 to 18 when said program is executed by said processing means in order to carry out the driving of the illumination source of the imaging system of the claims 1 to 15.

16. Illumination method for an imaging system comprising at least a backlit display used as illumination source;

a photon sensor; and

an electronic system for delivering a signal by said photon sensor;

comprising the steps of;

generating a modulated illumination from successively different regions of an electronic display using a backlighting driver;

computing the distances between the center of each region successively lit and the photon sensor;

recording the reception time of the modulated illumination reflected by an object or the phase delay between the emitted illumination and the reflected illumination using the photon sensor.

17. Illumination method according to claim 16, where the display video content is modified in synchronization with the successive illumination.

18. Illumination method according to claim 16, where the regions successively illuminated are moved across the display following a random pattern.

19. A portable device comprising:

an electronic display;

a led-based backlighting system for backlighting said electronic display;

a photon detector;

an electronic system for delivering a signal depending on the time of flight of photons sent by said backlighting system, reflected by an object and received by said photon detector.