Touch Sensitive Image Display

• US 20110248963A1
• Filed: 12/23/2009
• Published: 10/13/2011
• Est. Priority Date: 12/24/2008
• Status: Active Grant

• Current Assignee: Promethean Limited (Best Assistant Education Group Co.)
• Original Assignee: Light Blue Optics Ltd (Lifesize Communications Incorporated)
• Inventors: Cable, Adrian J., Lawrence, Nicholas A., Benet Ballester, Raul, Wright, James E. G.
• Granted Patent: US 8,947,402 B2
• Time in Patent Office: Days
• US Class Current: 345/175
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2205 using downstream optical component
• CPC Class Codes: G03H 1/2294 Addressing the hologram to an active spatial light modulator
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2001/2213 Diffusing screen revealing the real holobject, e.g. container filed with gel to reveal the 3D holobject
• CPC Class Codes: G03H 2001/2215 Plane screen
• CPC Class Codes: G03H 2001/2221 Screen having complex surface, e.g. a structured object
• CPC Class Codes: G03H 2001/2271 RGB holobject
• CPC Class Codes: G03H 2210/22 2D SLM object wherein the object beam is formed of the light modulated by the SLM SLM per se G03H2001/0224
• CPC Class Codes: G03H 2210/441 Numerical processing applied to the object data other than numerical propagation synthesizing propagation G03H1/0808
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

We describe a touch sensitive image display device for projecting a touch sensitive displayed image at an acute angle onto a surface on which the device is placed. The device comprises: light sources to project two-dimensional first and second light distributions in respective first and second planes; and a multi-pixel sensor system to remotely detect touch of an area of said surface within or adjacent to the displayed image by detecting light from the first distribution to provide a detected touch signal. The multi-pixel sensor system also remotely detects presence of an object within the second light distribution to provide a detected presence signal. The device is configured to multiplex projection of the first light and second distributions. A controller has an input to receive the detected touch and detected presence signals and is configured to control the device responsive to these signals.

Claims

1. A touch sensitive image display device for projecting a touch sensitive displayed image at an acute angle onto a surface on which the device is placed, the device comprising:

a light source to project a substantially two-dimensional first light distribution in a first plane;

a light source to project a substantially two-dimensional second light distribution in a second plane, wherein said second plane is different to said first plane;

a multi-pixel sensor system to remotely detect touch of an area of said surface within or adjacent to said displayed image by detecting light from said first distribution, and having an output to provide a detected touch signal;

said multi-pixel sensor system to remotely detect presence of an object at least partially within said second light distribution by detecting light from said second distribution, and having an output to provide a detected presence signal; and

a controller having an input to receive said detected touch signal and an input to receive said detected presence signal and configured to control said touch sensitive image display device responsive to said signals, wherein

said device is configured to multiplex projection of the first light distribution and projection of the second light distribution.

2. The touch sensitive image display device according to claim 1, comprising:

at least one further light source to project a further substantially two-dimensional second light distribution in a further plane, wherein said further plane is different to each other said plane; and

at least one further multi-pixel sensor system, each said further multi-pixel sensor system to remotely detect presence of an object at least partially within at least one said further light distribution by detecting light from said at least one further distribution, and having an output to provide a detected presence signal.

3. The touch sensitive image display device according to claim 2, wherein said device is configured to multiplex projection of the first light distribution, the second light distribution and at least one said further light distribution.

4. The touch sensitive image display device according to claim 1, wherein said multi-pixel sensor system to detect touch comprises a plurality of multi-pixel sensors each to remotely detect touch of an area of said surface within or adjacent to said displayed image, and having an output to provide a detected touch signal.

5. The touch sensitive image display device according to claim 1, wherein said multi-pixel sensor system to detect presence comprises a plurality of multi-pixel sensors each to remotely detect presence of an object at least partially within said second light distribution, and having an output to provide a detected presence signal.

6. The touch sensitive image display device according to claim 1, wherein said light source to project said first light distribution is said light source to project said second light distribution.

7. The touch sensitive image display device according to claim 1, wherein said first plane and said second plane are substantially parallel planes.

8. The touch sensitive image display device according to claim 1, wherein said multiplexing is wavelength multiplexing.

9. The touch sensitive image display device according to claim 1, wherein said multiplexing is time multiplexing.

10. The touch sensitive image display device according to claim 9, wherein said responsive controller is configured to read said detected touch signal and said detected presence signal in synchronism with said time multiplexing.

11. The touch sensitive image display device according to claim 9, wherein said controller is configured to perform said responsive control by distinguishing between said receiving of said detected touch signal and said receiving of a detected presence signal on the basis of a timing of receiving a said signal.

12. The touch sensitive image display device according to claim 11, configured to determine an action to be initiated by said responsive control on the basis of said distinguishing.

13. The touch sensitive image display device according to claim 9, further comprising moveable optics to alternately project said first light distribution and said second light distribution.

14. The touch sensitive image display device according to claim 13, wherein said moveable optics comprises a rotatable mirror.

15. The touch sensitive image display device according to claim 1, wherein said multi-pixel sensor system to detect touch is to detect a location of said touch and said responsive control performs an action determined on the basis of said detected touch location and controls said device to perform said action.

16. The touch sensitive image display device according to claim 1, wherein said multi-pixel sensor system to detect presence is to detect a location of said presence and said responsive control performs an action determined on the basis of said detected presence location and controls said device to perform said action.

17. The touch sensitive image display device according to claim 15, wherein said action comprises selecting a menu on the basis of said detected presence location and displaying said selected menu.

18. The touch sensitive image display device according to claim 1, wherein said sensor system to detect touch is configured to detect light scattered from said first light distribution.

19. The touch sensitive image display device according to claim 1, wherein said sensor system to detect presence is configured to detect light scattered from said second light distribution.

20. The touch sensitive image display device according to claim 1, wherein said controller is configured to detect hovering of a said object by detecting absence of a said touch detection and occurrence of a said presence detection on the basis of said signals.

21. The touch sensitive image display device according to claim 1, further comprising a spatial light modulator (SLM) and a controller to control said SLM, on the basis of data defining said displayed image, to replay a target image distorted to compensate for projection onto said surface at said acute angle.

22. The touch sensitive image display device according to claim 1, wherein a multi-pixel sensor of said multi-pixel sensor system to detect touch is a multi-pixel sensor of said multi-pixel sensor system to detect presence.

23. The touch sensitive image display device according to claim 1, wherein said multi-pixel sensor system to detect touch is configured to use pixels of said multi-pixel sensor and said multi-pixel sensor system to detect presence is configured to use other pixels of said multi-pixel sensor.

24. A consumer electronic device such as a camcorder, camera, music player, mobile phone, media player or computer, comprising the touch sensitive image display device according to claim 1.

25. A touch sensitive image display device for projecting a touch sensitive displayed image at an acute angle onto a surface on which the device is placed, the device comprising:

a light source to project a first light distribution;

a light source to project a second light distribution;

a multi-pixel sensor system to remotely detect location of touch of an area of said surface within or adjacent to said displayed image by detecting change of said first distribution, and having an output to provide a detected touch location signal;

a multi-pixel sensor system to remotely detect location of an object at least partially within said second light distribution, and having an output to provide a detected object location signal;

a controller having an input to receive said detected touch location signal and an input to receive said detected object location signal, and configured to control said device responsive to said detected touch location signal and to control said device responsive to said detected object location signal.

26. The touch sensitive image display device of claim 25, wherein at least one said output to provide a detected location signal is configured to indicate a light distribution of said location detection.

27. The touch sensitive image display device of claim 25, comprising:

at least one light source to project at least one further light distribution;

said multi-pixel sensor system to remotely detect location of an object at least partially within the or each said further light distribution, and having at least one output to indicate a said further distribution and to provide a signal indicating a said location of said object in said indicated further distribution.

28. The touch sensitive image display device of claim 25, wherein the controller is configured to select an action on the basis of at least one of said signals, and to control said touch sensitive image display device to perform said action.

29. The touch sensitive image display device of claim 28, wherein the controller is configured to select said action further on the basis of at least one said indication of light distribution.

30. The touch sensitive image display device of claim 25, wherein said touch sensitive image display is operable by a user'"'"'s finger as a joystick.

31. The touch sensitive image display device of claim 25, wherein said touch is a touch by a user'"'"'s finger.

32. The touch sensitive image display device of claim 25, wherein said object is a user'"'"'s finger.

33. The touch sensitive image display device of claim 25, wherein the controller is further configured to perform a said responsive control on the basis of a rate of change of at least one said detected location.

34. The touch sensitive image display device of claim 25, wherein the controller is further to configured to perform a said responsive control on the basis of a direction of change of at least one said detected location.

35. The touch sensitive image display device of claim 25, wherein the controller is further configured to perform a said responsive control on the basis of a locus of change of at least one said detected location.

36. The touch sensitive image display device of claim 25, wherein the controller is further configured to perform a said responsive control on the basis of difference between two said detected locations.

37. The touch sensitive image display device of claim 25 wherein the controller is further configured to perform a said responsive control on the basis of a rate of change of difference between two said detected locations.

38. The touch sensitive image display device of claim 25, wherein a said responsive control controls said touch sensitive image display device to update or move at least a portion of said displayed image.

39. The touch sensitive image display device of claim 25, wherein a said responsive control controls said touch sensitive image display device to display a further image adjacent to or at least partially overlapping said displayed image.

40. The touch sensitive image display device of claim 25, wherein a said multi-pixel sensor system comprises at least one multi-pixel sensor.

41. The touch sensitive image display device of claim 25, wherein a said sensor of said multi-pixel sensor system to detect touch is a said sensor of said multi-pixel sensor system to remotely detect location of an object.

42. The touch sensitive image display device of claim 25, further comprising an anti-distortion system to map a said detected location of touch to a portion of said input image.

43. The touch sensitive image display device of claim 25, wherein at least one said light source is another of said light sources.

44. A consumer electronic device such as a camcorder, camera, music player, mobile phone, media player or computer, comprising the touch sensitive image display device according to claim 25.