Interactive display device

• US 6,840,627 B2
• Filed: 01/21/2003
• Issued: 01/11/2005
• Est. Priority Date: 01/21/2003
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Olbrich, Craig A
• Primary Examiner(s): Dowling, William C.
• Application Number:
  US10/349,240
• Publication Number:
  US 20040141162A1
• Time in Patent Office: 721 Days
• Field of Search: 353/42, 353/69, 353/101, 353/122, 348/745, 348/806, 345/730
• US Class Current: 353/42
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor

Abstract

A display device including a light engine configured to project an image onto a display surface, an image sensor configured to capture a presentation image larger than the projected image, and a processor, coupled to the image sensor, that is configured to modify the projected image based on the captured image.

Claims

1. A display device, comprising:

a light engine configured to project an image onto a display surface;

an image sensor configured to capture a presentation image larger than the projected image, where the captured image includes an operator providing an operator signal defining an interpretable pattern;

a processor, coupled to the image sensor, configured to modify the projected image based on the interpretable pattern.

2. The display device of claim 1, where the processor is configured to modify the projected image by altering the performance of the light engine.

3. The display device of claim 1, where the processor is configured to modify the projected image by altering the content of the projected image.

4. The display device of claim 1, including a recorder configured to store the captured image.

5. An interactive projector, comprising:

a light engine configured to project an image onto a display surface;

an image sensor configured to capture an operator image including an operator signal; and

a processor coupled with the image sensor and configured to correlate the operator signal with a predefined command.

6. The projector of claim 5, where the image sensor is configured to capture the operator signal as the operator moves.

7. The projector of claim 5, where the image sensor is configured to capture the projected image.

8. The projector of claim 5, where the processor is configured to modify a presentation according to the predefined command.

10. The projector of claim 5, where the projector is selected from an LCD projector and a micromirror projector.

11. The projector of claim 5, where the image sensor is a camera.

9. An interactive projector, comprising:

a light engine configured to project an image onto a display surface;

an image sensor configured to capture an operator image, including an operator signal;

a processor coupled with the image sensor and configured to correlate the operator signal with a predefined command; and

a memory connected to the processor, where the memory includes a database associating a plurality of predefined commands with corresponding operator signals.

12. A method of controlling a presentation, comprising:

projecting an image onto a surface;

capturing a presentation image larger than the projected image that includes an image of an operator;

displaying a pattern within the captured image;

detecting the displayed pattern; and

correlating the detected pattern with a predefined command.

13. The method of claim 12, further comprising executing the predefined command.

14. The method of claim 13, where executing the predefined command includes modifying the projected presentation.

16. The method of claim 12, where projecting the image includes directing the projected image along an optical pathway, and capturing the presentation image includes directing the presentation image reciprocally along the substantially same optical pathway.

18. The method of claim 12, where displaying a pattern with the captured image includes tracing an interpretable pattern.

19. The method of claim 18, where tracing the interpretable pattern includes drawing the pattern on a surface.

21. The method of claim 18, where correlating the interpretable pattern with the predefined command includes comparing the interpretable pattern with a plurality of predefined patterns.

22. The method of claim 21, where correlating the interpretable pattern with the predefined command further includes selecting a best matching predefined pattern from the plurality of predefined patterns.

23. The method of claim 22, further comprising executing the predefined command corresponding to the best matching predefined pattern.

24. The method of claim 12, further comprising normalizing the captured image.

15. A method at controlling a presentation, comprising:

projecting an image onto a surface;

capturing a presentation image larger than the projected image;

displaying a pattern within the captured image;

detecting the displayed pattern; and

correlating the detected pattern with a predefined command;

where capturing a presentation image larger then the projected image includes capturing an image of an operator.

17. A method of controlling a presentation, comprising:

projecting an image onto a surface;

capturing a presentation image larger than the projected image;

displaying a pattern within the captured image;

detecting the displayed pattern; and

correlating the detected pattern with a predefined command;

where displaying a pattern within the captured image includes displaying a cue card.

20. A method of controlling a presentation, comprising:

projecting an image onto a surface;

capturing a presentation image larger than the projected image;

tracing an interpretable pattern within the captured image;

detecting the interpretable pattern; and

correlating the interpretable pattern with a predefined command;

where tracing the interpretable pattern includes making a hand motion.

25. A storage medium readable by a processor, having embodied therein a program of commands executable by the processor to:

project an image onto a surface;

capture a presentation image larger than the projected image that includes an operator image;

detect a pattern displayed within the captured image; and

correlate the detected pattern with a predefined command.

26. The storage medium of claim 25, where the program of commands includes commands executable by the processor to execute the predefined command.

27. The storage medium of claim 25, where the program of commands includes commands executable by the processor to capture an image of an operator.

28. A display system, comprising:

means for projecting an image onto a surface;

means for capturing an image that includes an operator image and the projected image;

means for interpreting an operator movement pattern;

means for correlating the operator movement pattern with a predefined command.

29. The display system at claim 28, further comprising means for executing the predefined command.

30. An interactive projector, comprising:

a light engine configured to project an image onto a display surface;

an image sensor configured to capture an operator image and an operator signal defining an interpretable pattern; and

a processor coupled with the image sensor and configured to correlate the operator signal with a predefined command.

31. An interactive projector, comprising:

a light engine configured to project a presentation onto a display surface;

an image sensor configured to capture a presentation image larger than the projected image that includes an operator image;

a processor coupled with the image sensor and configured to correlate an operator hand motion with a predefined command; and

a memory connected to the processor, where the memory includes a database associating a plurality of predefined commands with corresponding operator hand motions.