Method of using video reflection in providing input data to a computer system

• US 6,088,018 A
• Filed: 06/11/1998
• Issued: 07/11/2000
• Est. Priority Date: 06/11/1998
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Knowlson, Kenneth L., Needham, Bradford H., DeLeeuw, William C.
• Primary Examiner(s): Liang, Regina
• Application Number:
  US09/096,282
• Time in Patent Office: 761 Days
• Field of Search: 345/156, 345/157, 345/158, 345/145, 345/146, 345/113, 345/114, 345/115, 345/343, 345/344, 345/345
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Providing input signals to a computer system having a display, the computer system being coupled to a video camera or other video source, is accomplished by capturing video data signals generated by the video camera, the video data signals representing a scene, rendering the scene on the display such that the scene is reflected and transparently visible on the display, analyzing the video data signals to detect an object in the scene, and generating an input signal for the computer system in response to the detected object.

Claims

1. A method of providing input signals to a system having a display, the system being coupled to a source of video data signals, comprising:

capturing video data signals generated by the video source, the video data signals representing a scene;

rendering the scene on the display such that the scene is transparently visible on the display;

analyzing the video data signals to detect an object in the scene; and

automatically generating an input event for a program of the system when the object is detected in the scene.

2. The method of claim 1, wherein the scene comprises a user of the system and the rendered scene comprises a reflected image of the user.

3. The method of claim 1, wherein the detected object comprises at least one body part of a user of the system.

4. The method of claim 1, wherein the detected object comprises at least one predetermined prop.

5. The method of claim 1, further comprising displaying at least one display object on the display in addition to the transparently rendered scene.

6. The method of claim 5, further comprising interpreting movement of the detected object in the scene as selecting the at least one display object.

7. The method of claim 6, wherein the at least one display object is an icon.

8. The method of claim 1, wherein analyzing the video data signals comprises analyzing color values of pixels of the video data signals and tagging pixels having selected color values.

9. The method of claim 8, further comprising identifying a block of tagged pixels as the detected object and generating corresponding input signals when the detected object matches predetermined criteria of objects signifying input events.

10. The method of claim 1, wherein the input signal is at least one of a mouse-down event, a mouse-up event, and a cursor position movement.

11. In a system having a source of video data and a display, an apparatus comprising:

means for capturing video data signals generated by the video source, the video data signals representing a scene;

means for rendering the scene on the display such that the scene is transparently visible on the display;

means for analyzing the video data signals to detect an object in the scene; and

means for automatically generating an input event for a program of the system when the object is detected in the scene.

12. The apparatus of claim 11, further comprising means for displaying at least one display object on the display in addition to the rendered scene.

13. The apparatus of claim 12, wherein the generating means comprises means for interpreting movement of the detected object in the scene as selecting the at least one display object.

14. The apparatus of claim 13, wherein the analyzing means comprises means for analyzing color values of pixels of the video data signals and means for tagging pixels having selected color values.

15. The apparatus of claim 14, further comprising means for identifying a block of tagged pixels as the detected object and means for generating corresponding input signals when the detected object matches predetermined criteria of objects signifying input events.

16. In a system having a source of video data and a display, an apparatus comprising:

video capture circuitry to capture video data signals generated by the video source, the video data signals representing a scene;

video render circuitry to render the scene on the display such that the scene is transparently visible on the display;

color analyzer circuitry to analyze the video data signals to detect an object in the scene; and

input handler circuitry to automatically generate an input event for a program of the system when the object is detected in the scene.

17. An article comprising a machine readable medium having a plurality of machine readable instructions, wherein when the instructions are executed by a processor the instructions cause a system to capture video data signals generated by a video source, the video data signals representing a scene, to render the scene on a display such that the scene is transparently visible on the display, to analyze the video data signals to detect an object in the scene, and to automatically generate an input event for a program of the system when the object is detected in the scene.

18. The article of claim 17, wherein the machine readable medium further comprises instructions to render an image of the scene on the display such that the rendered scene comprises a reflected image of the scene.

19. The article of claim 17, wherein the machine readable medium further comprises instructions to display at least one display object on the display in addition to the transparently rendered scene.

20. The article of claim 19, wherein the machine readable medium further comprises instructions to interpret movement of the detected object in the scene as selecting the at least one display object.

21. The article of claim 17, wherein the machine readable medium further comprises instructions to analyze color values of pixels of the video data signals and to tag pixels having selected color values.

22. The article of claim 21, wherein the machine readable medium further comprises instructions to identify a block of tagged pixels as the detected object and to generate corresponding input signals when the detected object matches predetermined criteria of objects signifying input events.

23. In a computer system coupled to a source of video data signals and a display, an apparatus for providing input signals to the computer system, the apparatus comprising:

a filter graph for processing video data signals received from the video source, the video data signals representing a scene captured by the video source, the filter graph comprising;

a video renderer filter to render the scene on the display such that the scene is transparently visible on the display;

a color analyzer filter to analyze color values of pixels of the video data signals and to tag color values of pixels within specified ranges; and

a block detector filter coupled to the color analyzer filter to analyze the tagged color values of pixels of the video data signals, to identify blocks of pixels with selected color values as detected objects of the scene, and to provide a notification of potential input events; and

an input event handler to analyze the notification and to determine if the detected objects signify input signals for the computer system.

24. The apparatus of claim 23, wherein the filter graph further comprises a video capture filter to capture individual frames of video data signals from the video source.

25. The apparatus of claim 24, wherein the filter graph further comprises a tee filter coupled to the video capture filter to split the video data signals into at least two substantially similar data streams, a first one of the data streams being communicated to the video renderer filter and a second one of the data streams being communicated to the color analyzer filter.

26. The apparatus of claim 23, wherein the rendered scene comprises a reflected image of the scene.

27. The apparatus of claim 23, further comprising message-based interfaces for communication between the filter graph and the input event handler.