Computer interface system and method

• US 20030043271A1
• Filed: 09/04/2001
• Published: 03/06/2003
• Est. Priority Date: 09/04/2001
• Status: Abandoned Application

• Current Assignee: Fox Digital, Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Dantwala, Nehal R.
• Application Number:
  US09/945,957
• Publication Number:
  US 20030043271A1
• Time in Patent Office: Days
• US Class Current: 348/207.1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A system for interfacing with a computer using visual cues, and a method of performing visual-cue operation. In a computer system having a central processing unit (CPU), and memory, a data-storage device, and an interface for receiving, interpreting and executing commands formulated by a user, a camera is positioned to allow the user to enter its visual field. To remotely operate the computer, the user performs a predetermined motion or series of motions while in the camera'"'"'s field of view. The camera captures an image of the user and digitized the image into a video data stream. A video processor monitors the video data stream for indications that the user has entered a visual cue by performing a prescribed motion. When a visual cue is recognized, the video processor then generates a command set corresponding to the recognized cue. The command set then presented to the computer'"'"'s command processor for execution. Ease of use for the visual cue interface is enhanced by using the computer'"'"'s graphical display to superimpose a command template over the image of the user being captured by the camera.

Claims

1. A system capable of remotely interfacing with a computer using visual cues, said system comprising:

a video camera capable of capturing an image and converting the captured image into a video data stream; and

a video processor in communication with the video camera, wherein the video processor is capable of recognizing at least one visual cue, and in response to recognizing a visual cue, generating a computer command set and presenting the computer command set to the computer for execution.

2. The system as claimed in claim 1, further comprising:

a graphical display device in communication with the video processor through a graphical display interface module for selectively displaying an image captured by the video camera.

3. The system as claimed in claim 2 wherein the video processor is further capable of generating a visual cue command template for display on the graphical display device.

4. The system as claimed in claim 2 wherein the system is capable of displaying a captured image on the graphical display device.

5. The system as claimed in claim 1 wherein the system further comprises:

a plurality of video cameras; and

a multiplexer in communication with each of said plurality of video cameras and in communication with the video processor;

wherein the video processor is capable of processing a multiplexed video data stream from the multiplexer.

6. The system as claimed in claim 5 wherein the video processor is capable of directing the multiplexer to include in the video stream video data corresponding only to a selected camera.

7. A method of interfacing with a computer using visual cues, the method comprising the steps of:

providing a video camera for capturing and digitizing video images into a video data stream;

providing a video processor in communication with the video camera for receiving the digitized video data stream;

recognizing in the video processor that a visual cue has been executed; and

generating in the video processor a command set corresponding to the recognized visual cue for presentation to the computer.

8. The method of interfacing with a computer using visual cues as claimed in claim 7 wherein the step of recognizing in the video processor that a visual cue has been executed further comprises the steps of:

storing visual cue information in a database in communication with the video processor;

grabbing selected portions of the video data stream;

storing the grabbed selected portions of the video data stream; and

comparing the stored portions of the video data stream with visual cue information stored in the database to determine if a visual cue has been executed by the user.

9. The method of interfacing with a computer using visual cues as claimed in claim 7, further comprising the step of generating a user-confirmation query.

10. The method of interfacing with a computer using visual cues as claimed in claim 9, wherein the step of generating in the video processor a command set for presentation to the computer is not completed until an affirmative response to a user confirmation query is received.

11. The method of interfacing with a computer using visual cues as claimed in claim 10, wherein the affirmative response is an explicit affirmative response.

12. The method of interfacing with a computer using visual cues as claimed in claim 7, wherein the method further comprises the step of generating a visual cue template.

13. The method of interfacing with a computer using visual cues as claimed in claim 7, wherein the method further comprises the step displaying the visual cue template on a monitor that is connected to the computer.

14. The method of interfacing with a computer using visual cues as claimed in claim 7, wherein the method further comprises the step of displaying an image that is being captured by the video camera on a monitor that is connected to the computer.

15. The method of interfacing with a computer using visual cues as claimed in claim 7, wherein the step of providing a video camera for capturing and digitizing video images into a video data stream includes the step of:

providing a plurality of video cameras; and

providing a video processor that is capable of processing video data from the plurality of video cameras.

16. A video processor for detecting visual cues executed by a user for remote operation of a computer system comprising a central processing unit, a graphical display device, and at least one video camera, wherein said video processor is capable of:

receiving video data from said at least one video camera;

recognizing when video data contains information corresponding to a visual cue; and

generating a command set corresponding to a visual cue.

17. The video processor as claimed in claim 16, wherein said video processor is capable of generating a visual cue template for display on the graphical display device.

18. The video processor as claimed in claim 17, wherein said video processor generates the template only after receiving a user request to do so.

19. The video processor as claimed in claim 16, wherein the computer system includes a plurality of video cameras and a multiplexer, and said video processor is capable of monitoring a multiplexed video data stream.

20. The video processor as claimed in claim 19, wherein said video processor is capable of determining which video camera received a recognized visual cue.

21. The video processor as claimed in claim 20, wherein said video processor is capable of sending control commands to the multiplexer.

22. The video processor as claimed in claim 16, wherein said video processor is capable of generating a user confirmation query.

23. The video processor as claimed in claim 22, wherein the command set is not generated until an affirmative confirmation to a confirmation query has been received.

24. The video processor as claimed in claim 23, wherein the command set is not generated until an explicit affirmative confirmation request is received.

25. The video processor as claimed in claim 16, wherein said video processor recognizes visual cues by:

grabbing selected frames of video from the video data at predetermined intervals;

storing the grabbed frames of video from the video data; and

comparing the stored frames of video to determine if there has been a change from one interval to another in an image captured by the video camera.

26. The video processor as claimed in claim 25, wherein said video processor is further capable of determining if a change in a captured image corresponds to a visual cue.