Virtual Interface System

• US 20090153468A1
• Filed: 10/31/2006
• Published: 06/18/2009
• Est. Priority Date: 10/31/2005
• Status: Abandoned Application

• Current Assignee: National University of Singapore
• Original Assignee: National University of Singapore
• Inventors: Nee, Andrew Yeh Ching, Ong, Soh Khim, Yuan, Miaolong
• Application Number:
  US12/084,410
• Publication Number:
  US 20090153468A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

The invention relates to a virtual interface system, to a method of providing a virtual interface, and to a data storage medium having stored thereon computer code means for instructing a computer system to execute a method of providing a virtual interface. A virtual interface system comprises a camera; a processor coupled to the camera for receiving and processing video data representing a video feed captured by the camera; a display coupled to the processor and the camera for displaying first and second interface elements superimposed with the video feed from the camera in response to display data from the processor, the second interface element being displayed at a fixed location on the display; wherein the processor tracks a motion action of a user based on the video data received from the camera, controls a display location of the first interface element on the display based on the tracked motion action; and determines a user input based on a relative position of the first and second interface elements on the display.

Claims

1. A virtual interface system comprising

a camera;

a processor coupled to the camera for receiving and processing video data representing a video feed captured by the camera;

a display coupled to the processor and the camera for displaying first and second interface elements superimposed with the video feed from the camera in response to display data from the processor, the second interface element being displayed at a fixed location on the display;

wherein the processor tracks a motion action of a user based on the video data received from the camera, controls a display location of the first interface element on the display based on the tracked motion action; and

identifies a user input selection based on determining that a duration during which the first and second interface elements remain substantially at a constant relative lateral position with reference to a display plane of the display exceeds a threshold value.

2. The system as claimed in claim 1, wherein the processor tracks the motion action of the user based on tracking relative movement of a reference object captured in the video feed and the camera.

3. The system as claimed in claim 2, wherein the reference object comprises a stationary object, and the camera is moved under the motion action of the user.

4. The system as claimed in claim 2, wherein the reference object is worn by the user and is moved under the motion of the user.

5. The system as claimed in claim 4, wherein the reference object is a cap attached to the finger of the user.

6. The system as claimed in claim 1, wherein the camera is mounted on the user'"'"'s head.

7. The system as claimed in claim 1, wherein the first interface element comprises a keyboard or control panel, and the second interface element comprises a stylus.

8. The system as claimed in claim 1, wherein the second interface element comprises a keyboard or control panel, and the first interface element comprises a stylus.

9. A method of providing a virtual interface, the method comprising the steps of

displaying on a display first and second interface elements superimposed with video feed from a camera and in response to display data from a processor, the second interface element being displayed at a fixed location on the display;

tracking a motion action of a user based on the video data received from the camera;

controlling a display location of the first interface element on the display based on the tracked motion action; and

identifying a user input selection based on determining that a duration during which the first and second interface elements remain substantially at a constant relative lateral position with reference to a display plane of the display exceeds a threshold value.

10. A data storage medium having stored thereon computer code means for instructing a computer system to execute a method of providing a virtual interface, the method comprising the steps of

displaying on a display first and second interface elements superimposed with video feed from a camera and in response to display data from a processor, the second interface element being displayed at a fixed location on the display;

tracking a motion action of a user based on the video data received from the camera;

controlling a display location of the first interface element on the display based on the tracked motion action; and

identifying a user input selection based on determining that a duration during which the first and second interface elements remain substantially at a constant relative lateral position with reference to a display plane of the display exceeds a threshold value.