Gesture-Based User Interface Employing Video Camera

• US 20130201135A1
• Filed: 03/11/2013
• Published: 08/08/2013
• Est. Priority Date: 05/15/1998
• Status: Active Grant

• Current Assignee: Advance Touchscreen And Gesture Technologies, LLC
• Original Assignee: Lester F. Ludwig
• Inventors: LUDWIG, Lester F.
• Granted Patent: US 8,878,807 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 1/0066 using a MIDI interface
• CPC Class Codes: G10H 1/348 Switches actuated by parts of the body other than fingers
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2220/521 Hall effect transducers or similar magnetic field sensing semiconductor devices, e.g. for string vibration sensing or key movement sensing
• CPC Class Codes: G10H 2220/525 Piezoelectric transducers for vibration sensing or vibration excitation in the audio range; Piezoelectric strain sensing, e.g. as key velocity sensor; Piezoelectric actuators, e.g. key actuation in response to a control voltage
• CPC Class Codes: G10H 2230/095 Spint zither, i.e. mimicking any neckless stringed instrument in which the strings do not extend beyond the sounding board
• CPC Class Codes: G10H 2230/101 Spint koto, i.e. mimicking any traditional asian-style plucked zither with movable bridges
• CPC Class Codes: G10H 2230/115 Spint sitar, i.e. mimicking any long-necked plucked string instrument with a large number of additional non-playable sympathetic resonating strings or an additional gourd-like resonating chamber
• CPC Class Codes: G10H 2230/145 Spint guitar keyboard, i.e. mimicking a combination of a guitar-like instrument, with or without strings, and a piano-like keyboard, e.g. with white and black keys arranged like on a piano
• CPC Class Codes: G10H 2230/271 Spint gong, i.e. mimicking circular flat, nippled or bowl-shaped metallic percussion instruments G10H2230/321 takes precedence
• CPC Class Codes: G10H 3/18 using a string, e.g. electric guitar mechanical features G10D1/085
• CPC Class Codes: G10H 3/26 : using electric feedback
• CPC Class Codes: Y10S 84/10 : Feedback

Abstract

Systems and methods for providing a free-space gesture-based user interface for a computer workstation and desktop software applications are disclosed. In one implementation, the system includes a video camera to generate real-time video signals responsive to a user gesture as observed by the video camera, and a processor to generate control signals responsive to the real-time video signals responsive to the user gesture observed by the video camera. The control signals are used to control a desktop software application executing on the computer workstation, such that at least one aspect of the desktop software application is responsive to the user gesture observed by the video camera.

Claims

1. A system for providing a gesture-based user interface for a computer workstation, the system comprising:

a video camera to generate real-time video signals responsive to a user gesture as observed by the video camera; and

a processor to generate control signals responsive to the real-time video signals responsive to the user gesture observed by the video camera, the control signals to control a desktop software application executing on the computer workstation;

wherein at least one aspect of the desktop software application is responsive to the user gesture observed by the video camera.

2. The system of claim 1, wherein the user gesture comprises movement of the user'"'"'s hand.

3. The system of claim 1, wherein the user gesture comprises a posture of the user'"'"'s hand.

4. The system of claim 1, wherein the user gesture comprises movement of the user'"'"'s body.

5. The system of claim 1, wherein the user gesture comprises movement of an object.

6. The system of claim 1, wherein the desktop software application is a graphics design software application.

7. The system of claim 1, wherein the video camera generates real-time video signals responsive to a user'"'"'s facial expressions as observed by the video camera.

8. The system of claim 1, wherein the system is configured to recognize a position of the user with respect to the video camera, and the processor is configured to generate control signals in response to the user gesture and the user position.

9. The system of claim 1, wherein the system is configured to recognize the user gesture, user position and user proximity to the video camera in a three-dimensional space, and the processor is configured to generate control signals in response to the user gesture, user position and user proximity to the video camera.

10. The system of claim 1, wherein the video camera is a mobile video camera and moves to track movements by the user.

13. The system of claim 1, wherein the user gesture comprises a posture of the user'"'"'s hand.

11. A method of providing a gesture-based user interface for a computer workstation, the method comprising:

generating real-time video signals responsive in response to a user gesture;

generating control signals responsive to the real-time video signals responsive to the user gesture; and

enabling control of a desktop software application executing on the computer workstation using the control signals;

wherein at least one aspect of the desktop software application is responsive to the user gesture.

12. The method of claim 11, wherein the user gesture comprises movement of the user'"'"'s hand.

14. The method of claim 11, wherein the user gesture comprises movement of the user'"'"'s body.

15. The method of claim 11, wherein the user gesture comprises movement of an object.

16. The method of claim 11, wherein the desktop software application is a graphics design software application.

17. The method of claim 11, further comprising:

generating real-time video signals responsive to a user'"'"'s facial expressions.

18. The method of claim 11, further comprising:

determining a position of the user with respect to a source of the video signals, and generating control signals in response to the user gesture and the user position.

19. The method of claim 11, further comprising:

determining the user gesture, a user position and a user proximity to a source of the video signals in a three-dimensional space, and generating control signals in response to the user gesture, user position and user proximity to the source of the video signals.