GESTURE RECOGNITION

• US 20130307775A1
• Filed: 05/15/2013
• Published: 11/21/2013
• Est. Priority Date: 05/16/2012
• Status: Abandoned Application

• Current Assignee: Stmicroelectronics (Research & Development) Limited (STMicroelectronics NV)
• Original Assignee: Stmicroelectronics Pte Limited (STMicroelectronics NV)
• Inventors: Raynor, Jeffrey M.
• Application Number:
  US13/894,690
• Publication Number:
  US 20130307775A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/021 Arrangements integrating additional peripherals in a keyboard, e.g. card or barcode reader, optical scanner
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A system includes two or more optical sensors configured to generate image data based on gestures made by a user. One or more processing devices identifies movement quadrants based on the generated image data. If a match of the identified movement quadrants to one of a set of gesture commands is detected, one or more control signals associated with the matching gesture command are generated.

Claims

1. A system, comprising:

a first optical sensor configured to generate image data;

a second optical sensor configured to generate image data; and

one or more processing devices configured to generate one or more control signals by;

determining a first velocity based on image data generated by the first optical sensor;

determining a second velocity based on image data generated by the second optical sensor;

determining whether image data generated by the first optical sensor and image data generated by the second optical sensor are associated with a gesture based on the determined velocities; and

when it is determined image data generated by the first optical sensor and image data generated by the second optical sensor are associated with the gesture, generating one or more control signals associated with the gesture.

2. The system of claim 1 wherein the one or more processing devices are configured to:

determine a motion vector based on the first velocity, the motion vector representing a velocity of movement of a user part relative to the first optical sensor.

3. The system of claim 2, wherein the one or more processing devices are configured to:

determine a directional quadrant of the motion vector.

4. The system of claim 3 wherein the directional quadrant is one of four directional quadrants corresponding to up, down, left and right.

5. The system of claim 2 wherein the one or more processing devices are configured to:

compare a magnitude of the motion vector to a threshold magnitude; and

determine a movement quadrant associated with the motion vector when the magnitude of the motion vector exceeds the threshold magnitude.

6. The system of claim 1 wherein the first optical sensor, the second optical sensor and at least one of the one or more processing devices are incorporated within a user input device.

7. The system of claim 1, wherein the first optical sensor is configured to capture a succession of images and the one or more processing devices are configured to compare images of the succession of images.

8. The system of claim 7 wherein the first optical sensor comprises a photo-detector coupled to a movement processor configured to receive signals from the photo-detector and to generate the succession of images.

9. The system of claim 1 wherein the first optical sensor and the second optical sensor are incorporated into a keyboard.

10. The system of claim 9 wherein the first and second optical sensors are positioned substantially between respective keys of the keyboard.

11. The system of claim 9 wherein the first and second optical sensors are positioned such that they replace one or more keys of the keyboard.

12. The system according to claim 1, comprising a further optical sensor configured to provide cursor-control data.

13. The system according to claim 1, comprising a computing device configured to control a graphical display unit based on the one or more generated control signals.

14. The system according to claim 2 wherein the user part is a user finger.

15. The system of claim 1 wherein the one or more processing devices are configured to:

determine a first motion vector based on the first velocity, the first motion vector representing a velocity of movement of a user part relative to the first optical sensor;

determine a second motion vector based on the second velocity, the second motion vector representing a velocity of movement of a user part relative to the second optical sensor;

compare a magnitude of the first motion vector to a first threshold magnitude;

compare a magnitude of the second motion vector to a second threshold magnitude;

when the magnitude of the first motion vector exceeds the first threshold magnitude, determine a first movement quadrant based on the first motion vector;

when the magnitude of the second motion vector exceeds the second threshold magnitude, determine a second movement quadrant based on the second motion vector; and

determine whether the first movement quadrant and the second movement quadrant are associated with the gesture.

16. The system of claim 15 wherein the first threshold magnitude is equal to the second threshold magnitude.

17. A user input device comprising:

a plurality of optical sensors configured to generate velocity information based on image data; and

one or more processing devices configured to generate movement information based on velocity information generated by the plurality of optical sensors, wherein the movement information is associated with one or more control gestures of a plurality of control gestures.

18. The user input device of claim 17 wherein the plurality of optical sensors are configured to generate image data based on movement of one or more user fingers.

19. The user input device of claim 17 wherein the one or more processing devices are configured to:

generate movement vectors based on the generated image data; and

generate quadrant information based on the generated movement vectors.

20. The user input device of claim 19 wherein the one or more processing devices are configured to:

detect when the quadrant information matches one of the plurality of control gestures; and

when a match is detected, generate control signals corresponding to the matching control gesture.

21. A device, comprising:

an input configured to receive image data; and

one or more processing devices configured to generate one or more control signals by;

determining a first velocity based on received image data;

determining a second velocity based received image data;

determining whether the first velocity and the second velocity are associated with a gesture; and

when it is determined the first velocity and the second velocity are associated with the gesture, generating one or more control signals associated with the gesture.

22. The device of claim 21 wherein the one or more processing devices are configured to:

generate movement vectors based on received image data;

determine first and second movement quadrants based on the generated movement vectors, wherein determining whether the first velocity and the second velocity are associated with the gesture comprises determining whether the first and second movement quadrants are associated with the gesture.

23. The device of claim 21 wherein the one or more control signals comprise display control signals.

24. A method, comprising:

generating, using a plurality of optical sensors, image data based on user gestures;

determining, using one or more processing devices, a first velocity based on the generated image data;

determining, using the one or more processing devices, a second velocity based on the generated image data;

determining, using the one or more processing devices, whether the first velocity and the second velocity are associated with a command gesture; and

when it is determined the first velocity and the second velocity are associated with the command gesture, generating, using the one or more processing devices, one or more control signals associated with the command gesture.

25. The method of claim 24, comprising determining the first movement quadrant by generating a motion vector based on the first velocity, the motion vector representing movement of a user part relative to one of the plurality of optical sensors.

26. The method of claim 25 wherein the first movement quadrant corresponds to a directional quadrant of the motion vector.

27. The method of claim 26 wherein the directional quadrant is one of four directional quadrants corresponding to up, down, left and right.

28. The method of claim 25 comprising determining whether the motion vector has a magnitude greater than a threshold magnitude.

30. The non-transitory computer-readable medium of claim 27 wherein the method comprises:

generating a first motion vector based on the first velocity;

generating a second motion vector based on the second velocity; and

generating a first movement quadrant based on the first motion vector and a second movement quadrant based on the second motion vector, wherein determining whether the first velocity and the second velocity are associated with the command gesture comprises determining whether the first movement quadrant and the second movement quadrant are associated with the command gesture.

31. The non-transitory computer-readable medium of claim 30 wherein the first motion vector is indicative of a movement of a first user-finger relative to a first image sensor and the second motion vector is indicative of a movement of a second user-finger relative to a second image sensor.

29. A non-transitory computer-readable medium whose contents configure one or more processing devices to perform a method, the method comprising:

determining a first velocity based on received image data;

determining a second velocity based on received image data;

determining whether the first velocity and the second velocity are associated with a command gesture; and

when it is determined the first velocity and the second velocity are associated with the command gesture, generating one or more control signals associated with the command gesture.

32. A system, comprising:

a plurality of means for generating image data;

means for converting generated image data into data indicative of velocities;

means for identifying matches of data indicative of velocities to gestures; and

means for generating control signals associated with gestures in response to identified matches.

33. The system of claim 32 wherein the means for converting comprises an input/output processor of a user-input device.

34. The system of claim 33 wherein the means for generating control signals comprises a gesture processor of a computing device coupled to the user-input device.

35. The system of claim 32 wherein the means for identifying matches comprises means for determining movement quadrants based on data indicative of velocities.