GESTURE RECOGNITION USING PLURAL SENSORS

• US 20120280900A1
• Filed: 05/06/2011
• Published: 11/08/2012
• Est. Priority Date: 05/06/2011
• Status: Abandoned Application

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Wang, Kong Qiao, Ollikainen, Jani Petri Juhani
• Application Number:
  US13/102,658
• Publication Number:
  US 20120280900A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

Apparatus comprises a processor; a user interface enabling user interaction with one or more software applications associated with the processor; first and second sensors configured to detect, and generate signals corresponding to, objects located within respective first and second sensing zones remote from the apparatus, wherein the sensors are configured such that their respective sensing zones overlap spatially to define a third, overlapping, zone in which both the first and second sensors are able to detect a common object; and a gesture recognition system for receiving signals from the sensors, the gesture recognition system being responsive to detecting an object inside the overlapping zone to control a first user interface function in accordance with signals received from both sensors.

Claims

1. (canceled)

14. A method comprising:

receiving signals from first and second sensors, the first and second sensors having respective first and second object sensing zones and providing a third, overlapping, zone in which both the first and second sensors can detect a common object, and

in response to detecting an object in the overlapping zone, controlling a first user interface function in accordance with the signals received from both sensors.

15. A method according to claim 14, further comprising receiving, in response to detecting an object outside of the overlapping zone, a signal from only one of the sensors;

and controlling a second, different, user interface function in accordance with said received signal.

16. A method according to claim 15, further comprising receiving, in response to detecting an object outside of the overlapping zone, a signal from only the second sensor;

and controlling a third, different, user interface function in accordance with said received signal.

18. A method according to claim 15, comprising identifying from signals received from both sensors one or more predetermined gestures based on detected movement of the object, and controlling the first user interface function in accordance with the or each identified gesture.

19. A method according to claim 15, comprising identifying image signals received from different regions of an optical sensor, and controlling different respective user interface functions dependent on the region in which an object is detected.

20. (canceled)

21. A non-transitory computer-readable storage medium having stored thereon computer-readable code, which, when executed by computing apparatus, causes the computing apparatus to perform a method comprising:

receiving signals from first and second sensors, the first and second sensors having respective first and second object sensing zones and providing a third, overlapping, zone in which both the first and second sensors can detect a common object, and

in response to detecting an object in the overlapping zone, controlling a first user interface function in accordance with the signals received from both sensors.

22. Apparatus, the apparatus having at least one processor and at least one memory having computer-readable code stored thereon which when executed controls the at least one processor:

to receive signals from first and second sensors, the first and second sensors having respective first and second object sensing zones and providing a third, overlapping, zone in which both the first and second sensors can detect a common object, and

to respond to detecting an object in the overlapping zone by controlling a first user interface function in accordance with the signals received from both sensors.

2. Apparatus according to claim 22, wherein the computer-readable code stored when executed controls the at least one processor to respond to detecting an object outside of the overlapping zone to control a second, different, user interface function in accordance with a signal received from only one of the sensors.

3. Apparatus according to claim 22, wherein the computer-readable code stored when executed controls the at least one processor to respond to detecting an object inside the overlapping zone to identify from signals received from both sensors one or more predetermined gestures based on detected movement of the object, and to control the first user interface function in accordance with each identified gesture.

4. Apparatus according to claim 22, wherein the first sensor is an optical sensor and the second sensor senses radio waves received using a different part of the electromagnetic spectrum, and optionally is a radar sensor.

5. Apparatus according to claim 4, further comprising an image processor associated with the optical sensor, the image processor being configured to identify image signals received from different regions of the optical sensor, and wherein computer-readable code stored when executed controls the at least one processor configured to control different respective user interface functions dependent on the region in which an object is detected.

6. Apparatus according to claim 4, wherein the radar sensor is configured to emit and receive radio signals in such a way as to define a wider spatial sensing zone than a spatial sensing zone of the optical sensor.

7. Apparatus according to claim 22, wherein the computer-readable code stored when executed controls the at least one processor configured-to identify, from the received image and radio sensing signals, both a translational and a radial movement and/or radial distance for an object with respect to the apparatus and to determine therefrom the one or more predetermined gestures for controlling the first user interface function.

8. Apparatus according to claim 7, wherein the computer-readable code stored when executed controls the at least one processor configured to identify, from the received image signal, a motion vector associated with the foreground object'"'"'s change of position between subsequent image frames and to derive therefrom the translational movement.

9. Apparatus according to claim 22, wherein the apparatus is a mobile communications terminal.

10. Apparatus according to claim 9, wherein the mobile communications terminal comprises a display on one side or face thereof for displaying graphical data controlled by means of signals received from both the first and second sensors.

11. Apparatus according to claim 9, wherein the first sensor is an optical sensor and the second sensor senses radio waves received using a different part of the electromagnetic spectrum, and optionally is a radar sensor and wherein the optical sensor is a camera provided on the same side or face as the display.

12. Apparatus according to claim 11, wherein the radar sensor is configured to receive reflected radio signals from the same side or face as the display.

13. Apparatus according to claim 22, wherein the computer-readable code stored when executed controls the at least one processor to detect a hand-shaped object.