Apparatus, Methods And Computer Program Products Providing Finger-Based And Hand-Based Gesture Commands For Portable Electronic Device Applications

• US 20120056804A1
• Filed: 11/14/2011
• Published: 03/08/2012
• Est. Priority Date: 06/28/2006
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Radivojevic, Zoran, Zou, Yanming, Wang, Kong Qiao, Takala, Roope Tapio, Lantz, Vuokko Tuulikki, Lehtiniemi, Reijo, Vatanparast, Ramin, Rantala, Jukka Iimari
• Application Number:
  US13/295,340
• Publication Number:
  US 20120056804A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A method includes executing a gesture with a user-manipulated physical object in the vicinity of a device; generating data that is descriptive of the presence of the user-manipulated object when executing the gesture; and interpreting the data as pertaining to at least one object, such as an object displayed by the device.

Claims

1. A method, comprising:

detecting execution of a gesture performed with a user-manipulated physical object in the vicinity of a device;

generating data that is descriptive of the presence or movement of the user-manipulated object when executing the gesture; and

interpreting the data as pertaining to at least one object displayed by the device.

3. The method of claim 1, wherein generating data comprises generating data that is descriptive of motion being made by the user-manipulated object in either three dimensional space or two dimensional space.

6. The method of claim 1, wherein generating data comprises generating data that is descriptive of motion being made by the user-manipulated object over a period of time.

7. The method of claim 1, wherein generating data comprises sequentially creating individual ones of a plurality of records, wherein individual ones of the plurality of records comprises data descriptive of a location of the user-manipulated physical object at a corresponding point in time while the gesture is executed.

11. The method of claim 1, wherein the presence or motion comprises at least one of:

a substantially circular motion, a substantially linear motion, at least one substantially circular motion in combination with at least one substantially linear motion, a substantially circular motion and a substantially linear motion, in combination with a period of substantially no motion, a substantially curved motion, and a tapping motion.

12. The method of claim 1, where the user-manipulated physical object is comprised of at least two objects, and where the motion comprises movement of one of the at least two objects relative to at least one other of the at least two objects.

13. The method of claim 1, where the data is descriptive of at least one of a velocity and an acceleration of the user-manipulated physical object.

14. The method of claim 1, wherein the data is descriptive of at least one of a spatial orientation of at least a part of the user-manipulated physical object in two or three dimensional space, a repose of at least a part of the user-manipulated physical object in two or three dimensional space and a shape formed by at least a part of the user-manipulated physical object in two or three dimensional space.

2. (canceled)

4-5. -5. (canceled)

8-10. -10. (canceled)

15. An apparatus, comprising:

at least one processor; and

at least one memory storing computer program instructions configured, working with the at least one processor, to cause the apparatus to perform at least the following;

detecting execution of a gesture performed with a user-manipulated physical object in the vicinity of a device;

generating data that is descriptive of the presence or movement of the user-manipulated object when executing the gesture; and

interpreting the data as pertaining to at least one object displayed by the device.

16. The apparatus of claim 15, comprising a sensor arrangement configured to output data that is descriptive of motion being made by the user-manipulated physical object or portion of the user-manipulated physical object in two or three dimensional space, and wherein the sensor arrangement is comprised of at least one of a plurality of acoustic sensors and a plurality of light sensors.

17. The apparatus of claim 15, embodied in a device that comprises means for conducting wireless communications.

18. The apparatus of claim 15, wherein the data is descriptive of at least one of a spatial orientation of at least a part of the user-manipulated physical object in two or three dimensional space, the repose of at least a part of the user-manipulated physical object in two or three dimensional space and a shape formed by at least a part of the user-manipulated physical object in two or three dimensional space.

19. A non-transitory computer readable medium,

storing computer program instructions that, when performed by at least one processor, causes at least the following to be performed:

detecting execution of a gesture performed with a user-manipulated physical object in the vicinity of a device;

generating data that is descriptive of the presence or movement of the user-manipulated object when executing the gesture; and

interpreting the data as pertaining to at least one object displayed by the device.

21. The non-transitory computer readable medium of claim 19, wherein generating data comprises generating data that is descriptive of a motion made by the user-manipulated object in either three dimensional space or two dimensional space.

24. The non-transitory computer readable medium of claim 19, wherein generating data comprises generating data that is descriptive of a motion made by the user-manipulated object over a period of time.

25. The non-transitory computer readable medium of claim 19, wherein generating data comprises sequentially creating individual ones of a plurality of records, wherein individual ones of the plurality of records comprise data descriptive of a location of the user-manipulated physical object at a corresponding point in time while the gesture is executed.

29. The non-transitory computer readable medium of claim 19, wherein generating data comprises generating data that is descriptive of a motion made by the user-manipulated object in at least one of two dimensional space and three dimensional space, wherein the motion comprises at least one of:

a substantially circular motion;

a substantially linear motion;

at least one substantially circular motion in combination with at least one substantially linear motion;

a substantially circular motion and a substantially linear motion, in combination with a period of substantially no motion;

a substantially curved motion; and

a tapping motion.

30. The non-transitory computer readable medium of claim 29, wherein the user-manipulated physical object is comprised of at least two objects, and wherein the motion comprises movement of one of the at least two objects relative to at least one other of the at least two objects.

31. The non-transitory computer readable medium of claim 19, wherein the data is descriptive of at least one of a velocity and an acceleration of the user-manipulated physical object.

32. The non-transitory computer readable medium of claim 19, wherein the data is descriptive of at least one of a spatial orientation of at least a part of the user-manipulated physical object in two or three dimensional space, the repose of at least a part of the user-manipulated physical object in two or three dimensional space and a shape formed by at least a part of the user-manipulated physical object in two or three dimensional space.

20. (canceled)

22-23. -23. (canceled)

26-28. -28. (canceled)

33-45. -45. (canceled)