Asymmetric mapping for tactile and non-tactile user interfaces

• US 9,229,534 B2
• Filed: 02/27/2013
• Issued: 01/05/2016
• Est. Priority Date: 02/28/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Galor, Micha
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US13/778,172
• Publication Number:
  US 20130222239A1
• Time in Patent Office: 1,042 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

A method, including receiving, by a computer, a sequence of signals indicating a motion of a hand of a user within a predefined area, and segmenting the area into multiple regions. Responsively to the signals, a region is identified in which the hand is located, and a mapping ration is assigned to the motion of the hand based on a direction of the motion and the region in which the hand is located. Using the assigned mapping ratio, a cursor on a display is presented responsively to the indicated motion of the hand.

Claims

1. A method, comprising:

receiving, by a computer, a sequence of signals indicating a motion of a hand of a user within a predefined area;

segmenting the area into multiple regions;

identifying, responsively to the signals, a region in which the hand is located;

assigning a mapping ratio to the motion of the hand based on a direction of the motion and the region in which the hand is located; and

presenting, using the assigned mapping ratio, a cursor on a display responsively to the indicated motion of the hand.

2. The method according to claim 1, wherein the signals indicate the hand manipulating a mouse, and wherein the predefined area comprises a two dimensional area including the mouse, and wherein the region comprises a two dimensional region within the two dimensional area.

3. The method according to claim 2, wherein receiving the signals comprises receiving the signals from one or more sensing devices mounted on the mouse, each of the one or more sensing devices selected from a list comprising an optical sensor and an ultrasonic senor.

4. The method according to claim 2, wherein receiving the signals comprises receiving the signals from a sensing device configured to collect images of the area, the sensing device selected from a list comprising a two dimensional optical sensor and a three dimensional optical sensor.

5. The method according to claim 1, wherein the region comprises a two dimensional region within a touchpad, and wherein receiving the signals comprises collecting the signals from tactile sensors positioned within the touchpad.

6. The method according to claim 1, wherein the motion of the hand comprises a three dimensional gesture performed by the hand, and wherein the predefined area comprises a three dimensional area including the hand, and wherein the region comprises a three dimensional region within the three dimensional area.

7. The method according to claim 6, wherein receiving the signals comprises collecting, from a three dimensional sensing device, three dimensional information of the area.

8. The method according to claim 1, wherein the mapping ratio is inversely related to a difficulty of moving the hand in the direction of the motion within the region.

9. The method according to claim 8, wherein the difficulty comprises an impediment positioned in proximity to the hand and in the direction of the motion, the impediment selected from a list comprising an edge of the area and an obstacle positioned within the area.

10. An apparatus, comprising:

a sensing device; and

a computer executing a mixed modality user interface, and configured to receive, from the sensing device, a sequence of signals indicating a motion of a hand of a user within a predefined area, to segment the area into multiple regions, to identify, responsively to the signals, a region in which the hand is located, to assign a mapping ratio to the motion of the hand based on a direction of the motion and the region in which the hand is located, and to present, using the assigned mapping ratio, a cursor on a display responsively to the indicated motion of the hand.

11. The apparatus according to claim 10, and comprising a mouse, and wherein the signals indicate the hand manipulating a mouse, and wherein the predefined area comprises a two dimensional area including the mouse, and wherein the region comprises a two dimensional region within the two dimensional area.

12. The apparatus according to claim 11, and comprising one or more sensing devices mounted on the mouse, and wherein the computer is configured to receive the signals from the one or more sensing devices, each of the one or more sensing devices selected from a list comprising an optical sensor and an ultrasonic senor.

13. The apparatus according to claim 11, and comprising a sensing device configured to collect images of the area, and wherein the computer is configured to receive the signals from the sensing device, the sensing device selected from a list comprising a two dimensional optical sensor and a three dimensional optical sensor.

14. The apparatus according to claim 10, and comprising a touchpad having tactile sensors positioned within the touchpad, wherein the area is comprised in the touchpad, and wherein the region comprises a two dimensional region on the touchpad, and wherein the computer is configured to receive the signals from the tactile sensors.

15. The apparatus according to claim 10, wherein the motion of the hand comprises a three dimensional gesture performed by the hand, and wherein the predefined area comprises a three dimensional area including the hand, and wherein the region comprises a three dimensional region within the three dimensional area.

16. The apparatus according to claim 15, and comprising a three dimensional sensing device configured to collect three dimensional information of the area, and wherein the computer is configured to receive the signals from the three dimensional sensing device.

17. The apparatus according to claim 10, wherein the mapping ratio is inversely related to a difficulty of moving the hand in the direction of the motion within the region.

18. The apparatus according to claim 17, wherein the difficulty comprises an impediment positioned in proximity to the hand and in the direction of the motion, the impediment selected from a list comprising an edge of the area and an obstacle positioned within the area.

19. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer, cause the computer to receive a sequence of signals indicating a motion of a hand of a user within a predefined area, to segment the area into multiple regions, to identify responsively to the signals, a region in which the hand is located, to assign a mapping ratio to the motion of the hand based on a direction of the motion and the region in which the hand is located, and to present, using the assigned mapping ratio, a cursor on a display responsively to the indicated motion of the hand.