Electronic device with sensing assembly and method for interpreting consecutive gestures

• US 8,619,029 B2
• Filed: 12/21/2009
• Issued: 12/31/2013
• Est. Priority Date: 05/22/2009
• Status: Expired due to Fees

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Inventors: Alameh, Rachid, Merrell, Thomas, Paitl, Kenneth, Pullela, Venkata Surya Narayana (Murthy)
• Primary Examiner(s): Feild, Joseph
• Assistant Examiner(s): HOFFNER, LINH NGUYEN
• Application Number:
  US12/643,211
• Publication Number:
  US 20100295781A1
• Time in Patent Office: 1,471 Days
• Field of Search: 345/173, 345/156, 345/158, 349/58, 398/115, 455/73
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A method for interpreting at least two consecutive gestures includes providing a sensing assembly having at least one photoreceiver and a plurality of phototransmitters, wherein each phototransmitter is positioned to emit infrared light away from the electronic device about a corresponding central transmission axis, wherein each central transmission axis is oriented in a different direction with respect to the others, and controlling emission of infrared light by each of the phototransmitters during each of a plurality of time periods. During each of the plurality of phototransmitters and for each of the plurality of time periods, a corresponding measured signal is generated which is indicative of a respective amount of infrared light which originated from that phototransmitter during that time period and was reflected by the external object prior to being received by a photoreceiver. The measured signals are evaluated to identity a first gesture, and the electronic device is controlled in response to identification of the first gesture according to a first mode of operation. A parameter of a second gesture is also determined, and the electronic device is controlled in response to the determined parameter of the second gesture according to a second mode of operation.

Claims

1. A method for interpreting at least two consecutive gestures, wherein each gesture is a specified pattern of movement of an external object relative to an electronic device, the method comprising:

providing as part of the electronic device a sensing assembly including at least one photoreceiver and a plurality of phototransmitters, wherein each phototransmitter is positioned to emit infrared light away from the electronic device about a corresponding central transmission axis, wherein each central transmission axis is oriented in a different angular direction with respect to the others;

controlling emission of infrared light by each of the phototransmitters during each of a plurality of time periods;

for each of the plurality of phototransmitters and for each of the plurality of time periods, generating a corresponding measured signal indicative of a respective amount of infrared light which originated from that phototransmitter during that time period and was reflected by the external object prior to being received by a photoreceiver;

evaluating the measured signals to identify a first gesture;

controlling the electronic device in response to the identification of the first gesture according to a first mode of operation of the electronic device;

determining a parameter of a second gesture; and

controlling the electronic device in response to the determined parameter of the second gesture according to a second mode of operation.

2. The method of claim 1, wherein the first mode of operation links the identification of the first gesture to a mode change function that activates the second mode of operation, and wherein each of the gestures is selected from the group consisting of a slide gesture, a push gesture, a pull gesture, a tilt gesture, a hover gesture, and a combination gesture formed from at least two of the slide gesture, the push gesture, the pull gesture, the tilt gesture, and the hover gesture.

3. The method of claim 1, wherein identification of an intermediate gesture subsequent to occurrence of the first gesture and prior to occurrence of the second gesture triggers a change between the first mode of operation and the second mode of operation.

4. The method of claim 1, wherein determining a parameter of the second gesture includes assuming an occurrence of the second gesture in response to the identification of the first gesture, and the second mode of operation lasts for a predetermined duration and links an assumed occurrence of the second gesture to a null function.

5. The method of claim 4, wherein the first gesture is a slide gesture in a first direction and the second gesture is a slide gesture in a second direction that is opposite to the first direction, and the first mode of operation links an identification of a slide gesture to a scrolling, a panning, or a zooming function.

6. The method of claim 5, wherein after the predetermined duration has passed, the first mode of operation is again activated such that a subsequent identified slide gesture controls a scrolling, a panning, or a zooming function.

7. The method of claim 4, wherein the predetermined duration is selectable by a user.

8. The method of claim 1, wherein evaluating the measured signals also includes:

determining a first identification threshold, wherein determining a parameter of the second gesture includes determining whether a calculated measured signal set corresponding to the second gesture includes a signal having a magnitude which is greater than the first identification threshold, and if so, identifying the second gesture, and if not, ignoring the second gesture, and wherein the second mode of operation links an ignored second gesture to a null function and links an identification of the second gesture to a function that is the same as the function associated with the first mode of operation.

9. The method of claim 8, wherein the first gesture is a slide gesture in a first direction and the second gesture is a slide gesture in a reverse direction, and the first mode of operation links an identification of a slide gesture to a scrolling, a panning or a zooming function.

10. The method of claim 1, wherein the determining a parameter of the second gesture includes:

calculating whether the second gesture is of greater duration than a setpoint duration, and wherein the second mode of operation links a determination that the second gesture is of shorter duration than the setpoint duration to a null function, and links a determination that the second gesture is of greater duration that the setpoint duration to a function that is the same as a function associated with the first mode of operation.

11. The method of claim 10, wherein the first gesture is a slide gesture in a first direction and the second gesture is a slide gesture in a reverse direction, and the first mode of operation links an identification of a slide gesture to a scrolling function.

12. The method of claim 10, wherein evaluating the measured signals to identify the first gesture also includes calculating a duration of the first gesture, and using the duration of the first gesture as the setpoint duration.

13. A method for detecting two or more consecutive specified patterns of movement of an external object relative to an electronic device, the method comprising:

providing as part of the electronic device a sensing assembly including at least one phototransmitter and a plurality of photoreceivers, wherein the phototransmitter is positioned to emit infrared light away from the electronic device about a central transmission axis, and each photoreceiver is positioned to receive infrared light about a corresponding central receiving axis, wherein each central receiving axis is oriented in a different direction with respect to the others;

controlling emission of infrared light by the phototransmitter during each of a plurality of sequential time periods;

for each of the plurality of photoreceivers and for each of the plurality of sequential time periods, generating a corresponding measured signal indicative of a respective amount of infrared light which originated from the phototransmitter during the corresponding time period and was reflected by the external object prior to being received by the corresponding photoreceiver; and

evaluating the measured signals to identify a first gesture, wherein the first gesture includes a first of the two or more consecutive specified patterns of movement;

controlling the electronic device in response to the identification of the first gesture according to a first mode of operation of the electronic device;

determining a parameter of a second gesture; and

controlling the electronic device in response to the determined parameter of the second gesture according to a second mode of operation.

14. The method of claim 13, wherein the first mode of operation links the identification of the first gesture to a mode change function that activates the second mode of operation.

15. The method of claim 13, wherein identification of an intermediate gesture subsequent to occurrence of the first gesture and prior to occurrence of the second gesture triggers a change between the first mode of operation and the second mode of operation.

16. The method of claim 13, wherein determining a parameter of the second gesture including assuming an occurrence of the second gesture in response to the identification of the first gesture, and the second mode of operation lasts for a predetermined duration and links an assumed occurrence of the second gesture to a null function.

17. The method of claim 13, wherein evaluating the measured signals also includes determining a first identification threshold, wherein determining a parameter of the second gesture includes determining whether a calculated measured signal set corresponding to the second gesture includes a signal having a magnitude which is greater than the first identification threshold, and if so, identifying the second gesture, and if not, ignoring the second gesture, and wherein the second mode of operation links an ignored second gesture to a null function and links an identification of a second gesture to a function that is the same as that associated with the first mode of operation.

18. The method of claim 13, wherein the determining a parameter of the second gesture includes:

calculating whether the second gesture is of greater duration than a setpoint duration, and wherein the second mode of operation links a determination that the second gesture is of shorter duration than the setpoint duration to a null function, and links a determination that the second gesture is of greater duration that the setpoint duration to a function that is the same as a function associated with the first mode of operation.

19. A method for interpreting at least two consecutive gestures, wherein each gesture is a specified pattern of movement of an external object relative to an electronic device, the method comprising:

providing as part of the electronic device a sensing assembly including at least one photoreceiver and a plurality of phototransmitters, wherein each phototransmitter is positioned to emit infrared light away from the electronic device about a corresponding central transmission axis, wherein each central transmission axis is oriented in a different direction with respect to the others;

controlling emission of infrared light by each of the phototransmitters during each of a plurality of time periods;

for each of the plurality of phototransmitters and for each of the plurality of time periods, generating a corresponding measured signal indicative of a respective amount of infrared light which originated from that phototransmitter during that time period and was reflected by the external object prior to being received by a photoreceiver;

evaluating the measured signals to identify a first gesture;

controlling the electronic device in response to the identification of the first gesture according to a first mode of operation of the electronic device;

determining a parameter of a second gesture, wherein the first gesture and the second gesture are the same type of gesture and the first mode of operation and the second mode of operation are different; and

controlling the electronic device in response to the determined parameter of the second gesture according to a second mode of operation.

20. The method of claim 19, wherein the first gesture and the second gesture are performed in opposite directions from each other.