Electronic device with sensing assembly and method for detecting basic gestures

• US 8,344,325 B2
• Filed: 12/17/2009
• Issued: 01/01/2013
• Est. Priority Date: 05/22/2009
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Inventors: Merrell, Thomas, Alameh, Rachid
• Primary Examiner(s): Kim, Kiho
• Application Number:
  US12/640,867
• Publication Number:
  US 20100299642A1
• Time in Patent Office: 1,111 Days
• Field of Search: 250/349
• US Class Current: 250/349
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

An electronic device and method detects a predefined gesture. The electronic device includes a sensing assembly including at least one photoreceiver and a plurality of phototransmitters, where each phototransmitter is positioned to emit infrared light away from the electronic device about a corresponding central transmission axis, and where each central transmission axis is oriented in a different direction with respect to the others. Further, the emission of infrared light by each of the phototransmitters is controlled during each of a plurality of sequential time periods to facilitate detecting the gesture.

Claims

1. A method for detecting a specified pattern of movement of an external object relative to an electronic device, the method comprising:

providing as part of the electronic device a sensing assembly including;

a photoreceiver with a center reception axis,

a first phototransmitter with a first center transmission axis oriented in a different direction with respect to the center reception axis,

a second phototransmitter with a second center transmission axis oriented in a different direction with respect to the center reception axis and the first center transmission axis, and

a third phototransmitter with a third center transmission axis oriented in a different direction with respect to the center reception axis, the first center transmission axis, and the second center transmission axis;

emitting first infrared light from the first phototransmitter during a first time period;

generating a first measured signal indicative of an amount of the first infrared light that was reflected by the external object prior to being received by the photoreceiver during the first time period;

emitting second infrared light from the second phototransmitter during a second time period;

generating a second measured signal indicative of an amount of the second infrared light that was reflected by the external object prior to being received by the photoreceiver during the second time period;

emitting third infrared light from the third phototransmitter during a third time period;

generating a third measured signal indicative of an amount of the third infrared light that was reflected by the external object prior to being received by the photoreceiver during the third time period, wherein the first, second, and third time periods occur sequentially; and

evaluating the first measured signal, the second measured signal, and the third measured signal to detect the specified pattern of movement.

2. The method of claim 1, wherein the first center transmission axis, the second center transmission axis, and the third center transmission axis all diverge from each other.

3. The method of claim 1, further including:

controlling the electronic device based on the detected specified pattern of movement.

4. The method of claim 1, wherein the evaluating comprises, for at least one of the phototransmitters, analyzing a corresponding measured signal set to identify a predetermined feature and detect the specified pattern of movement based on the predetermined feature.

5. The method of claim 1, wherein the evaluating for a push or pull gesture comprises, for at least one of the phototransmitters, analyzing a respective measured signal set to determine whether corresponding intensity values sequentially increase or decrease over at least a subset of the first, second, and third time periods, which are sequential time periods.

6. The method of claim 1, wherein the evaluating for a slide gesture comprises, for at least two of the phototransmitters, analyzing a respective difference measured signal set corresponding to the two phototransmitters to identify if a positive peak is followed by a negative peak or vice versa.

7. The method of claim 1, wherein the evaluating comprises, for at least two of the phototransmitters, analyzing respective measured signal sets corresponding to the two phototransmitters to identify a predetermined feature in each and to compare the timing of the predetermined features with respect to each other.

8. The method of claim 1, wherein the specified pattern of movement is one selected from the group including:

a hover gesture, and a tilt gesture.

9. The method of claim 1, wherein the evaluating further includes detecting a predetermined hand configuration.

10. The method of claim 1, wherein the emitting of the first, second, and third infrared light, respectively, by the first phototransmitter, second phototransmitter, and third phototransmitter, respectively, includes controlling the intensity of the first, second, and third infrared light to avoid saturating the photoreceiver.

11. The method of claim 1, wherein the specified pattern of movement is one selected from the group including:

a push gesture, a pull gcsture, and a slide gesture.

12. A method for detecting a specified pattern of movement of an external object relative to an electronic device, the method comprising:

providing as part of the electronic device a sensing assembly including;

a phototransmitter with a center transmission axis,

a first photoreceiver with a first center reception axis oriented in a different direction with respect to the center transmission axis,

a second photoreceiver with a second center reception axis oriented in a different direction with respect to the center transmission axis and the first center reception axis, and

a third photoreceiver with a third center reception axis oriented in a different direction with respect to the center transmission axis, the first center reception axis, and the second center reception axis;

emitting first infrared light from the phototransmitter during a first time period;

generating a first measured signal indicative of an amount Of the first infrared light which originated from the phototransmitter during the first time period and was reflected by the external object prior to being received by the first photoreceiver;

emitting second infrared light from the phototransmitter during a second time period;

generating a second measured signal indicative of an amount of the second infrared light which originated from the phototransmitter during the second time period and was reflected by the external object prior to being received by the second photoreceiver;

emitting third infrared light from the phototransmitter during a third time period wherein the first, second, and third time periods occur sequentially;

generating a third measured signal indicative of an amount of the third infrared light which originated from the phototransmitter during the third time period and was reflected by the external object prior to being received by the third photoreceiver; and

evaluating the first measured signal, the second measured signal, and the third measured signal to detect the specified pattern of movement.

13. The method of claim 12, wherein the first center reception axis, the second centerreception axis, and the third center reception axis all diverge from each other.

14. The method of claim 12, further including:

controlling the electronic device based on the specified pattern of movement.

15. The method of claim 12, wherein the evaluating comprises, for at least one of the photoreceivers, analyzing a corresponding measured signal set to identify a predetermined feature and detect the specified pattern of movement based on the predetermined feature.

16. The method of claim 12, wherein the evaluating for a push or pull gesture comprises, for at least one of the photoreceivers, analyzing a respective measured signal set to determine whether corresponding intensity values sequentially increase or decrease over time.

17. The method of claim 12, wherein the evaluating for a slide gesture comprises, for at least two of the photoreceivers, analyzing a respective difference measured signal set corresponding to the two photoreceivers to identify if a positive peak is followed by a negative peak or vice versa.

18. The method of claim 12, wherein the evaluating comprises, for at least two of the photoreceivers, analyzing respective measured signal sets corresponding to the two photoreceivers to identify a predetermined feature in each and to compare the timing of the predetermined features with respect to each other.

19. The method of claim 12, wherein the specified pattern of movement is one selected from the group including:

a hover gesture, and a tilt gesture.

20. The method of claim 12, wherein the evaluating further includes detecting a predetermined hand configuration.

21. The method of claim 12, wherein the emitting of the first, second, and third infrared light includes controlling the intensity of the first, second, and third infrared light to avoid saturating at least one of the photoreceivers.

22. The method of claim 12, wherein the specified pattern of movement is one selected from the group including:

a push gesture, a pull gesture, and a slide gesture.

23. An electronic device for detecting a specified pattern of movement of an external object relative to the electronic device, the electronic device comprising:

a sensing assembly including;

a photoreceiver having a center reception axis;

a first phototransmitter configured to emit first infrared light so that first transmitted infrared light including the emitted first infrared light is directed outward away from the electronic device about a first center transmission axis that is oriented in a different direction with respect to the center reception axis;

a second phototransmitter configured to emit second infrared light so that second transmitted infrared light including the emitted second infrared light is directed outward away from the electronic device about a second center transmission axis that is oriented in a different direction with respect to the first center transmission axis and the center reception axis; and

a third phototransmitter configure to emit third infrared light so that third transmitted infrared light including the emitted third infrared light is directed outward away from the electronic device about a third center transmission axis that is oriented in a different direction with respect to the first center transmission axis, the second center transmission axis, and the center reception axis; and

a processor in communication with the sensing assembly that is configured for actuating the first phototransmitter to emit the first infrared light during a first time period , for actuating the second phototransmitter to emit the second infrared light during a second time period, and for actuating the third phototransmitter to emit the third infrared light during a third time period, wherein the first, second, and third time periods are sequential time periods;

wherein the electronic device is further configured to operate so that the photoreceiver generates a first measured signal indicative of an amount of the first infrared light emitted from the first phototransmitter during the first time period that was reflected by the external object prior to being received by the photoreceiver, the photoreceiver generates a second measured signal indicative of an amount of the second infrared light emitted from the second phototransmitter during the second time period that was reflected by the external object prior to being received by the photoreceiver, and the photoreceiver generates a third measured signal indicative of an amount of the third infrared light emitted from the third phototransmitter during the third time period that was reflected by the external object prior to being received by the photoreceiver, and

wherein the processor is further configured to evaluate the first, second, and third measured signals to detect the specified pattern of movement.

24. The electronic device of claim 23,

wherein the sensing assembly includes a pyramid-type structure having a central surface supporting the photoreceiver and a plurality of outer surfaces extending away from the central surface and being inclined relative to the central surface,

wherein each outer surface corresponds to a respective one of the phototransmitters, and

wherein:

(i) the first, second, and third phototransmitters are respectively oriented so that the first center transmission axis is normal to a first of the outer surfaces corresponding to the first phototransmitter, the second center transmission axis is normal to a second of the outer surfaces corresponding to the second phototransmitter, and the third center transmission axis is normal to a third of the outer surfaces corresponding to the third phototransmitter;

or (ii) the pyramid-type structure forms at least one lens that refracts the first, second, and third infrared light emitted from the phototransmitters;

or (iii) the first, second, and third phototransmitters are respectively located proximate first, second, and third outer edges of the electronic device, respectively, and are respectively oriented to direct the first, second, and third infrared light respectively emitted thereby toward the first, second, and third outer surfaces, respectively, by way of first, second, and third waveguides, respectively, the directed first, second, and third infrared light in turn respectively being reflected off of the first, second, and third outer surfaces, respectively, outward away from the electronic device as the first, second, and third transmitted infrared light, respectively.

25. The method of claim 23, wherein the first center transmission axis, the second center transmission axis, and the third center transmission axis all diverge from each other.