Method for detecting gestures using a multi-segment photodiode and one or fewer illumination sources

• US 9,229,581 B2
• Filed: 01/17/2012
• Issued: 01/05/2016
• Est. Priority Date: 05/05/2011
• Status: Active Grant

• Current Assignee: Maxim Integrated Products, Inc. (Analog Devices, Inc.)
• Original Assignee: Maxim Integrated Products, Inc. (Analog Devices, Inc.)
• Inventors: Skurnik, David, Kestelli, Nevzat Akin, Veygman, Ilya K., Chamakura, Anand, Edwards, Christopher Francis, Kerness, Nicole, Parvarandeh, Pirooz, Hsu, Sunny Kweisun
• Primary Examiner(s): Legasse, Jr., Francis M
• Assistant Examiner(s): Williams, Don
• Application Number:
  US13/352,299
• Publication Number:
  US 20120280904A1
• Time in Patent Office: 1,449 Days
• Field of Search: 250/216, 250/231.13, 250/231.14, 250/231.16, 250/239, 250/237.G, 250/237.R, 356/218, 356/222, 356614-617
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

A gesture sensing device includes a multiple segmented photo sensor and a control circuit for processing sensed voltages output from the sensor. The control circuit processes the sensed voltage signals to determine target motion relative to the segmented photo sensor. The control circuit includes an algorithm configured to calculate one of more differential analog signals using the sensed voltage signals output from the segmented photo sensors. A vector is determined according to the calculated differential analog signals, the vector is used to determine a direction and/or velocity of the target motion.

Claims

1. A method of detecting a gesture, the method comprising:

selectively blocking a portion of light reflected from an object from impinging on a light sensor assembly depending upon a position of the object relative to the light sensor assembly using a light modifying wall structure disposed adjacent to the light sensor assembly, the light modifying wall structure comprising a plurality of layers and a plurality of vias, respective ones of the plurality of layers and the plurality of vias offset in a stair-step fashion with respect to a center axis defined perpendicular to a surface of the light sensor assembly;

calculating one or more differential signals according to time dependent signals output from the light sensor assembly, the light sensor assembly comprising a plurality of light sensors configured to detect light reflected from the object and to output the time dependent signals in response thereto; and

determining an object motion direction of the object passing over the light sensor assembly by applying vector analysis to the one or more differential signals.

2. The method of claim 1 further comprising determining a proportional value of an object motion velocity of the target passing the segmented sensor by applying vector analysis to the one or more differential signals.

3. The method of claim 1 wherein the light sensed by the light sensor assembly comprises light originated from an illumination source and reflected off the object.

4. The method of claim 1 wherein the light sensed by the light sensor assembly comprises ambient light.

5. The method of claim 1 wherein the one or more differential signals comprise one or more differential composite signals, wherein a composite signal is a signal formed from the addition of two or more time dependent signals.

6. The method of claim 1 wherein calculating one or more differential signals comprises calculating a first differential signal indicating the object motion direction along an x-axis.

7. The method of claim 6 wherein the first differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a positive x-direction if the positive maximum value precedes the negative maximum value in time.

8. The method of claim 6 wherein the first differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a negative x-direction if the negative maximum value precedes the positive maximum value in time.

9. The method of claim 6 wherein calculating one or more differential signals comprises calculating a second differential signal indicating the object motion direction along a y-axis.

10. The method of claim 9 wherein the second differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a positive y-direction if the positive maximum value precedes the negative maximum value in time.

11. The method of claim 9 wherein the second differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a negative y-direction if the negative maximum value precedes the positive maximum value in time.

12. The method of claim 9 further comprising calculating a proportional value of an object motion velocity along the x-axis using a time difference between successive zero crossings of the first differential signal, and calculating a proportional value of a target motion velocity along the y-axis using a time difference between successive zero crossings of the second differential signal.

13. The method of claim 12 further comprising superimposing the proportional value of the object motion velocity along the x-axis and the proportional value of the object motion velocity along the y-axis to form an object vector.

14. The method of claim 13 further comprising determining one of a predefined set of directions according to the object vector.

15. The method of claim 14 wherein the predefined set of directions comprise a positive x-direction, a negative x-direction, a positive y-direction, and a negative y-direction.

16. The method of claim 14 wherein the object vector has a object vector angle and determining one of the predefined set of directions comprises comparing the object vector angle to a set of defined threshold angles.

17. The method of claim 14 wherein determining one of the predefined set of directions comprises comparing the object vector to a set of predefined distribution patterns, each distribution pattern corresponding to one of the directions in the predefined set of directions.

18. The method of claim 17 wherein comparing the object vector comprises determining a confidence value associated with comparing the object vector to each distribution pattern, and selecting one of the predefined set of directions according to the highest confidence value.

19. An apparatus comprising:

a light sensor assembly comprising a plurality of light sensors, the plurality of light sensors configured to detect the light reflected from an object and to output time dependent signals in response thereto;

a light modifying wall structure disposed adjacent to the light sensor assembly, the light modifying wall structure configured to selectively block a portion of the light reflected from the object depending on a position of the object relative to the light sensor assembly, the light modifying wall structure comprising a plurality of layers and a plurality of vias, respective ones of the plurality of layers and the plurality of vias offset in a stair-step fashion with respect to a center axis defined perpendicular to a surface of the light sensor assembly;

a memory configured to store data representing the time dependent signals; and

a processor coupled to the memory, the processor configured to execute program instructions to cause the processor to;

calculate one or more differential signals according to the time dependent signals output from the light sensor assembly; and

determine an object motion direction of an object passing over the light sensor assembly by applying vector analysis to the one or more differential signals.

20. The apparatus of claim 19 wherein the program instructions are further configured to determine a proportional value of an object motion velocity of the object passing over the light sensor assembly by applying vector analysis to the one or more differential signals.

21. The apparatus of claim 19 wherein the light sensed by the light sensor assembly comprises light originated from an illumination source and reflected off the object.

22. The apparatus of claim 19 wherein the light sensed by the light sensor assembly comprises ambient light.

23. The apparatus of claim 19 wherein the one or more differential signals comprise one or more differential composite signals, wherein a composite signal is a signal formed from the addition of two or more time dependent signals.

24. The apparatus of claim 19 wherein calculating one or more differential signals comprises calculating a first differential signal indicating the object motion direction along an x-axis.

25. The apparatus of claim 24 wherein the first differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a positive x-direction if the positive maximum value precedes the negative maximum value in time.

26. The apparatus of claim 24 wherein the first differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a negative x-direction if the negative maximum value precedes the positive maximum value in time.

27. The apparatus of claim 24 wherein calculating one or more differential signals comprises calculating a second differential signal indicating the object motion direction along a y-axis.

28. The apparatus of claim 27 wherein the second differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a positive y-direction if the positive maximum value precedes the negative maximum value in time.

29. The apparatus of claim 27 wherein the second differential signal includes a positive maximum value and a negative maximum value, further wherein the object motion direction is determined to be in a negative y-direction if the negative maximum value precedes the positive maximum value in time.

30. The apparatus of claim 27 wherein the program instructions are further configured to calculate a proportional value of an object motion velocity along the x-axis using a time difference between successive zero crossings of the first differential signal, and calculate a proportional value of an object motion velocity along the y-axis using a time difference between successive zero crossings of the second differential signal.

31. The apparatus of claim 30 wherein the program instructions are further configured to superimpose the proportional value of the object motion velocity along the x-axis and the proportional value of the object motion velocity along the y-axis to form a an object vector.

32. The apparatus of claim 31 wherein the program instructions are further configured to determine one of a predefined set of directions according to the object vector.

33. The apparatus of claim 32 wherein the predefined set of directions comprise a positive x-direction, a negative x-direction, a positive y-direction, and a negative y-direction.

34. The apparatus of claim 33 wherein the object vector has an object vector angle and determining one of the predefined set of directions comprises comparing the object vector angle to a set of defined threshold angles.

35. The apparatus of claim 32 wherein determining one of the predefined set of directions comprises comparing the object vector to a set of predefined distribution patterns, each distribution pattern corresponding to one of the directions in the predefined set of directions.

36. The apparatus of claim 35 wherein comparing the object vector comprises determining a confidence value associated with comparing the object vector to each distribution pattern, and selecting one of the predefined set of directions according to the highest confidence value.