Gesture detection using ambient light sensors

• US 9,256,290 B2
• Filed: 07/01/2013
• Issued: 02/09/2016
• Est. Priority Date: 07/01/2013
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Mankowski, Peter, Wu, Xiaowei, Zawada, Krzysztof
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US13/932,487
• Publication Number:
  US 20150002386A1
• Time in Patent Office: 953 Days
• Field of Search: 345156-158, 345173-179, 345/207, 178 1801- 1804
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A device and method to detect a gesture made by an object in touch-less communication with the device are described. The device includes a collection engine to collect light intensity measurements of light intensity at two or more measurement cycles from two or more ambient light sensors arranged at respective surface locations of the device. The device also includes a processor to identify the gesture based on the light intensity measurements at each of the two or more ambient light sensors at two or more of the two or more measurement cycles, and a memory device to store a gesture library that associates the gesture with an output signal.

Claims

1. A device to detect a gesture made by an object in touch-less communication, the device comprising:

a collection engine configured to collect light intensity measurements of light intensity at two or more measurement cycles from two or more ambient light sensors arranged at respective surface locations of the device;

a processor configured to identify the gesture based on the light intensity measurements at each of the two or more ambient light sensors at two or more of the two or more measurement cycles; and

a memory device configured to store a gesture library that associates the gesture with an output signal.

2. The device according to claim 1, wherein the collection engine outputs the light intensity measurements collected from each of the two or more ambient light sensors at each measurement cycle of the two or more measurement cycles as a frame of data.

3. The device according to claim 2, wherein the processor identifies the gesture by processing the frame of data output by the collection engine, the processing including the processor comparing the light intensity measurements of the frame of data with other ones of the frame of data and using a process of elimination of other gestures among a set of gestures.

4. The device according to claim 3, wherein, when the processor identifies the gesture, the processor stops the processing of subsequent ones of the frame of data output by the collection engine.

5. The device according to claim 3, wherein, when the processor identifies the gesture, the processor continues processing subsequent ones of the frame of data output by the collection engine to verify the gesture.

6. The device according to claim 3, wherein the processor processes a first set of the frame of data and, when the processor receives a trigger signal, the processor processes a second set of the frame of data.

7. The device according to claim 3, wherein the processor starts processing the frame of data output after the processor receives a trigger signal.

8. The device according to claim 1, wherein the processor associates the gesture with the output signal based on the gesture library and outputs the output signal.

9. The device according to claim 8, wherein the memory device stores a second gesture library, each of the gesture library and the second gesture library corresponding to a respective application being executed by the device, and the processor selects the gesture library or the second gesture library based on whether the device is executing the application corresponding to the gesture library or the second gesture library.

10. The device according to claim 9, wherein the processor outputs the output signal associated with the gesture according to the gesture library only when the device is executing the application corresponding with the gesture library.

11. A method of detecting a gesture made by an object in touch-less communication with a device, the method comprising:

receiving light intensity measurements of light intensity at two or more measurement cycles from two or more ambient light sensors arranged at respective surface locations of the device;

identifying the gesture, using a processor, based on the light intensity measurements at each of the two or more ambient light sensors at two or more of the two or more measurement cycles; and

storing, using a memory device, a gesture library that associates the gesture with an output signal.

12. The method according to claim 11, wherein the receiving the light intensity measurements from each of the two or more ambient light sensors at each measurement cycle of the two or more measurement cycles is as a frame of data.

13. The method according to claim 12, wherein the processor identifying the gesture includes processing the frame of data, the processing including comparing the light intensity measurements of the frame of data with other ones of the frame of data and using a process of elimination of other gestures among a set of gestures.

14. The method according to claim 13, further comprising the processor ceasing the processing of subsequent received ones of the frame of data when the processor identifies the gesture.

15. The method according to claim 13, further comprising the processor continuing the processing of subsequent received ones of the frame of data when the processor identifies the gesture to verify the gesture.

16. The method according to claim 13, wherein the processing includes the processor processing a first set of the frame of data and, when the processor receives a trigger signal, the processor processing a second set of the frame of data.

17. The method according to claim 13, wherein the processing includes the processor processing the frame of data after the processor receives a trigger signal.

18. The method according to claim 11, further comprising the processor associating the gesture with the output signal based on the gesture library and outputting the output signal.

19. The method according to claim 11, further comprising the memory device storing a second gesture library, each of the gesture library and the second gesture library corresponding to a respective application being executed by the device, and the processor selecting the gesture library or the second gesture library based on whether the device is executing the application corresponding to the gesture library or the second gesture library.

20. The method according to claim 19, wherein the processor outputs the output signal associated with the gesture according to the gesture library only when the device is executing the application corresponding with the gesture library.