SYSTEMS AND METHODS FOR PROXIMITY SENSOR AND IMAGE SENSOR BASED GESTURE DETECTION

• US 20160026255A1
• Filed: 03/13/2014
• Published: 01/28/2016
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: eyeSight Mobile Technologies Ltd.
• Original Assignee: eyeSight Mobile Technologies Ltd.
• Inventors: KATZ, Itay
• Granted Patent: US 9,977,507 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Systems, methods, and non-transitory computer-readable media are disclosed. For example, a dual sensor control device is disclosed that includes at least one processor for receiving information from a proximity sensor and an image sensor. The processor may be configured to receive first data from the proximity sensor while the image sensor is in a first state, determine, using the first data, a presence of an object in proximity to the proximity sensor. The processor may also be configured to output, based on the determined presence of the object in proximity to the proximity sensor, a signal to the image sensor to cause the image sensor to enter a second state, different from the first state. The processor may also be configured to receive second data from the image sensor in the second state, and output at least one of a message and a command associated with the second data.

Claims

20. A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to perform operations including:

receiving first data from the proximity sensor while an image sensor is in a first state;

determining, using the first data, a presence of an object in proximity to a proximity sensor;

outputting, based on the determined presence of the object in proximity to the proximity sensor, a signal to the image sensor to cause the image sensor to enter a second state, different from the first state;

receiving second data from the image sensor in the second state; and

outputting at least one of a message and a command associated with the second data.

21. A three-dimensional control device, comprising:

at least one processor for receiving information from a proximity sensor and an image sensor, the at least one processor being configured to;

receive first data, associated with a detected object, from the proximity sensor while the proximity sensor operates at a first level of power consumption, wherein the first data is reflective of at least a one-dimensional position of the object relative to the proximity sensor;

receive second data, associated with the detected object, from the image sensor while the image sensor operates at a second level of power consumption greater than the first level, wherein the second data is reflective of at least a two-dimensional position of the object relative to the image sensor; and

coordinate the first data and the second data to obtain three-dimensional information associated with the detected object.

22. The device of claim 21, wherein the at least one processor is further configured to output at least one of a message and a command associated with the three-dimensional information.

30. The device of claim 21, wherein the first data is associated with a first resolution and the second data is associated with a second resolution that is greater than the first resolution.

31. The device of claim 21, wherein the at least one processor is further configured to determine whether the proximity sensor and the image sensor are facing a user based on information received from at least one of an accelerometer and a gyroscope.

32. The device of claim 21, wherein the at least one processor is further configured to determine, using the first data, whether the object performed a gesture parallel to a display.

23-1. The device of claim 23, wherein the at least one processor is further configured to determine a circular gesture.

29. The device of claim 28, wherein the at least one processor is further configured to distinguish between a clockwise circular gesture and a counter-clockwise circular gesture.

36. A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to perform operations including:

receiving first data, associated with a detected object, from a proximity sensor while the proximity sensor operates at a first level of power consumption, wherein the first data is reflective of at least a one-dimensional position of the object relative to the proximity sensor;

receiving second data, associated with the detected object, from an image sensor while the image sensor operates at a second level of power consumption greater than the first level, wherein the second data is reflective of at least a two-dimensional position of the object relative to the image sensor; and

coordinating the first data and the second data to obtain three-dimensional information associated with the detected object.

37. The non-transitory computer-readable medium of claim 36, wherein the instructions, when executed by the at least one processor, further causes the at least one processor to perform an additional operation including determining a gesture using the three-dimensional information.

38. The non-transitory computer-readable medium of claim 37, wherein the instructions, when executed by the at least one processor, further causes the at least one processor to perform additional operations including:

determining, using the first data, whether the detected object is moving toward or away from the device;

determining, using the second data, whether one or more fingers associated with the detected object are spread or closed; and

determining at least one of a zoom-in gesture and a zoom-out gesture based on the determination of whether the detected object is moving toward or away from the device and the determination of whether the one or more fingers associated with the detected object are spread or closed.

39. The non-transitory compute-readable medium of claim 36, wherein the instructions, when executed by the at least one processor, further causes the at least one processor to perform an additional operation including distinguishing between a clockwise circular gesture and a counter-clockwise circular gesture.

40. The non-transitory computer-readable medium of claim 36, wherein the instructions, when executed by the at least one processor, further causes the at least one processor to perform an additional operation including determining, using the first data, whether the object performed a gesture parallel to a display.