Vehicle systems and methods for interaction detection

• US 10,761,610 B2
• Filed: 05/21/2018
• Issued: 09/01/2020
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: eyeSight Mobile Technologies Ltd.
• Original Assignee: eyeSight Mobile Technologies Ltd.
• Inventors: Katz, Itay
• Primary Examiner(s): Siddiqui, Md Saiful A
• Application Number:
  US15/984,999
• Publication Number:
  US 20180356896A1
• Time in Patent Office: 834 Days
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/325 Power saving in peripheral device
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 2201/12 Acquisition of 3D measurements of objects
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Systems, methods, and non-transitory computer-readable media are disclosed. For example, a dual sensor control device is disclosed that includes at least one processor for receiving information from a proximity sensor and an image sensor. The processor may be configured to receive first data from the proximity sensor while the image sensor is in a first state, determine, using the first data, a presence of an object in proximity to the proximity sensor. The processor may also be configured to output, based on the determined presence of the object in proximity to the proximity sensor, a signal to the image sensor to cause the image sensor to enter a second state, different from the first state. The processor may also be configured to receive second data from the image sensor in the second state, and output at least one of a message and a command associated with the second data.

Claims

1. A device for detection of object location and motion, comprising:

at least one processor for receiving information from a proximity sensor and an image sensor, the at least one processor being configured to;

receive first data from the proximity sensor;

detect, using the received first data, a presence of an object in proximity to the proximity sensor;

receive, from the image sensor, second data reflective of images of the object;

detect, based on a combination of the first data and the second data, a zoom gesture, wherein the at least one processor is further configured to distinguish the zoom gesture between a zoom-in gesture and a zoom-out gesture using the combination of the first data and the second data; and

output at least one of a message and a command associated with the zoom gesture.

2. The device of claim 1, wherein the first data is reflective of at least a one-dimensional position of the object relative to the proximity sensor.

3. The device of claim 1, wherein the second data is reflective of at least a two-dimensional position of the object relative to the image sensor.

4. The device of claim 1, wherein the at least one processor is further configured to detect the object in the second data based on at least one of a contour or a location of the object in the second data.

5. The device of claim 1, wherein the object is at least one of a hand, a finger, and a handheld object used for pointing.

6. The device of claim 1, wherein detecting the zoom gesture further comprises:

determining, using the first data, whether the object is moving toward or away from the device;

determining, using the second data, whether one or more fingers associated with the detected object are spread or closed; and

determining the zoom gesture based on the determination of whether the object is moving toward or away from the device and the determination of whether the one or more fingers associated with the detected object are spread or closed.

7. The device of claim 1, wherein detecting the zoom gesture further comprises:

determining, using the first data and the second data, whether one or more fingers associated with the object are open or closed while the object moves toward the device;

determining, using the first data and the second data, whether the one or more fingers associated with the object are open or closed while the object moves away from the device; and

determining the zoom gesture based on a combination of the determination of whether the one or more fingers associated with the object are open or closed while the object moves toward the device and the determination of whether the one or more fingers associated with the object are open or closed while the object moves away from the device.

8. The device of claim 1, wherein the at least one processor is further configured to output the message or the command associated with the zoom gesture to enable gesture control.

9. The device of claim 1, wherein the first state is an off state, and the second state is an on state.

10. The device of claim 1, wherein the first state is associated with at least one of a first sampling rate, a first resolution, and a first exposure length, and the second state is at least one of a second sampling rate different than the first sampling rate, a second resolution different than the first resolution, and a second exposure length different than the first exposure length.

11. The device of claim 1, wherein the first data is associated with a first resolution and the second data is associated with a second resolution greater than the first resolution.

12. The device of claim 1, wherein the at least one processor is further configured to:

determine, using data from the proximity sensor, if the object exits a field of view of the proximity sensor; and

output, based on the determined exit, a second signal to the image sensor to cause the image sensor to enter a third state.

13. The device of claim 1, wherein the at least one processor is further configured to:

determine, using the first data, information associated with the distance to the object;

determine, using the second data, information associated with a horizontal position and a vertical position of the object; and

combine the distance information, the horizontal position information, and the vertical position information to determine a three-dimensional gesture.

14. The device of claim 1, wherein the at least one processor is further configured to determine a circular gesture based on the combination of the first data and the second data.

15. The device of claim 1, wherein the at least one processor is further configured to distinguish between a clockwise circular gesture and a counter-clockwise circular gesture based on the combination of the first data and the second data.

16. A device for detection of object location and motion, comprising:

at least one processor for receiving information from a proximity sensor and an image sensor, the at least one processor being configured to;

receive first data from the proximity sensor;

detect, using the received first data, a presence of an object in proximity to the proximity sensor;

receive, from the image sensor, second data reflective of images of the object;

detect, based on a combination of the first data and the second data, a zoom gesture, wherein the at least one processor is further configured to distinguish the zoom gesture between a zoom-in gesture and a zoom-out gesture using the combination of the first data and the second data; and

output at least one of a message and a command associated with the detected zoom gesture to enable gesture control.

17. The device of claim 16, wherein the object is at least one of a hand, a finger, and a handheld object used for pointing.

18. The device of claim 16, wherein detecting the zoom gesture further comprises:

determining, using the first data, whether the object is moving toward or away from the device;

determining, using the second data, whether one or more fingers associated with the detected object are spread or closed; and

determining the zoom gesture based on the determination of whether the object is moving toward or away from the device and the determination of whether the one or more fingers associated with the detected object are spread or closed.

19. The device of claim 16, wherein detecting the zoom gesture further comprises:

determining, using the first data and the second data, whether one or more fingers associated with the object are open or closed while the object moves toward the device;

determining, using the first data and the second data, whether the one or more fingers associated with the object are open or closed while the object moves away from the device; and

determining the zoom gesture based on a combination of the determination of whether the one or more fingers associated with the object are open or closed while the object moves toward the device and the determination of whether the one or more fingers associated with the object are open or closed while the object moves away from the device.

20. A device for detection of object location and motion, comprising:

at least one processor for receiving information from a proximity sensor and an image sensor, the at least one processor being configured to;

receive, from the proximity sensor, first data indicative of a presence of an object in proximity to the proximity sensor;

receive, from the image sensor, second data reflective of images of the object;

detect, based on a combination of the first data and the second data, a zoom gesture performed by the object; and

output at least one of a message and a command associated with the zoom gesture, wherein detecting the zoom gesture further comprises;

determining, using the first data and the second data, whether one or more fingers associated with the object are open or closed while the object moves toward the device;

determining, using the first data and the second data, whether the one or more fingers associated with the object are open or closed while the object moves away from the device; and

determining the zoom gesture based on a combination of the determination of whether the one or more fingers associated with the object are open or closed while the object moves toward the device and the determination of whether the one or more fingers associated with the object are open or closed while the object moves away from the device.

21. A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to perform operations including:

receiving first data from the proximity sensor while the image sensor is in a first state;

detecting, using the received first data, a presence of an object in proximity to the proximity sensor;

extracting, using the received first data, proximity sensor information associated with the detected object;

outputting, based on the detected presence of the object, a signal to cause the image sensor to enter a second state different from the first state;

receiving, from the image sensor in the second state, second data reflective of images of the object;

extracting, using the received second data, image information reflective of images of the object;

determining, based on a combination of the proximity sensor information associated with the detected object and the extracted image information reflective of images of the object, a zoom gesture performed by the object, wherein the at least one processor is further configured to distinguish the determined zoom gesture between a zoom-in gesture and a zoom-out gesture using the combination of the first data and the second data; and

outputting at least one of a message and a command associated with the zoom gesture.