Gesture recognition systems and devices for low and no light conditions

• US 9,990,043 B2
• Filed: 07/01/2015
• Issued: 06/05/2018
• Est. Priority Date: 07/09/2014
• Status: Active Grant

• Current Assignee: West Texas Technology Partners LLC
• Original Assignee: Atheer Labs, Inc. (Atheer, Inc.)
• Inventors: Fink, Ryan, Phelps, Ryan, Peck, Gary
• Primary Examiner(s): Mehmood, Jennifer
• Assistant Examiner(s): Nokham, James
• Application Number:
  US14/789,788
• Publication Number:
  US 20160011669A1
• Time in Patent Office: 1,070 Days
• Field of Search: 348135, 382118
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Gesture recognition systems for detecting gesture commands in light conditions and in dark conditions including a computing system having a processor and a thermographic camera configured to detect infrared radiation from a gesture made by a user and communicate gesture image information to the processor for carrying out a computer-readable gesture command are shown and described. In some examples, the computing system and the thermographic camera are supported on an eyewear article frame. In some other examples, the computing system and the thermographic camera are components of a mobile device. In even other examples, the computing system and the thermographic camera are components of a desk top computer or a laptop computer.

Claims

1. A system, comprising:

a thermographic camera having a first field of view, the thermographic camera to capture an infrared image within the first field of view;

an optical camera having a second field of view, the optical camera to detect an optical image, wherein the first field of view and the second field of view are substantially the same; and

a processor coupled to the thermographic camera, the processor to;

receive the infrared image from the thermographic camera;

receive the optical image from the optical camera;

determine whether a light condition of the optical image is a normal light condition, a low light condition, or a no light condition;

in response to the low light condition or the no light condition;

detect infrared radiation in the infrared image;

define a first readable zone within the infrared image, wherein the first readable zone is a portion of the first field of view that includes an image of a body part of a user;

identify a first gesture made by the user based on the infrared radiation within the first readable zone to obtain first gesture information; and

execute a first gesture recognition command associated with the first gesture information; and

in response to the normal light condition;

define a second readable zone within the optical image associated, wherein the second readable zone is a portion of the second field of view that includes the image of the body part of the user;

identify a second gesture made by the user within the second readable zone using optical recognition to obtain second gesture information; and

execute a second gesture recognition command associated with the second gesture information.

2. The system of claim 1, wherein the processor, the thermographic camera, and the optical camera are supported on an eyewear article frame.

3. The system of claim 2, wherein the eyewear article frame further comprises an image generator operable to display an augmented reality image to the user.

4. The system of claim 1, wherein the processor, the thermographic camera, and the optical camera are components of a mobile device.

5. The system of claim 4, wherein the mobile device is a smart phone.

6. The system of claim 1, wherein the processor, the thermographic camera, and the optical camera are components of a desktop computer or a laptop computer.

7. The system of claim 1, wherein the first gesture or the second gesture is a hand gesture.

8. The system of claim 7, wherein the hand gesture is at least one of an open hand gesture, a closed hand gesture, a swipe right, a swipe left, a swipe forward, or a swipe backward.

9. The system of claim 1, wherein the first gesture or the second gesture is a head gesture.

10. The system of claim 9, wherein the head gesture is at least one of a single-eye wink, a two-eye blink, an upward head movement, a downward head movement, a rightward head movement, or a leftward head movement.

11. A system, comprising:

a processor to;

receive an infrared image from a thermographic camera;

receive an optical image from an optical camera;

determine whether a light condition of the optical image is a normal light condition, a low light condition, or a no light condition;

in response to the low light condition or the no light condition;

detect infrared radiation in the infrared image;

define a first readable zone within the infrared image, wherein the first readable zone is a portion of a first field of view that includes an image of a body part of a user;

identify a first gesture made by the user based on the infrared radiation within the first readable zone to obtain first gesture information; and

execute a first gesture recognition command associated with the first gesture information; and

in response to the normal light condition;

define a second readable zone within the optical image associated, wherein the second readable zone is a portion of a second field of view that includes the image of the body part of the user;

identify a second gesture made by the user within the second readable zone using optical recognition to obtain second gesture information; and

execute a second gesture recognition command associated with the second gesture information.

12. The system of claim 11, wherein the processor, the thermographic camera, and the optical camera are supported on an eyewear article frame, the eyewear article frame further comprising an image generator operable to display an augmented reality image to the user.

13. The system of claim 11, wherein the processor, the thermographic camera, and the optical camera are components of a mobile device.

14. The system of claim 11, wherein the processor, the thermographic camera, and the optical camera are components of a desktop computer or a laptop computer.

15. The system of claim 11, wherein the gesture is a hand gesture, the hand gesture being at least one of an open hand gesture, a closed hand gesture, a swipe right, a swipe left, a swipe forward, or a swipe backward.

16. The system of claim 11, wherein the gesture is a head gesture, the head gesture being at least one of a single-eye wink, a two-eye blink, an upward head movement, a downward head movement, a rightward head movement, or a leftward head movement.

17. A non-transitory computer-readable medium storing instructions to cause a processing device to:

receive an infrared image from a thermographic camera;

receive an optical image from an optical camera;

determine whether a light condition of the optical image is a normal light condition, a low light condition, or a no light condition;

in response to the low light condition or the no light condition;

detect infrared radiation in the infrared image;

define a first readable zone within the infrared image, wherein the first readable zone is a portion of a field of view that includes an image of a body part of a user;

identify a first gesture made by the user based on the infrared radiation within the first readable zone to obtain first gesture information; and

execute a first gesture recognition command associated with the first gesture information; and

in response to the normal light condition;

define a second readable zone within the optical image associated, wherein the second readable zone is a portion of a second field of view that includes the image of the body part of the user;

identify a second gesture made by the user within the second readable zone using optical recognition to obtain second gesture information; and

execute a second gesture recognition command associated with the second gesture information.

18. The non-transitory computer-readable medium of claim 17, wherein the processing device, the thermographic camera, and the optical camera are supported on an eyewear article frame, the eyewear article frame further comprising an image generator operable to display an augmented reality image to the user.