System And Methods For Eye Gaze Triggered Control Of Appliance By Hand Gesture

• US 20170293363A1
• Filed: 04/07/2017
• Published: 10/12/2017
• Est. Priority Date: 04/07/2016
• Status: Abandoned Application

• Current Assignee: Jeffrey Shawn Mclaughlin
• Original Assignee: Jeffrey Shawn Mclaughlin
• Inventors: McLaughlin, Jeffrey Shawn
• Application Number:
  US15/482,643
• Publication Number:
  US 20170293363A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G08C 17/02 using a radio link

Abstract

The herein disclosed systems and methods provide a user with an ability to control the operation of an appliance from a distance without needing to utilize an intermediary device encompassing multiple layers of graphical screen user interface or verbal dialog user interface. The present invention combines eye gaze recognition as a trigger with motion gesture recognition for appliance operation in a novel way to provide the user with a simple two-step procedure for operating an appliance at a distance.

An exemplary embodiment of the present system comprises a camera head unit including an eye gaze recognizing functionality receiving an eye gaze from a user and activating a hand gesture recognizing functionality, wherein the hand gesture recognizing functionality is receiving a hand gesture from the user and determining an operation based upon the hand gesture, and a communication device communicatively connected to the camera head unit and to the appliance for communicating the operation to the appliance. And exemplary embodiment of the present method for controlling an appliance from a distance comprises the steps of: receiving an eye gaze from a user; activating hand gesture recognition; receiving a hand gesture from the user; determining an operation based upon the hand gesture; and communicating the operation to the appliance.

Claims

1. A system for controlling an appliance at a distance, comprising:

a camera head unit including an eye gaze recognizing functionality receiving an eye gaze from a user and activating a hand gesture recognizing functionality, the hand gesture recognizing functionality receiving a hand gesture from the user and determining an operation based upon the hand gesture; and

a communication device communicatively connected to the camera head unit and to the appliance, for communicating the operation to the appliance.

2. The system for controlling an appliance at a distance as recited in claim 1, wherein the camera head unit includes an eye gaze signaling light.

3. The system for controlling an appliance at a distance as recited in claim 2, wherein the eye gaze signaling light displays red before an eye gaze is received by the eye gaze recognizing functionality and displays green after an eye gaze is received by the eye gaze recognizing functionality.

4. The system for controlling an appliance at a distance as recited in claim 1, wherein the camera head unit includes a speaker for emitting an eye gaze signaling audible sound.

5. The system for controlling an appliance at a distance as recited in claim 1, wherein the eye gaze is a predetermined eye gaze time period.

6. A method for controlling an appliance at a distance, comprising:

receiving an eye gaze from a user;

activating hand gesture recognition;

receiving a hand gesture from the user;

determining an operation based upon the hand gesture; and

communicating the operation to the appliance.

7. The method for controlling an appliance at a distance as recited in claim 6, wherein the step of activating hand gesture recognition includes signaling to the user that hand gesture recognition has been activated.

8. The method for controlling an appliance at a distance as recited in claim 7, wherein signaling includes changing a color of an eye gaze signaling light.

9. The method for controlling an appliance at a distance as recited in claim 7, wherein signaling includes turning on an eye gaze signaling light.

10. The method for controlling an appliance at a distance as recited in claim 7, wherein signaling includes emitting an audible sound.

11. The method for controlling an appliance at a distance as recited in claim 6, further comprising the step of receiving a predetermined eye gaze time period from the user.

12. The method for controlling an appliance at a distance as recited in claim 6, further comprising the step of receiving a configuration from the user.

13. The method for controlling an appliance at a distance as recited in claim 12, wherein the configuration includes an eye gaze time period.

14. The method for controlling an appliance at a distance as recited in claim 12, wherein the configuration includes an eye gaze time period and a set of established hand gestures and corresponding operations.