SYSTEM, COMPONENTS AND METHODOLOGIES FOR GAZE DEPENDENT GESTURE INPUT CONTROL
First Claim
Patent Images
1. A control system comprising:
- at least one user interface that outputs data to a user;
at least one gaze tracking sensor that tracks a gaze of the user and outputs data indicating a gaze direction of the user;
a processor that receives the data indicating the gaze direction of the user; and
at least one gesture recognition sensor that detects at least one gesture made by the user and outputs data indicating the at least one gesture,wherein the processor includes a means for determining the functionality a user wishes to control by tracking the user'"'"'s gaze using the data indicating the gaze direction of the user and identifying a selected area of interest displayed on the at least one user interface based on the data indicating the gaze direction of the user, andwherein the processor also includes a means for recognizing at least one gesture based on the data indicating the at least one gesture made by the user and for controlling at least one operation associated with the selected area of interest based on the data indicating the at least one gesture made by the user.
1 Assignment
0 Petitions
Accused Products
Abstract
A control system, components and methodologies enable control of vehicle and in-vehicle system functionality via gesture recognition. In illustrative embodiments, the control system, constituent components and methodologies determine what functionality a user wishes to control by tracking the user'"'"'s gaze to identify a selected function or function set. In combination with identifying the selected function and function set, one or more sensors installed in the vehicle detect one or more user gestures initiated by a user to interact with and/or control the selected function/function set.
-
Citations
24 Claims
-
1. A control system comprising:
-
at least one user interface that outputs data to a user; at least one gaze tracking sensor that tracks a gaze of the user and outputs data indicating a gaze direction of the user; a processor that receives the data indicating the gaze direction of the user; and at least one gesture recognition sensor that detects at least one gesture made by the user and outputs data indicating the at least one gesture, wherein the processor includes a means for determining the functionality a user wishes to control by tracking the user'"'"'s gaze using the data indicating the gaze direction of the user and identifying a selected area of interest displayed on the at least one user interface based on the data indicating the gaze direction of the user, and wherein the processor also includes a means for recognizing at least one gesture based on the data indicating the at least one gesture made by the user and for controlling at least one operation associated with the selected area of interest based on the data indicating the at least one gesture made by the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for receiving at least one control command from a user, the method comprising:
-
tracking a gaze of the user using at least one gaze tracking sensor and outputting data indicating a gaze direction of the user; receiving, at a processor, the data indicating the gaze direction of the user; detecting at least one gesture performed by the user using at least one gesture recognition sensor and outputting data indicating the at least one gesture to the processor; determining functionality a user wishes to control by tracking the user'"'"'s gaze using the data indicating the gaze direction of the user and identifying a selected area of interest displayed on the at least one user interface based on the data indicating the gaze direction of the user, and recognizing at least one gesture based on the data indicating the at least one gesture made by the user; and controlling at least one operation associated with the selected area of interest based on the data indicating the at least one gesture made by the user. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A transportation system comprising:
-
at least one user interface that outputs data to a user; at least one gaze tracking sensor that tracks a gaze of the user and outputs data indicating a gaze direction of the user; a passenger vehicle including the at least one user interface, a processor that receives the data indicating the gaze direction of the user; and at least one gesture recognition sensor that detects at least one gesture made by the user and outputs data indicating the at least one gesture, wherein the processor includes a means for determining the functionality a user wishes to control by tracking the user'"'"'s gaze using the data indicating the gaze direction of the user and identifying a selected area of interest displayed on the at least one user interface based on the data indicating the gaze direction of the user, and wherein the processor includes software that recognizes at least one gesture based on the data indicating the at least one gesture made by the user and controls at least one operation associated with the selected area of interest based on the data indicating the at least one gesture made by the user.
-
Specification