Three dimensional gesture recognition in vehicles
First Claim
Patent Images
1. A method for performing gesture recognition in a vehicle, comprising the steps of:
- receiving one or more raw frames from a time of flight (TOF) camera of a vehicle occupant;
performing clustering to determine one or more objects of interest of the vehicle occupant;
locating one or more arm clusters of the vehicle occupant;
locating a palm cluster of the vehicle occupant;
calculating a location of a tip of a hand of the vehicle occupant;
defining one or more predetermined search spaces in accordance with the location of the tip of the hand;
defining one or more partition spaces within the one or more search spaces; and
locating the hand within the partition and search spaces.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for performing gesture recognition of a vehicle occupant employing a time of flight (TOF) sensor and a computing system in a vehicle. An embodiment of the method of the invention includes the steps of receiving one or more raw frames from the TOF sensor, performing clustering to locate one or more body part clusters of the vehicle occupant, calculating the location of the tip of the hand of the vehicle occupant, determining whether the hand has performed a dynamic or a static gesture, retrieving a command corresponding to one of the determined static or dynamic gestures, and executing the command.
-
Citations
18 Claims
-
1. A method for performing gesture recognition in a vehicle, comprising the steps of:
-
receiving one or more raw frames from a time of flight (TOF) camera of a vehicle occupant; performing clustering to determine one or more objects of interest of the vehicle occupant; locating one or more arm clusters of the vehicle occupant; locating a palm cluster of the vehicle occupant; calculating a location of a tip of a hand of the vehicle occupant; defining one or more predetermined search spaces in accordance with the location of the tip of the hand; defining one or more partition spaces within the one or more search spaces; and locating the hand within the partition and search spaces. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for performing gesture recognition of a vehicle occupant employing a time of flight (TOF) sensor and a computing system in a vehicle, comprising the steps of:
-
receiving one or more raw frames from the TOF sensor; performing clustering to locate one or more body part clusters of the vehicle occupant; calculating a location of a tip of a hand of the vehicle occupant; defining one or more predetermined search spaces in accordance with the location of the tip of the hand; defining one or more partition spaces within the one or more search spaces; and locating the hand within the partition and search spaces; determining whether the hand has performed a dynamic or a static gesture; retrieving a command corresponding to one of the determined static and dynamic gesture; and executing the command.
-
-
11. A system for performing gesture recognition in a vehicle, comprising:
-
a time of flight (TOF) camera for providing one or more raw frames of a vehicle occupant; and a processor for performing clustering to determine one or more objects of interest of the vehicle occupant, locating one or more arm clusters of the vehicle occupant as one of the objects of interest, calculating a location of a tip of a hand of the vehicle occupant, defining one or more predetermined search spaces in accordance with the location of the tip of the hand, defining one or more partition spaces within the one or more search spaces, and locating the hand within the partition and search spaces. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18)
-
Specification