SYSTEM AND METHOD FOR GESTURE-BASED POINT OF INTEREST SEARCH
2 Assignments
0 Petitions
Accused Products
Abstract
A user, such as the driver of a vehicle, to retrieve information related to a point of interest (POI) near the vehicle by pointing at the POI or performing some other gesture to identify the POI. Gesture recognition is performed on the gesture to generate a target region that includes the POI that the user identified. After generating the target region, information about the POI can be retrieved by querying a server-based POI service with the target region or by searching in a micromap that is stored locally. The retrieved POI information can then be provided to the user via a display and/or speaker in the vehicle. This process beneficially allows a user to rapidly identify and retrieve information about a POI near the vehicle without having to navigate a user interface by manipulating a touchscreen or physical buttons.
-
Citations
40 Claims
-
1-20. -20. (canceled)
-
21. A vehicle-based computer-implemented method for controlling a component of the vehicle, the method comprising:
-
receiving, via a sensor within the vehicle, a first selecting input from a user inside the vehicle, wherein the first selecting input is a first directional gesture performed by the user; processing the first selecting input to identify and select a first component of the vehicle to be controlled by the user; providing, to the user, a first feedback signal confirming selection of the first component to be controlled; subsequent to providing the first feedback signal, receiving in a capture region inside the vehicle, a first data signal for controlling the first component, wherein the first data signal is a second directional gesture that is directed at the first component; and processing the first data signal to determine a first command for controlling the first component. - View Dependent Claims (22, 23, 24, 25, 26, 27)
-
-
28. A vehicle-based computing system for controlling a component of the vehicle, the system comprising:
-
one or more processors; and a non-transitory computer-readable storage medium for storing computer program instructions, the program instructions, when executed by the processors cause the processors to perform; receiving, via a sensor within the vehicle, a first selecting input from a user inside the vehicle, wherein the first selecting input is a first directional gesture performed by the user; processing the first selecting input to identify and select a first component of the vehicle to be controlled by the user; providing, to the user, a first feedback signal confirming selection of the first component to be controlled; subsequent to providing the first feedback signal, receiving in a capture region inside the vehicle a first data signal for controlling the first component, the first data signal is a second directional gesture that is directed at the first component; and processing the first data signal to determine a first command for controlling the first component. - View Dependent Claims (29, 30, 31, 32, 33, 34)
-
-
35. A vehicle-based computing system for controlling a component of the vehicle, the system comprising:
-
one or more sensors within the vehicle; one or more processors; and a non-transitory computer-readable storage medium for storing computer program instructions, the program instructions, when executed by the processors cause the processors to perform; receiving, via the sensors within the vehicle, a first selecting input from a user inside the vehicle, wherein one or more of the sensors is a microphone capturing voice signals within the vehicle; processing the first selecting input to identify and select a first component of the vehicle to be controlled by the user by performing voice recognition on a voice signal to identify the first component of the vehicle, wherein the first selecting input comprises the voice signal that includes a name of the first component; providing, to the user, a first feedback signal confirming selection of the first component to be controlled; subsequent to providing the first feedback signal, receiving, using the sensors, in a capture region inside the vehicle a first data signal for controlling the first component, the first data signal is a directional gesture that is directed at the first component, wherein one or more of the sensors includes a camera system including one or more cameras positioned to capture the directional gesture performed in the capture region inside the vehicle; and processing the first data signal to determine a first command for controlling the first component. - View Dependent Claims (36, 37, 38, 39, 40)
-
Specification