System and method for gesture-based point of interest search
First Claim
1. A vehicle-based computer-implemented method for retrieving information associated with a point of interest (POI), the method comprising:
- accessing, at a computer system, movement data representing a current speed of a vehicle;
accessing location data identifying a current location and an orientation of the vehicle;
analyzing the movement data and the location data to find a region that the vehicle is likely to travel through;
retrieving, from a POI data server, information associated with one or more points of interest inside the region;
storing the information in a local storage;
subsequent to storing the information, receiving a data signal representing an identifying gesture performed by a user inside the vehicle;
performing gesture recognition on the data signal to determine a direction vector representing a direction of the identifying gesture;
analyzing the direction vector and the location data to generate a target region exterior to the vehicle and corresponding to the direction of the identifying gesture;
receiving a voice command issued by the user inside the vehicle;
performing voice recognition on the voice command to determine one or more words spoken by the user as part of the voice command;
analyzing the voice command words to identify a POI located in the target region;
retrieving, from the local storage, information associated with the POI; and
providing the retrieved information to the user, the retrieved information including information associated with the POI,wherein the target region is in a shape of a cone,wherein a tip of the cone corresponds to the current location of the vehicle,wherein the target region aligns with the direction vector, andwherein an extent of the target region is dependent on the current speed of the vehicle.
2 Assignments
0 Petitions
Accused Products
Abstract
A user, such as the driver of a vehicle, to retrieve information related to a point of interest (POI) near the vehicle by pointing at the POI or performing some other gesture to identify the POI. Gesture recognition is performed on the gesture to generate a target region that includes the POI that the user identified. After generating the target region, information about the POI can be retrieved by querying a server-based POI service with the target region or by searching in a micromap that is stored locally. The retrieved POI information can then be provided to the user via a display and/or speaker in the vehicle. This process beneficially allows a user to rapidly identify and retrieve information about a POI near the vehicle without having to navigate a user interface by manipulating a touchscreen or physical buttons.
27 Citations
14 Claims
-
1. A vehicle-based computer-implemented method for retrieving information associated with a point of interest (POI), the method comprising:
-
accessing, at a computer system, movement data representing a current speed of a vehicle; accessing location data identifying a current location and an orientation of the vehicle; analyzing the movement data and the location data to find a region that the vehicle is likely to travel through; retrieving, from a POI data server, information associated with one or more points of interest inside the region; storing the information in a local storage; subsequent to storing the information, receiving a data signal representing an identifying gesture performed by a user inside the vehicle; performing gesture recognition on the data signal to determine a direction vector representing a direction of the identifying gesture; analyzing the direction vector and the location data to generate a target region exterior to the vehicle and corresponding to the direction of the identifying gesture; receiving a voice command issued by the user inside the vehicle; performing voice recognition on the voice command to determine one or more words spoken by the user as part of the voice command; analyzing the voice command words to identify a POI located in the target region; retrieving, from the local storage, information associated with the POI; and providing the retrieved information to the user, the retrieved information including information associated with the POI, wherein the target region is in a shape of a cone, wherein a tip of the cone corresponds to the current location of the vehicle, wherein the target region aligns with the direction vector, and wherein an extent of the target region is dependent on the current speed of the vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable storage medium for storing computer program instructions for retrieving information associated with a point of interest (POI), the program instructions when executed by a processor cause the processor to perform steps including:
-
accessing movement data representing a current speed of a vehicle; accessing location data identifying a current location and an orientation of the vehicle; analyzing the movement data and the location data to find a region that the vehicle is likely to travel through; retrieving, from a POI data server, information associated with one or more points of interest inside the region; storing the information in a local storage; subsequent to storing the information, receiving a data signal representing an identifying gesture performed by a user inside the vehicle; performing gesture recognition on the data signal to determine a direction vector representing the direction of the identifying gesture; analyzing the direction vector and the location data to generate a target region exterior to the vehicle and corresponding to the direction of the identifying gesture; receiving a voice command issued by the user inside the vehicle; performing voice recognition on the voice command to determine one or more words spoken by the user as part of the voice command; analyzing the voice command words to identifying a POI located in the target region; retrieving, from the local storage, information associated with the POI; and providing the retrieved information to the user, the retrieved information including information associated with the POI, wherein the target region is in a shape of a cone, wherein a tip of the cone corresponds to the current location of the vehicle, wherein the target region aligns with the direction vector, and wherein an extent of the target region is dependent on the current speed of the vehicle. - View Dependent Claims (10, 11)
-
-
12. A vehicle-based computing system for retrieving information associated with a point of interest (POI), the system comprising:
-
a POI information retrieval module including a local storage; a location module that is included as a module of the POI information retrieval module and is configured to access location data identifying a current location and an orientation of a vehicle; a management module that is included as a module of the POI information retrieval module and is configured to; access movement data representing a current speed of the vehicle; analyze the movement data and the location data to find a region that the vehicle is likely to travel through; retrieve, from a POI data server, information associated with one or more points of interest inside the region; and store the information in the local storage; a gesture recognition module that is included as a module of the POI information retrieval module and is configured to; receive a data signal representing an identifying gesture performed by a user inside the vehicle, the identifying gesture oriented in a direction; and perform gesture recognition on the data signal to determine a direction vector representing the direction of the identifying gesture; a voice recognition module that is included as a module of the POI information retrieval module and is configured to; receive a voice command, the voice command issued by the user inside the vehicle; and perform voice recognition on the voice command to determine one or more words spoken by the user as part of the voice command; an input analysis module that is included as a module of the POI information retrieval module and is configured to; analyze the direction vector and the location data to generate a target region exterior to the vehicle and corresponding to the direction of the identifying gesture; and analyze the voice command words to identify a POI located in the target region; a search module that is included as a module of the POI information retrieval module and is configured to retrieve, from the locally stored information, information associated with the POI; and a data output module that is included as a module of the POI information retrieval module and is configured to provide the retrieved information to the user, the retrieved information including information associated with the POI, wherein the target region is in a shape of a cone, wherein a tip of the cone corresponds to the current location of the vehicle, wherein the target region aligns with the direction vector, and wherein an extent of the target region is dependent on the current speed of the vehicle. - View Dependent Claims (13, 14)
-
Specification