Interpreting user queries based on device orientation

• US 10,185,746 B2
• Filed: 08/20/2015
• Issued: 01/22/2019
• Est. Priority Date: 08/20/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Grimsmo, Nils, Behzadi, Behshad, Bergenlid, Fredrik
• Primary Examiner(s): Park, Grace
• Application Number:
  US14/831,296
• Publication Number:
  US 20160055218A1
• Time in Patent Office: 1,251 Days
• CPC Class Codes: G06F 16/2425 Iterative querying; Query formulation based on the results of a preceding query
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided from a user device, and determining that the query implicitly references some entity, and in response: obtaining an approximate location and an approximate orientation of the user device, obtaining a set of entities including one or more entities, each entity in the set of entities being at least partially within a range that is based on the approximate location and that includes an extended portion based on the approximate orientation, selecting an entity from the set of entities, and providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.

Claims

1. A computer-implemented method executed by one or more processors, the method comprising:

receiving, by the one or more processors, a query provided from a user device; and

determining, by the one or more processors, that the query implicitly references some entity, and in response;

obtaining, by the one or more processors, an approximate location and an approximate orientation of the user device;

determining a first geometric shape defined by a range that is based on the approximate location, wherein the approximate location is within the first geometric shape, and the range defines a radius, and the first geometric shape is a circular geometric shape having the radius;

extending a portion of the first geometric shape to form an extended portion of the first geometric shape that extends from the first geometric shape by an extended range that is greater than the range of the first geometric shape and in a direction of the approximate orientation of the user device, wherein the extended portion is conical in shape and centered on the approximate orientation of the user device and is less than the first geometric shape in degrees;

obtaining, by the one or more processors, a set of entities comprising one or more entities, each entity in the set of entities being at least partially within the first geometric shape defined by the range that is based on the approximate location of the user device or within the extended portion of the first geometric shape;

selecting, by the one or more processors, an entity from the set of entities; and

providing, by the one or more processors, a revised query based on the query and the entity, the revised query explicitly referencing the entity.

2. The method of claim 1, wherein the approximate orientation indicates a compass direction of the user device, the extended portion of the range being provided based on the compass direction.

3. The method of claim 1, wherein the approximate orientation indicates a tilt of the user device relative to a horizontal plane.

4. The method of claim 1, wherein the approximate orientation is determined based on a signal provided from a sensor of the user device.

5. The method of claim 1, wherein at least one entity in the set of entities is provided based on image data, the image data being obtained by the user device in response to the approximate orientation.

6. The method of claim 1, wherein selecting an entity from the set of entities is based on one or more entity query patterns associated with the entity.

7. A system comprising:

a data store for storing data; and

one or more processors configured to interact with the data store, the one or more processors being further configured to perform operations comprising;

receiving a query provided from a user device; and

determining that the query implicitly references some entity, and in response;

obtaining an approximate location and an approximate orientation of the user device;

determining a first geometric shape defined by a range that is based on the approximate location, wherein the approximate location is within the first geometric shape, and the range defines a radius, and the first geometric shape is a circular geometric shape having the radius;

extending a portion of the first geometric shape to form an extended portion of the first geometric shape that extends from the first geometric shape by an extended range that is greater than the range of the first geometric shape and in a direction of the approximate orientation of the user device, wherein the extended portion is conical in shape and centered on the approximate orientation of the user device and is less than the first geometric shape in degrees;

obtaining a set of entities comprising one or more entities, each entity in the set of entities being at least partially within the first geometric shape defined by the range that is based on the approximate location of the user device or within the extended portion of the first geometric shape;

selecting an entity from the set of entities; and

providing a revised query based on the query and the entity, the revised query explicitly referencing the entity.

8. The system of claim 7, wherein the approximate orientation indicates a compass direction of the user device, the extended portion of the range being provided based on the compass direction.

9. The system of claim 7, wherein the approximate orientation indicates a tilt of the user device relative to a horizontal plane.

10. The system of claim 7, wherein the approximate orientation is determined based on a signal provided from a sensor of the user device.

11. The system of claim 7, wherein at least one entity in the set of entities is provided based on image data, the image data being obtained by the user device in response to the approximate orientation.

12. The system of claim 7, wherein selecting an entity from the set of entities is based on one or more entity query patterns associated with the entity.

13. A non-transitory computer readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving a query provided from a user device; and

determining that the query implicitly references some entity, and in response;

obtaining, by the one or more processors, an approximate location and an approximate orientation of the user device;

determining a first geometric shape defined by a range that is based on the approximate location, wherein the approximate location is within the first geometric shape, and the range defines a radius, and the first geometric shape is a circular geometric shape having the radius;

extending a portion of the first geometric shape to form an extended portion of the first geometric shape that extends from the first geometric shape by an extended range that is greater than the range of the first geometric shape and in a direction of the approximate orientation of the user device, wherein the extended portion is conical in shape and centered on the approximate orientation of the user device and is less than the first geometric shape in degrees;

obtaining, by the one or more processors, a set of entities comprising one or more entities, each entity in the set of entities being at least partially within the first geometric shape defined by the range that is based on the approximate location of the user device or within the extended portion of the first geometric shape;

selecting, by the one or more processors, an entity from the set of entities; and

providing, by the one or more processors, a revised query based on the query and the entity, the revised query explicitly referencing the entity.

14. The computer readable medium of claim 13, wherein the approximate orientation indicates a compass direction of the user device, the extended portion of the range being provided based on the compass direction.

15. The computer readable medium of claim 13, wherein the approximate orientation indicates a tilt of the user device relative to a horizontal plane.

16. The computer readable medium of claim 13, wherein the approximate orientation is determined based on a signal provided from a sensor of the user device.

17. The computer readable medium of claim 13, wherein at least one entity in the set of entities is provided based on image data, the image data being obtained by the user device in response to the approximate orientation.

18. The computer readable medium of claim 13, wherein selecting an entity from the set of entities is based on one or more entity query patterns associated with the entity.