CONTEXTUAL QUERY ADJUSTMENTS USING NATURAL ACTION INPUT

• US 20140019462A1
• Filed: 07/15/2012
• Published: 01/16/2014
• Est. Priority Date: 07/15/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Heck, Larry Paul, Chinthakunta, Madhusudan, Iyer, Rukmini
• Application Number:
  US13/549,503
• Publication Number:
  US 20140019462A1
• Time in Patent Office: Days
• US Class Current: 707/754
• CPC Class Codes: G06F 16/20 of structured data, e.g. relational data

Abstract

Within the field of computing, many scenarios involve queries formulated by users resulting in query results presented by a device. The user may request to adjust the query, but many devices can only process requests specified in a well-structured manner, such as a set of recognized keywords, specific verbal commands, or a specific manual gesture. The user thus communicates the adjustment request in the constraints of the device, even if the query is specified in a natural language. Presented herein are techniques for enabling users to specify query adjustments with natural action input (e.g., natural-language speech, vocal inflection, and natural manual gestures). The device may be configured to evaluate the natural action input, identify the user'"'"'s intended query adjustments, generate an adjusted query, and present an adjusted query result, thus enabling the user to interact with the device in a similar manner as communicating with an individual.

Claims

1. A method of presenting query results to a device using a server having a processor, the method comprising:

executing on the processor instructions configured to, upon receiving a first query from the device provided by a user;

execute the first query to generate a query result;

identify at least one natural action request that, when included in a natural action input of the user, indicates a query adjustment of the first query; and

present to the device the query result and the natural action requests associated with the natural action inputs and the query adjustments.

2. The method of claim 1, the instructions further configured to, after presenting the query result to the device, upon receiving a natural action input from the device:

identifying in the natural action input at least one natural action request;

generating an adjusted query comprising the first query adjusted by the at least one query adjustment associated with the natural action request;

executing the adjusted query to generate an adjusted query result; and

present the adjusted query result to the device.

3. The method of claim 1:

the query result comprising at least one entity;

presenting the query result to the device comprising;

identifying, for respective entities of the query result, at least one natural-language entity request referencing the entity.

4. A method of facilitating, using a server having a processor, query results presented by devices and comprising at least one entity, the method comprising:

executing on the processor instructions configured to, upon receiving a first query and a query result from the device;

for respective entities of the query result, identify at least one entity action associated with at least one natural action input performable by the user and a query adjustment of the first query; and

present to the device the entity actions associated with the entities, the natural action inputs, and the query adjustments.

5. A method of evaluating queries of a user on a device having a processor, the method comprising:

executing on the processor instructions configured to;

upon receiving from the user a first query;

execute the first query to generate a first query result, and

present the first query result to the user; and

upon receiving a natural action input from the user;

identify in the natural action input at least one query adjustment related to the first query result;

generate an adjusted query comprising the first query adjusted by the at least one query adjustment;

execute the adjusted query to generate an adjusted query result; and

present the adjusted query result to the user.

6. The method of claim 5, the natural action input having a natural action input type selected from a natural action input type set comprising:

a spoken utterance;

a written utterance;

a vocal inflection;

a manual gesture;

a touch action;

an optical movement.

7. The method of claim 5:

the first query result specifying at least one query adjustment associated with a natural action request; and

identifying the query adjustment comprising;

identifying in the natural action input a natural action request specified by the first query result; and

selecting the query adjustment associated with the natural action request.

8. The method of claim 5, identifying the query adjustment comprising:

upon receiving the first query result, evaluating the first query result to identify at least one natural action request indicating a query adjustment upon the first query; and

upon receiving the natural action input;

identifying in the natural action input a natural action request specified by the first query result; and

selecting the query adjustment associated with the natural action request.

9. The method of claim 8:

the instructions comprising a computing environment executing an application receiving the first query from the user and presenting the first query result; and

presenting the adjusted query result comprising;

presenting the adjusted query result to the application.

10. The method of claim 5, identifying the query adjustment comprising:

interpreting the natural action input within a context of the query result to identify the query adjustment.

11. The method of claim 5, identifying the query adjustment comprising:

sending the first query and the natural action input to a server; and

receiving the query adjustment from the server.

12. The method of claim 5:

the query result associated with at least one action having an action identifier; and

the query adjustment comprising;

identifying at least one natural action request specifying the action other than the action identifier; and

adjusting the first query according to the action.

13. The method of claim 5:

at least one action associated with an entity of the query result; and

presenting the query result comprising;

presenting with an entity of the query result at least one action identifier associating an action with the entity.

14. The method of claim 5:

the natural action input comprising at least one filter criterion for filtering the first query; and

the query adjustment comprising;

filtering the first query according to the at least one filter criterion.

15. The method of claim 5:

the natural action input comprising a reference to a prior query; and

the query adjustment comprising;

combining the first query and the prior query.

16. The method of claim 5:

the natural action input directed to an input component separate from the query result and resulting in an input component value; and

the query adjustment comprising;

associating the input component value with the query result.

17. The method of claim 5:

the natural action input specifying an entity action to be performed on an entity of the first query result; and

the query adjustment comprising;

specifying the entity action to be performed on the entity.

18. The method of claim 5:

the natural action input referencing an entity of the first query result; and

the query adjustment comprising;

identifying the entity of the first query result referenced by the natural action input; and

focusing the first query on the entity referenced by the natural action input.

19. The method of claim 18:

the first query result comprising at least one entity;

presenting the first query result comprising;

presenting with respective entities of the first query result at least one natural-language entity reference associated with the entity; and

identifying the entity referenced by the natural action input comprising;

identifying an entity associated with a natural-language entity reference in the natural action input.

20. The method of claim 18:

the first query ambiguously referencing;

with a first probability, a first entity that is currently presented the first query result, and

with a second probability, a second entity that is not currently presented in the first query result; and

the query adjustment comprising;

raising the first probability of the first entity as compared with the second probability of the second entity.