ENABLING MULTIDIMENSIONAL SEARCH ON NON-PC DEVICES

• US 20120303664A1
• Filed: 05/27/2011
• Published: 11/29/2012
• Est. Priority Date: 05/27/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Apacible, Johnson, Encarnacion, Mark, Sinyagin, Aleksey
• Granted Patent: US 8,700,594 B2
• Time in Patent Office: Days
• US Class Current: 707/780
• CPC Class Codes: G06F 16/3322 using system suggestions G06F16/3325 takes precedence
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/953 Querying, e.g. by the use of web search engines
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

Multidimensional search capabilities are enabled on a non-PC (personal computer) device being utilized by a user. An original query submitted by the user via the non-PC device is received. A structured data repository is accessed to extract structured data that is available for the original query, where the extracted structured data represents attributes of the original query. The extracted structured data is provided to the user in the form of a hierarchical menu which allows the user to interactively modify the original query, such modification resulting in a revised query.

Claims

1. A computer-implemented process for enabling multidimensional search capabilities on a non-PC (personal computer) device being utilized by a user, comprising:

using a computer to perform the following process actions;

receiving an original query submitted by the user via the non-PC device;

accessing a structured data repository to extract structured data that is available for the original query, wherein the extracted structured data represents attributes of the original query; and

providing the extracted structured data to the user in the form of a hierarchical menu which allows the user to interactively modify the original query, such modification resulting in a revised query.

2. The process of claim 1, wherein the original query comprises one or more query terms, the non-PC device comprises an audio capture device, and the process action of receiving an original query submitted by the user via the non-PC device comprises the actions of:

using the audio capture device to capture the query terms when they are spoken by the user;

using a speech recognition application to convert the captured query terms to text-based query terms;

searching for matches to the text-based query terms in a dictionary of known words and word phrases;

whenever no matching words or word phrases are found in the dictionary, notifying the user that the original query is invalid;

whenever more than one matching word or word phrase is found in the dictionary,

providing each matching word or word phrase found in the dictionary to the user, and

whenever the user selects one or more matching words or word phrases he is interested in, assigning the selected matching words or word phrases to be the original query; and

whenever just one matching word or word phrase is found in the dictionary, assigning the one matching word or word phrase to be the original query.

3. The process of claim 1, wherein the process action of receiving an original query submitted by the user via the non-PC device comprises the actions of:

capturing an initial query term which is entered by the user into the non-PC device;

searching for the initial query term in a template of allowed query terms and allowed options therefor;

whenever the initial query term is not found in the template, notifying the user that the initial query term is invalid;

whenever the initial query term is found in the template, prompting the user to enter additional information into the non-PC device related to each allowed option for the initial query term that is specified in the template; and

assigning the initial query term and additional information entered by the user to be the original query.

4. The process of claim 1, wherein the process action of accessing a structured data repository to extract structured data that is available for the original query comprises the actions of:

identifying entities and properties that are either explicitly or implicitly present in the original query;

for each identified entity,

querying the structured data repository to identify types of said entity that are possible, and

for each identified type of said entity that is possible, querying the structured data repository to identify properties of said type that are possible; and

for each identified property, querying the structured data repository to identify entities that could have said property.

5. The process of claim 4, wherein whenever one or more entities are identified to be either explicitly or implicitly present in the original query, the process action of providing the extracted structured data to the user in the form of a hierarchical menu which allows the user to interactively modify the original query comprises the actions of:

providing the user with a first user-selectable menu of the identified entities;

whenever the user selects an entity from the first user-selectable menu, providing the user with a second user-selectable menu of the identified types of the selected entity;

whenever the user selects a type of the selected entity from the second user-selectable menu, providing the user with a third user-selectable menu of the identified properties of the selected type of the selected entity; and

whenever the user selects a property of the selected type of the selected entity from the third user-selectable menu, using the selected entity, the selected type of said entity, and the selected property of said type to generate the revised query.

6. The process of claim 4, wherein whenever one or more properties are identified to be either explicitly or implicitly present in the original query, the process action of providing the extracted structured data to the user in the form of a hierarchical menu which allows the user to interactively modify the original query comprises the actions of:

providing the user with a first user-selectable menu of the identified properties;

whenever the user selects a property from the first user-selectable menu, providing the user with a second user-selectable menu of the identified entities that could have the selected property; and

whenever the user selects an entity that could have the selected property from the second user-selectable menu, using the selected property and the selected entity that could have said property to generate the revised query.

7. The process of claim 4, wherein the original query comprises one or more query terms, and the process action of identifying entities and properties that are either explicitly or implicitly present in the original query comprises an action of using a set of grammar rules to parse the original query and match the query terms against a set of dictionaries that are maintained by the grammar rules.

8. The process of claim 1, further comprising the actions of:

submitting the revised query to a search service;

receiving search results for the revised query from the search service; and

providing the search results to the user via the non-PC device.

9. The process of claim 8, wherein the process action of submitting the revised query to a search service comprises the actions of:

using a method for integrating specialized knowledge sources into a general search service to select one or more target search engines each of which are determined to have a degree of relevance to the revised query that is higher than a prescribed threshold; and

submitting the revised query to each target search engine.

10. The process of claim 9, wherein each target search engine comprises either a general purpose search engine, or an expert knowledge search engine that is associated with a specific specialized knowledge source which includes curated data about one or more specific topics.

11. The process of claim 8, wherein the process action of submitting the revised query to a search service comprises an action of submitting the revised query to a general purpose search engine.

12. The process of claim 1, wherein the non-PC device comprises either a smartphone, or a tablet computer, or a personal digital assistant device, or a three-dimensional television system, or a three-dimensional heads-up display system, or a video game console.

13. The process of claim 1, wherein the structured data repository is constructed by crawling one or more prescribed websites, said websites comprising either Wikipedia, or Encyclopedia.com.

14. The process of claim 1, wherein the structured data repository comprises one or more online knowledge bases in which data is already organized in a structured manner.

15. The process of claim 14, wherein the one or more online knowledge bases comprise either Freebase, or Wolfram|Alpha, or the Internet Movie Database.

16. The process of claim 1, wherein the non-PC device comprises a display device and a handheld three-dimensional remote controller device, and the process action of providing the extracted structured data to the user in the form of a hierarchical menu which allows the user to interactively modify the original query comprises the actions of:

displaying a plurality of graphical elements on the display device, wherein each graphical element represents a different item of extracted structured data and is labeled to identify said item; and

whenever the user utilizes the remote controller device to virtually point to and select one or more of the graphical elements, using the item of extracted structured data represented by each selected graphical element to generate the revised query.

17. The process of claim 1, wherein the non-PC device comprises a display device and a three-dimensional gesture-sensing device, and the process action of providing the extracted structured data to the user in the form of a hierarchical menu which allows the user to interactively modify the original query comprises the actions of:

displaying a plurality of graphical elements on the display device, wherein each graphical element represents a different item of extracted structured data and is labeled to identify said item; and

whenever the user gestures with his hand to virtually grab one or more of the graphical elements, using the item of extracted structured data represented by each grabbed graphical element to generate the revised query.

18. A system for allowing a user to submit queries to a search service for particular online information he is interested in, comprising:

a computing device; and

a computer program having program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to,

receive an original query submitted by the user via the computing device,

access a structured data repository to extract structured data that is available for the original query, wherein the extracted structured data represents attributes of the original query,

provide the extracted structured data to the user in the form of a hierarchical menu which allows the user to interactively modify the original query, such modification resulting in a revised query, and

submit the revised query to the search service.

19. The system of claim 18, wherein the program module for accessing a structured data repository to extract structured data that is available for the original query comprises program modules for:

identifying entities and properties that are either explicitly or implicitly present in the original query;

for each identified entity,

querying the structured data repository to identify types of said entity that are possible, and

for each identified type of said entity that is possible, querying the structured data repository to identify properties of said type that are possible; and

for each identified property, querying the structured data repository to identify entities that could have said property.

20. A computer-implemented process for enabling multidimensional search capabilities on a non-PC (personal computer) device being utilized by a user, comprising:

using a computer to perform the following process actions;

receiving an original query submitted by the user via the non-PC device, wherein the non-PC device comprises an audio capture device, and said receiving comprising the actions of,

using the audio capture device to capture one or more query terms which are spoken by the user,

using a speech recognition application to convert the captured query terms to text-based query terms,

searching for matches to the text-based query terms in a dictionary of known words and word phrases,

whenever more than one matching word or word phrase is found in the dictionary, providing each matching word or word phrase found in the dictionary to the user, and assigning the matching words or word phrases which are selected by the user to be the original query, and

whenever just one matching word or word phrase is found in the dictionary, assigning the one matching word or word phrase to be the original query;

identifying entities and properties that are either explicitly or implicitly present in the original query;

for each identified entity, querying a structured data repository to identify types of said entity that are possible, and for each identified type of said entity that is possible, querying the structured data repository to identify properties of said type that are possible;

for each identified property, querying the structured data repository to identify entities that could have said property;

providing the identified entities, the identified types of each identified entity, the identified properties of each identified type of each identified entity, the identified properties, and the identified entities that could have each identified property to the user in the form of a hierarchical menu which allows the user to interactively modify the original query, such modification resulting in a revised query;

using a method for integrating specialized knowledge sources into a general search service to select one or more target search engines each of which are determined to have a degree of relevance to the revised query that is higher than a prescribed threshold;

submitting the revised query to each target search engine;

receiving search results for the revised query from each target search engine; and

providing the search results to the user via the non-PC device.