MULTIMODAL NATURAL LANGUAGE QUERY SYSTEM FOR PROCESSING AND ANALYZING VOICE AND PROXIMITY BASED QUERIES

• US 20120271625A1
• Filed: 03/27/2012
• Published: 10/25/2012
• Est. Priority Date: 12/28/2010
• Status: Abandoned Application

• Current Assignee: Portal Communications, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Portal Communications, LLC (Dominion Harbor Enterprises, LLC)
• Inventors: Bernard, David E.
• Application Number:
  US13/431,966
• Publication Number:
  US 20120271625A1
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: Y10S 707/918 Location

Abstract

The present disclosure provides a natural language query system and method for processing and analyzing multimodally-originated queries, including voice and proximity-based queries. The natural language query system includes a Web-enabled device including a speech input module for receiving a voice-based query in natural language form from a user and a location/proximity module for receiving location/proximity information from a location/proximity device. The query system also includes a speech conversion module for converting the voice-based query in natural language form to text in natural language form and a natural language processing module for converting the text in natural language form to text in searchable form. The query system further includes a semantic engine module for converting the text in searchable form to a formal database query and a database-look-up module for using the formal database query to obtain a result related to the voice-based query in natural language form from a database.

Claims

1. A query system, comprising:

a computing device communicatively coupled to a network and configured to receive audio input comprising a query and determine location information; and

a server communicatively coupled to the computing device via the network, wherein the server is configured to;

receive the query from the computing device;

perform natural language processing on the query using lexicons and grammar rules to determine a meaning of the query, wherein the natural language processing comprises converting text in natural language form to text in searchable form using the lexicons and grammar rules to determine the meaning of the query;

utilize location information to further determine the meaning of the query;

perform a database look up based on the determined meaning of the query, wherein the database look up is provided with a context and environment for narrowing and streamlining the database look up utilizing the location information and rank responses of the database lookup using an accuracy algorithm.

2. The query system of claim 1, wherein the computing device comprises one of a smart phone or tablet device.

3. The query system of claim 2, wherein the computing device comprises Global Positioning Satellite functionality providing the location information.

4. The query system of claim 3, wherein the computing device further comprises a Radio Frequency Identification scanner providing the location information.

5. The query system of claim 1, further comprising a user database configured to store a plurality of queries from a plurality of users.

6. The query system of claim 5, wherein the server is further configured to:

determine the meaning of the query based upon data in the user database.

7. The query system of claim 1, further comprising a plurality of databases communicatively coupled to the server.

8. The query system of claim 7, further comprising a middleware application executed on the server, wherein the middleware application is configured to route the query to one or more of the plurality of databases and to rank accuracy of results from the one or more of the plurality of databases.

9. The query system of claim 1, further comprising a semantic engine module executed on the server for converting the determined query to a formal database query.

10. The query system of claim 1, further comprising a speech conversion module executed on the server for converting the query in audio and natural language form to text in natural language form.

11. The query system of claim 10, further comprising a natural language processing module executed on the server for converting the text in natural language form to text in searchable form using lexicons and grammar rules to parse sentences and determine underlying meanings of the query.

12. A mobile device query method, comprising:

receiving an audio query from a user;

determining location information of the user based on Global Positioning Satellite functionality or Radio Frequency Identification readings;

transmitting the audio query and the location information to a server; and

receiving a plurality of responses to the audio query from the server, each of the plurality of responses is ranked by the server using an accuracy algorithm;

wherein the server is configured to;

perform natural language processing on the audio query using lexicons and grammar rules to parse sentences and determine a meaning of the audio query, wherein the natural language processing comprises converting text in natural language form to text in searchable form using the lexicons and grammar rules to determine the meaning of the audio query;

utilize the location information to further determine the meaning of the audio query; and

perform a database look up based on the determined meaning of the audio query, wherein the database look up is provided with a context and environment for narrowing and streamlining the database look up utilizing the location information.