Multimodal natural language query system and architecture for processing voice and proximity-based queries

• US 20060116987A1
• Filed: 01/24/2005
• Published: 06/01/2006
• Est. Priority Date: 11/29/2004
• Status: Active Grant

• Current Assignee: Portal Communications, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: The Intellection Group, Inc.
• Inventors: Bernard, David E.
• Granted Patent: US 7,376,645 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

The present invention provides a wireless natural language query system, architecture, and method for processing multimodally-originated queries, including voice and proximity-based queries. The natural language query system includes a Web-enabled device including a speech input module for receiving a voice-based query in natural language form from a user and a location/proximity module for receiving location/proximity information from a location/proximity device. The natural language query system also includes a speech conversion module for converting the voice-based query in natural language form to text in natural language form and a natural language processing module for converting the text in natural language form to text in searchable form. The natural language query system further includes a semantic engine module for converting the text in searchable form to a formal database query and a database-look-up module for using the formal database query to obtain a result related to the voice-based query in natural language form from a database.

Claims

1. A natural language query system for processing voice and proximity-based queries, comprising:

a device, comprising;

a speech input module for receiving a voice-based query in natural language form from a user; and

a location/proximity module for receiving location/proximity information from a location/proximity device;

a speech conversion module for converting the voice-based query in natural language form to text in natural language form;

a natural language processing module for converting the text in natural language form to text in searchable form;

a semantic engine module for converting the text in searchable form to a formal database query; and

a database-look-up module for using the formal database query to obtain a result related to the voice-based query in natural language form from a database.

2. The natural language query system of claim 1, wherein the device comprises a device selected from the group consisting of a Web-enabled portable personal computer, a Web-enabled laptop computer, a Web-enabled personal digital assistant, and a Web-enabled phone.

3. The natural language query system of claim 1, wherein the speech input module comprises a speech plug-in and a microphone.

4. The natural language query system of claim 1, wherein the location/proximity module comprises a location/proximity module selected from the group consisting of a radio frequency identification reader and a global positioning system.

5. The natural language query system of claim 1, wherein the location/proximity device comprises a location/proximity device selected from the group consisting of a radio frequency identification tag and a satellite.

6. The natural language query system of claim 1, wherein the speech conversion module resides in a speech server located remotely from the device.

7. The natural language query system of claim 1, wherein the natural language processing module resides in a server located remotely from the device.

8. The natural language query system of claim 1, wherein the semantic engine module resides in a database server located remotely from the device.

9. The natural language query system of claim 1, wherein the database-look-up module resides in a database server located remotely from the device.

10. The natural language query system of claim 1, further comprising a speech output module for delivering the result related to the voice-based query in natural language form to the user.

11. A natural language query architecture for processing voice and proximity-based queries, comprising:

a Web-enabled device, comprising;

a speech plug-in for receiving a voice-based query in natural language form from a user; and

a location/proximity plug-in for receiving location/proximity information from a location/proximity device;

a speech conversion algorithm for converting the voice-based query in natural language form to text in natural language form;

a natural language processing algorithm for converting the text in natural language form to text in searchable form;

a semantic engine algorithm for converting the text in searchable form to a formal database query; and

a database-look-up algorithm for using the formal database query to obtain a result related to the voice-based query in natural language form from a database.

12. The natural language query architecture of claim 11, wherein the Web-enabled device comprises a Web-enabled device selected from the group consisting of a Web-enabled portable personal computer, a Web-enabled laptop computer, a Web-enabled personal digital assistant, and a Web-enabled phone.

13. The natural language query architecture of claim 11, wherein the speech input plug-in comprises a speech input plug-in and a microphone.

14. The natural language query architecture of claim 11, wherein the location/proximity plug-in comprises a location/proximity plug-in selected from the group consisting of a radio frequency identification reader and a global positioning system.

15. The natural language query architecture of claim 11, wherein the location/proximity device comprises a location/proximity device selected from the group consisting of a radio frequency identification tag and a satellite.

16. The natural language query architecture of claim 11, wherein the speech conversion algorithm resides in a speech server located remotely from the Web-enabled device.

17. The natural language query architecture of claim 11, wherein the natural language processing algorithm resides in a server located remotely from the Web-enabled device.

18. The natural language query architecture of claim 11, wherein the semantic engine algorithm resides in a database server located remotely from the Web-enabled device.

19. The natural language query architecture of claim 11, wherein the database-look-up algorithm resides in a database server located remotely from the Web-enabled device.

20. The natural language query architecture of claim 11, further comprising a speech output plug-in for delivering the result related to the voice-based query in natural language form to the user.

21. A natural language query method for processing voice and proximity-based queries, comprising:

providing a device, comprising;

a speech input module for receiving a voice-based query in natural language form from a user; and

a location/proximity module for receiving location/proximity information from a location/proximity device;

converting the voice-based query in natural language form to text in natural language form using a speech conversion module;

converting the text in natural language form to text in searchable form using a natural language processing module;

converting the text in searchable form to a formal database query using a semantic engine module; and

obtaining a result related to the voice-based query in natural language form from a database using the formal database query and a database-look-up module.

22. The natural language query method of claim 21, wherein the device comprises a device selected from the group consisting of a Web-enabled portable personal computer, a Web-enabled laptop computer, a Web-enabled personal digital assistant, and a Web-enabled phone.

23. The natural language query method of claim 21, wherein the speech input module comprises a speech plug-in and a microphone.

24. The natural language query method of claim 21, wherein the location/proximity module comprises a location/proximity module selected from the group consisting of a radio frequency identification reader and a global positioning system.

25. The natural language query method of claim 21, wherein the location/proximity device comprises a location/proximity device selected from the group consisting of a radio frequency identification tag and a satellite.

26. The natural language query method of claim 21, wherein the speech conversion module resides in a speech server located remotely from the device.

27. The natural language query method of claim 21, wherein the natural language processing module resides in a server located remotely from the device.

28. The natural language query method of claim 21, wherein the semantic engine module resides in a database server located remotely from the device.

29. The natural language query method of claim 21, wherein the database-look-up module resides in a database server located remotely from the device.

30. The natural language query method of claim 21, further comprising delivering the result related to the voice-based query in natural language form to the user using a speech output module.