Natural language recognition using distributed processing

• US 20060149549A1
• Filed: 08/16/2004
• Published: 07/06/2006
• Est. Priority Date: 08/15/2003
• Status: Active Grant

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Napper, Jonathon Leigh
• Granted Patent: US 7,660,466 B2
• Time in Patent Office: Days
• US Class Current: 704/257
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 40/279 Recognition of textual entities
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06V 30/226 of cursive writing
• CPC Class Codes: G06V 30/242 Division of the character sequences into groups prior to recognition; Selection of dictionaries
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications

Abstract

A method and system for computer-based recognition of natural language data. The method is implemented on a distributed computer network and includes obtaining natural language data, such as digital ink handwriting, using an input device (415), receiving the natural language data on a server via a network, processing the natural language data using a recognizer (440) residing on the server (430) to produce intermediate format data (445), transmitting the intermediate format data (445) to an application (450), and decoding the intermediate format data 445 into computer-readable format data using the application (450) and context information associated with the application (450).

Claims

1. A method of providing computer-based recognition of natural language data, comprising the steps of:

generating natural language data using an input device; and

,

transmitting the natural language data to a server via a network;

wherein, the server is programmed and configured to process the natural language data using a recognizer residing on the server to produce intermediate format data, and is further programmed and configured to transmit the intermediate format data to an application, and further wherein, the intermediate format data is decoded into computer-readable format data using context information associated with the application.

3. The method as claimed in claim 1 or 2, wherein the natural language data is digital ink or speech.

4. The method as claimed in claim 1 or 2, wherein processing the natural language data includes one or more of:

normalizing the data;

segmenting the data; and

classifying the data.

5. The method as claimed in claim 1 or 2, wherein the recognizer is implemented using software or hardware.

6. The method as claimed in claim 1 or 2, wherein the intermediate format data is a Directed Acyclic Graph (DAG) data structure.

7. The method as claimed in claim 6, wherein the DAG data structure is a matrix containing the processing results of segments of the natural language data.

8. The method as claimed in claim 1 or 2, wherein the intermediate format data includes segmented time-series classifier data.

9. The method as claimed in claim 1 or 2, wherein the natural language data is derived from protein sequencing, image processing, computer vision or econometrics.

10. The method as claimed in claim 1 or 2, wherein the application is remote to both the input device and the server.

11. The method as claimed in claim 1 or 2, wherein the application resides on the server.

12. The method as claimed in claim 1 or 2, wherein the context information is a user dictionary.

13. The method as claimed in claim 1 or 2, wherein the recognizer can be trained for a specific user.

14. The method as claimed in claim 1 or 2, wherein the input device is associated with a paper-based interface provided with coded markings.

15. The method as claimed in claim 14, wherein the coded markings are a pattern of infrared markings.

16. The method as claimed in claim 14, wherein the input device is an optically imaging pen.

17. The method as claimed in claim 14, wherein each paper-based interface is uniquely identified and stored on a network server.

2. A method for computer-based recognition of natural language data, the method implemented on a network and comprising the steps of:

obtaining natural language data using an input device;

receiving the natural language data on a server via the network;

processing the natural language data using a recognizer residing on the server to produce intermediate format data;

transmitting the intermediate format data to an application; and

,

decoding the intermediate format data into computer-readable format data using context information associated with the application.

18. A method for computer-based recognition of natural language data, comprising the steps of:

receiving natural language data at a server from a remote input device;

processing the natural language data using a recognizer residing on the server to produce intermediate format data; and

,

transmitting the intermediate format data to an application;

wherein, the application is programmed and configured to decode the intermediate format data into computer-readable format data using context information associated with the application.

19. A method of providing computer-based recognition of natural language data for interaction with an application, wherein natural language data is received at a server from a remote input device, and the server processes the natural language data using a recognizer residing on the server to produce intermediate format data, the method comprising:

the application receiving the intermediate format data from the server; and

,

the application decoding the intermediate format data into computer-readable format data using context information associated with the application.

20. A method of recognising digital ink input by a user into a computer-based digital ink recognition system, the user interacting with a paper-based document, the paper-based document having disposed therein or thereon coded data indicative of a particular field of the paper-based document and of at least one reference point of the paper-based document, the method including the steps of:

receiving in a server, indicating data from a sensing device, operated by the user, regarding the identity of the paper-based document and at least one of a position and a movement of the sensing device relative to the paper-based document;

processing the indicating data using a recognizer residing on the server to produce intermediate format data; and

,

transmitting the intermediate format data to an application;

wherein, the application decodes the intermediate format data into computer-readable format data using context information associated with the paper-based document;

further wherein, the sensing device comprises;

(a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to the paper-based document; and

(b) a processor adapted to;

(i) identify at least some of the coded data from one or more of the captured images;

(ii) decode at least some of the coded data; and

(iii) generate the indicating data using at least some of the decoded coded data.

22. The method as claimed in claim 20 or 21, wherein the particular field of the paper-based document is associated with at least one zone of the paper-based document, and the method includes identifying the context information from the at least one zone.

21. A method of recognising digital ink input by a user into a computer-based digital ink recognition system, the method including the steps of:

providing a user with a paper-based document, the paper-based document having disposed therein or thereon coded data indicative of a particular field of the paper-based document and of at least one reference point of the paper-based document;

receiving in a server, indicating data from a sensing device, operated by the user, regarding the identity of the paper-based document and at least one of a position and a movement of the sensing device relative to the paper-based document;

processing the indicating data using a recognizer residing on the server to produce intermediate format data;

transmitting the intermediate format data to an application;

decoding the intermediate format data into computer-readable format data using context information associated with the paper-based document;

wherein the sensing device comprises;

(a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to the paper-based document; and

(b) a processor adapted to;

(i) identify at least some of the coded data from one or more of the captured images;

(ii) decode at least some of the coded data; and

(iii) generate the indicating data using at least some of the decoded coded

23. A system for computer-based recognition of natural language data, the system implemented on a network and comprising:

a server to receive natural language data generated by an input device via the network; and

,

a recognizer residing on the server to process the natural language data to produce intermediate format data;

wherein,

an application receives the intermediate format data and decodes the intermediate format data into computer-readable format data using context information associated with the application.

25. The system as claimed in claim 23 or 24, wherein the input device is a pen-based input device.

26. The system as claimed in claim 23 or 24, wherein the input device includes a microphone.

27. The system as claimed in claim 23 or 24, wherein the intermediate format data is transmitted to more than one application.

28. The system as claimed in claim 23 or 24, wherein the application initiates the processing of the natural language data.

29. The system as claimed in claim 23 or 24, including a recognizer manager to select a recognizer from a plurality of recognizers.

24. A system for computer-based recognition of natural language data, the system implemented on a network and comprising:

an input device to generate natural language data;

a server to receive the natural language data via the network;

a recognizer residing on the server to process the natural language data to produce intermediate format data; and

,

an application to receive the intermediate format data and to decode the intermediate format data into computer-readable format data using context information associated with the application.