Method and system for semantically labeling strings and providing actions based on semantically labeled strings

• US 7,770,102 B1
• Filed: 06/06/2000
• Issued: 08/03/2010
• Est. Priority Date: 06/06/2000
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wolff, Roger, Higashiyama, Nobuya, Huynh, Tuan, Wang, Ziyi, Reynar, Jeff, Ammerlaan, Michael
• Primary Examiner(s): RUTLEDGE, AMELIA L
• Application Number:
  US09/588,411
• Time in Patent Office: 3,710 Days
• Field of Search: 715/513, 715/512, 715/516, 715/234, 719/331
• US Class Current: 715/234
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

A method for recognizing strings and annotating, or labeling, the strings with a type label. After the strings are annotated with a type label, application program modules may use the type label to provide users with a choice of actions. If the user'"'"'s computer does not have any actions associated with a type label, the user may be provided with the option to surf to a download Uniform Resource Locator (URL) and download action plug-ins for that type label. One or more recognizer plug-ins perform the recognition of particular strings in an electronic document. The recognizer plug-ins may be packaged with an application program module or they may be written by third parties to recognize particular strings that are of interest. One or more action plug-ins provide possible actions to be presented to the user based upon the type label associated with the string.

Claims

1. For an electronic system stored on a computer medium for creating and editing an electronic document, a method for semantically labeling a string of text in the electronic document created in an application program module, the method comprising:

automatically receiving the string of text in a recognizer dynamic-link library after the entire string of text has been entered in the electronic document, wherein receiving the string of text comprises maintaining a job queue, the job queue storing the string of text before transmitting the string of text to at least one recognizer plug-in;

determining if the string of text has been edited before transmitting the string of text from the recognizer dynamic-link library to the at least one recognizer plug-in;

in response to determining if the string of text has been edited, deleting the edited string of text from the job queue;

in response to determining if the string of text has not been edited, transmitting the string of text, from the job queue, to the at least one recognizer plug-in during an idle time;

in each of the at least one recognizer plug-in, annotating the string of text to determine at least one label, wherein annotating the string of text comprises breaking the string of text by each of the at least one recognizer plug-in;

transmitting the at least one label from the at least one recognizer plug-in to the recognizer dynamic-link library, wherein transmitting the at least one label from the at least one recognizer plug-in comprises determining if the string of text annotated by the at least one recognizer plug-in has been edited after the string of text was transmitted to the recognizer dynamic-link library;

in response to determining the string of text has been edited after the string of text was transmitted to the recognizer dynamic-link library, transmitting the string of text from the application program module to the recognizer dynamic-link library;

compiling the at least one label into at least one semantic category at the recognizer dynamic-link library;

transmitting the at least one semantic category to the application program module such that each of the at least one label is associated with the string of text; and

embedding the at least one semantic category in the electronic document.

2. The method of claim 1 further comprising synchronizing the at least one label received from the at least one recognizer plug-in before transmitting the at least one label to the application program module.

3. The method of claim 1 further comprising:

receiving the at least one label in an action dynamic link library;

transmitting the at least one label to at least one of action plug-in; and

determining, in the at least one action plug-in, at least one action based on each of the at least one label and displaying at least one action received from the at least one action plug-in.

4. The method of claim 1 further comprising:

causing the application program module to fire an event within an object model of the application program module; and

causing a piece of code associated with the event to be executed when at least one of the at least one label is determined.

5. The method of claim 1 further comprising:

before the step of receiving the string of text in the recognizer dynamic-link library, determining a language of the string of text and if the language is not recognized by the recognizer dynamic-link library, then ending the method.

6. The method of claim 1 wherein annotating the string of text to determine the at least one label further comprises comparing the string of text with at least one stored string to determine a match.

7. A method for labeling a string of text in an electronic document as the electronic document is created in an application program module, the method comprising:

as the string of text is entered into the electronic document, automatically receiving the string of text in a recognizer dynamic link library during an idle time after the string of text has been entered in the electronic document and determining whether the string of text matches at least one stored string according to semantic categories, wherein receiving the string of text comprises;

maintaining a job queue, the job queue storing the string of text before transmitting the string of text to at least one recognizer plug-in,

determining if the string of text has been edited,

in response to determining if the string of text has been edited, deleting the edit string of text from the job queue; and

in response to determining if the string of text has not been edited, transmitting the string of text, from the job queue, to the at least one recognizer plug-in during an idle time;

if so, then determining a label associated with the matched stored string, wherein determining the label associated with the matched stored string comprises breaking the string of text by each of the at least one recognizer plug-in;

associating the label with the string of text;

transmitting the semantic categories to the application program module, wherein transmitting the semantic categories to the application module comprises determining if the string of text associated with the label has been edited after the string of text was transmitted to the recognizer dynamic-link library;

in response to determining if the string of text associated with the label has been edited after the string of text was transmitted to the recognizer dynamic-link library, transmitting the string of text from the application program module to the recognizer dynamic-link library; and

embedding the semantic categories in the electronic document.

8. The method recited in claim 7 further comprising determining at least one action associated with the label.

9. The method recited in claim 8 further comprising displaying an indication indicating that the label has been found for the string of text.

10. The method recited in claim 9 further comprising:

determining that a user has selected the string of text; and

in response, displaying the at least one action to the user.

11. The method recited in claim 10 further comprising:

receiving an indication that one of the at least one action has been selected; and

in response to receiving the indication that one of the at least one action has been selected, then causing the selected one of the at least one action to execute.

12. The method recited in claim 11 wherein causing the selected one of the at least one action to execute comprises determining whether an action plug-in dynamic link library assigned to the selected action is available;

and

if so, then receiving instructions from the action dynamic link library assigned to the selected action.

13. The method recited in claim 12 further comprising:

if the action plug-in dynamic link library is not available, then using a Uniform Resource Locator assigned to the action to navigate to a Web site and download the action plug-in dynamic link library.

14. The method recited in claim 13 further comprising determining metadata associated with the string of text.

15. A system, stored on a computer medium, for labeling a string in an electronic document as the string is entered into the electronic document, the system comprising:

an application program module for creating the electronic document;

a recognizer dynamic link library connected to the application program module, wherein the recognizer dynamic link library automatically receives the string during an idle time after the string has been entered in the electronic document; and

at least one recognizer plug-in connected to the recognizer dynamic link library, wherein the at least one recognizer plug-in receives the string, annotates the string to determine a label according to semantic categories embedded in the electronic document, wherein the string annotated to determine the label comprises break the string by each of the at least one recognizer plug-in, and associates the label with the string, wherein the at least one recognizer plug-in receiving the string comprises;

maintain a job queue, the job queue storing the string before transmitting the string to at least one recognizer plug-in,

determine if the string has been edited before transmitting the string to the at least one recognizer plug-in,

in response to the determination if the string has been edited before transmitting the string to the at least one recognizer plug-in, delete the edited string from the job queue,

in response to the determination if the string has not been edited before transmitting the string to the at least one recognizer plug-in, transmit the string, from the job queue, to the at least one recognizer plug-in during an idle time,

determine if the string of text associated with the label has been edited after the string of text was transmitted to the recognizer dynamic-link library;

in response to determining if the string of text associated with the label has been edited after the string of text was transmitted to the dynamic-link library, transmit the string of text from the application program module to the recognizer dynamic-link library, and

an action dynamic link library connected to the application program module.

16. The system of claim 15 further comprising at least one action plug-in connected to the action dynamic link library.

17. The system of claim 15 wherein the at least one recognizer plug-in compares the string to at least one stored string to determine whether the string matches any of the stored strings according to the semantic categories embedded in the electronic document.

18. The system of claim 17 wherein the label is associated with the matched stored string.

19. For an electronic system for creating and editing an electronic document, a computer-readable storage medium with instructions stored thereon for semantically labeling a string of text in the electronic document created in an application program module, the instructions comprising:

automatically receiving the string of text in a recognizer dynamic-link library after the entire string of text has been entered in the electronic document, wherein receiving the string of text comprises maintaining a job queue, the job queue storing the string of text before transmitting the string of text to at least one recognizer plug-in;

determining if the string of text has been edited;

in response to determining if the string of text has been edited, deleting the edited string of text from the job queue;

in response to determining if the string of text has not been edited, transmitting the string of text, from the job queue, to the at least one recognizer plug-in during an idle time;

in each of the at least one recognizer plug-in, annotating the string of text to determine a label according to semantic categories embedded in the electronic document, wherein annotating the string of text comprises breaking the string of text by each of the at least one recognizer plug-in;

associating each label with the string of text;

transmitting the labels from the at least one recognizer plug-ins to the recognizer dynamic-link library;

transmitting the labels to the application program module, wherein transmitting the labels to the application module comprises determining if the string of text associated with each label has been edited after the string of text was transmitted to the recognizer dynamic-link library;

in response to determining if the string of text associated with each label has been edited after the string of text was transmitted to the recognizer dynamic-link library, transmitting the string of text from the application program module to the recognizer dynamic-link library;

receiving the labels in the action dynamic link library;

transmitting the labels to at least one action plug-in; and

determining, in the at least one action plug-in, at least one action based on each of the labels and displaying at least one action received from the at least one action plug-in.