Aggregating document annotations

• US 9,626,348 B2
• Filed: 03/11/2011
• Issued: 04/18/2017
• Est. Priority Date: 03/11/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Naim, Oscar Gerardo, Vanderwende, Lucretia Henrica, Wongsuphasawat, Krist
• Primary Examiner(s): ASPINWALL, EVAN S
• Application Number:
  US13/045,535
• Publication Number:
  US 20120233150A1
• Time in Patent Office: 2,230 Days
• Field of Search: 707722, 707739
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9558 Details of hyperlinks; Management of linked annotations
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

Technologies pertaining to annotation aggregation are described herein. A user of a computing device assigns an annotation to a portion of a document, wherein the annotation comprises a tuple. The tuple comprises semantic relationships amongst words or phrases in the document. Relationship data is also generated, wherein the relationship data identifies the document, the author of the document, the author of the annotation, and other data. The annotations and relationship data are transmitted to a data store, where such information is aggregated with other annotations made by other annotators to various documents, thereby creating a network of knowledge

Claims

1. A method, comprising:

receiving, from a plurality of different computing devices and over a respective plurality of network connections, a plurality of data packets, wherein the plurality of different computing devices are operated by a plurality of different users, wherein each data packet in the plurality of data packets comprises;

an annotation that has been assigned to a document by a respective user, wherein the annotation is a tuple that comprises a first word or phrase extracted from the document, a second word or phrase extracted from the document, and a third word or phrase extracted from the document, wherein the third word or phrase relates the first word or phrase to the second word or phrase; and

relationship data that indicates that the annotation has been assigned to the document, wherein each data packet comprises a different annotation, and each data packet in the plurality of data packets has a same format;

aggregating the plurality of data packets in a data repository to form a network of knowledge, wherein the data repository is accessible to a processor; and

utilizing the processor to perform at least one processing function over at least one data packet in the data repository.

2. The method of claim 1, wherein the first word or phrase in the tuple is a subject of a parent phrase in the document, the second word or phrase in the tuple is an object of the parent phrase, and the third word or phrase in the tuple is a predicate that relates the subject with the object.

3. The method of claim 1, wherein the relationship data further identifies the user that assigned the annotation to the document.

4. The method of claim 1, wherein the annotation is automatically generated by extracting the tuple from a sentence of the document, and wherein the user assigns the annotation to the document in response to the annotation being generated.

5. The method of claim 1, wherein the data repository is accessible to a client computing device by way of an Internet browser.

6. The method of claim 1, wherein the relationship data further identifies a portion of the document that has been assigned the annotation.

7. The method of claim 1, wherein documents that have been assigned annotations are documents generated by way of a markup language.

8. The method of claim 1, wherein documents that have been assigned annotations are word processing documents.

9. The method of claim 1, wherein utilizing the processor to perform the at least one processing function over at least one data packet in the data repository comprises searching over the at least one data packet responsive to receipt of a query from a user.

10. The method of claim 9, wherein utilizing the processor to perform at least one processing function over at least one data packet in the data repository comprises generating a visualization for display on a computing device, wherein the visualization comprises a first graphical icon that is representative of a first document, a second graphical icon that is representative of a second document, and an edge between the first graphical icon and the second graphical icon that indicates that an author has assigned separate annotations to the first document and the second document.

11. The method of claim 9, wherein utilizing the processor to perform at least one processing function over at least one data packet in the data repository comprises generating a visualization for display on a computing device, wherein the visualization comprises a first graphical icon that is representative of the annotation, a second graphical icon that is representative of the document, and an edge between the first graphical icon and the second graphical icon that indicates that an author has assigned the annotation to the document.

12. The method of claim 11, wherein the visualization further comprises a fourth graphical icon that is representative of a second document and a second edge between the first graphical icon and the fourth graphical icon that indicates that the annotation has been assigned to the second document.

13. The method of claim 1, wherein utilizing the processor to perform at least one processing function over at least one data packet in the data repository comprises executing a data mining algorithm over the plurality of data packets in the data repository.

14. A system that comprises:

at least one processor; and

memory that stores instructions that, when executed by the at least one processor, cause the at least one processor to perform acts comprising;

receiving data packets from applications executing on client-computing devices by way of network connections, wherein the client computing devices are operated by different users, wherein each data packet in the data packets has a same format, and further wherein each data packet in the data packets comprises;

an annotation that has been generated by an extractor module configured to extract tuples from sentences in a respective document, the annotation assigned to the document by a respective user of a client computing device, wherein the annotation comprises a tuple, the tuple comprises a first word or phrase, a second word or phrase, and a third word or phrase, the first word or phrase is a subject of a parent phrase in the document, the second word or phrase is an obj ect of the parent phrase in the document, and the third word or phrase is a predicate of the parent phrase in the document; and

relationship data that indicates that the annotation has been assigned to the document; and

placing the data packets in a data repository to form a network of knowledge that is accessible to multiple users, wherein contents of the data repository are accessible to computing devices by way of a network.

15. The system of claim 14, wherein the network is the Internet.

16. The system of claim 14, the acts further comprising executing a search over the data packets in the data repository responsive to receipt of a query from a user.

17. The system of claim 14, wherein the applications executing on the client computing devices include a word processing application, wherein a user of the word processing application has assigned an annotation to a document utilizing the word processing application, and wherein a data packet that comprises the annotation is received subsequent to a different user of the word processing application approving the annotation for publishing.

18. The system of claim 14, wherein the applications executing on the client computing devices include an Internet browser, wherein a document in the documents is a web page, and wherein an annotation that is assigned to the web page is automatically generated.

19. Computer-readable memory comprising instructions that, when executed by at least one processor, cause the at least one processor to perform acts comprising:

receiving, from a word processing application on a computing device, a data packet, wherein the data packet comprises;

an annotation that corresponds to a portion of a document reviewed by a user of the word processing application, the annotation assigned to the portion of the document by the user, wherein the annotation comprises a tuple, wherein the tuple comprises a subject of a sentence or phrase in the document, an object of the sentence or phrase, and a predicate that relates the subject and the object; and

relationship data that comprises;

first data that indicates that the annotation has been assigned to the document;

second data that identifies the portion of the document that corresponds to the annotation;

third data that identifies an author of the document; and

fourth data that identifies an author of the annotation; and

repeating the act of receiving from a plurality of different computing devices operated by a plurality of different users, such that a plurality of data packets that comprise respective assigned annotations and relationship data are received, each data packet in the plurality of data packets has a same format;

causing the plurality of different data packets to be retained in a searchable database to form a network of knowledge;

receiving a query from another user;

executing a search over the plurality of data packets in the searchable database responsive to receiving the query from the another user; and

outputting search results to the another user subsequent to executing the search over the searchable database, wherein the search results comprise an indication of relationships between documents, document authors, and annotation authors.

20. The computer-readable memory of claim 19, wherein the annotation is automatically generated by extracting the tuple from the sentence or phrase.