Automatic generation of document summaries through use of structured text

• US 7,509,572 B1
• Filed: 07/16/1999
• Issued: 03/24/2009
• Est. Priority Date: 07/16/1999
• Status: Expired due to Fees

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Frieder, Ophir, Melander, Nicole M.
• Primary Examiner(s): Hutton; Doug
• Assistant Examiner(s): Nguyen; Maikhanh
• Application Number:
  US09/356,105
• Time in Patent Office: 3,539 Days
• Field of Search: 707/513, 707/514, 707/531, 707/3, 707/1, 707/5, 707/100, 707/102, 707/200, 715/513, 715/514, 715/531, 715/200, 715/201, 715/234, 715/273, 715/209, 715/231, 715254-256, 715/265, 715/274, 715/760, 715/841, 709/218, 709/231, 704/1, 704/4, 704 7- 10
• US Class Current: 715/234
• CPC Class Codes: G06F 16/345 Summarisation for human users
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation

Abstract

A summarization system generates summaries from documents. Text structure tags, in conformance with the Text Encoding Initiative (TEI), are inserted into the documents to generate encoded documents. The text structure tags, when associated with portions of the document, identify text types. A text type, such as an argumentative text type, provides meta-information about the associated portion of text. The documents are also encoded, via document type declaration (“DTD”) in the eXtensible mark-up language (“XML”), to generate a tree structure that depicts the text types and hierarchical relationships among the text types in the tree structure. The summarization system generates a summary of the documents by extracting portions of the document, associated with the text type tags, using the tree structure in accordance with user input. The summarization system may be used to generate summaries from multiple documents.

Claims

1. A computer readable medium comprising a plurality of instructions stored thereon when executed, generate summaries for a plurality of documents comprising text, the computer readable medium comprising sets of instructions for:

a) for each document in the plurality of documents, generating text structure tags for the document including generating text structure tags in accordance with Text Encoding Initiative (TEI), the text structure tags identifying a plurality of argumentative text types, wherein a text type comprises a type of argumentative content for an associated portion of a document, the types of argumentative content comprising an argument premise giving support, evidence, or reasoning for or against a conclusion or the conclusion comprising a resulting determination made using one or more argument premises;

b) for each document in the plurality of documents, encoding the document to generate a tree structure comprising a plurality of nodes, wherein the nodes correspond with the text types and hierarchical relationships among the nodes reflect argumentative relationships among the text types, and wherein encoding the document comprises mapping a base hierarchical structure, utilizing DTD of the eXtensible Markup Language (“

XML”

), to reflect said hierarchical relationships; and

processing the document to generate the tree structure in accordance with the base hierarchical structure;

c) selecting a plurality of tree structures for the plurality of documents;

d) combining, as a single logical tree structure, the plurality of tree structures; and

e) generating a summary for the plurality of documents by;

i) receiving from a user a selection of one or more particular text types for summarization, the one or more particular text types comprising the argument premise text type; and

ii) identifying, based upon the text type tags, a set of nodes from the plurality of tree structures corresponding to the one or more selected text types including one or more nodes corresponding to the argument premise text type; and

iii) extracting portions of text from the plurality of documents that correspond to the identified set of nodes selected to form the summary of the plurality of documents.

2. The computer readable medium as set forth in claim 1, further comprising sets of instructions for:

providing a visual hierarchy of the single logical tree structure;

providing a user interface for receiving user selection of one or more particular nodes of the single logical tree structure; and

extracting portions of text from the plurality of documents that correspond to said one or more selected nodes.

3. A computer system for generating summaries for a plurality of documents comprising text, said computer system comprising:

memory for storing the plurality of documents; and

a processing unit, coupled to said memory, configured for;

a) for each document in the plurality of documents, generating text structure tags for the document including generating text structure tags in accordance with Text Encoding Initiative (TEI), the text structure tags identifying a plurality of argumentative text types, wherein a text type comprises a type of argumentative content for an associated portion of a document, the types of argumentative content comprising an argument premise giving support, evidence, or reasoning for or against a conclusion or the conclusion comprising a resulting determination made using one or more argument premises;

b) for each document in the plurality of documents, encoding the document to generate a tree structure comprising a plurality of nodes, wherein the nodes correspond with the text types and hierarchical relationships among the nodes reflect argumentative relationships among the text types, and wherein encoding the document comprises mapping a base hierarchical structure, utilizing DTD of the eXtensible Markup Language (“

XML”

), to reflect said hierarchical relationships; and

processing the document to generate the tree structure in accordance with the base hierarchical structure;

c) selecting a plurality of tree structures for the plurality of documents;

d) combining, as a single logical tree structure, the plurality of tree structures; and

e) generating a summary for the plurality of documents by;

i) receiving from a user a selection of one or more particular text types for summarization, the one or more particular text types comprising the argument premise text type; and

ii) identifying, based upon the text type tags, a set of nodes from the plurality of tree structures corresponding to the one or more selected text types including one or more nodes corresponding to the argument premise text type; and

iii) extracting portions of text from the plurality of documents that correspond to the identified set of nodes selected to form the summary of the plurality of documents.

4. The computer system as set forth in claim 3, wherein said processor unit is further configured for:

providing a visual hierarchy of the single logical tree structure;

providing a user interface for receiving user selection of one or more particular nodes of the single logical tree structure; and

extracting portions of text from the plurality of documents that correspond to said one or more selected nodes.

5. A computer-implemented method for generating summaries for a plurality of documents comprising text, the method comprising:

a) for each document in the plurality of documents, generating text structure tags for the document including generating text structure tags in accordance with Text Encoding Initiative (TEI), the text structure tags identifying a plurality of argumentative text types, wherein a text type comprises a type of argumentative content for an associated portion of a document, the types of argumentative content comprising an argument premise giving support, evidence, or reasoning for or against a conclusion or the conclusion comprising a resulting determination made using one or more argument premises;

b) for each document in the plurality of documents, encoding the document to generate a tree structure comprising a plurality of nodes, wherein the nodes correspond with the text types and hierarchical relationships among the nodes reflect argumentative relationships among the text types, and wherein encoding the document comprises mapping a base hierarchical structure, utilizing DTD of the eXtensible Markup Language (“

XML”

), to reflect said hierarchical relationships; and

processing the document to generate the tree structure in accordance with the base hierarchical structure;

c) selecting a plurality of tree structures for the plurality of documents;

d) combing, as a single logical tree structure, the plurality of tree structures; and

e) generating a summary for the plurality of documents by;

i) receiving from a user a selection of one or more particular text types for summarization, the one or more particular text types comprising the argument premise text type; and

ii) identifying, based upon the text type tags, a set of nodes from the plurality of tree structures corresponding to the one or more selected text types including one or more nodes corresponding to the argument premise text type; and

iii) extracting portions of text from the plurality of documents that correspond to the identified set of nodes selected to form the summary of the plurality of documents.

6. The method as set forth in claim 5, wherein:

receiving a selection of one or more particular text types for summarization comprises receiving a selection for said argument premise text type for summarization; and

extracting portions of text from the plurality of documents comprises extracting portions of text from the plurality of documents that correspond to nodes corresponding to said argument premise text type.

7. The method as set forth in claim 5, wherein:

receiving a selection of one or more particular text types for summarization comprises receiving a selection for said conclusion text type for summarization; and

extracting portions of text from the plurality of documents comprises extracting portions of text from the plurality of documents that correspond to nodes corresponding to said conclusion text type.

8. The method as set forth in claim 5, wherein:

receiving a selection of one or more particular text types for summarization comprises receiving a selection for said argument premise and conclusion text types for summarization; and

extracting portions of text from the plurality of documents comprises extracting portions of text from the plurality of documents that correspond to nodes corresponding to said argument premise and conclusion text types.

9. The method as set forth in claim 5, further comprising:

providing a visual hierarchy of the single logical tree structure;

providing a user interface for receiving user selection of one or more particular nodes of the single logical tree structure; and

extracting portions of text from the plurality of documents that correspond to said one or more selected nodes.