TEMPLATE BOOTSTRAPPING FOR DOMAIN-ADAPTABLE NATURAL LANGUAGE GENERATION

• US 20150261745A1
• Filed: 05/29/2015
• Published: 09/17/2015
• Est. Priority Date: 11/29/2012
• Status: Active Grant

• Current Assignee: Thomson Reuters Enterprise Centre GmbH (The Woodbridge Co. Ltd.)
• Original Assignee: Thomson Reuters Global Resources Unlimited Company (The Woodbridge Co. Ltd.)
• Inventors: Howald, Blake, Schilder, Frank, Song, Dezhao
• Granted Patent: US 10,095,692 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 40/56 Natural language generation

Abstract

The present invention relates to a system and method for bootstrapping templates for use in natural language sentence generation. More specifically, the present invention relates to identifying a set of candidate sentences from a large corpus based on a set of original templates by using a similarity measure. The set of candidate sentences are then processed or cleaned to generate a set of templates for use in natural language sentence generation.

Claims

1. A computer implemented method comprising:

a) receiving by a computer comprising a processor and a memory a set of original templates and storing the set of original templates in the memory;

b) accessing by a computer a set of databases comprising a large corpus of documents and searching by a search engine the set of databases based on the set of original templates;

c) identifying by the search engine a set of candidate sentences from a set of documents in the corpus by using a similarity measure to determine a similarity score; and

d) processing the set of candidate sentences to generate a set of natural language generation templates.

2. The method of claim 1 further comprising sorting the set of candidate sentences based on the similarity score.

3. The method of claim 1 further comprising identifying all sentences in the corpus by splitting each sentence from each other sentence for every document in the corpus.

4. The method of claim 1 further comprising wherein the similarity measure comprises the formula:

5. The method of claim 1 wherein the identifying further comprises identifying a set of syntactically similar sentences that are not identical to any template in the set of original templates and that comprise a set of semantic characteristics similar to the set of original templates.

6. The method of claim 1 further comprising determining if the similarity score for a sentence and a template from the set of original templates is higher than a determined threshold and placing the sentence in the set of candidate sentences.

7. The method of claim 1 wherein the identifying further comprises identifying a set of candidate sentences that relate to a topic similar to a topic associated with the set of original templates.

8. The method of claim 1 further comprising wherein the set of original templates are manually generated for a domain.

9. The method of claim 1 further comprising wherein the large corpus of documents is a news corpus.

10. The method of claim 1 further comprising generating by a computer a set of natural language sentences based on the set of natural language templates.

11. A system for bootstrapping a set of templates for generating natural language sentences, the system comprising:

a) at least one database comprising a corpus of documents;

b) a computer comprising a processor and a memory, the memory containing a set of executable code executable by the processor;

c) a search controller configured to receive a set of original templates and generate a query based on the set of original templates;

d) a search engine adapted to receive the query from the search controller and search the corpus of documents using the query based on the set of original templates to identify a set of candidate sentences from the corpus of documents;

e) a template analyzer adapted to;

i) selecting a set of similar sentences from the identified set of candidate sentences by using a similarity measure to determine a similarity score for each selected sentence; and

ii) generating a set of natural language generation templates based at least in part on the similarity scores.

12. The system of claim 11 wherein the template analyzer is further adapted to sort the set of candidate sentences based on the similarity score.

13. The system of claim 11 wherein the template analyzer is further adapted to identify all sentences in the corpus by splitting each sentence from each other sentence for every document in the corpus.

14. The system of claim 11 wherein the similarity measure comprises the formula:

15. The system of claim 11 wherein the search engine is further adapted to identify a set of syntactically similar sentences that are not identical to any template in the set of original templates and that comprise a set of semantic characteristics similar to the set of original templates.

16. The system of claim 11 wherein the template analyzer is further adapted to determine if the similarity score for a sentence and a template from the set of original templates is higher than a determined threshold and to place the sentence in the set of candidate sentences.

17. The system of claim 11 wherein the template analyzer is adapted to identify a set of candidate sentences that relate to a topic similar to a topic associated with the set of original templates.

18. The system of claim 11 further comprising wherein the set of original templates are manually generated for a domain.

19. The system of claim 11 further comprising wherein the large corpus of documents is a news corpus.

20. The system of claim 11 wherein the template analyzer is further adapted to generate a set of natural language sentences based on the set of natural language templates.