Text-to-scene conversion

• US 7,373,292 B1
• Filed: 09/27/2005
• Issued: 05/13/2008
• Est. Priority Date: 10/23/2000
• Status: Expired due to Term

• Current Assignee: Rakuten Group, Inc.
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Coyne, Robert E., Sproat, Richard W.
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US11/235,952
• Time in Patent Office: 959 Days
• Field of Search: 704/7, 704/9
• US Class Current: 704/9
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/237 Lexical tools
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

A system is disclosed for generating a scene description from a set of words. The system includes modules that perform the following functions: performing a linguistic analysis on a set of words to generate a structure representation of semantic relationships between words within the set of words, converting the structure to a set of description elements representative of objects to be depicted in a scene and relationships between objects, depicting a spatial relationship by using at least one spatial tag of an associated one or more of the object, and assigning a set of depictors to each of the description elements. Each depictor in the set of depictors may include a reference to an object to be modified, parameters used in modifying the object and a procedure for modifying the object. The system may also include a module that generates the same description by execution of the procedure for the modification of the objects.

Claims

1. A system for generating a scene description from a set of words, the system comprising:

a module configured to perform a linguistic analysis on a set of words to generate a structure representative of semantic relationships between words within the set of words;

a module configured to convert the structure to a set of description elements representative of objects to be depicted in a scene and relationships between the objects;

a module configured to depict a spatial relationship by using at least one spatial tag of an associated one or more of the objects;

a module configured to assign a set of depictors to each of the description elements, wherein each depictor in the set of depictors comprises;

a reference to an object to be modified;

parameters used in modifying the object; and

a procedure for the modification of the object; and

a module configured to generate the scene description by execution of the procedure for the modification of the objects.

2. The system of claim 1, wherein the linguistic analysis includes tagging the set of words with grammatical parts of speech.

3. The system of claim 1, wherein the linguistic analysis includes parsing the set of words into a parse tree structure representative of the structure of the set of words.

4. The system of claim 1, wherein the structure representative of the semantic relations of the set of words is a dependency structure, wherein the dependency structure indicates words that a given word is dependent on and indicates the words that depend on the given word.

5. The system of claim 1, wherein each of the description elements is classified as belonging to a respective description element type.

6. The system of claim 5, wherein each of the description element types has an object to which the respective description element refers.

7. The system of claim 1, wherein at least one of the description elements is modified to resolve conflicts between some of the description elements.

8. The system of claim 1, wherein at least one of the description elements is modified to add constraints to at least some of the description elements.

9. The system of claim 1, wherein at least one of the depictors is modified to resolve conflicts between at least some of the depictors.

10. The system of claim 1, wherein at least one of the depictors is modified to add constraints to at least some of the depictors.

11. A system for generating a low-level scene description from a set of words, the system comprising:

a module configured to tag a set of words with parts of speech;

a module configured to parse the tagged set of words into a parse tree structure representative of a structure of the set of words;

a module configured to convert the parse tree into a structure representative of the semantic relations of the set of words;

a module configured to convert the structure into a high-level scene description that includes at least one description element;

a module configured to assign a set of depictors to each description element, wherein each of the depictors comprises;

a reference to an object to be modified;

parameters used in modifying the object; and

a procedure for the modification of the object; and

a module configured to identify at least one conflict between at least some of the depictors;

a module configured to modify at least one of the depictors to resolve the at least one conflict; and

a module configured to generate the low-level scene description by execution of the procedures for the modification of the objects.

12. The system of claim 11, wherein the structure representative of the semantic relations of the set of words is a dependency structure that indicates at least one word that a given word is dependent on and indicates the words that depend on the given word.

13. The system of claim 11, wherein each of the description elements is classified as belonging to a description element type.

14. The system of claim 11, wherein at least one of the description elements is modified to resolve conflicts between at least some of the description elements.

15. The system of claim 11, wherein at least one of the description elements is modified to add constraints to at least some of the description elements.

16. The system of claim 11, further comprising:

a module configured to depict a spatial relation by using at least one spatial tag of an associated one or more of the objects.

17. A system for generating a scene description from a set of words, the system comprising:

means for performing a linguistic analysis on the set of words to generate a structure representative of semantic relationships between words within the set of words;

means for converting the structure to a set of description elements representative of objects to be depicted in a scene and relationships between the objects;

means for depicting a spatial relation by using at least one spatial tag of an associated one or more of the objects;

means for assigning a set of constraints to each description element in the set of description elements; and

means for generating the scene description by solving the set of constraints for the set of descriptive elements.

18. The system of claim 17, wherein the linguistic analysis includes tagging the set of words with grammatical parts of speech.

19. The system of claim 17, wherein the linguistic analysis includes parsing the set of words into a parse tree structure representative of the structure of the set of words.

20. The system of claim 17, wherein the structure representative of the semantic relations of the set of words is a dependency structure, wherein the dependency structure indicates words that a given word is dependent on and indicates the words that depend on the given word.