System, method and computer program product for graphically illustrating entities and generating a text-based report therefrom

• US 7,949,542 B2
• Filed: 05/05/2005
• Issued: 05/24/2011
• Est. Priority Date: 05/05/2005
• Status: Active Grant

• Current Assignee: Ionosoft, Inc.
• Original Assignee: Ionosoft, Inc.
• Inventors: Hamiter, David M., Harrison, Rodney V., Hamiter, Stanley M. III
• Primary Examiner(s): Cobanoglu; Dilek B
• Assistant Examiner(s): SOREY, ROBERT A
• Application Number:
  US11/122,661
• Publication Number:
  US 20060262134A1
• Time in Patent Office: 2,210 Days
• Field of Search: 705/2
• US Class Current: 705/2
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 40/63 for local operation

Abstract

A computer-implemented method for graphically illustrating an entity and generating a text-based report therefrom includes providing a visual base representation of an entity. The base representation includes a plurality of elements at least one of which is modifiable, where the elements are each associated with a plurality of attributes. A visual diagram of a particular entity is built based upon the base representation of the entity. In this regard, at least one visual element is added to the base representation, where the added visual elements are modifiable. Accordingly, the diagram includes the elements of the base representation and the elements added to the base representation. After determining attributes associated with the added elements, a text-based report is generated from the diagram, where the report is generated based upon the elements of the diagram and the associated attributes, and where the report is automatically generated from the diagram without user input.

Claims

1. An apparatus comprising:

a local or remote memory device storing executable instructions; and

a processor configured to interact with and execute the instructions in the memory device, wherein execution of the instructions causes the processor to at least perform the following operations;

providing a diagram of a vascular system having at least one vascular object associated with a plurality of attributes, the at least one vascular object including a first vascular object having a length along which a finite number of greater than two interpretable points are positioned with a constant spacing therebetween, wherein each point is assigned a value representing a percent of the length of the respective vascular object along which the point is positioned;

receiving user input to build the diagram of the vascular system, wherein receiving user input to build the diagram includes;

receiving user input to add at least one additional vascular object or modifier to the diagram, the at least one additional vascular object or modifier including at least one second vascular object or modifier, and based on the receiving, snapping the second vascular object or modifier to one of the number of points on the first vascular object, the respective one of the number of points constituting a snap-to point; and

thereafter,

receiving user input to manipulate the shape of the first vascular object, and based on the receiving, increasing or decreasing the length of the first vascular object such that the number of points along the length of the first vascular object increases or decreases to thereby maintain the constant spacing, and such that the value assigned to the snap-to point is reassigned to another point on the first vascular object to reflect a change in percent of the length of the first vascular object along which the snap-to point and other point are positioned;

reassigning the second vascular object or modifier from the snap-to point to the other point such that the respective other point thereafter constitutes the snap-to point;

determining a plurality of attributes associated with each vascular object added to the diagram; and

automatically generating a text-based report from the diagram without user input other than the user input received to build the diagram, wherein the generating operation includes;

examining each vascular object by following a nested hierarchical ordering;

assigning at least one language string for each vascular object and associated attribute based upon the examination, each language string constituting a component of a sentence; and

compiling the language strings into sentences, and ordering and concatenating the sentences into the text-based report, including compiling each of one or more pluralities of language strings into a single sentence.

2. An apparatus according to claim 1, wherein the receiving user input to add at least one additional vascular object or modifier operation comprises:

receiving user input to select a second vascular object or a modifier from a menu;

receiving user input to drag the selected second vascular object or modifier from the menu to a stage including the diagram;

receiving user input to drop the selected second vascular object or modifier onto the stage; and

snapping the selected second vascular object or modifier to one of the number of points on the first vascular object.

3. An apparatus according to claim 2, wherein the snapping operation comprises:

determining a snap-to point from the number of points on the first vascular object based upon at least one predefined characteristic restriction imposed by the selected second vascular object or modifier; and

snapping the selected second vascular object or modifier to the determined snap-to point.

4. An apparatus according to claim 2, wherein the receiving user input to add operation includes receiving user input to add a modifier, including:

snapping the modifier to the first vascular object from which the modifier depends, the number of points on the first vascular object including a finite plurality of interpretable points along a length of, and proximate each of a pair of sides of, the vascular object;

framing a shape of the modifier by a series of consecutive points on the vascular object; and

fitting a stock representation of the modifier to the series of consecutive points framing the shape of the modifier to thereby form-fit the modifier to the vascular object.

5. An apparatus according to claim 1, wherein the receiving user input to manipulate operation further comprises receiving user input to increase or decrease a curvature of the vascular object.

6. An apparatus according to claim 1, wherein the receiving user input to add operation includes receiving user input to add a second vascular object, the selected second vascular object comprising a child vascular object and the first vascular object comprising a parent vascular object, the parent vascular object including a pair of sides, and wherein the snapping operation comprises:

determining an angle attribute of the child vascular object;

determining a side of the parent vascular object to which the child vascular object snaps; and

snapping the child vascular object proximate to the determined side of the parent such that the child vascular object extends from the determined side.

7. An apparatus according to claim 1, wherein the determining operation comprises for at least one vascular object added to the diagram of the vascular system:

determining a position attribute, a length attribute and an angle attribute associated with the vascular object, the position, length and angle attributes defining a direction of the vascular object; and

determining a name attribute associated with the vascular object based upon the direction of the vascular object and at least one rule.

8. An apparatus according to claim 1, wherein the vascular objects of the diagram comprise vascular objects of a plurality of vascular object types, and wherein the execution of the instructions causes the processor to further perform the following operations:

assigning each vascular object of the diagram to a respective holder array, each holder array including an identifier for each vascular object assigned to the holder array, the identifier being linked to the attributes associated with a respective vascular object,

wherein the generating operation comprises generating a text-based report based upon the holder arrays and the attributes linked to the vascular object identifiers in the holder arrays.

9. An apparatus according to claim 1, wherein the assigning operation includes placing at least one supporting word at least one of before or after an attribute to thereby assign a language string to the attribute.

10. An apparatus according to claim 1, wherein the compiling operation includes compiling the language strings into sentences based upon at least one function to correct any grammatical errors and thereby increase grammatical accuracy of the sentences.

11. An apparatus according to claim 1, wherein the providing operation comprises providing a diagram of a heart, the diagram including vascular objects comprising at least one vascular object representing at least one of a branch, a graft or a collateral, and at least one modifier depending from at least one vascular object, the at least one modifier representing at least one of a stent or an aberration.

12. A method comprising:

performing, by an apparatus including a processor configured to interact with a local or remote non-transitory memory device storing executable instructions, a number of steps including at least the following steps;

providing, by the processor, a diagram of a vascular system having at least one vascular object associated with a plurality of attributes, the at least one vascular object including a first vascular object having a length along which a finite number of greater than two interpretable points are positioned with a constant spacing therebetween, wherein each point is assigned a value representing a percent of the length of the respective vascular object along which the point is positioned;

receiving user input to build the diagram of the vascular system, wherein receiving user input to build the diagram includes;

receiving user input to add at least one additional vascular object or modifier to the diagram, the at least one additional vascular object or modifier including at least one second vascular object or modifier, and based on the receiving, snapping the second vascular object or modifier to one of the number of points on the first vascular object, the respective one of the number of points constituting a snap-to point; and

thereafter,

receiving user input to manipulate the shape of the first vascular object, and based on the receiving, increasing or decreasing the length of the first vascular object such that the number of points along the length of the first vascular object increases or decreases to thereby maintain the constant spacing, and such that the value assigned to the snap-to point is reassigned to another point on the first vascular object to reflect a change in percent of the length of the first vascular object along which the snap-to point and other point are positioned;

reassigning the second vascular object or modifier from the snap-to point to the other point such that the respective other point thereafter constitutes the snap-to point;

determining a plurality of attributes associated with each vascular object added to the diagram; and

automatically generating a text-based report from the diagram without user input other than the user input received to build the diagram, wherein the generating step includes;

examining each vascular object by following a nested hierarchical ordering;

assigning at least one language string for each vascular object and associated attribute based upon the examination, each language string constituting a component of a sentence; and

compiling the language strings into sentences, and ordering and concatenating the sentences into the text-based report, including compiling each of one or more pluralities of language strings into a single sentence.

13. A method according to claim 12, wherein the receiving user input to add at least one additional vascular object or modifier step comprises:

receiving user input to select a second vascular object or a modifier from a menu;

receiving user input to drag the selected second vascular object or modifier from the menu to a stage including the diagram;

receiving user input to drop the selected second vascular object or modifier onto the stage; and

snapping the selected second vascular object or modifier to one of the number of points on the first vascular object.

14. A method according to claim 13, wherein the snapping step comprises:

determining a snap-to point from the number of points on the first vascular object based upon at least one predefined characteristic restriction imposed by the selected second vascular object or modifier; and

snapping the selected second vascular object or modifier to the determined snap-to point.

15. A method according to claim 13, wherein the receiving user input to add step includes receiving user input to add a modifier, including:

snapping the modifier to the first vascular object from which the modifier depends, the number of points on the first vascular object including a finite plurality of interpretable points along a length of, and proximate each of a pair of sides of, the vascular object;

framing a shape of the modifier by a series of consecutive points on the vascular object; and

fitting a stock visual representation of the modifier to the series of consecutive points framing the shape of the modifier to thereby form-fit the modifier to the vascular object.

16. A method according to claim 12, wherein the receiving user input to manipulate step further comprises receiving user input to increase or decrease a curvature of the vascular object.

17. A method according to claim 12, wherein the receiving user input to add step includes receiving user input to add a second vascular object, the selected second vascular object comprising a child vascular object and the first vascular object comprising a parent vascular object, the parent vascular object including a pair of sides, and wherein the snapping step comprises:

determining an angle attribute of the child vascular object;

determining a side of the parent vascular object to which the child vascular object snaps; and

snapping the child vascular object proximate to the determined side of the parent such that the child vascular object extends from the determined side.

18. A method according to claim 12, wherein the determining step comprises for at least one vascular object added to the diagram of the vascular system:

determining a position attribute, a length attribute and an angle attribute associated with the vascular object, the position, length and angle attributes defining a direction of the vascular object; and

determining a name attribute associated with the vascular object based upon the direction of the vascular object and at least one rule.

19. A method according to claim 12, wherein the vascular objects of the diagram comprise vascular objects of a plurality of vascular object types, and wherein performing a number of steps further includes at least the following steps:

assigning each vascular object of the diagram to a respective holder array, each holder array including an identifier for each vascular object assigned to the holder array, the identifier being linked to the attributes associated with a respective vascular object,

wherein the generating step comprises generating a text-based report based upon the holder arrays and the attributes linked to the vascular object identifiers in the holder arrays.

20. A method according to claim 12, wherein the assigning step includes placing at least one supporting word at least one of before or after an attribute to thereby assign a language string to the attribute.

21. A method according to claim 12, wherein the compiling step includes compiling the language strings into sentences based upon at least one function to correct any grammatical errors and thereby increase grammatical accuracy of the sentences.

22. A method according to claim 12, wherein the providing step comprises providing a diagram of a heart, the diagram including vascular objects comprising at least one vascular object representing at least one of a branch, a graft or a collateral, and at least one modifier depending from at least one vascular object, the at least one modifier representing at least one of a stent or an aberration.

23. A non-transitory computer-readable storage medium having computer-readable program code portions stored therein that in response to execution by a processor cause the processor to at least perform the following operations:

providing a diagram of a vascular system having at least one vascular object associated with a plurality of attributes, the at least one vascular object including a first vascular object having a length along which a finite number of greater than two interpretable points are positioned with a constant spacing therebetween, wherein each point is assigned a value representing a percent of the length of the respective vascular object along which the point is positioned;

receiving user input to build the diagram of the vascular system, wherein receiving user input to build the diagram includes;

receiving user input to add at least one additional vascular object or modifier to the diagram, the at least one additional vascular object or modifier including at least one second vascular object or modifier, and based on the receiving, snapping the second vascular object or modifier to one of the number of points on the first vascular object, the respective one of the number of points constituting a snap-to point; and

thereafter,

receiving user input to manipulate the shape of the first vascular object, and based on the receiving, increasing or decreasing the length of the first vascular object such that the number of points along the length of the first vascular object increases or decreases to thereby maintain the constant spacing, and such that the value assigned to the snap-to point is reassigned to another point on the first vascular object to reflect a change in percent of the length of the first vascular object along which the snap-to point and other point are positioned;

reassigning the second vascular object or modifier from the snap-to point to the other point such that the respective other point thereafter constitutes the snap-to point;

determining a plurality of attributes associated with each vascular object added to the diagram; and

automatically generating a text-based report from the diagram without user input other than the user input received to build the diagram, wherein the generating operation includes;

examining each vascular object by following a nested hierarchical ordering;

assigning at least one language string for each vascular object and associated attribute based upon the examination, each language string constituting a component of a sentence; and

compiling the language strings into sentences, and ordering and concatenating the sentences into the text-based report, including compiling each of one or more pluralities of language strings into a single sentence.

24. A non-transitory computer-readable storage medium according to claim 23, wherein the receiving user input to add at least one additional vascular object or modifier operation comprises:

receiving user input to select a second vascular object or a modifier from a menu;

receiving user input to drag the selected second vascular object or modifier from the menu to a stage including the diagram;

receiving user input to drop the selected second vascular object or modifier onto the stage; and

snapping the selected second vascular object or modifier to one of the number of points on the first vascular object.

25. A non-transitory computer-readable storage medium according to claim 24, wherein the snapping operation comprises:

determining a snap-to point from the number of points on the first vascular object based upon at least one predefined characteristic restriction imposed by the selected second vascular object or modifier; and

snapping the selected second vascular object or modifier to the determined snap-to point.

26. A non-transitory computer-readable storage medium according to claim 24, wherein the receiving user input to add operation includes receiving user input to add a second vascular object, the selected second vascular object comprising a child vascular object and the first vascular object comprising a parent vascular object, the parent vascular object including a pair of sides, and wherein the snapping operation comprises:

determining an angle attribute of the child vascular object;

determining a side of the parent vascular object to which the child vascular object snaps; and

snapping the child vascular object proximate to the determined side of the parent such that the child vascular object extends from the determined side.

27. A non-transitory computer-readable storage medium according to claim 24, wherein the receiving user input to add operation includes receiving user input to add a modifier including:

snapping the modifier to the first vascular object from which the modifier depends, the number of points on the first vascular object including a finite plurality of interpretable points along a length of, and proximate each of a pair of sides of, the vascular object;

framing a shape of the modifier by a series of consecutive points on the vascular object; and

fitting a stock visual representation of the modifier to the series of consecutive points framing the shape of the modifier to thereby form-fit the modifier to the vascular object.

28. A non-transitory computer-readable storage medium according to claim 23, wherein the receiving user input to manipulate operation includes increasing or decreasing a curvature of the vascular object.

29. A non-transitory computer-readable storage medium according to claim 23, wherein the determining operation comprises for at least one vascular object added to the diagram of the vascular system:

determining a position attribute, a length attribute and an angle attribute associated with the vascular object, the position, length and angle attributes defining a direction of the vascular object; and

determining a name attribute associated with the vascular object based upon the direction of the vascular object and at least one rule.

30. A non-transitory computer-readable storage medium according to claim 23, wherein the vascular objects of the diagram comprise vascular objects of a plurality of vascular object types, and wherein the computer-readable storage medium has computer-readable program code portions stored therein that in response to execution by the processor cause the processor to further perform the following operations:

assigning each vascular object of the diagram to a respective holder array, each holder array including an identifier for each vascular object assigned to the holder array, the identifier being linked to the attributes associated with a respective vascular object,

wherein the generating operation comprises generating a text-based report based upon the holder arrays and the attributes linked to the vascular object identifiers in the holder arrays.

31. A non-transitory computer-readable storage medium according to claim 23, wherein the assigning operation includes placing at least one supporting word at least one of before or after an attribute to thereby assign a language string to the attribute.

32. A non-transitory computer-readable storage medium according to claim 23, wherein the compiling operation includes compiling the language strings into sentences based upon at least one function to correct any grammatical errors and thereby increase grammatical accuracy of the sentences.

33. A non-transitory computer-readable storage medium according to claim 23, wherein the providing operation includes providing a diagram of a heart, the diagram including vascular objects comprising at least one vascular object representing at least one of a branch, a graft or a collateral, and at least one modifier depending from at least one vascular object, the at least one modifier representing at least one of a stent or an aberration.