Panoptic visualization document collection

• US 10,268,761 B2
• Filed: 03/08/2012
• Issued: 04/23/2019
• Est. Priority Date: 12/21/2011
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Hadley, Brent L, Eames, Patrick J
• Primary Examiner(s): Dyer, Andrew R
• Application Number:
  US13/414,940
• Publication Number:
  US 20130166997A1
• Time in Patent Office: 2,602 Days
• Field of Search: 715202, 715203, 715209
• CPC Class Codes: G06F 16/9038 Presentation of query results
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A panoptic visualization document collection system includes a document parser and a colligater, and is configured to collect components of a document collection in a manner that that captures logical relationships between their content, which may in turn reflect relationships between the subjects or their objects depicted by the content. These logical relationships may be established by links between document components, which may be identified by information provided in associated metadata for the document components. The content may then be exploited according to these relationships, such as in a panoptic arrangement of the content in a manner that reflects the relationships. This type of arrangement may enable a user to see the content in a single view, and in an arrangement that facilitates a better understanding of the relationships between the content and their subjects or objects, which may be otherwise difficult to comprehend.

Claims

1. A method comprising:

receiving and disassembling one or more electronic documents into a plurality of constituent electronic document components each of which includes respective media content, the documents being disassembled according to a predetermined type of the documents;

colligating the document components, including for each of one or more document components of the plurality;

identifying one or more links between the document component and one or more other document components of the plurality, the one or more links being identified according to one or more of the documents, type of documents, or media content of the document component and one or more other document components; and

in metadata according to some metadata schema and associated with the document component,

providing structured information identifying the one or more links between the document component and one or more other document components that establish one or more logical relationships therebetween;

communicating the document components and metadata as a panoptic visualization document collection;

receiving and storing the document components and metadata in a page storage and a metadata storage, respectively;

identifying a subset of the document components from the page storage based on the metadata in the metadata storage;

generating a layout of including a panoptic arrangement of images of document components including the subset of the document components according to the metadata associated therewith, the panoptic arrangement being two-dimensional and the one or more logical relationships being expressed in the panoptic arrangement by a difference in size or depth of at least some of the images relative to others of the images, the images of document components including images of the respective media content thereof;

selecting one or more navigation options according to the metadata associated with the subset of the document components; and

communicating the one or more navigation options to a graphical user interface for presentation to a user along with the layout, the one or more navigation options thereby being selectable by the user to request an adjustment of the layout.

2. The method of claim 1, wherein a link of the one or more links is identified for the document component and one or more other document components sharing a common document with the respective document component, or one or more other document components adjacent the respective document component in a predetermined sequence.

3. The method of claim 1, wherein each document component of the plurality includes media content having a subject and including one or more objects reflecting or forming the respective subject, and

wherein the one or more links are identified according to the subject or one or more objects of the document component, and the subject or one or more objects of one or more other document components of the plurality.

4. The method of claim 3, wherein a link of the one or more links is identified for the document component and one or more other document components sharing a common subject or one or more common objects with the respective document component.

5. The method of claim 3, wherein a link of the one or more links is identified for the document component and one or more other document components including an object that is the subject of the respective document component, or one or more other document components having a subject that is an object of the respective document component.

6. The method of claim 1, wherein colligating the document components further includes:

identifying a layout for visual representations of at least some of the document components; and

in metadata associated with each document component in the layout,

providing information specifying one or more of a size, location or depth of the visual representation of the respective document component in the layout.

7. The method of claim 1, wherein the method further comprises for each of one or more document components of the plurality:

generating visual representations of the document component at respective resolutions for zoom levels of the document component; and

dividing the visual representations across the zoom levels into progressively larger numbers of tiles each of which covers a spatial area of the visual representation at a respective zoom level,

wherein communicating the document components includes communicating the tiles of the visual representations of the document components.

9. The apparatus of claim 1, wherein a link of the one or more links is identified for the document component and one or more other document components sharing a common document with the respective document component, or one or more other document components adjacent the respective document component in a predetermined sequence.

10. The apparatus of claim 1, wherein each document component of the plurality includes media content having a subject and including one or more objects reflecting or forming the respective subject, and

wherein the one or more links are identified according to the subject or one or more objects of the document component, and the subject or one or more objects of one or more other document components of the plurality.

11. The apparatus of claim 10, wherein a link of the one or more links is identified for the document component and one or more other document components sharing a common subject or one or more common objects with the respective document component.

12. The apparatus of claim 10, wherein a link of the one or more links is identified for the document component and one or more other document components including an object that is the subject of the respective document component, or one or more other document components having a subject that is an object of the respective document component.

13. The panoptic visualization document collection system of claim 10, wherein at least one of the one or more electronic documents relates to a complex system composed of a plurality of elements, at least some of the plurality of elements being composed of a plurality of other elements, and

wherein at least one document component has the complex system as its subject and elements of the plurality of elements or other elements as objects, and at least one other document component has an element of the plurality of elements as its subject, and elements of the plurality of other elements as objects.

14. The apparatus of claim 1, wherein the colligater being configured to colligate the document components further includes being configured to:

identify a layout for visual representations of at least some of the document components; and

in metadata associated with each document component in the layout,

provide information specifying one or more of a size, location or depth of the visual representation of the respective document component in the layout.

15. The apparatus of claim 1, wherein the memory stores further executable instructions that in response to execution by the processor cause the apparatus to further implement:

a tiler coupled to the colligater and configured to generate, for each of one or more document components of the plurality, visual representations of the document component at respective resolutions for zoom levels of the document component, and divide the visual representations across the zoom levels into progressively larger numbers of tiles each of which covers a spatial area of the visual representation at a respective zoom level,

wherein the colligater being configured to communicate the document components includes being configured to communicate the document components to the tiler, the tiler being further configured to communicate the tiles of the visual representations of the document components.

8. An apparatus comprising a processor and a memory storing executable instructions that in response to execution by the processor cause the apparatus to implement at least:

a panoptic visualization document collection system comprising;

a document parser configured to receive and disassemble one or more electronic documents into a plurality of constituent document components each of which includes respective media content, the documents being disassembled according to a predetermined type of the documents;

a colligater coupled to the document parser and configured to colligate the document components, including for each of one or more document components of the plurality, the colligater being configured to;

identify one or more links between the document component and one or more other document components of the plurality, the one or more links being identified according to one or more of the documents, type of documents, or media content of the document component and one or more other document components; and

in metadata according to some metadata schema and associated with the document component,

provide structured information identifying the one or more links between the document component and one or more other document components that establish one or more logical relationships therebetween,

wherein the colligater is further configured to communicate the document components and metadata as a panoptic visualization document collection; and

a page storage and a metadata storage configured to receive and store the document components and metadata, respectively;

a panoptic visualization document layout system configured to identify a subset of the document components from the page storage based on the metadata in the metadata storage, and generate a layout including a panoptic arrangement of images of document components including the subset of the document components according to the metadata associated therewith, the panoptic arrangement being two-dimensional and the one or more logical relationships being expressed in the panoptic arrangement by a difference in size or depth of at least some of the images relative to others of the images, the images of document components including images of the respective media content thereof; and

a panoptic visualization document navigation system configured to select one or more navigation options according to the metadata associated with the subset of the document components, and communicate the one or more navigation options to a graphical user interface for presentation to a user along with the layout, the one or more navigation options thereby being selectable by the user to request an adjustment of the layout.

16. A computer-readable storage medium that is non-transitory and has computer-readable program code portions stored therein that, in response to execution by a processor, cause an apparatus to at least:

receive and disassemble one or more electronic documents into a plurality of constituent document components each of which includes respective media content, the documents being disassembled according to a predetermined type of the documents;

colligate the document components, including for each of one or more document components of the plurality, the apparatus being caused to;

identify one or more links between the document component and one or more other document components of the plurality, the one or more links being identified according to one or more of the documents, type of documents, or media content of the document component and one or more other document components; and

in metadata according to some metadata schema and associated with the document component,

provide structured information identifying the one or more links between the document component and one or more other document components, that establish one or more logical relationships therebetween;

communicate the document components and metadata as a panoptic visualization document collection;

receive and cause storage of the document components and metadata in a page storage and a metadata storage, respectively;

identify a subset of the document components from the page storage based on the metadata in the metadata storage; and

generate a layout including a panoptic arrangement of images of document components including the subset of the document components according to the metadata associated therewith, the panoptic arrangement being two-dimensional and the one or more logical relationships being expressed in the panoptic arrangement by a difference in size or depth of at least some of the images relative to others of the images, the images of document components including images of the respective media content thereof;

select one or more navigation options according to the metadata associated with the subset of the document components; and

communicate the one or more navigation options to a graphical user interface for presentation to a user along with the layout, the one or more navigation options thereby being selectable by the user to request an adjustment of the layout.

17. The computer-readable storage medium of claim 16, wherein a link of the one or more links is identified for the document component and one or more other document components sharing a common document with the respective document component, or one or more other document components adjacent the respective document component in a predetermined sequence.

18. The computer-readable storage medium of claim 16, wherein each document component of the plurality includes media content having a subject and including one or more objects reflecting or forming the respective subject, and

wherein the one or more links are identified according to the subject or one or more objects of the document component, and the subject or one or more objects of one or more other document components of the plurality.

19. The computer-readable storage medium of claim 18, wherein a link of the one or more links is identified for the document component and one or more other document components sharing a common subject or one or more common objects with the respective document component.

20. The computer-readable storage medium of claim 18, wherein a link of the one or more links is identified for the document component and one or more other document components including an object that is the subject of the respective document component, or one or more other document components having a subject that is an object of the respective document component.

21. The computer-readable storage medium of claim 16, wherein the apparatus being caused to colligate the document components further includes being caused to:

identify a layout for visual representations of at least some of the document components; and

in metadata associated with each document component in the layout,

provide information specifying one or more of a size, location or depth of the visual representation of the respective document component in the layout.

22. The computer-readable storage medium of claim 16, wherein the computer-readable storage medium has further computer-readable program code portions stored therein that, in response to execution by the processor, cause the apparatus to further:

generate, for each of one or more document components of the plurality, visual representations of the document component at respective resolutions for zoom levels of the document component, and divide the visual representations across the zoom levels into progressively larger numbers of tiles each of which covers a spatial area of the visual representation at a respective zoom level,

wherein the apparatus being caused to communicate the document components includes being caused to communicate the tiles of the visual representations of the document components.