Panoptic visualization of a three-dimensional representation of a complex system

• US 9,734,625 B2
• Filed: 01/28/2013
• Issued: 08/15/2017
• Est. Priority Date: 01/28/2013
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Floyd, Joseph F, Eames, Patrick J, Hadley, Kyle M, Hadley, Brent L
• Primary Examiner(s): Du, Haixia
• Application Number:
  US13/752,060
• Publication Number:
  US 20140210824A1
• Time in Patent Office: 1,660 Days
• Field of Search: None
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

A system is provided for panoptic visualization of a 3D representation of a complex system. The system includes a visualization engine configured to receive a digital 3D model of a complex system and produce a plurality of electronic document components including 2D images depicting elements of the complex system. The system also includes a data extractor configured to generate 2D derivatives of the 3D model, and communicate the 2D derivatives for inclusion in a panoptic visualization document collection. The data extractor may be configured to receive a document component including a 2D image depicting an element of the complex system, and extract from the 3D model, information identifying a spatial, design or functional relationship between the respective element and one or more other elements of the complex system. The data extractor may then be configured to provide the extracted information in metadata associated with the document component.

Claims

1. An apparatus for implementation of a system for panoptic visualization of a three-dimensional (3D) representation of a complex system, the apparatus comprising a processor and a memory storing executable instructions that, in response to execution by the processor, cause the apparatus to implement at least:

a visualization engine configured to receive a digital 3D model of a complex system and from the digital 3D model, produce a plurality of electronic document components including two-dimensional (2D) images depicting elements of the complex system; and

a data extractor coupled to the visualization engine and configured to generate 2D derivatives of the 3D model, including for each of one or more document components, the data extractor being configured to;

receive the document component including a 2D image depicting an element of the complex system, and extract from the 3D model, information identifying a spatial, design or functional relationship between the respective element and one or more other, different elements of the complex system depicted by the respective 2D image or another 2D image of the 2D images depicting elements of the complex system; and

provide the extracted information as structured information in metadata according to some metadata schema and associated with the document component,

wherein the data extractor is configured to communicate the 2D derivatives for inclusion in a panoptic visualization document collection, the 2D derivatives including the document components and associated metadata.

2. The apparatus of claim 1, wherein for each of one or more document components including a 2D image depicting an element of the complex system, the data extractor is configured to further extract information reflecting a 3D geometry of the respective element within a coordinate system of the complex system.

3. The apparatus of claim 1, wherein the memory stores further executable instructions that, in response to execution by the processor, cause the apparatus to further implement:

a colligater configured to receive the 2D derivatives and colligate the document components thereof, including for each of one or more of the document components, the colligater being configured to;

identify a link between the document component and one or more other document components, the link establishing a logical relationship between the respective document components according to the spatial, design or functional relationship between one or more elements of the complex system depicted by 2D images of the respective document components; and

provide structured information identifying the link between the document component and one or more other document components, the respective structured information being provided in metadata according to some metadata schema and associated with the document component,

wherein the colligater is further configured to communicate the document components and metadata as the panoptic visualization document collection.

4. The apparatus of claim 3, wherein the memory stores further executable instructions that, in response to execution by the processor, cause the apparatus to further implement:

a document parser configured to receive and disassemble an electronic document into a plurality of other document components not produced from the 3D model,

wherein the colligater is further configured to identify a link and provide structured information for one or more of the other document components, at least one link being identified between one of the document components and one of the other document components, and

wherein the colligater is configured to communicate the document components, other document components and metadata as the panoptic visualization document collection.

5. The apparatus of claim 1, wherein the panoptic visualization document collection has a plurality of document components, each document component including respective media content and having associated metadata providing structured information about the document component, the associated metadata for the document components further including structured information identifying links between the document components that establish one or more logical relationships between the respective media content thereof,

wherein the memory stores further executable instructions that, in response to execution by the processor, cause the apparatus to further implement a layout engine configured to generate a layout of document components of the panoptic visualization document collection, the layout including a panoptic arrangement of images of the document components according to the associated metadata of the respective document components, the images of the document components including images of the respective media content thereof, and

wherein the layout is a two-dimensional layout in which the one or more logical relationships between the respective media content of the document components are expressed by a difference in size, location or depth of at least some of the images relative to others of the images.

6. The apparatus of claim 5, wherein the layout includes at least some of the document components of the 2D derivatives, and one or more other document components not produced from the 3D model.

7. The apparatus of claim 6, wherein for each of one or more document components including a 2D image depicting an element of the complex system, the data extractor is configured to further extract information reflecting a 3D geometry of the respective element within a coordinate system of the complex system, and

wherein the one or more other document components depict one or more elements of the complex system, and have associated metadata absent information reflecting the 3D geometry of the respective one or more elements within the coordinate system of the complex system.

8. A method comprising:

receiving a digital three-dimensional (3D) model of a complex system and from the 3D model, producing a plurality of electronic document components including two-dimensional (2D) images depicting elements of the complex system;

generating 2D derivatives of the 3D model, including for each of one or more document components;

receiving the document component including a 2D image depicting an element of the complex system, and extracting from the 3D model, information identifying a spatial, design or functional relationship between the respective element and one or more other, different elements of the complex system depicted by the respective 2D image or another 2D image of the 2D images depicting elements of the complex system; and

providing the extracted information as structured information in metadata according to some metadata schema and associated with the document component; and

communicating the 2D derivatives for inclusion in a panoptic visualization document collection, the 2D derivatives including the document components and associated metadata.

9. The method of claim 8, wherein for each of one or more document components including a 2D image depicting an element of the complex system, the extracting further includes extracting information reflecting a 3D geometry of the respective element within a coordinate system of the complex system.

10. The method of claim 8 further comprising:

receiving the 2D derivatives and colligating the document components thereof, including for each of one or more of the document components;

identifying a link between the document component and one or more other document components, the link establishing a logical relationship between the respective document components according to the spatial, design or functional relationship between one or more elements of the complex system depicted by 2D images of the respective document components; and

providing structured information identifying the link between the document component and one or more other document components, the respective structured information being provided in metadata according to some metadata schema and associated with the document component; and

communicating the document components and metadata as the panoptic visualization document collection.

11. The method of claim 10 further comprising:

receiving and disassembling an electronic document into a plurality of other document components not produced from the 3D model,

wherein the identifying a link and providing structured information identifying the link occurs for one or more of the other document components, at least one link being identified between one of the document components and one of the other document components, and

wherein the communicating the document components and metadata includes communicating the document components, other document components and metadata as the panoptic visualization document collection.

12. The method of claim 8, wherein the panoptic visualization document collection has a plurality of document components, each document component including respective media content and having associated metadata providing structured information about the document component, the associated metadata for the document components further including structured information identifying links between the document components that establish one or more logical relationships between the respective media content thereof,

wherein the method further comprises generating a layout of document components of the panoptic visualization document collection, the layout including a panoptic arrangement of images of the document components according to the associated metadata of the respective document components, the images of the document components including images of the respective media content thereof, and

wherein the layout is a two-dimensional layout in which the one or more logical relationships between the respective media content of the document components are expressed by a difference in size, location or depth of at least some of the images relative to others of the images.

13. The method of claim 12, wherein the layout includes at least some of the document components of the 2D derivatives, and one or more other document components not produced from the 3D model.

14. The method of claim 13, wherein for each of one or more document components including a 2D image depicting an element of the complex system, the extracting further includes extracting information reflecting a 3D geometry of the respective element within a coordinate system of the complex system, and

wherein the one or more other document components depict one or more elements of the complex system, and have associated metadata absent information reflecting the 3D geometry of the respective one or more elements within the coordinate system of the complex system.

15. A computer-readable storage medium that is non-transitory and has computer-readable program code portions stored therein that, in response to execution by a processor, cause an apparatus to at least:

receive a digital three-dimensional (3D) model of a complex system and from the digital 3D model, produce a plurality of electronic document components including two-dimensional (2D) images depicting elements of the complex system;

generate 2D derivatives of the 3D model, including for each of one or more document components, the apparatus being caused to;

receive the document component including a 2D image depicting an element of the complex system, and extract from the 3D model, information identifying a spatial, design or functional relationship between the respective element and one or more other, different elements of the complex system depicted by the respective 2D image or another 2D image of the 2D images depicting elements of the complex system; and

provide the extracted information as structured information in metadata according to some metadata schema and associated with the document component; and

communicate the 2D derivatives for inclusion in a panoptic visualization document collection, the 2D derivatives including the document components and associated metadata.

16. The computer-readable storage medium of claim 15, wherein for each of one or more document components including a 2D image depicting an element of the complex system, the apparatus is caused to further extract information reflecting a 3D geometry of the respective element within a coordinate system of the complex system.

17. The computer-readable storage medium of claim 15, wherein the computer-readable storage medium has further computer-readable program code portions stored therein that, in response to execution by the processor, cause the apparatus to further:

receive the 2D derivatives and colligate the document components thereof, including for each of one or more of the document components, the apparatus being caused to;

identify a link between the document component and one or more other document components, the link establishing a logical relationship between the respective document components according to the spatial, design or functional relationship between one or more elements of the complex system depicted by 2D images of the respective document components; and

provide structured information identifying the link between the document component and one or more other document components, the respective structured information being provided in metadata according to some metadata schema and associated with the document component; and

communicate the document components and metadata as the panoptic visualization document collection.

18. The computer-readable storage medium of claim 17, wherein the computer-readable storage medium has further computer-readable program code portions stored therein that, in response to execution by the processor, cause the apparatus to further:

receive and disassemble an electronic document into a plurality of other document components not produced from the 3D model,

wherein the apparatus is further caused to identify a link and provide structured information for one or more of the other document components, at least one link being identified between one of the document components and one of the other document components, and

wherein the apparatus is caused to communicate the document components, other document components and metadata as the panoptic visualization document collection.

19. The computer-readable storage medium of claim 17, wherein the panoptic visualization document collection has a plurality of document components, each document component including respective media content and having associated metadata providing structured information about the document component, the associated metadata for the document components further including structured information identifying links between the document components that establish one or more logical relationships between the respective media content thereof,

wherein the computer-readable storage medium has further computer-readable program code portions stored therein that, in response to execution by the processor, cause the apparatus to further generate a layout of document components of the panoptic visualization document collection, the layout including a panoptic arrangement of images of the document components according to the associated metadata of the respective document components, the images of the document components including images of the respective media content thereof, and

wherein the layout is a two-dimensional layout in which the one or more logical relationships between the respective media content of the document components are expressed by a difference in size, location or depth of at least some of the images relative to others of the images.

20. The computer-readable storage medium of claim 19, wherein the layout includes at least some of the document components of the 2D derivatives, and one or more other document components not produced from the 3D model.

21. The computer-readable storage medium of claim 20, wherein for each of one or more document components including a 2D image depicting an element of the complex system, the apparatus is caused to further extract information reflecting a 3D geometry of the respective element within a coordinate system of the complex system, and

wherein the one or more other document components depict one or more elements of the complex system, and have associated metadata absent information reflecting the 3D geometry of the respective one or more elements within the coordinate system of the complex system.