Method and System for Interactive Virtual Inspection of Modeled Objects

• US 20080247636A1
• Filed: 10/19/2007
• Published: 10/09/2008
• Est. Priority Date: 03/20/2006
• Status: Active Grant

• Current Assignee: Siemens Energy Incorporated (Siemens AG)
• Original Assignee: Siemens Power Generation, Inc.
• Inventors: Genc, Yakup, Shannon, Robert E., Davis, Fredrick M., Zhang, Xiang, Kabanov, Sergey
• Granted Patent: US 8,477,154 B2
• Time in Patent Office: Days
• US Class Current: 382/152
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A method of using a Graphic User Interface (GUI) for interactive virtual inspection of modeled objects. The method includes acquiring a three-dimensional model of a modeled object and displaying a first view of the modeled object for a user to identify locations of interest on a surface of the modeled object visible within the first view. The user enters information to create a markup tag that annotates the location of interest, and the markup tag is automatically associated with the location of interest on the modeled object. A second view of the modeled object is displayed including the user identified location of interest and the markup tag.

Claims

1. A method of using a Graphic User Interface (GUI) for interactive virtual inspection of modeled objects comprising:

acquiring a three-dimensional model of a modeled object;

displaying a first view of said modeled object;

identifying by a user, a location of interest on a surface of said modeled object that is visible within said first view;

creating a markup tag having information entered by said user that annotates said location of interest;

automatically associating said markup tag with said location of interest on said modeled object;

displaying a second view of said modeled object having at least one image point that correlates to the user identified location of interest on said modeled object; and

conveying said markup tag to said second view of said modeled object.

2. The method of claim 1, wherein said location of interest visible in said first figure defines a segment of a feature on said surface of said modeled object, and further including the step of identifying by a user, in said second view, a location of interest visible in said second view and defining a further segment of said feature, at least a portion of which is not visible in said first view.

3. The method of claim 2, including the step of associating said markup tag with said location of interest defining said further segment of said feature identified in said second view.

4. The method of claim 1, further including viewing a plurality of second views comprising two-dimensional and three-dimensional views of said modeled object, and including the step of switching between said two-dimensional and three-dimensional views to provide additional markups.

5. The method of claim 1, wherein said step of displaying said second view comprises a user selecting a thumbnail view of said second view from a plurality of thumbnail views of said modeled object, and said second view comprises a scanned image of said modeled object.

6. The method of claim 1, wherein a plurality of views of said modeled object are stored in a searchable database and said step of conveying said markup tag to said second view further comprises a search and filter step comprising:

conveying search criteria as a query to said database;

displaying in a thumbnail window of a display thumbnail views from said database corresponding to said search criteria and including information from one or more markup tags; and

designating one or more of said thumbnail views for display in a main window of said display as a full size high resolution view including information from said markup tag.

7. The method of claim 1, including the step of a user selecting a mode from a set of modes comprising a database browse mode wherein a plurality of views of said modeled object are stored in a database and said database browse mode comprises user input of a search query provided to said database, and providing searching based on object properties including an object identifier associated with each of the plurality of views and providing view based searching including searching a view name and/or view orientation.

8. The method of claim 1, including the step of a user selecting a mode from a set of modes including a visualization mode comprising selecting markup tag properties to be displayed with said second view including a markup type and a defect type.

9. The method of claim 1, including the step of a user selecting a mode from a set of modes including a visualization mode comprising optimizing resolution of user selected areas of said modeled object with reference to geometric characteristics or visually observable surface characteristics of said modeled object and said location of interest.

10. The method of claim 9, wherein said visualization mode comprises operating on a segment of said object and applying a histogram operation limited to said segment.

11. The method of claim 1, including the step of a user selecting a mode from a set of modes including a markup/inspection mode comprising identifying said location of interest by a user entering a markup geometry comprising a line, area or volume indicator on said location of interest in said first view, and said markup tag comprises user entered classification information descriptive of said location of interest.

12. The method of claim 1, wherein a plurality of views of said modeled object are stored in a centralized database accessed by a plurality of distributed users, and including the step of synchronizing views accessed by said plurality of users to distribute information from a markup tag produced by any one of said users to any other user.

13. The method of claim 1, wherein said three-dimensional model, said markup tag and a plurality of images for display as said second view are stored in a database accessed by a plurality of distributed users, and user access to said database is controlled with reference to a user access authorization level including a first access level that allows a user to only view a markup tag conveyed to said second view, a second level that allows a user to only view and edit a markup tag by adding user-defined information to a markup tag conveyed to said second view, and a third level that allows a user to view and edit a markup tag by adding and/or deleting user-defined information to and from a markup tag conveyed to said second view.

14. The method of claim 1, wherein said second view comprises a scanned two-dimensional image.

15. A system for interactive virtual inspection of modeled objects comprising:

a processor;

a display device coupled to said processor;

a memory device; and

program code resident in said memory device, said program code executable by said processor to run a graphic user interface (GUI) for analyzing modeled objects comprising;

an acquisition module configured to acquire a three-dimensional model of a modeled object;

a display module configured to display views of said modeled object on said display, wherein a user interacting with said graphic user interface selects a first view of said modeled object for viewing on said display;

a processing module configured to identify a location of interest on a surface of said modeled object that is visible within said first view and to designate global coordinate points of said three-dimensional model that characterize said location of interest of said modeled object; and

an inspection module configured to create a markup tag, wherein said user interacts with said markup tag to provide information that annotates said location of interest, wherein said processing module associates said markup tag with said designated global coordinate points of said three-dimensional model;

wherein

upon said user selecting a second view of said modeled object that has at least one image point that correlates to a corresponding designated global coordinate point of said three-dimensional model that characterize said location of interest for display by said display module, said processing module conveys said markup tag so that said user may also view said information included in said markup tag.

16. The system of claim 15, including a searchable database storing a plurality of views of said modeled object, wherein said display module further comprises a mode window and a search dialog for operating with said acquisition module to convey search criteria as a query to said database.

17. The system of claim 16, wherein said display module further comprises a thumbnail window for operating with said acquisition module to display a plurality of thumbnail views retrieved from said database in response to said query to said database and a main window for displaying one or more full size high resolution views including information from said markup tag.

18. The system of claim 15, including a visualization module operating with a visualization control in said display module for a user to select markup tag properties to be displayed with said second view including a dialog box for selecting criteria comprising markup type and/or defect type.

19. The system of claim 15, wherein said inspection module operates with said display module to display a markup dialog for a user to enter descriptions of said location of interest including markup type and defect type.

20. The system of claim 15, including a database storing said three-dimensional model, said markup tag and a plurality of images for display as said second view, and including a security module operable to control access to said database based on different levels of user access authorization including a first access level that allows a user to only view said markup tag conveyed to said second view, a second level that allows a user to only view and add user-defined information to said markup tag conveyed to said second view, and a third level that allows a user to view, add and/or delete user-defined information to and from said markup tag conveyed to said second view.