AUGMENTABLE AND SPATIALLY MANIPULABLE 3D MODELING

• US 20170060379A1
• Filed: 03/24/2016
• Published: 03/02/2017
• Est. Priority Date: 08/31/2015
• Status: Active Grant

• Current Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Original Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Inventors: Griesmer, Paul, Capozella, Michael
• Granted Patent: US 10,620,778 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 7/564 from contours

Abstract

Augmentable and manipulable modeling of equipment provides a three dimensional, manipulable base model image of an equipment specimen on a display system using optical base model data obtained using a computing system. Base model data collection can be user-controlled to permit changing spatial aspects of the base model image (size, perspective, orientation). User inputs concerning functions, conditions and the like can be transmitted from a model control unit to the computing system via a two-way communication link, generating augmenting data that is combined with the base model data to render augmented three dimensional models. User inputs also can be received directly by the computing system, for example using a display system touchscreen. Augmenting data received by the computing system and/or display system also can be transmitted via the communication link to the model control unit. Such implementations permit realistic simulation of the effects of a control system on a real world system, equipment, etc.

Claims

1. A method for generating a spatially manipulable and augmentable model of an equipment specimen on a display system, the method comprising:

receiving base model data;

generating a base model image based on the base model data;

receiving augmenting data;

processing the base model data and augmenting data to generate an augmented model image on the display system.

2. The method of claim 1 wherein the base model data comprises compositional data and spatial data, the method further comprising receiving updated spatial data relating to the size, perspective and/or orientation of the base model image or augmented model image based on relative movement of a data acquisition device and a base model data source.

3. The method of claim 1 wherein the base model image and the augmented model image are each presented as a three dimensional image on the display system.

4. The method of claim 1 wherein at least one of the following is configured to receive augmenting data:

a model control unit; and

/or

the display system.

5. The method of claim 1 wherein the display system comprises a touchscreen configured to receive a user input comprising augmenting data.

6. The method of claim 1 wherein the base model data comprises optically readable data on a base model data source;

and

further wherein the display system is part of a computing system comprising the display system and an optical data acquisition device configured to read the base model data.

7. The method of claim 1 wherein the augmenting data comprises data changing one or more operational characteristics of the equipment specimen.

8. One or more computer-readable storage media having program instructions stored thereon to generate augmentable and spatially manipulable model images of an equipment specimen, wherein the program instructions, when executed by a computing system, direct the computing system to at least:

receive base model data;

generate a base model image on a display system based on the base model data, wherein the computing system comprises the display system;

receive first augmenting data;

process the base model data and first augmenting data to generate a first augmented model image on the display system.

9. The one or more computer-readable storage media of claim 8 wherein the display system comprises a touchscreen configured to receive a user input comprising the augmenting data.

10. The one or more computer-readable storage media of claim 8 wherein the program instructions, when executed by a computing system, further direct the computing system to at least:

receive second augmenting data;

process the base model data, the first augmenting data and the second augmenting data to generate a second augmented model image on the display system.

11. The one or more computer-readable storage media of claim 8 wherein the base model data comprises compositional data and spatial data;

and

further wherein the program instructions, when executed by a computing system, further direct the computing system to at least receive updated spatial data relating to the size, perspective and/or orientation of the base model image based on relative movement of a data acquisition device and a base model data source.

12. The one or more computer-readable storage media of claim 8 wherein the base model image and the augmented model image are each presented as a three dimensional image on the display system.

13. The one or more computer-readable storage media of claim 8 wherein at least one of the following is configured to receive augmenting data:

a model control unit; and

/or

the display system.

14. The one or more computer-readable storage media of claim 8 wherein the base model data comprises optically readable data on a base model data source;

and

further wherein the display system is part of a computing system comprising the display system and an optical data acquisition device configured to read the base model data.

15. The one or more computer-readable storage media of claim 8 wherein the augmenting data comprises data changing one or more operational characteristics of the equipment specimen.

16. A system for generating a spatially manipulable and augmentable model of an equipment specimen on a display system, the system comprising:

a computing system comprising;

an optical data acquisition device;

a processing system; and

the display system, wherein the display system comprises a touchscreen;

a base model data source comprising optical base model data, wherein the display system is configured to generate a base model image on the touchscreen when the optical base model data is processed by the display system;

further wherein the display system is configured to generate an augmented model image when the display system receives augmenting data.

17. The system of claim 16 wherein the optical base model data comprises compositional data and spatial data;

further wherein the augmenting data comprises at least one of the following;

updated spatial data relating to the size, perspective and/or orientation of the base model image based on relative movement of a data acquisition device and a base model data source; and

user-input data pertaining to changing operation of the equipment specimen.

18. The system of claim 17 wherein the augmenting data is received by at least one of the following:

the touchscreen;

a model control unit coupled to the display system; and

the optical data acquisition device.

19. The system of claim 16 wherein the base model source is a card comprising:

edge lines containing the base model data; and

optical readable indicia on the surface of the card.

20. The system of claim 16 further comprising a model control unit in communication with the computing system and configured to transmit augmenting data to the computing system.