METHOD AND SYSTEM FOR POSITIONING A VIRTUAL OBJECT IN A VIRTUAL SIMULATION ENVIRONMENT

• US 20170092000A1
• Filed: 09/25/2015
• Published: 03/30/2017
• Est. Priority Date: 09/25/2015
• Status: Abandoned Application

• Current Assignee: Siemens Industry Software Limited (Siemens AG)
• Original Assignee: Siemens Industry Software Limited (Siemens AG)
• Inventors: Schwimmer, Moshe
• Application Number:
  US14/866,329
• Publication Number:
  US 20170092000A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00

Abstract

Systems and a method for positioning a virtual object, defined by a 3D model, in a virtual simulation environment include identifying a real object in a real environment from a 3D image of a 3D camera. The identified real object is linked to a corresponding virtual object. The location data of the position and orientation of the real object in the real scene is extracted. The extracted location data is used to position the linked virtual object at a specific virtual position and at a specific virtual orientation in the virtual scene reflecting the specific position and the specific orientation of the corresponding real object in the real scene.

Claims

1. A method for positioning a virtual object in a virtual simulation environment by a data processing system, wherein the virtual simulation environment comprises a virtual scene reflecting a real scene of a real environment, and wherein the virtual simulation environment is provided at least one virtual object representing at least one real object of the real environment, the at least one virtual object being defined by a three-dimensional (3D) virtual model, the method comprising:

receiving a positioning of a 3D camera in the real scene;

registering the 3D camera in the virtual simulation environment;

receiving a positioning of a real object at a specific position and a specific orientation in the real scene;

capturing, by the 3D camera, at least one 3D image of the real object positioned in the real scene;

identifying, from the at least one captured 3D image, the real object;

linking the identified real object to a corresponding virtual object;

extracting location data of the specific position and of the specific orientation in the real scene of the identified real object;

positioning the linked virtual object at a specific virtual position and at a specific virtual orientation in the virtual scene reflecting the specific position and the specific orientation of the corresponding real object in the real scene, the positioning comprising using the extracted location data.

2. The method of claim 1, wherein the 3D virtual model is selected from the group consisting of:

computer aided design (CAD) model;

CAD-like model;

point cloud model; and

3D computer model.

3. The method of claim 1, further comprising:

receiving a variation of positioning of the specific position and of the specific orientation of the real object;

repeating steps the capturing, the extracting, and the positioning so as to reposition the linked virtual object at a specific second virtual position and at a specific second virtual orientation in the virtual scene reflecting a specific second position and a specific second orientation of the corresponding real object in the real scene.

4. The method of claim 1, wherein the real object is selected from the group consisting of:

a piece of equipment;

a tool;

a piece of material;

a semi-finished product; and

a finished product.

5. The method of claim 1, where the capturing is performed automatically via picking.

6. The method of claim 1, where the capturing is adapted to be performed manually.

7. A data processing system comprising:

a processor; and

an accessible memory, the data processing system configured to;

receive a positioning of a three-dimensional (3D) camera in a real scene;

register the 3D camera in a virtual simulation environment;

receive a positioning of at least one real object at a specific position and a specific orientation in the real scene;

receive inputs, by the 3D camera, of a capturing of at least one 3D image of the at least one real object positioned in the real scene;

identify, from the at least one captured 3D image, the at least one real object;

link the at least one identified real object to a corresponding virtual object defined by a 3D virtual model;

receive inputs of extracted location data of the specific position and of the specific orientation in the real scene of the at least one identified real object;

position, using the extracted location data, the linked virtual object at a specific virtual position and at a specific virtual orientation in the virtual scene reflecting the specific position and the specific orientation of the corresponding real object in the real scene.

8. The data processing system of claim 7, wherein the 3D virtual model is selected from the group consisting of:

computer-aided design (CAD) model;

CAD-like model;

point cloud model; and

3D computer model.

9. The data processing system of claim 7, wherein the real object is selected from the group consisting of:

a piece of equipment;

a tool;

a piece of material;

a semi-finished product; and

a finished product.

10. A non-transitory computer-readable medium encoded with executable instructions that, when executed, cause one or more data processing systems to:

receive a positioning of a three-dimensional (3D) camera in a real scene;

register the 3D camera in a virtual simulation environment;

receive a positioning of at least one real object at a specific position and a specific orientation in the real scene;

receive inputs, by the 3D camera, of a capturing of at least one 3D image of the at least one real object positioned in the real scene;

identify, from the at least one captured 3D image, the at least one real object;

link the at least one identified real object to a corresponding virtual object defined by a 3D virtual model;

receive inputs of extracted location data of the specific position and of the specific orientation in the real scene of the at least one identified real object;

position, using the extracted location data, the linked virtual object at a specific virtual position and at a specific virtual orientation in the virtual scene reflecting the specific position and the specific orientation of the corresponding real object in the real scene.

11. The non-transitory computer-readable medium of claim 10, wherein the 3D virtual model is selected from the group consisting of:

computer-aided design (CAD) model;

CAD-like model;

point cloud model; and

3D computer model.

12. The non-transitory computer-readable medium of claim 10, wherein the real object is selected from the group consisting of:

a piece of equipment;

a tool;

a piece of material;

a semi-finished product; and

a finished product.