INSPECTION PROCESSING SYSTEM, INSPECTION PROCESSING METHOD, AND INSPECTION PROCESSING PROGRAM

• US 20190035155A1
• Filed: 07/25/2018
• Published: 01/31/2019
• Est. Priority Date: 07/27/2017
• Status: Active Grant

• Current Assignee: Obayashi Corporation
• Original Assignee: Obayashi Corporation
• Inventors: IKEDA, Yuichi, HORII, Tamaki, GOTO, Kazuyuki, TAKENAKA, Hidefumi, YAMAMOTO, Takayuki
• Granted Patent: US 11,094,120 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30132 Masonry; Concrete
• CPC Class Codes: G06T 2207/30136 Metal
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 7/0004 Industrial image inspection

Abstract

An inspection processing system includes a control unit connected to a photographing unit and an output unit. The control unit includes circuitry. The inspection processing system identifies a current position, displays a virtual image of a three-dimensional model of a structure corresponding to the current position. The virtual image is superimposed on a structure image obtained from the photographing unit. The inspection processing system further obtains an evaluation result of an evaluation item of an inspection subject using the structure image on which the displayed virtual image is superimposed, and records the evaluation result in an inspection information memory in association with the position of the inspection subject in the three-dimensional model.

Claims

1. An inspection processing system comprising a control unit connected to a photographing unit and an output unit, wherein the control unit includes circuitry, the circuitry is configured to:

identify a current position;

display a virtual image of a three-dimensional model of a structure corresponding to the current position, the virtual image being superimposed on a structure image obtained from the photographing unit;

obtain an evaluation result of an evaluation item of an inspection subject using the structure image on which the displayed virtual image is superimposed; and

record the evaluation result in an inspection information memory in association with the position of the inspection subject in the three-dimensional model.

2. The inspection processing system according to claim 1, wherein the circuitry is configured to

generate the virtual image of the three-dimensional model having a predetermined transmittance, and

display the virtual image as being superimposed on the structure image.

3. The inspection processing system according to claim 1, wherein the circuitry is configured to

generate the virtual image of the three-dimensional model on which a contour is displayed, and

display the virtual image as being superimposed on the structure image.

4. The inspection processing system according to claim 1, wherein the circuitry is configured to

change a manner of displaying the virtual image based on the evaluation result.

5. The inspection processing system according to claim 4, wherein the circuitry is configured to

change a color scheme of the virtual image based on a fitting status between the virtual image and the structure image in the evaluation result.

6. The inspection processing system according to claim 1, wherein the circuitry is configured to

calculate the evaluation result of the structure image based on attribute information of the three-dimensional model.

7. A method for assisting inspection using an inspection processing system including a control unit connected to a photographing unit and an output unit comprising:

by circuitry of the control unit, identifying a current position;

by the circuitry, displaying a virtual image of a three-dimensional model of a structure corresponding to the current position, the virtual image being superimposed on a structure image obtained from the photographing unit;

by the circuitry, obtaining an evaluation result of an evaluation item of an inspection subject using the structure image on which the displayed virtual image is superimposed; and

by the circuitry, recording the evaluation result in an inspection information memory in association with the position of the inspection subject in the three-dimensional model.

8. The method according to claim 7, the method further comprising:

by the circuitry, generating the virtual image of the three-dimensional model having a predetermined transmittance, and

by the circuitry, displaying the virtual image as being superimposed on the structure image.

9. The method according to claim 7, the method further comprising:

by the circuitry, generating the virtual image of the three-dimensional model on which a contour is displayed, and

by the circuitry, displaying the virtual image as being superimposed on the structure image.

10. The method according to claim 7, the method further comprising:

by the circuitry, changing a manner of displaying the virtual image based on the evaluation result.

11. The method according to claim 7, the method further comprising:

by the circuitry, changing a color scheme of the virtual image based on a fitting status between the virtual image and the structure image in the evaluation result.

12. The method according to claim 7, the method further comprising:

by the circuitry, calculating the evaluation result of the structure image based on attribute information of the three-dimensional model.

13. A non-transitory computer-readable medium that stores a program thereon, wherein the program, when executed by circuitry of a control unit of an inspection processing system connected to a photographing unit and an output unit, causes the circuitry to:

identify a current position;

display a virtual image of a three-dimensional model of a structure corresponding to the current position, the virtual image being superimposed on a structure image obtained from the photographing unit;

obtain an evaluation result of an evaluation item of an inspection subject using the structure image on which the displayed virtual image is superimposed; and

record the evaluation result in an inspection information memory in association with the position of the inspection subject in the three-dimensional model.

14. The non-transitory computer-readable medium according to claim 13, wherein the program, when executed by the circuitry, causes the circuitry to

generate the virtual image of the three-dimensional model having a predetermined transmittance, and

display the virtual image as being superimposed on the structure image.

15. The non-transitory computer-readable medium according to claim 13, wherein the program, when executed by the circuitry, causes the circuitry to

generate the virtual image of the three-dimensional model on which a contour is displayed, and

display the virtual image as being superimposed on the structure image.

16. The non-transitory computer-readable medium according to claim 13, wherein the program, when executed by the circuitry, causes the circuitry to

change a manner of displaying the virtual image based on the evaluation result.

17. The non-transitory computer-readable medium according to claim 13, wherein the program, when executed by the circuitry, causes the circuitry to

change a color scheme of the virtual image based on a fitting status between the virtual image and the structure image in the evaluation result.

18. The non-transitory computer-readable medium according to claim 13, wherein the program, when executed by the circuitry, causes the circuitry to

calculate the evaluation result of the structure image based on attribute information of the three-dimensional model.