IMAGING ASSISTING DEVICE AND PROGRAM

• US 20200132998A1
• Filed: 10/03/2019
• Published: 04/30/2020
• Est. Priority Date: 10/26/2018
• Status: Active Application

• Current Assignee: Mitutoyo Corporation
• Original Assignee: Mitutoyo Corporation
• Inventors: Abe, Shinsaku
• Granted Patent: US 10,845,603 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts

Abstract

An imaging assisting device includes a head-mounted display unit worn to a head of a user, and a control unit configured to control the head-mounted display unit. The head-mounted display unit includes a frame worn to the head of the user and a display screen of transmissive type supported by the frame at a position where the display screen covers a field of view of the user in a state that the frame is worn by the user, the display screen being configured to display an object defined in a virtual space such that the object is superimposed on a real space. The control unit displays a guide graphic on the display screen as an object defined in the virtual space, the guide graphic indicating an imaging range of an imaging module.

Claims

1. An imaging assisting device comprising:

a head-mounted display unit worn to a head of a user; and

a control unit configured to control the head-mounted display unit, wherein

the head-mounted display unit includes

a frame worn to the head of the user, and

a display screen of transmissive type supported by the frame at a position where the display screen covers a field of view of the user in a state that the frame is worn by the user, the display screen being configured to display an object defined in a virtual space such that the object is superimposed on a real space, and

the control unit is configured to perform control to display a guide graphic on the display screen as an object defined in the virtual space, the guide graphic indicating an imaging range of an imaging module.

2. The imaging assisting device according to claim 1, wherein

the imaging module is supported by the frame of the head-mounted display unit, and

the control unit is configured to perform control to display the guide graphic on the display screen such that the guide graphic is positioned at constant coordinates in a coordinate system for the virtual space based on the imaging module.

3. The imaging assisting device according to claim 1 further comprising a position and attitude sensor configured to detect a position and an attitude of the head-mounted display unit, wherein

a position, an attitude, and an angle of view of the imaging module are fixed in a real space where the imaging module is installed, and

the control unit is configured to perform control, based on the position and the attitude of the head-mounted display unit detected by the position and attitude sensor, to display the guide graphic on the display screen such that the guide graphic is positioned at the constant coordinates in the coordinate system for the virtual space fixed with respect to the real space.

4. The imaging assisting device according to claim 1 further comprising a position and attitude sensor configured to detect a position and an attitude of the head-mounted display unit, wherein

at least one of a position, an attitude, and an angle of view of the imaging module is variable, and

the control unit is configured to

acquire at least one of the position, the attitude, and the angle of view of the imaging module that is variable,

calculate coordinates at which the guide graphic is to be displayed, based on the acquired at least one of the position, the attitude, and the angle of view of the imaging module, in the coordinate system for the virtual space fixed with respect to the real space, and

perform control, based on the calculated coordinates in the virtual space at which the guide graphic is to be displayed and the position and the attitude of the head-mounted display unit detected by the position and attitude sensor, to display the guide graphic on the display screen such that the guide graphic is positioned at the calculated coordinates in the virtual space at which the guide graphic is to be displayed.

5. The imaging assisting device according to claim 1 further comprising an arrangement information acquisition unit configured to acquire arrangement information indicating arrangement of an object in the real space including the imaging range of the imaging module, wherein

the control unit is configured to perform control to identify a position of an imaging target object to be imaged based on the arrangement information and information indicating a shape of the imaging target object, and

in a case where the imaging target object is not positioned within the imaging range, the control unit is configured to perform control to display, on the display screen, navigation information for guidance of the imaging target object moving into the imaging range and/or alarm information indicating that the imaging target object is not positioned within the imaging range.

6. A program for causing a computer to function as a control unit in the imaging assisting device described in claim 1.