MEASUREMENT DATA COLLECTION DEVICE AND PROGRAM

• US 20200134317A1
• Filed: 10/03/2019
• Published: 04/30/2020
• Est. Priority Date: 10/29/2018
• Status: Active Grant

• Current Assignee: Mitutoyo Corporation
• Original Assignee: Mitutoyo Corporation
• Inventors: Abe, Shinsaku
• Granted Patent: US 10,853,652 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices

Abstract

A measurement data collection device includes a head-mounted display unit and a control unit to control the head-mounted display unit, and the measurement data collection device collects a measurement value measured by a measurement tool handled by the user. The head-mounted display unit includes a frame wearable on the head of the user, a display screen of transmissive type to display a three-dimensional image by superimposing the three-dimensional image on a real space, and a camera supported by the frame. Additionally, the control unit includes, a support information generation unit to generate a guide frame as support information, the guide frame being displayed in a reading position, a display control unit to control the support information generated by the support information generation unit, and a measurement value reading unit to read a measurement value by analyzing an image of the measurement tool captured by the camera.

Claims

1. A measurement data collection device comprising:

a head-mounted display unit wearable on the head of a user; and

a control unit configured to control the head-mounted display unit,

the measurement data collection device being configured to collect a measurement value measured by a measurement tool handled by the user,

wherein the head-mounted display unit includes,

a frame wearable on the head of the user,

a display screen of transmissive type supported by the frame at a position to cover a field of view of the user in a state where the head-mounted display unit is worn by the user and configured to display a three-dimensional image by superimposing the three-dimensional image on a real space, and

a camera supported by the frame at a position to image the front of the user in a state where the head-mounted display unit is worn by the user, and

the control unit includes,

a support information generation unit configured to generate a guide frame as support information, the guide frame being displayed in a reading position which is a suitable position of the measurement tool to be imaged by the camera,

a display control unit configured to control the support information generated by the support information generation unit to be displayed on the display screen; and

a measurement value reading unit configured to read a measurement value by analyzing an image of the measurement tool captured by the camera.

2. The measurement data collection device according to claim 1, wherein the support information generation unit generates the guide frame in fixed coordinates on a relative coordinate system based on a point of the head-mounted display unit.

3. The measurement data collection device according to claim 1,

wherein the head-mounted display unit further includes a 3D sensor supported by the frame to face toward the front of the user in a state where the head-mounted display unit is worn by the user and configured to acquire point cloud data indicating a position of an object body in front of the user,

the control unit further includes a three-dimensional information analysis unit configured to identify, based on the point cloud data acquired by the 3D sensor, a position of the measurement tool handled by the user, and

the support information generation unit generates, based on the position of the measurement tool identified by the three-dimensional information analysis unit, navigation information as the support information, the navigation information guiding the user to move the measurement tool close to the reading position.

4. The measurement data collection device according to claim 3, wherein when the position of the identified measurement tool coincides with the reading position, the three-dimensional information analysis unit outputs a trigger signal for prompting the camera to capture the image of the measurement tool.

5. The measurement data collection device according to claim 3, wherein the three-dimensional information analysis unit identifies, based on the point cloud data acquired by the 3D sensor, the type of the measurement tool handled by the user and identifies, in accordance with the type of the measurement tool, the size, position, and/or shape of the guide frame generated by the support information generation unit.

6. The measurement data collection device according to claim 1 further comprising a measurement data storage unit configured to store measurement data obtained by associating the measurement value read by the measurement value reading unit with information of the measurement tool used in the measurement.

7. A program for causing a computer to function as the control unit of the measurement data collection device described in claim 1.