Apparatus and method of analyzing tool trace, and computer program for executing the method

• US 10,460,200 B2
• Filed: 10/31/2017
• Issued: 10/29/2019
• Est. Priority Date: 07/19/2017
• Status: Active Grant

• Current Assignee: Republic Of Korea National Forensic Service Director Ministry Of Public Administration And Security
• Original Assignee: Rural Development Administration
• Inventors: Seo, Young Il, Lee, Sang Yoon, Joo, Eun Ah, Lim, Dong A, Kim, Jin Pyo, Park, Nam Kyu
• Primary Examiner(s): Li, Ruiping
• Application Number:
  US15/799,820
• Publication Number:
  US 20190026595A1
• Time in Patent Office: 728 Days
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

Provided is a method of analyzing a tool trace, the method being performed by a tool trace analyzing apparatus including a camera unit and including obtaining a first image that is a three-dimensional (3D) image of the tool trace; displaying the first image on a screen; storing, in a database, second images that are 3D images of one or more tools and that correspond to a plurality of pieces of feature information of the one or more tools; when a specific tool is selected based on a user input, searching for a second image from among the second images in the database, the second image corresponding to the specific tool, and displaying the second image on the screen; matching the second image with the first image and thus generating a match image; and displaying the match image on the screen.

Claims

1. A method of analyzing a tool trace, the method being performed by a portable tool trace analyzing apparatus comprising a camera unit and comprising:

obtaining a first image that is a three-dimensional (3D) image of the tool trace;

displaying the first image on a screen;

storing, in a database, second images that are 3D images of one or more tools and that correspond to a plurality of pieces of feature information of the one or more tools;

when a specific tool is selected based on a user input, searching for a second image from among the second images in the database, the second image corresponding to the specific tool, and displaying the second image on the screen;

matching the second image that is selected with the first image and thus generating a match image;

displaying the match image on the screen;

wherein the generating of the match image comprises;

calculating an error between the first image and the second image;

when the calculated error is greater than a preset reference value, the tool trace is not determined to match the specific tool, and when the calculated error is equal to or less than the preset reference value, the tool trace is determined to match the specific tool; and

displaying a result of the determination on the screen;

wherein the feature information of the one or more tools comprises at least a shape of a tool head; and

wherein the generating of the match image further comprises generating the match image by matching a head part of the tool in the second image, with the first image.

2. The method of claim 1, wherein the obtaining of the first image comprises:

obtaining two-dimensional (2D)) images at a plurality of different locations with respect to the tool trace by using the camera unit; and

generating the first image that is the 3D image by using the 2D images.

3. The method of claim 2, wherein the obtaining of the 2D images comprises obtaining the 2D images captured at the plurality of different locations in 360-degree all directions with respect to the tool trace.

4. The method of claim 1, further comprising classifying the plurality of pieces of feature information into one or more categories, and externally displaying a classification image comprising the plurality of pieces of classified feature information of the one or more tools.

5. The method of claim 4, wherein the displaying of the second image on the screen comprises, when feature information from among the plurality of pieces of classified feature information comprised in the classification image is selected, searching for the second image of the specific tool corresponding to the selected feature information, and displaying the second image on the screen.

6. A computer program stored in a medium for executing the method of claim 1, by using a computer.

7. A portable tool trace analyzing apparatus comprising:

a camera unit configured to obtain two-dimensional (2D) images by imaging a tool trace at a plurality of different locations with respect to the tool trace;

a first image generator configured to generate a first image that is a three-dimensional (3D) image of the tool trace by using the 2D images;

a database configured to store second images that are 3D images of one or more tools and that correspond to a plurality of pieces of feature information of the one or more tools;

a match image generator configured to search for a second image from among the second images in the database, the second image corresponding to a tool selected from among the one or more tools based on an external input, and to generate a match image by matching the second image with the first image;

a determiner configured to calculate an error between the first image and the second image during the generation of the match image, and to determine that the tool trace does not match the specific tool when the calculated error is greater than a preset reference value, and that the tool trace matches the specific tool when the calculated error is equal to or less than the preset reference value; and

a display configured to externally display the first image, the second image, the match image and a result of the determination of the determiner;

wherein the feature information of the one or more tools comprises at least a shape of a tool head; and

wherein the match image generator generates the match image by matching a head part of the tool in the second image with the first image.

8. The tool trace analyzing apparatus of claim 7, wherein the database is further configured to store the second images that correspond to a plurality of pieces of feature information of the one or more tools.

9. The tool trace analyzing apparatus of claim 8, further comprising a feature information classifying unit configured to classify the plurality of pieces of feature information into one or more categories and to provide, to the display, a classification image comprising the plurality of pieces of classified feature information of the one or more tools.

10. The tool trace analyzing apparatus of claim 9, further comprising a user command recognizer configured to recognize a user input, and

wherein, when feature information from among the plurality of pieces of classified feature information comprised in the externally displayed classification image is selected by the user command recognizer, the match image generator is further configured to search for the second image of the tool corresponding to the selected feature information, and to generate the match image by matching the second image with the first image.