Image processing system and method

• US 9,542,405 B2
• Filed: 01/16/2015
• Issued: 01/10/2017
• Est. Priority Date: 03/21/2014
• Status: Active Grant

• Current Assignee: Hanwha Vision Company Limited (Hanwha Corporation)
• Original Assignee: Hanwha Techwin Co., Ltd. (Hanwha Corporation)
• Inventors: Park, Dongjun, Park, Joonyoung, Shin, Hakchul, Ryu, Yeongeol
• Primary Examiner(s): MOTSINGER, SEAN T
• Application Number:
  US14/598,399
• Publication Number:
  US 20150269143A1
• Time in Patent Office: 725 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/54 Browsing; Visualisation therefor
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

An image processing system and an image processing method. The image processing system includes: an image analysis engine configured to analyze an input image and generate metadata about the input image; an indexing engine configured to structuralize and organize the metadata and generate index data based on the metadata; a search engine configured to extract index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and a browsing engine configured to generate a heatmap based on the extracted index data and image data and display the heatmap and an image matching the search condition on a screen.

Claims

1. An image processing system comprising at least one hardware processor to implement:

an image analysis engine configured to analyze an input image and generate metadata about the input image;

an indexing engine configured to structuralize and organize the metadata and generate index data based on the metadata;

a search engine configured to extract index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and

a browsing engine configured to generate a heatmap based on the extracted index data and image data and display the heatmap and an image matching the search condition on a screen,

wherein the image analysis engine is configured to classify objects included in the input image, analyze motions or lines of movement of the objects, and perform cumulative hashing on a result of analyzing the motions of the objects per unit time.

2. The image processing system of claim 1, wherein the browsing engine is configured to divide a region of the input image matching the search condition into predetermined units, calculate an amount of motions in divided regions from the index data to establish priorities, allocate different indications according to the established priorities to generate the heatmap, and apply smoothing filtering to the heatmap to reconfigure the heatmap.

3. The image processing system of claim 2, wherein the browsing engine is configured to generate the heatmap by connecting regions of the heatmap having a same indication and processing contour lines on the connected regions.

4. The image processing system of claim 2, wherein the browsing engine is configured to perform overlapping one of the image matching the search condition and the reconfigured heatmap on the other.

5. The image processing system of claim 3, wherein, if a point is selected on the reconfigured heatmap, the browsing engine is configured to provide a summarized image corresponding to the selected point.

6. The image processing system of claim 5, wherein the browsing engine is configured to display the reconfigured heatmap, the image matching the search condition and the summarized image on different regions of the screen.

7. An image processing system comprising:

a heatmap generator, implemented by using at least one hardware processor, configured to divide a region of an image matching a search condition into predetermined units, calculate an amount of motions in divided regions from index data to establish priorities, allocate different indications according to the established priorities to generate a heatmap, and apply smoothing filtering to the heatmap to reconfigure the heatmap; and

a display configured to display the reconfigured heatmap and the image matching the search condition,

wherein the heatmap generator is further configured to classify objects included in the image, analyze motions or lines of movement of the objects, and perform cumulative hashing on a result of analyzing the motions of the objects per unit time, and

wherein the index data are generated based on a result of the cumulative hashing.

8. The image processing system of claim 7, wherein the heatmap generator is configured to generate the heatmap by connecting regions of the heatmap having a same indication and process contour lines on the connected regions.

9. The image processing system of claim 7, wherein the heatmap generator comprises an overlapper, implemented by using the at least one hardware processor, configured to overlap one of the image matching the search condition and the reconfigured heatmap on the other.

10. The image processing system of 7, wherein the heatmap generator comprises:

a summarized image generator, implemented by using the at least one hardware processor, if a point is selected on the reconfigured heatmap, configured to generate a summarized image corresponding to the selected point.

11. The image processing system of claim 10, wherein the display is configured to display the reconfigured heatmap, the image matching the search condition and the summarized image, on different regions of the screen.

12. An image processing method comprising:

analyzing an input image and generating metadata about the input image;

structuralizing and organizing the metadata and generating index data based on the metadata;

extracting index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and

generating a heatmap based on the extracted index data and image data, and displaying the heatmap and an image matching the search condition on a screen,

wherein the analyzing comprises;

classifying objects included in the input image and analyzing motions or lines of movement of the objects; and

performing cumulative hashing on a result of analyzing motions of the objects per unit time.

13. The image processing method of claim 12, wherein the generating of the heatmap comprises:

dividing a region of an image matching a search condition into predetermined units;

calculating an amount of motions in the divided regions from index data to establish priorities;

allocating different indications according to the established priorities to generate a heatmap; and

applying smoothing filtering to the heatmap to reconfigure the heatmap.

14. The image processing method of claim 13, further comprising generating the heatmap by connecting regions of the heatmap having a same indication and processing contour lines on the connected regions.

15. The image processing method of claim 13, further comprising overlapping one of the image matching the search condition and the reconfigured heatmap on the other.

16. The image processing method of claim 13, further comprising, if a point is selected on the reconfigured heatmap, generating a summarized image corresponding to the selected point.

17. A non-transitory computer-readable recording medium having recorded thereon a computer program for executing an image processing method, the image processing method comprising:

analyzing an input image and generating metadata about the input image;

structuralizing and organizing the metadata and generating index data based on the metadata;

extracting index data matching a search condition and image data corresponding to the index data matching the search condition, from the input image; and

generating a heatmap based on the extracted index data and image data, and displaying the heatmap and an image matching the search condition on a screen,

wherein the analyzing comprises;

classifying objects included in the input image and analyzing motions or lines of movement of the objects; and

performing cumulative hashing on a result of analyzing motions of the objects per unit time.