Human body security inspection method and system

• US 9,552,521 B2
• Filed: 07/21/2014
• Issued: 01/24/2017
• Est. Priority Date: 07/23/2013
• Status: Active Grant

• Current Assignee: Nuctech Company Limited (Tsinghua Tongfang Co., Ltd.), Tsinghua University
• Original Assignee: Nuctech Company Limited (Tsinghua Tongfang Co., Ltd.), Tsinghua University
• Inventors: Fu, Liaohua, Chen, Zhiqiang, Li, Yuanjing, Zhao, Ziran, Wu, Wanlong, Jin, Yingkang, Liu, Yinong, Liu, Wenguo, Ding, Xianli, Sang, Bin, Tang, Le, Ruan, Ming, Zhu, Chenguang, Ding, Fuhua, Cao, Shuo
• Primary Examiner(s): Johns, Andrew W
• Application Number:
  US14/337,190
• Publication Number:
  US 20150030205A1
• Time in Patent Office: 918 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 2201/05 Recognition of patterns representing particular kinds of hidden objects, e.g. weapons, explosives, drugs
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

The present invention provides a human body security inspection method and system. The method comprises: retrieving in real-time scanning row or column image data of a personal to be inspected; transmitting in real-time the image data to an algorithm processing module and processing these image data by the module; automatically recognizing a suspicious matter by a suspicious matter automatic target recognition technique, after retrieving an image data of an entire scanning image of the personal; any of the following three inspection modes is selected, so as to perform a further processing on basis of the recognition result of the suspicious matter, (1) in a manner of automatic target recognition technique, (2) in a combination manner of the automatic target recognition technique and a privacy protection image; and (3) a combination manner of the automatic target recognition technique, a privacy protection image and human intervention.

Claims

1. A human body security inspection method, comprising the steps of:

retrieving in real-time scanning row or column image data of a personal to be inspected;

transmitting in real-time the image data to an algorithm processing module and processing these image data by the algorithm processing module;

automatically recognizing a suspicious matter by a suspicious matter automatic target recognition technique, after retrieving image data of an entire scanning image of the personal to be inspected, wherein any one of the following three inspection modes is selected based on the selection of a remote operator, so as to perform a further processing on basis of the recognition result of the suspicious matter,

(1) determining whether to give an alarm that the suspicious matter is present or not, without displaying any image, directly from an automatic recognition result of the suspicious matter;

(2) using a split-display technique to display a privacy protection image of the personal to be inspected and an outline image of the personal to be inspected on an equipment end display and a remote operation end display of the human body security inspection system respectively, and determining whether to give an alarm from the automatic recognition result of the suspicious matter and showing the suspicious matter in a form of a suspected mark in the privacy protection image and the outline image respectively;

(3) using the split-display technique to display the privacy protection image and the outline image on the equipment end display and the remote operation end display of the human body security inspection system respectively, and showing the suspicious matter on the privacy protection image and the outline image in a form of a suspected mark,

performing a modifying operation of the suspected mark on the outline image by the remote operator and confirming to submit this modifying operation,

determining whether to give an alarm from the results by the operation of the operator, and displaying the modified suspected mark on the privacy protection image.

2. The human body security inspection method of claim 1, wherein

the suspected mark matched with the suspicious matter is correspondingly displayed on the privacy protection image, based on a sort of the recognized suspicious matter and its position and size in the outline image.

3. The human body security inspection method of claim 2, wherein

the suspected mark is a suspected frame, and a colour of the suspected frame represents the sort of the suspected matter.

4. The human body security inspection method of claim 3, wherein

a suspected blue frame represents a metal article, a suspected green frame represents a non-metal article, and a suspected red frame represents explosives or drugs.

5. The human body security inspection method of claim 4, wherein

the privacy protection image is fully matched with an outline of the personal to be inspected, but does not contain detailed features of the personal to be inspected.

6. The human body security inspection method of claim 5, wherein

the privacy protection image and the outline image of the personal to be inspected are simultaneously obtained from the original scanning image, by means of the algorithm processing module in the human body security inspection system.

7. The human body security inspection method of claim 6, wherein

the physical profile image is obtained by removing the detailed features of the personal to be inspected with algorithm of the algorithm processing module.

8. The human body security inspection method of claim 7, wherein

during the removing step, mending and removing roughness of edges of the privacy protection image and/or holes in an interior of the privacy protection image caused by presence of the suspicious matter, by means of the algorithm.

9. The human body security inspection method of claim 6, wherein

the outline image is obtained by performing denoising and contour extracting process on the original scanning image.

10. The human body security inspection method of claim 1, wherein

the modifying operation comprises any one of addition of the suspected mark, deletion of the suspected mark, change of its size and change of its colour, or any combination thereof, and the privacy protection image is a puppet image or a physical profile image.

11. A human body security inspection system, comprising:

at least a processor;

at least a memory communicatively coupled to the at least processor and bearing instructions that upon execution by the at least processor cause the system at least to;

retrieve scanning images of a personal to be inspected within a scanning region,

identify a suspect matter by implementing an automatic target recognition technique,

send an alarm in response to an identification of the suspect matter,

generate an outline image, a privacy protection image, and a mark indicative of the suspect matter, and

display the privacy protection image and the outline image on an equipment end display device and a remote operation end display in a form of split-display.

12. The human body security inspection system of claim 11, wherein the at least a memory further bears instructions that upon execution by the at least a processor cause the system, in response to a selection from the human-computer interaction device, to perform any one of the following inspection modes:

(1) determining whether to give an alarm that the suspect matter is present or not, without displaying any image, directly from an automatic recognition result of the suspect matter;

(2) using the split-display technique to display the privacy protection image and the outline image on the equipment end display and the remote operation end display, determining whether to give an alarm from the automatic recognition result of the suspect matter, and showing the mark indicative of the suspect matter in the privacy protection image and the outline image, respectively;

or

(3) using the split-display technique to display the privacy protection image and the outline image on the equipment end display and the remote operation end display and showing the mark indicative of the suspect matter on the privacy protection image and the outline image,

performing a modifying operation of the mark indicative of the suspect matter on the outline image and confirming to submit the modifying operation,

determining whether to give an alarm from a result obtained by the modifying operation, and displaying a modified mark on the privacy protection image.

13. The human body security inspection system of claim 12, wherein

the mark indicative of the suspect matter is a frame, and the modifying operation comprises any one of addition of the mark, deletion of the mark, change of its size and change of its colour, or any combination thereof.

14. The human body security inspection system of claim 12, wherein

a display on a scanning apparatus of the human body security inspection system is the equipment end display, and the privacy protection image displayed on the equipment end display is matched with the outline image displayed on the remote operation end display,

if the mark indicative of the suspect matter on the outline image is modified, then the mark indicative of the suspect matter on the privacy protection image displayed on the equipment end display is automatically modified so as to match to the mark of the outline image.