Detection of items in an object

• US 10,163,200 B2
• Filed: 03/24/2015
• Issued: 12/25/2018
• Est. Priority Date: 03/24/2014
• Status: Active Grant

• Current Assignee: Smiths Heimann GmbH
• Original Assignee: Smiths Heimann GmbH
• Inventors: Heilmann, Geert
• Primary Examiner(s): Bernardi, Brenda C
• Application Number:
  US15/128,873
• Publication Number:
  US 20170103513A1
• Time in Patent Office: 1,372 Days
• CPC Class Codes: G01N 2223/206 sources operating at different energy levels
• CPC Class Codes: G01N 2223/401 image processing
• CPC Class Codes: G01N 23/04 and forming images of the material
• CPC Class Codes: G01V 5/224 Multiple energy techniques using one type of radiation, e.g. X-rays of different energies
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/30112 Baggage; Luggage; Suitcase
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/68 of symmetry
• CPC Class Codes: G06V 10/42 Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
• CPC Class Codes: G06V 10/443 by matching or filtering
• CPC Class Codes: G06V 2201/05 Recognition of patterns representing particular kinds of hidden objects, e.g. weapons, explosives, drugs

Abstract

This disclosure relates to a system and method for detecting an item having at least one symmetry property inside an inspection object based on at least one transmission image. The method includes the steps: (a) detection of edges of individual items contained in the transmission image in order to produce an edge image; and (b) detection of the item by determining a symmetry line that can be associated with an item with at least one symmetry property contained in the transmission image based on pairs of edge picture elements of the edge image that are positioned symmetrically to each other relative to the symmetry line; and in step (b), in determining the symmetry line in the edge image, the only edge picture elements that are taken into account are those for which the symmetry line lies in an item contained in the transmission image, to which item the edge belongs.

Claims

1. A method for detecting a three-dimensional item inside an inspection object, the method comprising:

detecting edges of a plurality of items contained in a transmission image of an inspection object in order to produce an edge image, at least some of the items being three-dimensional; and

detecting within the plurality of items a three-dimensional item having at least one symmetry property by determining a symmetry line of the items contained in the transmission image, the three-dimensional item having at least one symmetry property comprising a bottle, the symmetry line determined by detecting pairs of edge picture elements of the edge image that are positioned symmetrically to each other relative to the symmetry line that is to be determined, wherein, in the determining a symmetry line in the edge image, the only edge picture elements that are taken into account are those for which the symmetry line in the transmission image lies in the image region of the three-dimensional item to which the edge picture elements belong, determining, in the respective transmission images, a direction for the respective symmetry line by determining a bottom of the bottle and a neck of the bottle in the respective transmission images based on a difference in thickness between the bottom of the bottle and the neck of the bottle; and

producing an output classification associated with the item detected.

2. The method according to claim 1, further comprising:

determining at least one feature descriptor for at least one image region in the vicinity of a selected edge picture element in the transmission image; and

comparing the at least one feature descriptor to reference values in order to validate the selected edge picture element as an outer edge of a container.

3. The method according to claim 1, wherein detecting the three-dimensional item having at least one symmetry property includes making a determination, based on intensity values of individual picture elements in the transmission image, as to which side of an edge under consideration is the one in which an image region of the transmission image can be associated with the item belonging to the edge.

4. The method according to claim 1, wherein the edge image is produced based on material information associated with individual picture elements of the transmission image.

5. The method according to claim 1, wherein respective edge picture elements of edges extending orthogonal to a symmetry line are not taken into account in the determining of a symmetry line.

6. The method according to claim 1, wherein the edge picture elements are only taken into account in the determining of a symmetry line if the respective edge picture elements have edge angles relative to the symmetry line that complement one another to 180°

or 360°

.

7. The method according to claim 1, further comprising:

segmenting of a three-dimensional item with symmetry properties in the edge image by determining an outline of the item;

wherein when there are two determined edges that are determined to be symmetrical to a symmetry line, missing parts of the edges are filled in mirror-symmetrically to the symmetry line if the missing parts lie in an overlap region in which the item and the edge of the item are partially overlapped by another item; and

wherein the overlap region is determined based on intensity values in the transmission image.

8. The method according to claim 1, wherein detecting a three-dimensional item with at least one symmetry property further comprises detecting the three-dimensional item with at least one symmetry property in at least three transmission images of the same inspection object from different irradiation directions.

9. The method according to claim 1, wherein producing an output classification associated with the item detected comprises inferring a content of the item detected based on at least one of the transmission image or the edge image and an outer material of the item detected.

10. The method according to claim 1, wherein producing an output classification associated with the item detected comprises determining whether the item poses a security risk.

11. The method according to claim 1, wherein the inspection object comprises a piece of luggage.

12. The method according to claim 8, further comprising:

validating of symmetry lines through projection in to a 3D space; and

inspecting the position of intersecting lines of the symmetry planes in the 3D space relative to one another.

13. A system for detecting an item inside an inspection object, the system comprising:

an inspection device configured to obtain a transmission image of an inspection object;

at least one computing device in communication with the inspection device the at least one computing device including;

a memory configured to store code;

a processor coupled to the memory, the processor configured to execute the code to cause the processor to;

receive a transmission image from the inspection device;

detect edges of a plurality of items contained in a transmission image of an inspection object in order to produce an edge image, at least some of the items being three-dimensional; and

detect within the plurality of items a three-dimensional item having at least one symmetry property by determining a symmetry line of the items contained in the transmission image, the three-dimensional item having at least one symmetry property comprising a bottle, the symmetry line determined by detecting pairs of edge picture elements of the edge image that are positioned symmetrically to each other relative to the symmetry line that is to be determined, wherein, in the determining a symmetry line in the edge image, the only edge picture elements that are taken into account are those for which the symmetry line in the transmission image lies in the image region of the three-dimensional item to which the edge picture elements belong, determining, in the respective transmission images, a direction for the respective symmetry line by determining a bottom of the bottle and a neck of the bottle in the respective transmission images based on a difference in thickness between the bottom of the bottle and the neck of the bottle; and

produce an output classification associated with the item detected.

14. The system according to claim 13, wherein the inspection device comprises an X-ray inspection system configured for producing at least one X-ray image of the inspection object.

15. The system according to claim 14, wherein the X-ray inspection system includes:

a transport apparatus leading through an irradiation tunnel, the transport apparatus configured to receive the inspection object;

at least one X-ray source arrayed around the transport apparatus, the X-ray source configured to emit X-rays in at least two different irradiation planes to irradiate the inspection object; and

at least one detector array oriented in each of the at least two different irradiation planes;

the at least one detector array configured to measure at least one intensity associated with the X-rays.

16. The method according to claim 13, wherein the inspection object comprises a piece of luggage.

17. A method for detecting a three-dimensional item inside an inspection object, the method comprising:

detecting edges of a plurality of items contained in a transmission image of an inspection object in order to produce an edge image, at least some of the items being three-dimensional; and

detecting within the plurality of items a three-dimensional item having at least one symmetry property by determining a symmetry line of the items contained in the transmission image, the three-dimensional item having at least one symmetry property comprising a bottle, the symmetry line determined by detecting pairs of edge picture elements of the edge image that are positioned symmetrically to each other relative to the symmetry line that is to be determined, wherein, in the determining a symmetry line in the edge image, the only edge picture elements that are taken into account are those for which the symmetry line in the transmission image lies in the image region of the three-dimensional item to which the edge picture elements belong;

segmenting of a three-dimensional item with symmetry properties in the edge image by determining an outline of the item, wherein when there are two determined edges that are determined to be symmetrical to a symmetry line, missing parts of the edges are filled in mirror-symmetrically to the symmetry line if the missing parts lie in an overlap region in which the item and the edge of the item are partially overlapped by another item, and wherein the overlap region is determined based on intensity values in the transmission image; and

producing an output classification associated with the item detected.