Method and system for performing inspection of a liquid product at a security checkpoint

• US 9,170,212 B2
• Filed: 04/03/2014
• Issued: 10/27/2015
• Est. Priority Date: 09/05/2008
• Status: Expired due to Fees

• Current Assignee: Vanderlande APC Inc (Toyota Motor Corporation)
• Original Assignee: Optosecurity Inc. (Toyota Motor Corporation)
• Inventors: Bouchard, Michel, Gudmundson, Dan, Bourbeau, Eric
• Primary Examiner(s): Seth, Manav
• Application Number:
  US14/244,213
• Publication Number:
  US 20140211980A1
• Time in Patent Office: 572 Days
• US Class Current: 1/1
• CPC Class Codes: G01F 23/288 X-rays; Gamma rays or other forms of ionising radiation
• CPC Class Codes: G01N 2001/024 passengers or luggage
• CPC Class Codes: G01N 2223/637 liquid
• CPC Class Codes: G01N 2223/639 material in a container
• CPC Class Codes: G01N 23/00 Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
• CPC Class Codes: G01N 23/04 and forming images of the material
• CPC Class Codes: G01N 9/24 by observing the transmission of wave or particle radiation through the material
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A method, an apparatus and a system are provided for assessing at a security checkpoint the threat status of a liquid product comprised of a bottle at least partially filled with liquid. Generally, an X-ray image of the liquid product is obtained and processed to derive a level of fill of the bottle and the threat status of the liquid product is determined at least in part based on the level of fill of the bottle. In some examples presented, an X-ray image of the liquid product is processed to derive location information associated with a meniscus formed by the liquid in the bottle and an estimated length of a path followed by X-rays through the liquid held in the bottle is used to determine the threat status of the liquid product, the length of the path being derived in part based on the location information.

Claims

1. A method for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, the method comprising:

a) receiving image data associated with the liquid product conveying an image of the liquid product, the image data being derived by performing a scan of the liquid product at the security checkpoint using an imaging apparatus that uses penetrating radiation;

b) processing the image data to derive information conveying a level of fill of the bottle, wherein processing image data includes;

i) processing the image data to derive geometric information associated with the bottle; and

ii) deriving the level of fill of the bottle at least in part based on the geometric information associated with the bottle;

c) determining the threat status of the liquid product at least in part based on the level of fill of the bottle;

d) releasing information conveying the determined threat status of the liquid product.

2. A method as defined in claim 1, wherein determining the threat status of liquid product comprises classifying the liquid product as a threat when the level of fill of the bottle is below a threshold level of fill.

3. A method as defined in claim 1, wherein processing the image data to derive information conveying the level of fill of the bottle comprises locating a meniscus formed by the liquid in the bottle.

4. A method as defined in claim 1, wherein the image data conveys a first image of the liquid product taken by subjecting the liquid product to rays of penetrating radiation in a first orientation and a second image of the liquid product taken by subjecting the liquid product to rays of penetrating radiation in a second orientation, wherein the information conveying the level of fill of the bottle conveys an adjusted level of fill of the bottle and wherein deriving said adjusted level of fill of the bottle comprises:

a) processing the image data corresponding to the first image of the liquid product to derive information conveying an estimated level of fill of the bottle holding the liquid at least in part based on the image data corresponding to the first image of the liquid product;

b) processing the image data corresponding to the second image of the liquid product and the estimated level of fill of the bottle obtained based on the image data corresponding to the first image to derive said adjusted level of fill of the bottle.

5. A method as defined in claim 1, wherein the bottle has a cross-sectional shape selected from the set consisting of a generally circular shape, a generally elliptical shape, generally rectangular shape and a generally square shape.

8. A method as defined in claim 1, wherein processing the image data to derive information conveying the level of fill of the bottle includes simulating responses to penetrating radiation of a virtual model of the bottle for different meniscus locations.

9. A method as defined in claim 8, wherein processing the image data to derive information conveying the level of fill of the bottle includes selecting a candidate meniscus location from the different meniscus locations, the selection being performed at least in part based on the simulated responses of the virtual model of the bottle and on the image data.

10. A method as defined in claim 9, wherein the selection is performed at least in part based on a comparison between the simulated responses of the virtual model of the bottle and the image data.

11. A method as defined in claim 8, wherein simulating responses of the virtual model of the bottle to penetrating radiation includes:

a) simulating a first response of the virtual model of the bottle to penetrating radiation for a first candidate meniscus location;

b) simulating a second response of the virtual model of the bottle to penetrating radiation for a second candidate meniscus location, the second meniscus location being selected at least in part based on the first candidate meniscus location and a comparison between the image data and the first simulated response.

12. A method as defined in claim 1, wherein processing the image data to derive information conveying the level of fill of the bottle includes:

i) processing the derived geometric information to derive a virtual model of the bottle;

ii) simulating responses of the derived virtual model of the bottle to penetrating radiation for different meniscus locations.

6. A computer program product stored on one or more non-transitory tangible computer readable storage media for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, the program product comprising instructions that, when executed, cause a programmable system including at least one programmable processor to perform operations, the operations comprising:

i) receiving image data associated with the liquid product conveying an image of the liquid product, the image data being derived by performing an scan of the liquid product at the security checkpoint using an imaging apparatus that uses penetrating radiation;

ii) processing the image data to derive information conveying a level of fill of the bottle, wherein processing the image data includes;

(1) processing the image data to derive geometric information associated with the bottle; and

(2) deriving the level of fill of the bottle at least in part based on the geometric information associated with the bottle;

iii) determining the threat status of the liquid product at least in part based on the level of fill of the bottle;

iv) releasing information conveying the determined threat status of the liquid product.

13. A computer program product as defined in claim 6, wherein determining the threat status of the liquid product comprises classifying the liquid product as a threat when the level of fill of the bottle is below a threshold level of fill.

14. A computer program product as defined in claim 6, wherein processing the image data to derive information conveying the level of fill of the bottle comprises locating a meniscus formed by the liquid in the bottle.

15. A computer program product as defined in claim 6, wherein the image data conveys a first image of the liquid product taken by subjecting the liquid product to rays of penetrating radiation in a first orientation and a second image of the liquid product taken by subjecting the liquid product to rays of penetrating radiation in a second orientation, wherein the derived information conveying the level of fill of the bottle conveys an adjusted level of fill of the bottle and wherein deriving said adjusted level of fill of the bottle comprises:

a) processing the image data corresponding to the first image of the liquid product to derive information conveying an estimated level of fill of the bottle holding the liquid at least in part based on the image data corresponding to the first image of the liquid product;

b) processing the image data corresponding to the second image of the liquid product and the estimated level of fill of the bottle obtained based on the image data corresponding to the first image to derive said adjusted level of fill of the bottle.

16. A computer program product as defined in claim 6, wherein the bottle has a cross-sectional shape selected from the set consisting of a generally circular shape, a generally elliptical shape, generally rectangular shape and a generally square shape.

17. A computer program product as defined in claim 6, wherein processing the image data to derive information conveying the level of fill of the bottle includes simulating responses of a virtual model of the bottle to penetrating radiation for different meniscus locations.

18. A computer program product as defined in claim 17, wherein processing the image data to derive information conveying the level of fill of the bottle includes selecting a candidate meniscus location from the different meniscus locations, the selection being performed at least in part based on a comparison between the simulated responses of the virtual model of the bottle and the image data.

19. A computer program product as defined in claim 17, wherein simulating responses of the virtual model of the bottle to penetrating radiation includes:

a) simulating a first response of the virtual model of the bottle to penetrating radiation for a first candidate meniscus location;

b) simulating a second response of the virtual model of the bottle to penetrating radiation for a second candidate meniscus location, the second meniscus location being selected at least in part based on the first candidate meniscus location and a comparison between the image data and the first simulated response.

20. A computer program product as defined in claim 6, wherein processing the image data to derive information conveying the level of fill of the bottle includes:

i) processing the derived geometric information to derive a virtual model of the bottle;

ii) simulating responses of the derived virtual model of the bottle to penetrating radiation for different meniscus locations.

7. An apparatus for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said apparatus comprising an input, a processing unit and an output, said apparatus comprising:

a) an input for receiving image data associated with the liquid product conveying an image of the liquid product, the image data being derived by performing an scan of the liquid product at the security checkpoint using an imaging apparatus that uses penetrating radiation;

b) a processing element in communication with said input, said processing element being programmed to;

i) process the image data to derive geometric information associated with the bottle; and

ii) process the image data to derive information conveying a level of fill of the bottle, wherein the information conveying the level of fill of the bottle is derived at least in part based on the derived geometric information associated with the bottle; and

iii) determine the threat status of the liquid product at least in part based on the level of fill of the bottle;

c) an output for releasing information conveying the determined threat status of the liquid product.

21. An apparatus as defined in claim 7, wherein said processing element is programmed to determine the threat status of the liquid product at least in part based on the level of fill of the bottle at least in part by classifying the liquid product as a threat when the level of fill of the bottle is below a threshold level of fill.

22. An apparatus as defined in claim 7, wherein said processing element is programmed to process the image data to derive information conveying the level of fill of the bottle at least in part by processing the image data to locate a meniscus formed by the liquid in the bottle.

23. An apparatus as defined in claim 7, wherein the image data conveys a first image of the liquid product taken by subjecting the liquid product to rays of penetrating radiation in a first orientation and a second image of the liquid product taken by subjecting the liquid product to rays of penetrating radiation in a second orientation, wherein the information conveying the level of fill of the bottle conveys an adjusted level of fill of the bottle and wherein said adjusted level of fill of the bottle is derived by said processing element being further programmed to:

a) process the image data corresponding to the first image of the liquid product to derive information conveying an estimated level of fill of the bottle holding the liquid at least in part based on the image data corresponding to the first image of the liquid product;

b) process the image data corresponding to the second image of the liquid product and the estimated level of fill of the bottle obtained based on the image data corresponding to the first image to derive said adjusted level of fill of the bottle.

24. An apparatus as defined in claim 7, wherein the bottle has a cross-sectional shape selected from the set consisting of a generally circular shape, a generally elliptical shape, generally rectangular shape and a generally square shape.

25. An apparatus as defined in claim 7, wherein processing the image data to derive information conveying the level of fill of the bottle includes simulating responses of a virtual model of the bottle to penetrating radiation for different meniscus locations.

26. An apparatus as defined in claim 25, wherein processing the image data to derive information conveying the level of fill of the bottle includes selecting a candidate meniscus location from the different meniscus locations, the selection being performed at least in part based on the simulated responses of the virtual model of the bottle and on the image data.

27. An apparatus as defined in claim 26, wherein the selection is performed at least in part based on a comparison between the simulated responses of the virtual model of the bottle and the image data.

28. An apparatus as defined in claim 25, wherein simulating responses of the virtual model of the bottle to penetrating radiation includes:

a. simulating a first response of the virtual model of the bottle to penetrating radiation for a first candidate meniscus location;

b. simulating a second response of the virtual model of the bottle to penetrating radiation for a second candidate meniscus location, the second meniscus location being selected at least in part based on the first candidate meniscus location and a comparison between the image data and the first simulated response.

29. An apparatus as defined in claim 7, wherein processing the image data to derive information conveying the level of fill of the bottle includes:

iii) processing the derived geometric information to derive a virtual model of the bottle;

iv) simulating responses of the derived virtual model of the bottle to penetrating radiation for different meniscus locations.