METHOD AND SYSTEM FOR PERFORMING X-RAY INSPECTION OF A LIQUID PRODUCT AT A SECURITY CHECKPOINT

• US 20100208972A1
• Filed: 03/27/2009
• Published: 08/19/2010
• Est. Priority Date: 09/05/2008
• Status: Active Grant

• Current Assignee: Vanderlande Industries BV (VIVE BV)
• Original Assignee: Optosecurity Inc.
• Inventors: Bouchard, Michel, Gudmundson, Dan, Bourbeau, Eric
• Granted Patent: US 8,867,816 B2
• Time in Patent Office: Days
• US Class Current: 382/132
• CPC Class Codes: G01F 23/288 X-rays; Gamma rays or other forms of ionising radiation
• CPC Class Codes: G01N 2001/024 passengers or luggage
• CPC Class Codes: G01N 2223/637 liquid
• CPC Class Codes: G01N 2223/639 material in a container
• CPC Class Codes: G01N 23/00 Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
• CPC Class Codes: G01N 23/04 and forming images of the material
• CPC Class Codes: G01N 9/24 by observing the transmission of wave or particle radiation through the material
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A method, an apparatus and a system are provided for assessing at a security checkpoint the threat status of a liquid product, where the liquid product is comprised of a bottle at least partially filled with liquid. In accordance with a broad aspect, the level of fill is used as a factor in the determination of the threat status of the liquid product. In accordance with another broad aspect, an X-ray image of the liquid product is obtained and processed to derive a level of fill of the bottle and the threat status of the liquid product is determined at least in part based on the level of fill of the bottle. In accordance with yet another broad aspect, an X-ray image of the liquid product is processed to derive location information associated with a meniscus formed by the liquid in the bottle. An estimated length of a path followed by X-rays through the liquid held in the bottle is derived in part based on the location information and is used to determine the threat status of the liquid product.

Claims

1. ) A method for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, the method comprising:

a) receiving X-ray image data associated with the liquid product conveying an image of the liquid product, the X-ray image data being derived by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

b) processing the X-ray image data to derive information conveying a level of fill of the bottle;

c) determining the threat status of the liquid product at least in part based on the level of fill of the bottle;

d) releasing information conveying the determined threat status of the liquid product.

2. ) A method as defined in claim 1, wherein determining the threat status of liquid product comprises classifying the liquid product as a threat when the level of fill of the bottle is below a threshold level of fill.

3. ) A method as defined in claim 1, wherein said method comprises:

a) processing the X-ray image data to derive geometric information associated with the bottle;

b) processing the X-ray image data to derive location information associated with a meniscus formed by the liquid in the bottle;

c) deriving the level of fill of the bottle at least in part based on the location information associated with the meniscus and the geometric information associated with the bottle.

4. ) A method as defined in claim 3, wherein said method comprises:

a) extracting from the X-ray image data X-ray attenuation information; and

b) determining the threat status of the liquid product at least in part based on the attenuation information and the level of fill of the bottle.

5. ) A method as defined in claim 4, said method comprising:

a) deriving path length data at least in part based on the location information associated with the meniscus and the geometric information associated with the bottle, the path length data conveying an estimated length of a path followed by X-rays through the liquid held in the bottle;

b) processing the X-ray image data to determine the threat status of the liquid product based in part on;

i) the path length data and the X-ray attenuation information; and

ii) the level of fill of the bottle.

6. ) A method as defined in claim 1, wherein processing the X-ray image data to derive information conveying the level of fill of the bottle comprises locating a meniscus formed by the liquid in the bottle.

7. ) A method as defined in claim 6, wherein the step of locating the meniscus formed by the liquid in the bottle comprises:

a) processing the X-ray image data to derive geometric information associated with the bottle at least in part based on an angle made between a longitudinal axis of the bottle and a horizontal plane;

b) processing the X-ray image data to derive location information associated with a meniscus foamed by the liquid in the bottle at least in part based on the angle made between the longitudinal axis of the bottle and the horizontal plane.

8. ) A method as defined in claim 7, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is in the range from about 5 degrees to about 40 degrees.

9. ) A method as defined in claim 7, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is in the range from about 5 degrees to about 30 degrees.

10. ) A method as defined in claim 7, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is in the range from about 10 degrees to about 20 degrees.

11. ) A method as defined in claim 7, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is about 15 degrees.

12. ) A method as defined in claim 7, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is about 0 degrees.

13. ) A method as defined in claim 1, wherein the X-ray image data associated with the liquid product is obtained using a multi-view X-ray machine, said X-ray image data conveying a first X-ray image of the liquid product taken by subjecting the liquid product to X-rays in a first orientation and a second X-ray image of the liquid product taken by subjecting the liquid product to X-rays in a second orientation, said method comprising:

a) processing the X-ray image data corresponding to the first X-ray image of the liquid product to derive information conveying an estimated level of fill of the bottle;

b) processing the X-ray image data corresponding to the second X-ray image of the liquid product and the estimated level of fill of the bottle obtained based on the X-ray image data corresponding to the first X-ray image to derive an adjusted level of fill of the bottle;

c) determining the threat status of the liquid product at least in part based on the adjusted level of fill of the bottle;

d) releasing information conveying the determined threat status of liquid product.

14. ) A method as defined in claim 1, wherein the bottle has a cross-sectional shape selected from the set consisting of a generally circular shape, a generally elliptical shape, generally rectangular shape and a generally square shape.

39. ) A method as defined in claim 1, wherein processing the X-ray image data to derive information conveying the level of fill of the bottle includes simulating X-ray responses of a virtual model of the container for different candidate levels of fill.

40. ) A method as defined in claim 39, wherein processing the X-ray image data to derive information conveying the level of fill of the bottle includes selecting a candidate level of fill from the different candidate levels of fill, the selection being performed at least in part based on the simulated responses of the virtual model of the container and on the X-ray image data.

41. ) A method as defined in claim 40, wherein the selection is performed at least in part based on a comparison between the simulated responses of the virtual model of the container and the X-ray image data.

42. ) A method as defined in claim 39, wherein simulating X-ray responses of the virtual model of the container includes:

a) simulating a first X-ray response of the virtual model of the container for a first candidate level of fill;

b) simulating a second X-ray response of the virtual model of the container for a second candidate level of fill, the second level of fill being selected at least in part based on the first candidate level of fill and a comparison between the X-ray image data and the first simulated X-ray response.

15. ) A computer readable storage medium storing a program element suitable for execution by a computing apparatus for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said computing apparatus comprising:

a) a memory unit;

b) a processor operatively connected to said memory unit, said program element when executing on said processor being operative for;

i) receiving X-ray image data associated with the liquid product conveying an image of the liquid product, the X-ray image data being derived by performing an X-ray product using an X-ray imaging apparatus;

ii) processing the X ray image data to derive information conveying a level of fill of the bottle;

iii) determining the threat status of the liquid product at least in part based on the level of fill of the bottle;

iv) releasing information conveying the determined threat status of the liquid product.

16. ) An apparatus for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said apparatus comprising an input, a processing unit and an output, said apparatus comprising:

a) an input for receiving X-ray image data associated with the liquid product conveying an image of the liquid product, the X-ray image data being derived by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

b) a processor in communication with said input, said processing being programmed to;

i) process the X-ray image data to derive information conveying a level of fill of the bottle; and

ii) determine the threat status of the liquid product at least in part based on the level of fill of the bottle;

c) an output for releasing information conveying the determined threat status of the liquid product.

17. ) A system suitable for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said system comprising:

a) an inspection device for performing an X-ray inspection on the liquid product using penetrating radiation to generate an X-ray image of the liquid product;

b) an apparatus for assessing the threat status of the liquid product, said apparatus comprising;

i) an input for receiving X-ray image data associated with the liquid product conveying an image of the liquid product, the X-ray image data being derived by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

ii) a processor in communication with said input, said processing being programmed to;

(1) process the X-ray image data to derive information conveying a level of fill of the bottle; and

(2) determine the threat status of the liquid product at least in part based on the level of fill of the bottle;

iii) an output for releasing information conveying the determined threat status of the liquid product;

c) a display screen in communication with the output of said apparatus for visually conveying to an operator the assessed threat status of the liquid product based on information released by the apparatus.

18. ) A system as defined in claim 17, wherein the inspection device is a multi-view X-ray machine.

19. ) A system as defined in claim 17, wherein the inspection device is a single-view X-ray machine.

20. ) A method for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, the method comprising:

a) performing an X-ray scan of the liquid product using an X-ray imaging apparatus to obtain X-ray image data conveying an image of the liquid product;

b) processing the X-ray image data to derive information conveying a level of fill of the bottle;

c) determining the threat status of the liquid product at least in part based on the level of fill of the bottle;

d) releasing information conveying the determined threat status of liquid product.

21. ) A method as defined in claim 20, said method comprising:

a) placing the liquid product in a tray;

b) introducing the tray and the liquid product in a scanning area of the X-ray imaging apparatus.

22. ) A method as defined in claim 20, wherein the bottle holding the liquid has a top extremity and a bottom extremity, the method comprising positioning the bottle to induce a meniscus formed by the liquid in the bottle to migrate toward one of the extremities while performing the X-ray inspection of the liquid product.

23. ) A method as defined in claim 22, wherein the bottle holding the liquid has a longitudinal axis, the method comprising positioning the bottle so that the longitudinal axis makes an angle with respect to a horizontal plane in the range from about 5 degrees to about 40 degrees.

24. ) A method as defined in claim 22, wherein the bottle holding the liquid has a longitudinal axis, the method comprising positioning the bottle so that the longitudinal axis makes an angle with respect to a horizontal plane in the range from about 5 degrees to about 30 degrees.

25. ) A method as defined in claim 22, wherein the bottle holding the liquid has a longitudinal axis, the method comprising positioning the bottle so that the longitudinal axis makes an angle with respect to a horizontal plane in the range from about 10 degrees to about 20 degrees.

26. ) A method as defined in claim 22, wherein the bottle holding the liquid has a longitudinal axis, the method comprising positioning the bottle so that the longitudinal axis makes an angle with respect to a horizontal plane of about 15 degrees.

27. ) A method as defined in claim 21, wherein the bottle holding the liquid has a longitudinal axis, the method comprising positioning the bottle so that the longitudinal axis is directed substantially along a horizontal plane so that the longitudinal axis makes an angle with respect to a horizontal plane of about 0 degrees.

28. ) A method as defined in claim 22, wherein the step of locating the meniscus formed by the liquid in the bottle comprises:

a) processing the X-ray image data to derive geometric information associated with the bottle at least in part based on the angle made between the longitudinal axis of the bottle and the horizontal plane;

b) processing the X-ray image data to derive location information associated with a meniscus formed by the liquid in the bottle at least in part based on the angle made between the longitudinal axis of the bottle and the horizontal plane.

29. ) A method as defined in claim 28, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is pre-determined.

30. ) A method as defined in claim 29, said method comprising:

a) placing the liquid product in a tray, wherein the angle made between the longitudinal axis of the bottle and the horizontal plane is determined at least in part based on geometric characteristics of the tray;

b) introducing the tray and the liquid product in a scanning area of the X-ray imaging apparatus.

31. ) A method for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, the method comprising:

a) receiving X-ray image data associated with the liquid product, the X-ray image data being derived by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

b) processing the X-ray image data to derive location information associated with a meniscus formed by the liquid in the bottle;

c) processing the X-ray image data in combination with the location information associated with the meniscus formed by the liquid in the bottle to derive path length data, the path length data conveying an estimated length of a path followed by X-rays through the liquid held in the bottle;

d) processing the X-ray image data in combination with the path length data to determine the threat status of the liquid product.

e) releasing information conveying the determined threat status of the liquid product.

32. ) A method as defined in claim 31, wherein the X-ray image data associated with the liquid product is obtained using a multi-view X-ray machine, said X-ray image data conveying a first X-ray image of the liquid product taken by subjecting the liquid product to X-rays in a first orientation and a second X-ray image of the liquid product taken by subjecting the liquid product to X-rays in a second orientation, said method comprising:

a) processing the X-ray image data corresponding to the first X-ray image of the liquid product to derive estimated location information associated with the meniscus formed by the liquid in the bottle;

b) processing the X-ray image data corresponding to the second X-ray image of the liquid product and the estimated location information associated with the meniscus obtained based on the X-ray image data corresponding to the first X-ray image to derive adjusted location information associated with the meniscus;

c) deriving the path length data at least in part based on the adjusted location information associated with the meniscus formed by the liquid in the bottle.

43. ) A method as defined in claim 31, wherein processing the X-ray image data to derive location information associated with the meniscus formed by the liquid in the bottle includes simulating X-ray responses of a virtual model of the container for different meniscus locations.

44. ) A method as defined in claim 43, wherein processing the X-ray image data to derive location information associated with the meniscus formed by the liquid in the bottle includes selecting a candidate meniscus location from the different meniscus locations, the selection being performed at least in part based on the simulated responses of the virtual model of the container and on the X-ray image data.

45. ) A method as defined in claim 44, wherein the selection is performed at least in part based on a comparison between the simulated responses of the virtual model of the container and the X-ray image data.

46. ) A method as defined in claim 43, wherein simulating X-ray responses of the virtual model of the container includes:

a) simulating a first X-ray response of the virtual model of the container for a first candidate meniscus location;

b) simulating a second X-ray response of the virtual model of the container for a second candidate meniscus location, the second meniscus location being selected at least in part based on the first candidate meniscus location and a comparison between the X-ray image data and the first simulated X-ray response.

33. ) A computer readable storage medium storing a program element suitable for execution by a computing apparatus for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said computing apparatus comprising:

a) a memory unit;

b) a processor operatively connected to said memory unit, said program element when executing on said processor being operative for;

i) receiving X-ray image data associated with the liquid product, the X-ray image data being derived by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

ii) processing the X-ray image data to derive location information associated with a meniscus formed by the liquid in the bottle;

iii) processing the X-ray image data in combination with the location information associated with the meniscus formed by the liquid in the bottle to derive path length data, the path length data conveying an estimated length of a path followed by X-rays through the liquid held in the bottle;

iv) processing the X-ray image data in combination with the path length data to determine the threat status of the liquid product.

v) releasing information conveying the determined threat status of the liquid product.

34. ) An apparatus for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said apparatus comprising:

a) an input for receiving X-ray image data associated with the liquid product, the X-ray image data being derived by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

b) a processor in communication with said input, said processor being programmed for;

i) processing the X-ray image data to derive location information associated with a meniscus formed by the liquid in the bottle;

ii) processing the X-ray image data in combination with the location information associated with the meniscus formed by the liquid in the bottle to derive path length data, the path length data conveying an estimated length of a path followed by X-rays through the liquid held in the bottle;

iii) processing the X-ray image data in combination with the path length data to determine the threat status of the liquid product.

c) an output in communication with said processor for releasing information conveying the determined threat status of the liquid product.

35. ) A system suitable for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said system comprising:

a) an inspection device for performing an X-ray inspection on the liquid product using penetrating radiation to generate an X-ray image of the liquid product;

b) an apparatus for assessing the threat status of the liquid product, said apparatus having;

i) an input for receiving the X-ray image of the liquid product;

ii) a processor in communication with said input, said processor being programmed for;

(1) processing the X-ray image to derive location information associated with a meniscus formed by the liquid in the bottle;

(2) processing the X-ray image in combination with the location information associated with the meniscus formed by the liquid in the bottle to derive path length data the path length data conveying an estimated length of a path followed by X-rays through the liquid held in the bottle;

(3) processing the X-ray image in combination with the path length data to determine the threat status of the liquid product;

iii) an output in communication with said processor for releasing information conveying the determined threat status of the liquid product;

c) a display screen in communication with the output of said apparatus for visually conveying to an operator the assessed threat status of the liquid product based on information released by the apparatus.

36. ) A system as defined in claim 35, wherein the inspection device is a multi-view X-ray machine.

37. ) An apparatus for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, said apparatus comprising:

a) means for receiving X-ray image data associated with the liquid product, the X-ray image data being obtained by performing an X-ray scan of the liquid product using an X-ray imaging apparatus;

b) means for processing the X-ray image data to derive information conveying a level of fill of the bottle;

c) means for determining the threat status of the liquid product at least in part based on the level of fill of the bottle;

d) means for releasing information conveying the determined threat status of liquid product.

38. ) A method for assessing a threat status of a liquid product at a security checkpoint, the liquid product being comprised of a bottle holding a liquid, wherein the bottle is at least partially filled with liquid, the method comprising:

a) determining if the bottle holding the liquid has a level of fill below a threshold level of fill;

b) in response to the level of fill of the bottle falling below the threshold level of fill, rejecting the liquid product as a being a potential threat;

c) in response to the level of fill of the bottle being at least at the threshold level of fill, screening the liquid product using an X-ray machine to derive the threat status of the liquid product.