Method and apparatus for assessing the threat status of luggage

• US 9,157,873 B2
• Filed: 06/15/2010
• Issued: 10/13/2015
• Est. Priority Date: 06/15/2009
• Status: Expired due to Fees

• Current Assignee: Vanderlande Industries BV (VIVE BV)
• Original Assignee: Optosecurity Inc.
• Inventors: Gudmundson, Dan, Perron, Luc
• Primary Examiner(s): THIRUGNANAM, GANDHI
• Application Number:
  US13/377,872
• Publication Number:
  US 20120093367A1
• Time in Patent Office: 1,946 Days
• Field of Search: 382/103
• US Class Current: 1/1
• CPC Class Codes: G01N 2223/419 computed tomograph
• CPC Class Codes: G01N 2223/423 multispectral imaging-multiple energy imaging
• CPC Class Codes: G01N 23/046 using tomography, e.g. computed tomography [CT]
• CPC Class Codes: G01V 5/20 Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects

Abstract

A method and apparatus for assessing a threat status of a piece of luggage. The method comprises the steps of scanning the piece of luggage with penetrating radiation to generate image data and processing the image data with a computing device to identify one or more objects represented by the image data. The method also includes further processing the image data to compensate the image data for interaction between the object and the penetrating radiation to produce compensated image data and then determine the threat status of the piece of luggage.

Claims

1. A method for assessing a threat status of a piece of luggage, said method comprising:

a) receiving X-ray image data derived by scanning the piece of luggage with a scanning device using X-rays, the X-ray image data conveying information about an attenuation of X-rays resulting from X-rays travelling through the piece of luggage;

b) processing the X-ray image data with a computing device programmed with software for;

i) detecting an object in the piece of luggage;

ii) deriving an X-ray signature associated with the detected object, the derived X-ray signature associated with the detected object conveying an amount of X-ray attenuation attributed to the detected object, wherein the X-ray signature associated with the detected object is derived at least in part by processing a virtual model of the detected object to simulate interactions between the detected object and X-rays;

iii) deriving compensated X-ray image data at least in part by reducing in the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object based at least in part on the derived X-ray signature associated with the detected object;

iv) determining the threat status of the piece of luggage at least in part based on the compensated X-ray image data.

2. A method as defined in claim 1, wherein deriving the compensated X-ray image data includes extracting a priori information from a knowledge database about interactions between X-rays and the detected object.

3. A method as defined in claim 2, wherein deriving the compensated X-ray image data includes deriving the X-ray signature associated with the detected object at least in part based on the a priori information.

4. A method as defined in claim 1, wherein simulating interactions between the detected object and X-rays includes

generating the virtual model of the object.

5. A method as defined in claim 1, wherein detecting the object in the piece of luggage includes processing the X-ray image data to identify object characterization features.

6. A method as defined in claim 1, wherein detecting the object in the piece of luggage includes processing a user input signal conveying a location corresponding to the object in an image of the piece of luggage derived based on the X-ray image data.

7. A method as defined in claim 6, wherein said method comprises:

a) processing the X-ray image data to render the image of the piece of luggage on a display device;

b) providing a control for allowing a user to select the location corresponding to the object on the rendered image of the piece of luggage.

8. A method as defined in claim 1, wherein deriving the compensated X-ray image data includes:

a) identifying a portion of the X-ray image data corresponding to the detected object;

b) reducing in the identified portion of the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object based at least in part on the derived X-ray signature associated with the detected object.

9. A method as defined in claim 1, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image data to render an image of the piece of luggage on a display to assist an operator in determining if the piece of luggage contains prohibited objects.

10. A method as defined in claim 9, comprising providing a user activated control for transmitting command signals to the computing device, the computing device being responsive to the command signals to alter a degree to which the effects of object induced X-ray attenuation are reduced in the X-ray image data.

11. A method as defined in claim 9, wherein the image of the piece of luggage rendered on the display device includes an overlay image conveying a position of the detected object.

12. A method as defined in claim 1, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image data with an automated threat detection engine to determine if the piece of luggage contains prohibited objects.

13. A method as defined in claim 1, wherein the detected object includes a laptop computer.

14. A method as defined in claim 1, wherein the detected object includes an electronic device.

15. A method as defined in claim 1, wherein the detected object includes a handle bar.

16. A system for assessing a threat status of a piece of luggage, comprising:

a) an X-ray scanner for scanning the piece of luggage with X-rays to derive X-ray image data, the X-ray data conveying information about an attenuation of X-rays resulting from X-rays travelling through the piece of luggage;

b) a computing system including at least one processor, the computing system being in communication with said X-ray scanner and being programmed with software for;

i) processing the X-ray image data to detect an object in the piece of luggage;

ii) deriving an X-ray signature associated with the detected object, the derived X-ray signature associated with the detected object conveying an amount of X-ray attenuation attributed to the detected object, wherein the X-ray signature associated with the detected object is derived at least in part by processing a virtual model of the detected object to simulate interactions between the detected object and X-rays;

iii) processing the X-ray image data to derive compensated X-ray image data at least in part by reducing in the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object, the compensated X-ray image data being derived at least in part based on the derived X-ray signature associated with the detected object;

iv) deriving information for use in determining the threat status of the piece of luggage at least in part by processing the compensated X-ray image data;

c) a display module in communication with said computing system for conveying information derived by said at least one processor.

28. A system as defined in claim 16, wherein simulating interactions between the detected object and X-rays includes generating the virtual model of the object.

29. A system as defined in claim 16, wherein detecting the object in the piece of luggage includes processing the X-ray image data to identify object characterization features.

30. A system as defined in claim 16, wherein detecting the object in the piece of luggage includes processing a user input signal conveying a location corresponding to the object in an image of the piece of luggage derived based on the X-ray image data.

31. A system as defined in claim 16, wherein the computing system is programmed with software for:

a) processing the X-ray image data to render the image of the piece of luggage on a display device;

b) providing a control for allowing a user to select the location corresponding to the object on the rendered image of the piece of luggage.

32. A system as defined in claim 16, wherein deriving the compensated X-ray image data includes:

a) identifying a portion of the X-ray image data corresponding to the detected object;

b) reducing in the identified portion of the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object based at least in part on the derived X-ray signature associated with the detected object.

33. A system as defined in claim 16, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image data to render an image of the piece of luggage on a display to assist an operator in determining if the piece of luggage contains prohibited objects.

34. A system as defined in claim 33, wherein the computing system is programmed with software for providing a user activated control for transmitting command signals to the computing device, the computing device being responsive to the command signals to alter a degree to which the effects of object induced X-ray attenuation are reduced in the X-ray image data.

35. A system as defined in claim 34, wherein the image of the piece of luggage rendered on the display device includes an overlay image conveying a position of the detected object.

36. A system as defined in claim 16, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image data with an automated threat detection engine to determine if the piece of luggage contains prohibited objects.

37. A system as defined in claim 16, wherein the detected object includes any one of a laptop computer, an electronic device and a handle bar.

17. An apparatus for assessing a threat status of a piece of luggage, the apparatus comprising:

a) an input for received X-ray image data derived by scanning the piece of luggage with an X-ray scanner, the X-ray data conveying information about an attenuation of X-rays resulting from X-rays travelling through the piece of luggage;

b) a computing device including at least one processor, said computing device being in communication with said input and being programmed for;

i) processing the X-ray image data to detect an object in the piece of luggage;

ii) deriving an X-ray signature associated with the detected object, the derived X-ray signature associated with the detected object conveying an amount of X-ray attenuation attributed to the detected object, wherein the X-ray signature associated with the detected object is derived at least in part by processing a virtual model of the detected object to simulate interactions between the detected object and X-rays;

iii) processing the X-ray image data to derive compensated X-ray image data at least in part by reducing in the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object, the compensated X-ray image data being derived at least in part based on the derived X-ray signature associated with the detected object;

iv) deriving information for use in determining the threat status of the piece of luggage at least in part by processing the compensated X-ray image data;

c) an output for releasing data conveying results obtained by the computing device.

18. A non-transitory computer readable storage medium storing a program element for execution by a computing device for assessing a threat status of a piece of luggage, the program element, when executed by the computing device, causing the execution of a method by the computing device comprising:

i) receiving X-ray image data derived by scanning the piece of luggage with a scanning device using X-rays, the X-ray image data conveying information about an attenuation of X-rays resulting from X-rays travelling through the piece of luggage;

ii) processing the X-ray image data to detect an object in the piece of luggage;

iii) deriving an X-ray signature associated with the detected object, the derived X-ray signature associated with the detected object conveying, an amount of X-ray attenuation attributed to the detected object, wherein the X-ray signature associated with the detected object is derived at least in part by processing a virtual model of the detected object to simulate interactions between the detected object and X-rays;

iv) processing the X-ray image data to derive compensated X-ray image data at least in part by reducing in the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object, the compensated X-ray image data being derived at least in part based on the derived X-ray signature associated with the detected object;

v) deriving information for use in determining the threat status of the piece of luggage at least in part by processing the compensated X-ray image data.

38. A non-transitory computer readable storage medium as defined in claim 18, wherein simulating interactions between the detected object and X-rays includes generating the virtual model of the object.

39. A non-transitory computer readable storage medium as defined in claim 18, wherein detecting the object in the piece of luggage includes processing the X-ray image data to identify object characterization features.

40. A non-transitory computer readable storage medium as defined in claim 18, wherein detecting the object in the piece of luggage includes processing a user input signal conveying a location corresponding to the object in an image of the piece of luggage derived based on the X-ray image data.

41. A non-transitory computer readable storage medium as defined in claim 18, wherein deriving information for use in determining the threat status of the piece of luggage includes:

a) processing the X-ray image data to render the image of the piece of luggage on a display device;

b) providing a control for allowing a user to select the location corresponding to the object on the rendered image of the piece of luggage.

42. A non-transitory computer readable storage medium as defined in claim 18, wherein deriving the compensated X-ray image data includes:

a) identifying a portion of the X-ray image data corresponding to the detected object;

b) reducing in the identified portion of the X-ray image data effects of object induced X-ray attenuation resulting from X-rays travelling through the detected object based at least in part on the derived X-ray signature associated with the detected object.

43. A non-transitory computer readable storage medium as defined in claim 18, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image data to render an image of the piece of luggage on a display to assist an operator in determining if the piece of luggage contains prohibited objects.

44. A non-transitory computer readable storage medium as defined in claim 43, wherein the method caused to be executed by the computing device comprises providing a user activated control for transmitting command signals to the computing device, the computing device being responsive to the command signals to alter a degree to which the effects of object induced X-ray attenuation are reduced in the X-ray image data.

45. A non-transitory computer readable storage medium as defined in claim 44, wherein the image of the piece of luggage rendered on the display device includes an overlay image conveying a position of the detected object.

46. A non-transitory computer readable storage medium as defined in claim 18, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image data with an automated threat detection engine to determine if the piece of luggage contains prohibited objects.

19. A method for assessing a threat status of a piece of luggage, said method comprising:

a) processing an X-ray image of the piece of luggage to detect a depiction of an object held in the piece of luggage;

b) deriving an X-ray signature associated with the object whose depiction was detected in the X-ray image of the piece of luggage, the X-ray signature conveying an amount of X-ray attenuation attributed to X-rays travelling through the object, wherein the amount of X-ray attenuation attributed to X-rays travelling through the object is derived at least in part by processing a virtual model of the object to simulate interactions between the object and X-rays;

c) processing the X-ray image to derive a compensated X-ray image of the piece of luggage by removing from the X-ray image at least part of the depiction of the object, the compensated X-ray image data being derived at least in part by compensating the X-ray image based on the derived amount of X-ray attenuation attributed to X-rays travelling through the object whose depiction was detected;

d) determining the threat status of the piece of luggage at least in part based on the compensated X-ray image of the piece of luggage.

20. A method as defined in claim 19, wherein determining the threat status of the piece of luggage includes rendering the compensated X-ray image of the piece of luggage on a display to assist an operator in determining if the piece of luggage contains prohibited objects.

21. A method as defined in claim 19, wherein determining the threat status of the piece of luggage includes processing the compensated X-ray image of the piece of luggage with an automated threat detection engine to determine if the piece of luggage contains prohibited objects.

22. A method as defined in claim 19, wherein removing from the X-ray image at least part of the depiction of the object includes generating the virtual model of the object.

23. A method as defined in claim 19, wherein the object includes a laptop computer.

24. A method as defined in claim 19, wherein the object whose depiction was detected in the X-ray image of the piece of luggage includes an electronic device.

25. A method as defined in claim 19, wherein the object whose depiction was detected in the X-ray image of the piece of luggage includes a handle bar.

26. A system for assessing a threat status of a piece of luggage, the system comprising:

a) an X-ray scanner for scanning the piece of luggage with X-rays to derive an X-ray image of the piece of luggage, the X-ray image of the piece of luggage conveying information about an attenuation of X-rays resulting from X-rays travelling through the piece of luggage;

b) a computing system including at least one processor, said computing system being in communication with said X-ray scanner and being programmed with software for;

i) processing the X-ray image of the piece of luggage to detect a depiction of an object held in the piece of luggage;

ii) deriving an X-ray signature associated with the object whose depiction was detected in the X-ray image of the piece of luggage, the X-ray signature conveying an amount of X-ray attenuation attributed to X-rays travelling through the object, wherein the amount of X-ray attenuation attributed to X-rays travelling through the object is derived at least in part by processing a virtual model of the object to simulate interactions between the object and X-rays;

iii) processing the X-ray image of the piece of luggage to derive a compensated X-ray image of the piece of luggage by removing from the X-ray image of the piece of luggage at least part of the depiction of the object, the compensated X-ray image data being derived at least in part by compensating the X-ray image based on the derived amount of X-ray attenuation attributed to X-rays travelling through the object whose depiction was detected;

iv) deriving information for use in determining the threat status of the piece of luggage at least in part by processing the compensated X-ray image of the piece of luggage;

c) an output for releasing data conveying results obtained by the computing system.

47. A system as defined in claim 26, wherein said system includes a display device in communication with said output and wherein the data conveying results obtained by the computing system released at said output causes said display device to render the compensated X-ray image of the piece of luggage to assist an operator in determining if the piece of luggage contains prohibited objects.

48. A system as defined in claim 26, wherein deriving information for use in determining the threat status of the piece of luggage includes processing the compensated X-ray image of the piece of luggage with an automated threat detection engine to determine if the piece of luggage contains prohibited objects.

49. A system as defined in claim 26, wherein removing from the X-ray image at least part of the depiction of the object includes generating the virtual model of the object.

50. A system as defined in claim 26, wherein the object whose depiction was detected in the X-ray image of the piece of luggage includes any one of a laptop computer, an electronic device and handle bar.

27. A non-transitory computer readable storage medium storing a program element for execution by a computing device for assessing a threat status of a piece of luggage, the program element, when executed by the computing device, causing the execution of a method by the computing device comprising:

a) processing an X-ray image of the piece of luggage to detect a depiction of an object held in the piece of luggage;

b) deriving an X-ray signature associated with the object whose depiction was detected in the X-ray image of the piece of luggage, the X-ray signature conveying an amount of X-ray attenuation attributed to X-rays travelling through the object, wherein the amount of X-ray attenuation attributed to X-rays travelling through the object is derived at least in part by processing a virtual model of the object to simulate interactions between the object and X-rays;

c) processing the X-ray image to derive a compensated X-ray image of the piece of luggage by removing from the X-ray image at least part of the depiction of the object, the compensated X-ray image data being derived at least in part by compensating the X-ray image based on the derived amount of X-ray attenuation attributed to X-rays travelling through the object whose depiction was detected;

d) deriving information for use in determining the threat status of the piece of luggage at least in part by processing the compensated X-ray image of the piece of luggage.

51. A non-transitory computer readable storage medium as defined in claim 27, wherein deriving information for use in determining the threat status of the piece of luggage includes processing the compensated X-ray image of the piece of luggage with an automated threat detection engine to determine if the piece of luggage contains prohibited objects.

52. A non-transitory computer readable storage medium as defined in claim 27, wherein removing from the X-ray image at least part of the depiction of the object includes generating the virtual model of the object.