Distributed analysis x-ray inspection methods and systems

• US 10,509,142 B2
• Filed: 01/15/2019
• Issued: 12/17/2019
• Est. Priority Date: 09/07/2011
• Status: Active Grant

• Current Assignee: Rapiscan Systems Incorporated (OSI Systems Incorporated)
• Original Assignee: Rapiscan Systems Incorporated (OSI Systems Incorporated)
• Inventors: Parikh, Shehul Sailesh, Sankaranarayanan, Balamurugan, Abel, Jeffrey Bryan, Kumar, Siva, Bendahan, Joseph
• Primary Examiner(s): Harandi, Siamak
• Application Number:
  US16/248,547
• Publication Number:
  US 20190162873A1
• Time in Patent Office: 336 Days
• CPC Class Codes: G01V 5/22 Active interrogation, i.e. by irradiating objects or goods using external radiation sources, e.g. using gamma rays or cosmic rays
• CPC Class Codes: G01V 5/271 using a network, e.g. a remote expert, accessing remote data or the like
• CPC Class Codes: G06Q 10/0838 Historical data
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/30248 Vehicle exterior or interior
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G08B 13/194 using image scanning and comparing systems

Abstract

The present specification discloses systems and methods for integrating manifest data for cargo and light vehicles with their X-ray images generated during scanning. Manifest data is automatically imported into the system for each shipment, and helps the security personnel to quickly determine the contents of cargo. In case of a mismatch between cargo contents shown by manifest data and the X-ray images, the cargo may be withheld for further inspection. In one embodiment, the process of analyzing the X-ray image of the cargo in conjunction with the manifest data is automated.

Claims

1. A method for inspecting cargo, wherein the cargo is associated with descriptive information about the cargo, comprising:

scanning the cargo, at a first location, wherein the first location comprises;

at least one X-ray inspection system for performing an X-ray scan, wherein the at least one X-ray inspection system is configured to generate data representative of one or more X-ray scan images from the X-ray scan;

a server configured to receive the data representative of the one or more X-ray scan images;

transmitting, using the server at the first location, at least a portion of the data representative of the X-ray scan images to a second location remote from the first location, wherein the second location comprises at least one computing device that is in communication with said first location via a network;

receiving, at the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images;

receiving, at the at least one computing device at the second location, data representative of the descriptive information about the cargo;

determining two or more cargo codes using the descriptive information about the cargo;

analyzing, using the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images to determine whether the cargo sufficiently corresponds to the descriptive information about the cargo; and

generating, using the at least one computing device at the second location, a status based on whether the cargo sufficiently corresponds to the descriptive information about the cargo.

2. The method of claim 1, further comprising routing, using the server, the at least a portion of the data representative of the one or more X-ray scan images to the at least one computing device at the second location based on metadata associated with the one or more X-ray scan images.

3. The method of claim 2, wherein the metadata comprises at least one of an inspection queue length or a contention time.

4. The method of claim 1, further comprising receiving, at the at least one computing device at the second location, electronic shipping data, wherein the electronic shipping data comprises the descriptive information about the cargo.

5. The method of claim 1, further comprising determining a plurality of features using the two or more cargo codes.

6. The method of claim 1, further comprising acquiring one or more images stored from an image database, wherein the one or more stored images are representative of the descriptive information about the cargo.

7. The method of claim 6, further comprising acquiring one or more features from the one or more stored images.

8. The method of claim 7, further comprising comparing the one or more features from the one or more stored images to one or more features of the one or more X-ray scan images to determine the probability that the cargo sufficiently corresponds to the descriptive information about the cargo.

9. The method of claim 7, wherein the one or more features from the one or more stored images comprises at least one of attenuation, texture, cargo height, density or atomic number.

10. The method of claim 1, further comprising communicating the status to a computing device at the first location.

11. The method of claim 1, further comprising receiving, at the server at the first location, manifest data, wherein the manifest data comprises the descriptive information about the cargo and transmitting, using the server at the first location, data indicative of the manifest data to the at least one computing device at the second location.

12. The method of claim 1, further comprising associating, using the server at the first location, a unique identifier with each of the one or more X-ray scan images.

13. The method of claim 12, further comprising storing each of the one or more X-ray scan images, the associated unique identifiers, manifest data, and the status in a database.

14. The method of claim 1, further comprising segregating the one or more X-ray scan images into one or more segmented parts based on the two or more cargo codes.

15. The method of claim 14, further comprising comparing each of the one or more segregated parts to images stored in a database, wherein the images are representative of the descriptive information about the cargo.

16. The method of claim 1, further comprising, at the second location, randomly assigning the one or more X-ray scan images for review to an operator workstation.

17. The method of claim 1, further comprising concurrently displaying, at the second location, an identifier of the cargo, a scan start time, a scan end time, and an output.

18. The method of claim 17, wherein the output is visually coded to differentially indicate whether the cargo is cleared, requires manual inspection, or is being analyzed.

19. A method for inspecting cargo, wherein the cargo is associated with descriptive information about the cargo, comprising:

scanning the cargo, at a first location, wherein the first location comprises;

at least one X-ray inspection system for performing an X-ray scan, wherein the at least one X-ray inspection system is configured to generate data representative of one or more X-ray scan images from the X-ray scan;

a server configured to receive the data representative of the one or more X-ray scan images;

transmitting, using the server at the first location, at least a portion of the data representative of the X-ray scan images to a second location remote from the first location, wherein the second location comprises at least one computing device that is in communication with said first location via a network;

receiving, at the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images;

receiving, at the at least one computing device at the second location, data representative of the descriptive information about the cargo;

using the at least one computing device at the second location, applying a threat detection process, wherein the threat detection process is adapted to generate a first map configured to mask background attenuation in at least a portion of the one or more X-ray scan images;

analyzing, using the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images to determine whether the cargo sufficiently corresponds to the descriptive information about the cargo; and

generating, using the at least one computing device at the second location, a status based on whether the cargo sufficiently corresponds to the descriptive information about the cargo.

20. The method of claim 19, wherein the threat detection process is further adapted to generate a second map configured to highlight regions in the one or more X-ray scan images that represent potential threats.

21. A method for inspecting cargo, wherein the cargo is associated with descriptive information about the cargo, comprising:

scanning the cargo, at a first location, wherein the first location comprises;

at least one X-ray inspection system for performing an X-ray scan, wherein the at least one X-ray inspection system is configured to generate data representative of one or more X-ray scan images from the X-ray scan;

a server configured to receive the data representative of the one or more X-ray scan images;

transmitting, using the server at the first location, at least a portion of the data representative of the X-ray scan images to a second location remote from the first location, wherein the second location comprises at least one computing device that is in communication with said first location via a network;

routing, using the server, the at least the portion of the data representative of the one or more X-ray scan images to the at least one computing device at the second location based on an inspection queue length and a contention time;

receiving, at the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images;

receiving, at the at least one computing device at the second location, data representative of the descriptive information about the cargo;

analyzing, using the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images to determine whether the cargo sufficiently corresponds to the descriptive information about the cargo; and

generating, using the at least one computing device at the second location, a status based on whether the cargo sufficiently corresponds to the descriptive information about the cargo.

22. A method for inspecting cargo, wherein the cargo is associated with descriptive information about the cargo, comprising:

scanning the cargo, at a first location, wherein the first location comprises;

at least one X-ray inspection system for performing an X-ray scan, wherein the at least one X-ray inspection system is configured to generate data representative of one or more X-ray scan images from the X-ray scan;

a server configured to receive the data representative of the one or more X-ray scan images;

transmitting, using the server at the first location, at least a portion of the data representative of the X-ray scan images to a second location remote from the first location, wherein the second location comprises at least one computing device that is in communication with said first location via a network;

receiving, at the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images;

receiving, at the at least one computing device at the second location, data representative of the descriptive information about the cargo;

using the at least one computing device at the second location, generating a first map configured to mask background attenuation in at least a portion of the one or more X-ray scan images and a second map configured to highlight regions in the one or more X-ray scan images that represent potential threats;

analyzing, using the at least one computing device at the second location, the at least a portion of the data representative of the one or more X-ray scan images to determine whether the cargo sufficiently corresponds to the descriptive information about the cargo; and

generating, using the at least one computing device at the second location, a status based on whether the cargo sufficiently corresponds to the descriptive information about the cargo.

23. The method of claim 22, further comprising associating, using the server at the first location, a unique identifier with each of the one or more X-ray scan images and storing each of the one or more X-ray scan images, the associated unique identifiers, and the status a database.

24. The method of claim 22, further comprising using manifest data associated with the cargo to acquire one or more stored images from an image database, wherein the manifest data is indicative of the descriptive information about the cargo.

25. The method of claim 24, further comprising acquiring one or more features from the one or more stored images and comparing the one or more features to one or more features of the one or more X-ray scan images to determine the probability that the cargo corresponds to the descriptive information about the cargo.

26. The method of claim 25, wherein the one or more features from the one or more stored images comprises at least one of attenuation, texture, cargo height, density and atomic number.

27. The method of claim 22, further comprising using electronic shipping data associated with the cargo to acquire one or more stored images from an image database, acquiring one or more features from the one or more stored images, and wherein the analyzing comprises comparing the one or more features acquired from the one or more stored images to one or more features of the one or more X-ray scan images.

28. The method of claim 22, further comprising segregating the one or more X-ray scan images into one or more segmented parts based on one or more cargo codes.

29. The method of claim 28, further comprising comparing each of the one or more segregated parts to images stored in a database, wherein the images are representative of the descriptive information about the cargo.

30. The method of claim 22, further comprising, at the second location, randomly assigning the one or more X-ray scan images for review to an operator workstation.