Systems and methods for generating projection images

• US 10,380,727 B2
• Filed: 08/18/2016
• Issued: 08/13/2019
• Est. Priority Date: 05/06/2016
• Status: Active Grant

• Current Assignee: Leidos Security Detection & Automation Incorporated (Leidos Holdings, Inc.)
• Original Assignee: L-3 Communications Security & Detection Systems, Inc. (Leidos Holdings, Inc.)
• Inventors: Foland, Andrew D., Smith, Andrew David, Wright, Justin L., Baker, Brian Joel
• Primary Examiner(s): Goradia, Shefali D
• Application Number:
  US15/240,688
• Publication Number:
  US 20170323436A1
• Time in Patent Office: 1,090 Days
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 2207/20216 Image averaging
• CPC Class Codes: G06T 2207/30112 Baggage; Luggage; Suitcase
• CPC Class Codes: G06T 2210/12 Bounding box
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation

Abstract

Systems, methods, and non-transitory computer-readable media taught herein process a subset of a three-dimensional array of voxels to form an image of a region of interest in an object. Images thus formed are clear, comprehensible, and contextual. The systems, methods, and non-transitory computer-readable media taught herein select the subset of voxels that represent the region of interest along a direction perpendicular to a view direction defined by the region of interest. The subset of voxels represents one or more portions of a plurality of image slices of the object.

Claims

1. A method of forming an image of an object, comprising:

receiving, using at least one processing unit, a three-dimensional array of voxels representing an object;

selecting, using the at least one processing unit, a subset of voxels from the array representing a region of interest (ROI) of the object, the subset of voxels representing one or more portions of a plurality of image slices of the object, the subset of voxels selected along a direction perpendicular to a view direction defined by the region of interest; and

forming an image of the ROI by processing the subset of voxels to at least sum data of the object included in the subset of voxels along the view direction.

2. The method of claim 1, further comprising rendering, using a graphic unit, the image of the ROI.

3. The method of claim 1, further comprising processing the image of the ROI using a computing device with a detection algorithm to detect a contraband item within the object.

4. The method of claim 1, wherein the array of voxels includes data of the object generated from measurement data obtained using a tomographic imaging technique.

5. The method of claim 1, wherein processing the subset of voxels to form the image of the ROI further includes averaging data of the object included in the subset of voxels along the view direction.

6. The method of claim 1, wherein processing the subset of voxels to form the image of the ROI includes:

summing data of the object excluded from the subset of voxels along the view direction to create a first two-dimensional dataset;

summing data of the object from all voxels along the view direction to create a second two-dimensional dataset; and

subtracting the first two-dimensional dataset from the second two-dimensional dataset.

7. The method of claim 1, wherein processing the subset of voxels to form the image of the ROI includes:

summing data of the object excluded from the subset of voxels along the view direction to create a first two-dimensional dataset;

receiving a second two-dimensional dataset generated from measurement data obtained from x-rays detected by a detector that pass through the object as it moves along a direction of transport;

subtracting the first two-dimensional dataset from the second two-dimensional dataset.

8. The method of claim 7, further comprising resampling the three-dimensional array of voxels from an orthographic coordinate system to a perspective coordinate system aligned with the view direction.

9. The method of claim 1, wherein a dimension of a voxel in the subset of voxels represents between 0.1 mm and 5 mm.

10. The method of claim 1, wherein the plurality of image slices of the object are all contiguous.

11. The method of claim 1, wherein the subset of voxels is a first subset of voxels and the ROI is a first ROI.

12. The method of claim 11, further comprising:

selecting, using the at least one processing unit, a second subset of voxels from the array representing a second region of interest (ROI) of the object, the second subset of voxels representing one or more portions of a second plurality of image slices of the object, the second subset of voxels selected along a direction perpendicular to a view direction defined by the second ROI; and

forming an image of the second ROI by processing the second subset of voxels.

13. The method of claim 12, wherein at least one voxel of the first subset of voxels is also included in the second subset of voxels.

14. The method of claim 13, wherein at least 50% of the voxels included in the first subset of voxels are also included in the second subset of voxels.

15. The method of claim 12, further comprising rendering, using a graphic unit, the image of the first ROI and the image of the second ROI on a display according to a user control.

16. The method of claim 15, wherein the image of the first ROI and the image of the second ROI are rendered at the same time.

17. The method of claim 15, wherein the image of the first ROI and the image of the second ROI are rendered at different times.

18. The method of claim 15, wherein the user control is rendered on a graphical user interface (GUI).

19. The method of claim 18, wherein the user control is any of a slider bar, a button, a gesture element responsive to a gesture, or a mouse control element.

20. The method of claim 1, wherein the view direction is selected by a user.

21. The method of claim 1, wherein a location of the region of interest is selected by a user.

22. The method of claim 1, further comprising rotating coordinate axes of the three-dimensional array of voxels to align with the view direction.

23. The method of claim 1, further comprising:

determining an image slice that denotes an edge of the object; and

excluding voxels beyond that slice from the subset of voxels.

24. The method of claim 23, wherein determining the image slice that denotes the edge of the object includes determining a slice at the edge of a sub-volume of the array of voxels that encompasses between 99% and 100% of a total sum of the data in the three-dimensional array of voxels.

25. The method of claim 1, further comprising:

receiving a tagged region within the image of the ROI corresponding to an item of interest; and

rendering, using the graphic unit, an image of the tagged region.

26. The method of claim 25, wherein the tagged region is identified by a user by dragging a bounding box to define the tagged region.

27. The method of claim 1, further comprising:

receiving a tagged region within the image of the ROI corresponding to an item of interest; and

saving, in a memory, data related to the location of the tagged region within the object.

28. The method of claim 27, wherein the tagged region is identified by a user by dragging a bounding box to define the tagged region.

29. An imaging system, comprising:

an imaging apparatus to acquire measurement data of an object; and

a programmable processing unit having a central processing unit, communicatively coupled to a memory, wherein upon execution of processor-executable instructions, the programmable processing unit operates to;

receive a three-dimensional array of voxels representing the object;

select a subset of voxels from the array representing a region of interest (ROI) of the object, the subset of voxels representing a subset of one or more portions of a plurality of image slices of the object, the subset of voxels selected along a direction perpendicular to a view direction defined by the ROI; and

form an image of the ROI by processing the subset of voxels to at least sum data of the object included in the subset of voxels along the view direction.

30. The imaging system of claim 29, wherein the programmable processing unit further executes instructions to render, using a graphic unit, the image of the ROI.

31. The imaging system of claim 29, wherein the programmable processing unit executes instructions to process the image of the ROI to detect a contraband item within the object of interest.

32. The imaging system of claim 29, wherein the imaging apparatus generates measurement data using a tomographic imaging technique.

33. The imaging system of claim 32, wherein the imaging apparatus includes an x-ray source to irradiate at least a portion of an object with a beam of x-ray radiation and a detector array to detect measurement data indicative of an interaction of x-rays with at least the portion of the object.

34. The imaging system of claim 33, wherein the programmable processing unit generates the three-dimensional array of voxels representing the object by applying a direct reconstruction technique, an iterative reconstruction technique, or both techniques to the measurement data.

35. The imaging system of claim 29, wherein the programmable processing unit receives the three-dimensional array of voxels from a memory.

36. The imaging system of claim 29, wherein processing the subset of voxels to form the image of the ROI further includes averaging data of the object included in the subset of voxels along the view direction.

37. The imaging system of claim 29, wherein processing the subset of voxels to form the image of the ROI includes:

summing data of the object excluded from the subset of voxels along the view direction to create a first two-dimensional dataset;

summing data of the object excluded from all voxels along the view direction to create a second two-dimensional dataset; and

subtracting the first two-dimensional dataset from the second two-dimensional dataset.

38. The imaging system of claim 29, wherein processing the subset of voxels to form the image of the ROI includes:

summing data of the object excluded from the subset of voxels along the view direction to create a first two-dimensional dataset;

receiving a second two-dimensional dataset generated from measurement data obtained from x-rays detected by a detector that pass through the object as it moves along a direction of transport;

subtracting the first two-dimensional dataset from the second two-dimensional dataset.

39. The imaging system of claim 38, wherein the programmable processing unit further operates to resample the three-dimensional array of voxels from an orthographic coordinate system to a perspective coordinate system aligned with the view direction.

40. The imaging system of claim 29, wherein a dimension of a voxel in the subset of voxels represents between 0.1 mm and 5 mm.

41. The imaging system of claim 29, wherein the plurality of image slices of the object are all contiguous.

42. The imaging system of claim 29, wherein the subset of voxels is a first subset of voxels and the ROI is a first ROI.

43. The imaging system of claim 42, wherein the programmable processing unit further executes instructions:

select, using the at least one processing unit, a second subset of voxels from the array representing a second region of interest (ROI) of the object, the second subset of voxels representing a subset of one or more portions of a plurality of image slices of the object, the second subset of voxels selected along a direction perpendicular to a view direction defined by the second ROI; and

form an image of the second ROI by processing the second subset of voxels.

44. The imaging system of claim 43, wherein at least one voxel of the first subset of voxels is also included in the second subset of voxels.

45. The imaging system of claim 44, wherein at least 50% of the voxels included in the first subset of voxels are also included in the second subset of voxels.

46. The imaging system of claim 43, wherein the programmable processing unit further operates to render, using a graphic unit, the image of the first ROI and the image of the second ROI on a display according to a user control.

47. The imaging system of claim 46, wherein the image of the first ROI and the image of the second ROI are rendered at the same time.

48. The imaging system of claim 46, wherein the image of the first ROI and the image of the second ROI are rendered at different times.

49. The imaging system of claim 46, wherein the user control is rendered on a graphical user interface (GUI).

50. The imaging system of claim 49, wherein the user control comprises any of a slider bar, a button, a gesture element responsive to a gesture, or a mouse control element.

51. The imaging system of claim 29, wherein the view direction is selected by a user.

52. The imaging system of claim 29, wherein a location of the region of interest is selected by a user.

53. The imaging system of claim 29, wherein the programmable processing unit further operates to rotate coordinate axes of the three-dimensional array of voxels to align with the view direction.

54. The imaging system of claim 29, wherein the programmable processing unit further operates to determine an image slice that denotes an edge of the object and excluding voxels beyond that slice from the subset of voxels.

55. The imaging system of claim 54, wherein determining the image slice that denotes the edge of the object includes determining a slice at the edge of a sub-volume of the array of voxels that encompasses between 99% and 100% of a total sum of the data in the three-dimensional array of voxels.

56. The imaging system of claim 29, wherein the programmable processing unit further operates to:

receive a tagged region within the image of the ROI corresponding to an item of interest; and

render, using the graphic unit, an image of the tagged region.

57. The method of claim 56, wherein the tagged region is identified by a user by dragging a bounding box to define the tagged region.

58. The imaging system of claim 29, wherein the programmable processing unit further operates to:

receive a tagged region within the image of the ROI corresponding to an item of interest; and

save, in a memory, data related to the location of tagged region within the object.

59. The imaging system of claim 58, wherein the tagged region is identified by a user by dragging a bounding box to define the tagged region.

60. A computer-implemented method comprising:

rendering, on a display, a graphical user interface (GUI) window to display an image of an object;

receiving, via one or more graphical user interface elements of the GUI, an identification of a region of interest in the object;

in response to the identification of the region of interest, processing a subset of voxels from a three-dimensional array of voxels representing the object to form an image of the ROI by at least summing data of the object included in the subset of voxels along the view direction, the subset of voxels representing one or more portions of a plurality of image slices of the object, the subset of voxels selected along a direction perpendicular to a view direction defined by the region of interest;

rendering the image of the ROI in the GUI window; and

receiving input via the GUI to manipulate the image of the ROI.

61. The computer-implemented method of claim 60, wherein the one or more graphical user interface elements comprise any of slider bars, a button, a gesture element responsive to a gesture, or a mouse control element.

62. The computer-implemented method of claim 60, wherein one of one or more graphical user interface elements of the GUI allows a user to select a dimension of the region of interest.

63. The computer-implemented method of claim 60, further comprising:

receiving, via the GUI, input to tag a region within the image of the ROI corresponding to an item of interest; and

rendering, an image of the tagged region in the GUI window.

64. The computer-implemented method of claim 63, wherein the tagged region is identified by a user by dragging a bounding box to define the tagged region.

65. The computer-implemented method of claim 60, further comprising:

receiving, via the GUI, input to tag a region within the image of the ROI corresponding to an item of interest; and

saving, in a memory, data related to the location of the tagged region within the object.

66. The computer-implemented method of claim 65, wherein the tagged region is identified by a user by dragging a bounding box to define the tagged region.