Method and apparatus for acquiring images from a multiple axis imaging system

• US 20040051030A1
• Filed: 09/17/2002
• Published: 03/18/2004
• Est. Priority Date: 09/17/2002
• Status: Abandoned Application

• Current Assignee: DMetrix, Inc.
• Original Assignee: DMetrix, Inc.
• Inventors: Bardak, Ibrahim, Olszak, Artur, Goodall, James
• Application Number:
  US10/245,740
• Publication Number:
  US 20040051030A1
• Time in Patent Office: Days
• US Class Current: 250/208.1
• CPC Class Codes: G02B 21/002 Scanning microscopes scanning near field optical microscopes G01Q60/18
• CPC Class Codes: G02B 21/367 providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
• CPC Class Codes: G06T 1/0007 Image acquisition

Abstract

A method and apparatus for acquiring images from a multiple axis imaging system. A data processing device is provided for receiving image data as it is read out of an imaging array, reorganizing the data, and otherwise processing it, for storage or in memory or transmission for display. The imaging system scans an object with an array of imaging elements having corresponding detectors for capturing the images. The data processing device reorganizes the data so that the data order corresponds to spatial locations of the respective object regions. The data may be transmitted in correct order for display of an image of the entire object, or may be mapped to a memory for rapid access and display of the image. Image processing may also take place prior to transmission or storage of the data. Data processing may be divided among a number of different processors. The data processor may be compressed for transmission.

Claims

1. An apparatus for acquiring an image of one or more objects, comprising:

an imaging array having a plurality of imaging elements for producing a corresponding array of image data representing the one or more objects, the spacing of the imaging elements being greater than the fields of view thereof in at least one direction;

a data processor for receiving said image data from said array microscope and reorganizing the received image data; and

a memory coupled to said data processor for storing at least a portion of the image data.

2. The apparatus of claim 1, wherein said data processor is adapted to reorganize the image data by mapping at least some of the image data to said memory so that data in adjacent memory locations correspond to adjacent fields of view of the one or more objects.

3. The apparatus of claim 1, wherein said data processor is adapted to reorganize the image data by buffering a portion of the image data with said memory so as to align at least a portion of the image data.

4. The apparatus of claim 1, wherein said data processor is adapted to reorganize the image data by buffering a portion of the image data with said memory so as to align a portion of the image data, and by mapping said aligned portion of the image data to said memory so that data in adjacent memory locations correspond to adjacent fields of view of the one or more objects.

5. The apparatus of claim 1, wherein said data processor is adapted to retrieve image data from said memory and reorganize the retrieved image data.

6. The apparatus of claim 5, wherein said data processor is adapted to store the reorganized data back in said memory.

7. The apparatus of claim 5, wherein said data processor is adapted to transmit the reorganized data to another location.

8. The apparatus of claim 1, wherein said data processor includes a plurality of parallel signal processor portions for receiving respective portions of said image data and reorganizing the respective portions of the received image data.

9. The apparatus of claim 8, wherein said memory includes a plurality of memory portions corresponding to said plurality of data processor portions for storing the image data reorganized by the respective processor portions.

10. The apparatus of claim 1, wherein said memory is a random access memory.

11. The apparatus of claim 1, wherein said data processor includes at least one of a DSP, a PLA, and an FPGA.

12. The apparatus of claim 1, further comprising a carriage for moving the one or more objects relative to said imaging elements to provide frames of image data corresponding to different rows across the one or more objects and said imaging elements, wherein, for each of said imaging elements, said frames produce corresponding strips of said image data, and wherein said data processor is adapted to delay at least a portion of one of said strips with respect to corresponding portions of others of said strips to align said portions.

13. The apparatus of claim 12, wherein said data processor is adapted to delay at least one of said strips with respect to others of said strips to align the strips so that the image data corresponding to a given row is made available at the same time.

14. The apparatus of claim 1, further comprising a data compressor for compressing the data output from said data processor, for transmission to a host computer.

15. The apparatus of claim 1, further comprising a host computer for receiving the reorganized image data from said data processor prior to storing at least a portion of the image data in said memory.

16. The apparatus of claim 15, further comprising a data compressor for compressing the data output from said data processor, for transmission to said host computer.

18. The apparatus of claim 14, further comprising a memory coupled to said data processor for storing at least a portion of said image data.

19. The apparatus of claim 18, wherein said data processor includes a plurality of parallel signal processor portions for receiving respective portions of said image data and reorganizing the respective portions of the received image data, wherein said memory includes a plurality of memory portions corresponding to said plurality of signal processor portions for storing the image data reorganized by the respective processor portions.

20. The apparatus of claim 18, wherein said memory is a random access memory.

21. The apparatus of claim 18, wherein said data processor is adapted to reorganize the image data by mapping at least some of the image data to said memory so that data in adjacent memory locations correspond to adjacent fields of view of the one or more objects.

22. The apparatus of claim 18, wherein said data processor is adapted to reorganize the image data by buffering a portion of the image data with said memory so as to align at least a portion of the image data.

23. The apparatus of claim 18, wherein said data processor is adapted to reorganize the image data by buffering a portion of the image data with said memory so as to align a portion of the image data, and by mapping said aligned portion of the image data to said memory so that data in adjacent memory locations correspond to adjacent fields of view of the one or more objects.

17. An apparatus for acquiring an image of one or more objects, comprising:

a two-dimensional imaging array comprising a plurality of imaging elements for producing a corresponding array of image data representing the one or more objects;

a carriage for moving the one or more objects relative to said imaging elements so that consecutive rows of said imaging array image laterally adjacent portions of the one or more objects during scanning of the one or more objects; and

a data processor for receiving said image data produced by said imaging array and reorganizing the received image data.

24. The apparatus of claim 17, wherein said data processor is adapted to retrieve image data from said memory and reorganize the retrieved image data.

25. The apparatus of claim 24, wherein said data processor is adapted to store the reorganized data back in said memory.

26. The apparatus of claim 24, wherein said data processor is adapted to transmit the reorganized data to another location.

27. The apparatus of claim 17, wherein said data processor includes a plurality of parallel signal processor portions for receiving respective portions of said image data and reorganizing the respective portions of the received image data.

28. The apparatus of claim 17, wherein said data processor includes at least one of a DSP, a PLA, and an FPGA.

29. The apparatus of claim 17, wherein said carriage is adapted for moving the one or more objects relative to said imaging elements to provide frames of image data corresponding to different rows across the one or more objects and said imaging elements, wherein, for each of said imaging elements, said frames produce corresponding strips of said image data, and wherein said data processor is adapted to delay at least a portion of one of said strips with respect to corresponding portions of others of said strips to align said portions.

30. The apparatus of claim 29, wherein said data processor is adapted to delay at least one of said strips with respect to others of said strips to align the strips so that the image data corresponding to a given row is made available at the same time.

31. The apparatus of claim 17, further comprising a data compressor for compressing the data output from said data processor, for transmission to a host computer.

32. The apparatus of claim 17, further comprising a host computer for receiving the reorganized image data from said data processor prior to storing at least a portion of the image data in said memory.

33. The apparatus of claim 32, further comprising a data compressor for compressing the data output from said data processor, for transmission to said host computer.

34. An apparatus for acquiring an image of one or more objects, comprising:

an imaging array comprising a plurality of imaging elements for producing a corresponding array of images on a detector;

a detector having a plurality of light detecting elements arranged in a single detector array, distinct portions of said light detecting elements corresponding to respective imaging elements, so as to produce a corresponding array of image data representing the one or more objects;

a carriage for moving the one or more objects relative to said imaging elements; and

a data processor for receiving said image data produced by said detector as the one or more objects are moved relative to said imaging elements and reorganizing the received image data.

35. The apparatus of claim 34, wherein said detector comprises a plurality of linear arrays of detecting elements disposed parallel to one another, each said linear array substantially spanning said imaging array laterally with respect to the direction of the motion.

36. The apparatus of claim 35, wherein said data processor is adapted to receive data from a detector array ordered so that contiguous data represent non-contiguous locations on an object, and reorder said data from a detector array so that, as reordered, contiguous data represent contiguous locations on the object.

37. The apparatus of claim 36, further comprising a memory, and wherein said data processor is adapted to receive said data from said detector as it is produced, and store said data, as reordered, into said memory.

38. The apparatus of claim 36, further comprising a memory for storing said image data, and wherein said data processor is adapted to retrieve said data from said memory to reorder said data.

39. The apparatus of claim 38, wherein said data processor is adapted to store said data, as reordered back in said memory.

40. The apparatus of claim 38, wherein said data processor is adapted to transmit said data, as reorganized, to another location.

41. An apparatus for acquiring an image of one or more objects, comprising:

a two-dimensional imaging array comprising a plurality of imaging elements for producing a corresponding array of image data representing the one or more objects;

a carriage for moving the one or more objects relative to said imaging elements so that consecutive rows of said imaging array image laterally-adjacent portions of the one or more objects during scanning of the one or more objects; and

a data compressor for compressing the data output from said signal processor, for transmission to a host computer.

42. The apparatus of claim 41, further comprising a host computer, wherein said data compressor is adapted to transmit compressed image data to said host computer.

43. The apparatus of claim 42, wherein said host computer is a PC.

44. An apparatus for acquiring image data, comprising:

a plurality of imaging elements having a known, ordered spatial relationship;

a plurality of detectors corresponding respectively to said imaging elements, said imaging elements being disposed so as to produce simultaneously at respective said detectors in image space thereof respective images of regions in object space thereof;

a read out mechanism for acquiring data from said detectors in a known order different from the order of said imaging elements; and

a mapping mechanism for reordering the data acquired by said read out mechanism so as to bear a desired relationship with one or more regions in object space of the imaging elements.

45. The apparatus of claim 44, wherein contiguous sets of data acquired from said detectors represent respectively non-contiguous object space regions.

66. The apparatus of claim 44, further comprising a memory for storing reordered data.

46. The apparatus of claim 4558, wherein said mapping mechanism reorders said sets of data so that contiguous sets of data correspond to contiguous object space regions.

47. The apparatus of claim 46, wherein said detectors have respective arrays of detector elements and data from spatially-adjacent detector elements is read out serially.

48. The apparatus of claim 47, wherein the data that is read out serially is reordered in consecutive sections.

49. The apparatus of claim 47, wherein the data that is reordered is stored in memory as reordered.

50. The apparatus of claim 47, wherein said imaging elements are arranged in a two-dimensional array.

51. The apparatus of claim 46, wherein a set of imaging elements is arranged in a linear array, and said detectors corresponding to said imaging elements in said linear array comprise respective portions of a linear array of detector elements.

52. The apparatus of claim 51, wherein data from spatially-adjacent detector elements is read out serially and thereafter reordered.

53. The apparatus of claim 46, wherein a set of imaging elements is arranged in a two-dimensional array, and said detectors corresponding to said imaging elements in said two-dimensional array comprise respective linear arrays of detector elements aligned in substantially the same direction.

54. The apparatus of claim 53, wherein data from spatially-adjacent detector elements is read out serially and thereafter reordered.

55. The apparatus of claim 54, wherein said mapping mechanism reorders sets of data read out serially so that contiguous sets of data correspond to contiguous object space regions.

56. The apparatus of claim 55, wherein data is stored in memory as reordered.

57. The apparatus of claim 53, wherein said linear arrays of detector elements are aligned along one dimension of said array of imaging elements, and data from detector elements that are spatially-adjacent in the other dimension of the array of imaging elements is read out serially in that other direction.

58. The apparatus of claim 57, wherein said mapping mechanism reorders sets of data read out serially so that contiguous sets of data correspond to contiguous object space regions.

59. The apparatus of claim 57, wherein data is stored in memory as reordered.

60. The apparatus of claim 57, wherein said plurality of imaging elements comprises a microscope array.

61. The apparatus of claim 57, wherein the plurality of imaging elements comprises an array microscope array.

62. The apparatus of claim 61, wherein the mapping mechanism reorders sets of data read out serially so that contiguous sets of data correspond to contiguous object space regions.

63. The apparatus of claim 61, wherein the mapping mechanism reorders sets of data read out serially so that sets of data corresponding to respective object regions imaged by respective imaging elements are arranged contiguously with one another as respective image data elements, and image data elements corresponding to contiguous object regions are arranged so as to be contiguous with one another.

64. The apparatus of claim 63, wherein data is stored in memory as reordered.

65. The apparatus of claim 63, wherein the plurality of detectors comprises a two-dimensional array, the read out mechanism comprises a circuit for acquiring data from said two-dimensional array of detectors, and said mapping mechanism comprises a data processor.

67. A method for acquiring an image of an object, comprising the steps of:

imaging the object to produce an ordered array of image data wherein each element of the array represents a different portion of the object;

reorganizing the received image data; and

storing the image data.

68. The method of claim 67, further comprising reorganizing the image data by mapping at least some of the image data to a memory so that data in adjacent memory locations of the memory correspond to adjacent fields of view of the one or more objects.

69. The method of claim 67, further comprising reorganizing the image data by buffering a portion of the image data with a memory so as to align at least a portion of the image data.

70. The method of claim 69, further comprising mapping said aligned portion of the image data to said memory so that data in adjacent memory locations of the memory correspond to adjacent fields of view of the one or more objects.

71. The method of claim 67, wherein said reorganizing is performed by parallel processing of respective portions of said image data.

72. The method of claim 67, further comprising moving the one or more objects relative to said imaging elements to provide frames of image data corresponding to different rows across the one or more objects and said imaging elements, wherein, for each of said imaging elements, said frames produce corresponding strips of said image data, and delaying at least a portion of one of said strips with respect to corresponding portions of others of said strips to align said portions.

73. The method of claim 72, further wherein said step of delaying includes delaying at least one of said strips with respect to others of said strips to align the strips so that the image data corresponding to a given row is made available at the same time.

74. The method of claim 67, further comprising compressing the received image data for transmission to a host computer prior to said step of storing the data and subsequent to said step of reorganizing the data.

75. The method of claim 74, wherein said step of reorganizing includes grouping said image data into tiles and aligning the tiles prior to said step of compressing.

76. The method of claim 76, wherein said step of storing stores said tiles in compressed form.

77. The method of claim 76, further comprising aligning the compressed tiles prior to said step of storing.

78. A method for acquiring an image of one or more objects, comprising:

providing a two-dimensional imaging array comprising a plurality of imaging elements for producing a corresponding array of image data representing the one or more objects;

moving the one or more objects relative to said imaging elements so that consecutive rows of said imaging array image laterally adjacent portions of the one or more objects during scanning of the one or more objects;

receiving said image data from said imaging array; and

reorganizing the received image data.

79. The method of claim 78, wherein said step of reorganizing includes mapping at least some of the image data to a memory so that data in adjacent memory locations of the memory correspond to adjacent fields of view of the one or more objects.

80. The method of claim 78, wherein said step of reorganizing includes buffering a portion of the image data with said memory so as to align at least a portion of the image data.

81. The method of claim 80, wherein said step of reorganizing includes mapping said aligned portion of the image data to said memory so that data in adjacent memory locations of the memory correspond to adjacent fields of view of the one or more objects.

82. The method of claim 78, wherein said step of reorganizing is performed by parallel processing of respective portions of said image data.

83. The method of claim 78, wherein said moving the one or more objects relative to said imaging elements provides frames of image data corresponding to different rows across the one or more objects and said imaging elements, wherein, for each of said imaging elements, said frames produce corresponding strips of said image data, and the method further comprises delaying at least a portion of one of said strips with respect to corresponding portions of others of said strips to align said portions.

84. The method of claim 83, wherein said step of delaying includes delaying at least one of said strips with respect to others of said strips to align the strips so that the image data corresponding to a given row is made available at the same time.

85. The method of claim 78, further comprising compressing the received image data for transmission to a host computer prior to said step of storing the data and subsequent to said step of reorganizing the data.

86. The method of claim 85, wherein said step of reorganizing includes grouping said image data into tiles and aligning the tiles prior to said step of compressing.

87. The method of claim 86, wherein said step of storing stores said tiles in compressed form.

88. The method of claim 87, further comprising aligning the compressed tiles prior to said step of storing.

89. A method for acquiring an image of one or more objects, comprising:

providing a two-dimensional imaging array comprising a plurality of imaging elements for producing a corresponding array of image data representing the one or more objects;

moving the one or more objects relative to said imaging elements so that consecutive rows of said imaging array image laterally adjacent portions of the one or more objects during scanning of the one or more objects;

compressing the image data; and

transmitting the compressed image data to a host computer.

90. The method of claim 89, wherein said step of reorganizing includes grouping said image data into tiles and aligning the tiles prior to said step of compressing.

91. The method of claim 90, wherein said step of storing stores said tiles in compressed form.

92. The method of claim 91, further comprising aligning the compressed tiles prior to said step of storing.

93. A method for acquiring image data, comprising:

providing a plurality of imaging elements having a known, ordered spatial relationship;

providing a plurality of detectors corresponding respectively to imaging elements being disposed so as to produce simultaneously at respective images of regions in object space thereof;

acquiring data from said detectors in a known order different from the order of the imaging elements; and

reordering the data acquired by the read out mechanism so as to bear a desired relationship with one or more regions in object space of the imaging elements.

94. The method of claim 93, wherein contiguous sets of data acquired from said detectors represent respectively non-contiguous object space regions.

95. The method of claim 94, wherein said sets of data are reordered so that contiguous sets of data correspond to contiguous object space regions.

96. The method of claim 95, wherein the detectors have respective arrays of detector elements and data from spatially-adjacent detector elements is read out serially.

97. The method of claim 96, wherein the data that is read out serially is reordered in consecutive sections.

98. The method of claim 96, wherein the data that is reordered is stored in a memory as reordered.