Compression packaged image transmission for telemicroscopy

• US 7,224,839 B2
• Filed: 05/30/2003
• Issued: 05/29/2007
• Est. Priority Date: 06/01/1998
• Status: Expired due to Fees

• Current Assignee: Carl Zeiss Microimaging Ais, Inc. (Carl-Zeiss-Stiftung)
• Original Assignee: Clariant GmbH (Clariant AG)
• Inventors: Zeineh, Jack A.
• Primary Examiner(s): Couso; Yon J.
• Application Number:
  US10/448,913
• Publication Number:
  US 20040008894A1
• Time in Patent Office: 1,460 Days
• Field of Search: 382/232, 382/239, 382/240, 382/128, 382/151, 358 1- 15, 348/14.01, 348/14.12, 348/14.13
• US Class Current: 382/232
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: G16H 10/40 for data related to laboratory analysis, e.g. patient specimen analysis
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring

Abstract

A system and method for visual image compression and transmission offers significant bandwidth conservation while retaining high resolution imaging capability. Videograpic images are decomposed into detail levels, and images are delivered to a remote site display at a level of detail proportional to the perception level of a viewer. Images are transformed, quantized, coded and queued for transmission in accordance with their level of image detail. Image detail layers are transmitted as an inverse function of image displacement speed and as a direct function of image magnification. Images are constructed vertically with each additional queueing layer providing additional image detail. Higher priority layers are lossy encoded, while the lowest priority layers (highest detail levels) are losslessly encoded.

Claims

1. A method for compressing visual image data for transmission over a bandwidth restricted transmission channel, comprising:

compressing visual image data indicative of an image by decomposing the image data into a plurality of resolution metric associated components, each respective resolution metric defining an image resolution level;

packetizing each of the resolution metric associated components into respective ones of a plurality of transmission protocol specific packets;

storing said plurality of transmission protocol specific packets in priority queues, where each priority queue has a discrete transmission priority ranging from highest to lowest priority;

adaptively directing each of the transmission protocol specific packets to a respective priority queue, wherein transmission packets are directed to priority queues having transmission priorities in inverse relationship to the image resolution level defined by each resolution metric; and

transmitting the contents of the priority queues in accordance with their order of priority.

2. A system for image compression and transmission over bandwidth restricted transmission channels, comprising:

an image compression engine, the image compression engine decomposing an image into a plurality of definition metric associated components, each respective definition metric defining an image resolution level;

a packetization engine for adaptively packaging metric associated components into respective ones of a plurality of transmission protocol specific packets;

a plurality of priority queues, each priority queue receiving and storing a respective one of the plurality of transmission protocol specific packets, each priority queue having a respective discrete transmission priority ranging from highest to lowest priority, which is in inverse relationship to an image resolution level defined by each metric.

3. A method for compressing visual image data for transmission over a bandwidth restricted transmission channel, comprising:

acquiring visual image data representing an image to be transmitted;

processing the visual image data by;

compressing the image data into a first data set defining a plurality of resolution metric associated component layers in accordance with a lossy compression transform;

summing the resultant image data comprising the layers;

determining a difference data set representing the difference between the resulted image and the acquired image data;

compressing the difference data set into a second data set in accordance with a lossless compression transform;

packetizing each of the data sets into respective ones of a plurality of transmission protocol specific packets;

providing a plurality of priority queues, each priority queue adapted to receive and store a respective one of the plurality of transmission protocol specific packets;

assigning each priority queue a discrete transmission priority ranging from highest to lowest priority; and

transmitting the contents of the priority queues in accordance with their order of priority.

4. The method according to claim 3, wherein the resolution metric associated component layers comprising the first data set each define a corresponding image resolution level and wherein transmission packets are directed to priority queues having transmission priorities in inverse relationship to the image resolution level defined by each resolution metric.

5. A system for layered image compression and transmission over bandwidth restricted transmission channels, comprising:

a frame differencing engine adapted to compare a present frame of a visual image data characterized by frame translations at variable time rates of change to a previous frame to thereby extract newly added image information;

an image compression engine, the compression engine decomposing the newly added image information into a plurality of definition metric associated components, each respective definition metric defining a progressive image resolution level;

a packetization engine adaptively packaging metric associated components into respective ones of a plurality of transmission protocol specific packets;

a plurality of priority queues, each priority queue receiving and storing a respective one of the plurality of transmission protocol specific packets, each priority queue having a respective discrete transmission priority progressing from highest to lowest priority; and

an assigning structure which assigns transmission packets containing metric associated components a priority queue having a priority in inverse relationship to the progressive image resolution level defined by each metric.

6. A method for compressing visual image data for transmission over a bandwidth restricted transmission channel, comprising:

acquiring visual image data representing an image to be transmitted;

compressing the visual image data by decomposing the image data into a plurality of resolution metric associated components, each respective resolution metric defining image data at a particular image resolution level;

packetizing each of the resolution metric associated components into respective ones of a plurality of transmission protocol specific packets;

adaptively directing and storing each of the transmission protocol specific packets to a respective priority queues where each priority queue having a transmission priority and adapted to receive and store a respective one of the plurality of

transmission protocol specific packets in the plurality; and

transmitting the contents of the priority queues over the bandwidth restricted transmission channel in accordance with their order of priority.

11. The method of claim 6, wherein the step of adaptively directing and storing each of the transmission protocol specific packets to a respective one of the priority queues in the plurality;

directs and stores the transmission protocol specific packets to priority queues having transmission priorities in an inverse relationship to the image resolution level defined by the resolution metric contained in the respective transmission protocol specific packet.

7. A system for image compression and transmission over bandwidth restricted transmission channel, said system comprising:

a telemicroscopy system for acquiring visual image data representing an image to be transmitted;

an image compression engine, the image compression engine receiving said visual image data and decomposing the image data into a plurality of resolution metric associated components, each respective resolution metric defining image data at a particular image resolution level;

a packetizing engine for adaptively packaging the resolution metric associated components into respective ones of a plurality of transmission protocol specific packets;

a plurality of priority queues, each priority queue having a transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets; and

a transmitter that transmits the contents of the priority queues over the bandwidth restricted transmission channel in order of priority.

12. The system of claim 7, wherein the plurality of priority queues receive and store the plurality of transmission protocol specific packets in reverse order of the image resolution level defined by the resolution metric contained in each packet such that priority queues having higher transmission priority receive and store packets having resolution metrics which define a lower image resolution level and priority queues having lower transmission priority receive and store packets having resolution metrics which define a higher image resolution level.

8. A method for compressing visual image data for transmission over a bandwidth restricted transmission channel, comprising:

acquiring visual image data representing an image to be transmitted;

compressing the image data into a first data set having a plurality of resolution metric associated component layers, each resolution metric associated component layer defining image data at a corresponding image resolution level;

summing the resultant image data comprising the layers into resultant image data;

determining a difference data representing the difference between the resultant image data and the acquired image data; and

compressing the difference data set into a second data set in accordance with a lossless compression transform;

packetizing each of the data sets into respective ones of a plurality of transmission protocol specific packets;

providing a plurality of priority queues, each priority queue having an assigned transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets;

assigning and storing each of the plurality of transmission protocol specific packets to one of the plurality of priority queues; and

transmitting the contents of the priority queues in accordance with their assigned transmission priority.

9. The method according to claim 8, wherein the assigning and storing each of the plurality of transmission protocol specific packets to one of the plurality of priority queues assigns and stores transmission packets to priority queues having transmission priorities in an inverse relationship to the image resolution level defined by the resolution metric contained within the packet.

10. A system for layered image compression and transmission over bandwidth restricted transmission channels, comprising:

a telemicroscopy system acquiring visual image data representing an image to be transmitted, the visual image data characterized by frame translations at variable time rates of change;

a frame differencing engine adapted to compare a present frame to a previous frame to thereby extract newly added image information;

an image compression engine, the compression engine decomposing the newly added image information into a plurality of definition metric associated components, each respective definition metric defining a progressive image resolution level;

a packetization engine for adaptively packaging the definition metric associated components into respective ones of a plurality of transmission protocol specific packets;

a plurality of priority queues, each priority queue receiving and storing a respective one of the plurality of transmission protocol specific packets, each priority queue having a respective discrete transmission priority progressing from highest to lowest; and

a transmission queue assignment part, assigning transmission packets containing metric associated components to a priority queue having a priority in inverse relationship to the progressive image resolution level defined by each metric.

13. A method for providing a series of images of a sample comprising:

providing the sample on a sample stage, the sample stage defining a planar surface moveable to a three dimensional position;

adjusting the stage to a first position and capturing first image data of the sample at a first resolution such that the first image data covers a first portion of the sample;

compressing and packetizing the first image data and transmitting the compressed and packetized first image data over a bandwidth-restricted transmission channel for storage and display;

adjusting the sample stage to a second position and capturing second image data of the sample at the first resolution such that the second image data covers a second portion of the sample;

comparing the first image data to the second image data in order to determine new image data representing a difference between the first and second image data;

compressing the new image data so it is represented as a set of frequency component coefficients that represent the level of image detail of the new image data, with lower frequency component coefficients representing the least amount of image detail and higher frequency component coefficients representing the highest amount of image detail;

packetizing the frequency component coefficients into a plurality of packets and storing the plurality of packets in a plurality of transmission queues, each transmission queue having an assigned transmission priority level; and

selectively transmitting the contents of the transmission queues in order of their priority over the bandwidth restricted transmission channel.

14. The method of claim 13, wherein the packetizing the frequency component coefficients into a plurality of packets and storing the plurality of packets in a plurality of transmission queues stores the packets in the plurality of transmission queues in a reverse order such that priority queues having higher transmission priority levels store packets having lower frequency component coefficients and priority queues having lower transmission priority levels store packets having higher frequency component coefficients.

15. The method of claim 14, wherein in the step of selectively transmitting the contents of the transmission queues in order of their priority, only the contents of transmission queues having higher transmission priority levels are transmitted if the adjustment of the sample stage exceeds a maximum threshold.

16. The method of claim 15, wherein in the step of selectively transmitting the contents of the transmission queues in order of their priority, the contents of transmission queues having lower transmission priority levels are transmitted as the adjustment of the sample stage falls below a maximum threshold.

17. A system for providing a series of images of a sample, the system comprising:

a sample slide defining a planar surface for holding the specimen, said slide stage moveable to a three dimensional position;

an adjustment control mechanism for controlling the lateral movement of the stage in either the lateral X and Y directions, and further controlling the vertical motion of the stage;

an imaging system for capturing image data, wherein the video imaging system;

captures first image data of the sample at a first resolution with the sample stage in first position such that the first image data covers a first portion of the sample; and

captures second image data of the sample at the first resolution with the sample stage in different positions such that the second image data covers a second portion of the sample;

comparison module for comparing the first image data to the second image data in order to determine difference image data;

a compression engine for compressing the difference image data so it is represented as a set of frequency component coefficients which represent different levels of image detail of the difference image data, with a lowest frequency component coefficient representing the lowest level of image detail and higher frequency component coefficients representing higher levels of image detail;

packetizing engine for packetizing the frequency component coefficients into a plurality of packets;

a plurality of transmission queues, each transmission queue having an assigned transmission priority level and used for storing the packetized frequency component coefficients; and

a transmission means for selectively transmitting the contents of the transmission queues in order of their priority level over the bandwidth restricted transmission channel.

18. The system of claim 17, wherein the packets are stored in the plurality of transmission queues in a reverse order such that priority queues having higher transmission priority levels store packets having lower coefficients and priority queues having lower transmission priority levels store packets having higher coefficients.

19. The system of claim 17, wherein only the contents of the transmission queue having the highest transmission priority level are transmitted if the adjustment of the sample stage a maximum threshold.

20. The system of claim 19, wherein the contents of transmission queues having lower transmission priority levels are transmitted as the adjustment of the sample stage decreases.

21. A moveable slide stage in a telemicroscopy system, said slide stage defining a planar surface for holding a specimen to be analyzed using the telemicroscopy system and comprising:

a first translational motor control system for controlling motion of the slide stage in first directions lateral to the planar surface;

a second translational motor control system for controlling motion of the slide stage in a vertical direction, orthogonal to the first directions, such vertical motion occurring at first increments; and

focus control circuitry including a microstepping motor for further adjusting the slide stage in the vertical direction, such motion occurring at second increments, wherein the second increments are substantially smaller than the first increments, thereby allowing for vertical optical sectioning by providing the micromotions necessary to adequately focus the telemicroscopy system on different image plane levels within the specimen.

22. A system for capturing an image of a specimen, compressing the image and transmitting the image over a bandwidth-restricted transmission channel, said system comprising:

a telemicroscopy system for capturing visual image data of the specimen, the image data representing an image to be transmitted, the telemicroscopy system including;

a moveable slide stage defining a planar surface for holding the specimen, said slide stage having a first translational motor control system for controlling motion for the slide stage in first directions lateral to the planar surface, a second translational motor control system for controlling motion for the slide stage in a vertical direction, orthogonal to the first directions, such vertical motion occurring at first increments, and focus control circuitry including a microstepping motor for further adjusting the slide stage in the vertical direction, such motion occurring at second increments, wherein the second increments are substantially smaller than the first increments, thereby allowing for vertical optical sectioning by providing the micromotions necessary to adequately focus the telemicroscopy system on different image plane levels within the specimen;

an image compression engine that receives said visual image data and decomposes the image data into a plurality of resolution metric associated components, each resolution metric defining image data at a particular image resolution level; and

a packetizing engine for adaptively packaging the resolution metric associated components into a plurality of transmission protocol specific packets.

23. The system of claim 22, further comprising:

a plurality of priority queues, each priority queue having a transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets; and

a transmission means coupled to the priority queues for transmitting the contents of the priority queues over the bandwidth restricted transmission channel in order of transmission priority.

24. The system of claim 23, wherein the plurality of priority queues receive and store the plurality of transmission protocol specific packets in reverse order of the image resolution level defined by the resolution metric contained in each packet such that priority queues having higher transmission priority receive and store packets having resolution metrics that define a lower image resolution level and priority queues having lower transmission priority receive and store packets having resolution metrics that define a higher image resolution level.