Compression packaged image transmission for telemicroscopy

• US 6,606,413 B1
• Filed: 06/01/1999
• Issued: 08/12/2003
• Est. Priority Date: 06/01/1998
• Status: Expired due to Fees

• Current Assignee: Carl Zeiss Microscopy GmbH (Carl-Zeiss-Stiftung)
• Original Assignee: Trestle Acquisition Corp.
• Inventors: Zeineh, Jack A.
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US09/323,371
• Time in Patent Office: 1,533 Days
• Field of Search: 382/232, 382/239, 382/240, 382/128, 382/151, 358/1.15, 348/14.01, 348/14.12, 348/14.13
• US Class Current: 382/232
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: G16H 10/40 for data related to laboratory analysis, e.g. patient specimen analysis
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring

Abstract

A system and method for visual image compression and transmission offers significant bandwidth conservation while retaining high resolution imaging capability. Videograpic images are decomposed into detail levels, and images are delivered to a remote site display at a level of detail proportional to the perception level of a viewer. Images are transformed, quantized, coded and queued for transmission in accordance with their level of image detail. Image detail layers are transmitted as an inverse function of image displacement speed and as a direct function of image magnification. Images are constructed vertically with each additional queueing layer providing additional image detail. Higher priority layers are lossy encoded, while the lowest priority layers (highest detail levels) are losslessly encoded.

Claims

1. A method for compressing visual image data for transmission over a bandwidth restricted transmission channel, comprising:

acquiring visual image data representing an image to be transmitted;

compressing the visual image data by decomposing the image data into a plurality of resolution metric associated components, each respective resolution metric defining image data at a particular image resolution level;

packetizing each of the resolution metric associated components into respective ones of a plurality of transmission protocol specific packets;

providing a plurality of priority queues, each priority queue having a transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets;

adaptively directing and storing each of the transmission protocol specific packets to a respective one of the priority queues in the plurality; and

transmitting the contents of the priority queues over the bandwidth restricted transmission channel in accordance with their order of priority.

6. The method of claim 1, wherein the step of adaptively directing and storing each of the transmission protocol specific packets to a respective one of the priority queues in the plurality;

directs and stores the transmission protocol specific packets to priority queues having transmission priorities in an inverse relationship to the image resolution level defined by the resolution metric contained in the respective transmission protocol specific packet.

2. A system for image compression and transmission over a bandwidth restricted transmission channel, said system comprising:

a telemicroscopy system for acquiring visual image data representing an image to be transmitted;

an image compression engine, the image compression image receiving said visual image data and decomposing the image data into a plurality of resolution metric associated components, each respective resolution metric defining image data at a particular image resolution level;

a packetizing engine for adaptively packaging the resolution metric associated components into respective ones of a plurality of transmission protocol specific packets;

a plurality of priority queues, each priority queue having a transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets; and

a means for transmitting the contents of the priority queues over the bandwidth restricted transmission channel in order of priority.

7. The system of claim 2, wherein the plurality of priority queues receive and store the plurality of transmission protocol specific packets in reverse order of the image resolution level defined by the resolution metric contained in each packet such that priority queues having higher transmission priority receive and store packets having resolution metrics which define a lower image resolution level and priority queues having lower transmission priority receive and store packets having resolution metrics which define a higher image resolution level.

3. A method for compressing visual image data for transmission over a bandwidth restricted transmission channel, comprising:

acquiring visual image data representing an image to be transmitted;

processing the visual image data including the steps of;

compressing the image data into a first data set having a plurality of resolution metric associated component layers, each resolution metric associated component layer defining image data at a corresponding image resolution level;

summing the compressed image data into resultant image data;

determining a difference data set representing the difference between the resultant image data and the acquired image data; and

compressing the difference data set into a second data set in accordance with a lossless compression transform;

packetizing each of the data sets into respective ones of a plurality of transmission protocol specific packets;

providing a plurality of priority queues, each priority queue having an assigned transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets;

assigning and storing each of the plurality of transmission protocol specific packets to one of the plurality of priority queues; and

transmitting the contents of the priority queues in accordance with their assigned transmission priority.

4. The method according to claim 3, wherein the step of assigning and storing each of the plurality of transmission protocol specific packets to one of the plurality of priority queues assigns and stores transmission packets to priority queues having transmission priorities in an inverse relationship to the image resolution level defined by the resolution metric contained within the packet.

5. A system for layered image compression and transmission over bandwidth restricted transmission channels, comprising:

a telemicroscopy system for acquiring visual image data representing an image to be transmitted, the visual image data characterized by frame translations at variable time rates of change;

a frame differencing engine adapted to compare a present frame to a previous frame to thereby extract newly added image information;

an image compression engine, the compression engine decomposing the newly added image information into a plurality of definition metric associated components, each respective definition metric defining a progressive image resolution level;

a packetization engine for adaptively packaging the definition metric associated components into respective ones of a plurality of transmission protocol specific packets;

a plurality of priority queues, each priority queue receiving and storing a respective one of the plurality of transmission protocol specific packets, each priority queue having a respective discrete transmission priority progressing from highest to lowest; and

wherein transmission packets containing metric associated components are assigned a priority queue having a priority in inverse relationship to the progressive image resolution level defined by each metric.

8. A method for providing a series of images of a sample comprising:

providing the sample on a sample stage, the sample stage defining a planar surface moveable in a lateral X and Y directions, and further moveable in a vertical Z direction;

adjusting the stage to a first X, Y and Z position and capturing first image data of the sample at a first resolution such that the first image data covers a first portion of the sample;

compressing and packetizing the first image data and transmitting the compressed and packetized first image data over a bandwidth-restricted transmission channel for storage and display;

adjusting the sample stage to second X, Y and Z position and capturing second image data of the sample at the first resolution such that the second image data covers a second portion of the sample;

comparing the first image data to the second image data in order to determine new image data representing a difference between the first and second image data;

compressing the new image data so it is represented as a set of frequency component coefficients that represent the level of image detail of the new image data, with lower frequency component coefficients representing the least amount of image detail and higher frequency component coefficients representing the highest amount of image detail;

packetizing the frequency component coefficients into a plurality of packets and storing the plurality of packets in a plurality of transmission queues, each transmission queue having an assigned transmission priority level; and

selectively transmitting the contents of the transmission queues in order of their priority over the bandwidth restricted transmission channel.

9. The method of claim 8, wherein the step of packetizing the frequency component coefficients into a plurality of packets and storing the plurality of packets in a plurality of transmission queues stores the packets in the plurality of transmission queues in a reverse order such that priority queues having higher transmission priority levels store packets having lower frequency component coefficients and priority queues having lower transmission priority levels store packets having higher frequency component coefficients.

10. The method of claim 9, wherein in the step of selectively transmitting the contents of the transmission queues in order of their priority, only the contents of transmission queues having higher transmission priority levels are transmitted if the adjustment of the sample stage in either the X direction, the Y direction or the Z direction exceeds a maximum threshold.

11. The method of claim 10, wherein in the step of selectively transmitting the contents of the transmission queues in order of their priority, the contents of transmission queues having lower transmission priority levels are transmitted as the adjustment of the sample stage in the X direction, the Y direction, and the Z direction falls below a maximum threshold.

12. A system for providing a series of images of a sample, the system comprising:

a sample slide stage defining a planar surface for holding the specimen, said slide stage moveable in an X direction and a Y direction, both lateral to the planar surface, and further moveable in a vertical directional orthogonal to the X and Y directions,

an adjustment control mechanism for controlling the lateral movement of the stage in either the lateral X and Y directions, and further controlling he vertical motion of the stage;

an imaging system for capturing image data, wherein the video imaging system;

captures first image data of the sample at a first resolution with the sample stage in first X, Y and Z positions such that the first image data covers a first portion of the sample; and

captures second image data of the sample at the first resolution with the sample stage in different X, Y and Z positions such that the second image data covers a second portion of the sample;

comparison module for comparing the first image data to the second image data in order to determine difference image data;

a compression engine for compressing the difference image data so it is represented as a set of frequency component coefficients which represent different levels of image detail of the difference image data, with a lowest frequency component coefficient representing the lowest level of image detail and higher frequency component coefficients representing higher levels of image detail,

packetizing engine for packetizing the frequency component coefficients into a plurality of packets;

a plurality of transmission queues, each transmission queue having an assigned transmission priority level and used for storing the packetized frequency component coefficients; and

a transmission means for selectively transmitting the contents of the transmission queues in order of their priority level over the bandwidth restricted transmission channel.

13. The system of claim 12, wherein the packets are stored in the plurality of transmission queues in a reverse order such that priority queues having higher transmission priority levels store packets having lower coefficients and priority queues having lower transmission priority levels store packets having higher coefficients.

14. The system of claim 12, wherein only the contents of the transmission queue having the highest transmission priority level are transmitted if the adjustment of the sample stage in either the X direction, the Y direction or the Z direction exceeds a maximum threshold.

15. The system of claim 14, wherein the contents of transmission queues having lower transmission priority levels are transmitted as the adjustment of the sample stage in the X direction, the Y direction, and the Z direction decreases.

16. A moveable slide stage in a telemicroscopy system, said slide stage defining a planar surface for holding a specimen to be analyzed using the telemicroscopy system and comprising:

a first translational motor control system for controlling motion of the slide stage in X and Y directions lateral to the planar surface;

a second translational motor control system for controlling motion of the slide stage in a vertical direction, orthogonal to the X and Y directions, such vertical motion occurring at first increments; and

focus control circuitry including a microstepping motor for further adjusting the slide stage in the vertical direction, such motion occurring at second increments, wherein the second increments are substantially smaller than the first increments, thereby allowing for vertical optical sectioning by providing the micromotions necessary to adequately focus the telemicroscopy system on different image plane levels within the specimen.

17. A system for capturing an image of a specimen, compressing the image and transmitting the image over a bandwidth-restricted transmission channel, said system comprising:

a telemicroscopy system for capturing visual image data of the specimen, the image data representing an image to be transmitted, the telemicroscopy system including;

a moveable slide stage defining a planar surface for holding the specimen, said slide stage having a first translational motor control system for controlling motion of the slide stage in X and Y directions lateral to the planar surface, a second translational motor control system for controlling motion of the slide stage in a vertical direction, orthogonal to the X and Y directions, such vertical motion occurring at first increments, and focus control circuitry including a microstepping motor for further adjusting the slide stage in the vertical direction, such motion occurring at second increments, wherein the second increments are substantially smaller than the first increments, thereby allowing for vertical optical sectioning by providing the micromotions necessary to adequately focus the telemicroscopy system on different image plane levels within the specimen,

an image compression engine that receives said visual image data and decomposes the image data into a plurality of resolution metric associated components, each resolution metric defining image data at a particular image resolution level; and

a packetizing engine for adaptively packaging the resolution metric associated components into a plurality of transmission protocol specific packets.

18. The system of claim 17, further comprising:

a plurality of priority queues, each priority queue having a transmission priority and adapted to receive and store a respective one of the plurality of transmission protocol specific packets; and

a transmission means coupled to the priority queues for transmitting the contents of the priority queues over the bandwidth restricted transmission channel in order of transmission priority.

19. The system of claim 18, wherein the plurality of priority queues receive and store the plurality of transmission protocol specific packets in reverse order of the image resolution level defined by the resolution metric contained in each packet such that priority queues having higher transmission priority receive and store packets having resolution metrics that define a lower image resolution level and priority queues having lower transmission priority receive and store packets having resolution metrics that define a higher image resolution level.