Three-dimensional image streaming system and method for medical images

• US 7,376,279 B2
• Filed: 12/14/2001
• Issued: 05/20/2008
• Est. Priority Date: 12/14/2000
• Status: Expired due to Fees

• Current Assignee: IDX Investment Corporation (General Electric Company)
• Original Assignee: IDX Investment Corporation (General Electric Company)
• Inventors: Dekel, Shai, Sherman, Alexander, Goldberg, Nitzan
• Primary Examiner(s): Dang; Duy M
• Application Number:
  US10/022,122
• Publication Number:
  US 20030005140A1
• Time in Patent Office: 2,349 Days
• Field of Search: 382232-233, 382/240, 382244-248, 382260-263, 382/264, 348/399, 703/247
• US Class Current: 382/240
• CPC Class Codes: G06T 9/007 Transform coding, e.g. discrete cosine transform
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: H04N 19/62 by frequency transforming in three dimensions H04N19/63 takes precedence

Abstract

In a system for transmitting a three-dimensional (3-D) digital image over a communication network, in response to a client computer generating a request for interaction with a 3-D image stored on an image storage device, a server computer performs two-dimensional sub-band transform decompositions in x-axis and y-axis directions upon the 3-D image, performs a one-dimensional sub-band transform decomposition in a z-axis direction upon a portion of the two-dimensionally transform-decomposed digital image, and progressively transmits to the client computer data representing a region of interest specified in the client request.

Claims

1. A system for transmitting three dimensional (x, y, z axis) digital source images over a communication network, comprising:

a storage device for storing three dimensional digital source images;

a client computer coupled to the communication network, said client computer operative to generate and transmit to a server computer a request for interaction with the three dimensional source image stored on said image storage device, said request for interaction comprising an ordered request list specifying data blocks for progressive rendering of a given region of interest (ROI) within said three dimensional source image; and

said server computer coupled to the communication network and said image storage device, the server computer comprising means for preprocessing said three dimensional source image through a three dimensional wavelet transform wherein resultant three dimensional subband coefficient data comprises interslice correlation information, receiving said ordered request list from the client computer and progressively transmitting to said client computer three dimensional subband coefficient data blocks corresponding to said given region of interest in accordance with said ordered request list.

2. The system according to claim 1, wherein:

the request generated by the client computer specifies a resolution; and

the server computer provides a number of three dimensional data blocks corresponding to said resolution.

3. The system according to claim 1, wherein said three dimensional wavelet transform comprises the steps of:

performing two dimensional subband transform decompositions in x-axis and y-axis directions on said three dimensional image to yield a two-dimensionally transform-decomposed digital image; and

performing a one dimensional subband decomposition in a z-axis direction on a portion of said two-dimensionally transform-decomposed three dimensional image.

4. The system according to claim 1, further comprising the step of transmitting to said client computer data representing thumbnail resolution images.

5. The system according to claim 1, wherein said ordered request list generated by said client computer specifies a quality threshold and said server computer comprises means for sending three dimensional subband coefficient data blocks corresponding to said quality threshold.

6. The system according to claim 1, wherein said client computer comprises means for requesting fewer quality layers if an image is mapped in accordance with a luminance mapping function to a viewing device having fewer bits per pixel than that of said image.

7. The system according to claim 1, wherein said three dimensional subband coefficient data block comprises x, y, z and quality layer information.

8. The system according to claim 1, wherein said three dimensional subband coefficient data block comprises x, y, z, resolution and quality layer information.

9. A method for transmitting a sequence of digital source images as a three dimensional image from a server computer to a client computer over a communication network, said method comprising the steps of:

storing a sequence of digital source images on a storage device;

a client computer coupled to said communication network generating and transmitting to a server computer a request for interaction with an image sequence stored on said storage device, said request for interaction comprising an ordered request list specifying data blocks for progressive rendering of a given region of interest (ROI) within said image sequence; and

said server computer coupled to said communication network and said image storage device performing two dimensional subband transform decompositions in x-axis and y-axis directions on each image within said sequence to yield a two-dimensionally transform-decomposed digital image;

said server computer performing a one dimensional subband transform decomposition in a z-axis direction on a portion of said two-dimensionally transform-decomposed digital image to generate three dimensional subband coefficient data comprising inter-image correlation information; and

said server computer progressively transmitting to said client computer three dimensional subband coefficient data blocks corresponding to said given region of interest in accordance with said ordered request list.

10. The method according to claim 9, further comprising the steps of:

including in the request generated by the client computer a specified resolution; and

providing one or more three dimensional data blocks from the server computer that correspond to said resolution.

11. The method according to claim 9, further comprising the step of said server computer transmitting to said client computer data representing thumbnail resolution images.

12. The method according to claim 9, wherein said ordered request list generated by said client computer specifies a quality threshold and said server computer sends three dimensional subband coefficient data blocks corresponding to said quality threshold.

13. The method according to claim 9, wherein said server computer progressively transmits said three dimensional subband coefficient data blocks to said client computer using one of the three progressive modes:

progressive by accuracy, progressive by resolution or progressive by spatial order.

14. The method according to claim 9, wherein said client computer requesting fewer quality layers if an image is mapped in accordance with a luminance mapping function to a viewing device having fewer bits per pixel than that of the image.

15. The method according to claim 9, wherein said three dimensional data block comprises x, y, z and quality layer information.

16. The method according to claim 9, wherein said three dimensional data block comprises x, y, z, resolution and quality layer information.

17. A server for progressive streaming of sequences of digital source images as a three dimensional image to a client over a communications network, comprising:

an image storage device for storing a sequence of digital source images;

a memory cache;

a processor in communication with said image storage device, said processor comprising means for;

preprocessing the image sequence through a three dimensional forward wavelet transform to yield three dimensional wavelet coefficient data comprising inter-image correlation information;

storing said three dimensional wavelet coefficient data in said memory cache;

receiving an ordered request list for one or more three dimensional data blocks from said client, each three dimensional data block corresponding to a given region of interest;

checking if a requested three dimensional data block is present in said memory cache, and if not, computing three dimensional subband coefficient data blocks corresponding to said data block and storing said coefficient data in said memory cache; and

transmitting to said client three dimensional subband coefficient data blocks corresponding to said given region of interest.

18. The server according to claim 17, wherein said three dimensional wavelet transform comprises the steps of:

performing two dimensional subband transform decompositions in x-axis and y-axis directions on said image sequence to yield two-dimensionally transform-decomposed digital images; and

performing a one dimensional subband decomposition in a z-axis direction on a portion of said two-dimensionally transform-decomposed image sequence.

19. The server according to claim 17, wherein said processor further comprises means for transmitting to said client computer data representing thumbnail resolution images.

20. The server according to claim 17, wherein said ordered request list received from the said client computer specifies a quality threshold and said processor comprises means for transmitting three dimensional subband coefficient data blocks corresponding to said quality threshold in response thereto.

21. The server according to claim 17, wherein said processor comprises means for progressively transmitting said three dimensional subband coefficient data blocks to said client computer using one of the following three progressive modes:

progressive by accuracy, progressive by resolution or progressive by spatial order.

22. The server according to claim 17, wherein said processor comprises means for receiving from said client computer a request for fewer quality layers if an image is mapped in accordance with a luminance mapping function to a viewing device having fewer bits per pixel than that of the image.

23. The server according to claim 17, wherein said three dimensional data block comprises x, y, z and quality layer information.

24. The server according to claim 17, wherein said three dimensional data block comprises x, y, z, resolution and quality layer information.

25. A computer readable recording medium that stores a computer program for progressively streaming sequences of digital source images as a three dimensional image to a client over a communications network, said computer program including instructions, which when executed, cause a computer to execute:

preprocessing said source image sequence through a three dimensional forward wavelet transform to yield three dimensional subband coefficient data comprising inter-image correlation information;

storing said three dimensional subband coefficient data in a memory cache;

receiving an ordered request list for one or more three dimensional data blocks from said client, each data block corresponding to a given region of interest;

checking if a requested three dimensional data block is present in said memory cache, and if not, computing three dimensional subband coefficient data blocks corresponding to said data block and storing said coefficient data in said memory cache; and

transmitting to the client three dimensional subband coefficient data blocks corresponding to said given region of interest.

26. The computer readable recording medium according to claim 25, further comprising transmitting to said client data representing thumbnail resolution images.

27. The computer readable recording medium according to claim 25, further comprising sending three dimensional subband coefficient data blocks corresponding to a quality threshold to said client in response to an ordered request list received therefrom.

28. The computer readable recording medium according to claim 25, wherein transmitting comprises progressively transmitting said three dimensional subband coefficient data blocks to said client using one of the following three progressive modes:

progressive by accuracy, progressive by resolution or progressive by spatial order.

29. The computer readable recording medium according to claim 25, wherein said three dimensional data block comprises x, y, z and quality layer information.

30. The computer readable recording medium according to claim 25, wherein said three dimensional data block comprises x, y, z, resolution and quality layer information.