Image publishing system using progressive image streaming

• US 7,290,011 B2
• Filed: 11/26/2003
• Issued: 10/30/2007
• Est. Priority Date: 11/26/2003
• Status: Expired due to Fees

• Current Assignee: IDX Investment Corporation (General Electric Company)
• Original Assignee: IDX Investment Corporation (General Electric Company)
• Inventors: Keselbrener, Laurence, Eldar, Adi
• Primary Examiner(s): Mofiz; Apu
• Assistant Examiner(s): Kim; Paul
• Application Number:
  US10/723,404
• Publication Number:
  US 20050114380A1
• Time in Patent Office: 1,434 Days
• Field of Search: 705/2, 709/207
• US Class Current: 707/693
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04N 1/2179 Interfaces allowing access to a plurality of users, e.g. connection to electronic image libraries
• CPC Class Codes: H04N 1/2191 for simultaneous, independent access by a plurality of different users
• CPC Class Codes: Y10S 707/915 Image
• CPC Class Codes: Y10S 707/922 Communications
• CPC Class Codes: Y10S 707/959 Network
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

An image publishing system provides a distribution mechanism whereby images are forwarded automatically to users in accordance with a set of publication rules. The rules determine which images are to be sent to which users. The images are forwarded to users as they become available on an image archive storage device. This overcomes the requirement of users having to manually request the transmission of each individual image they would like to view. Progressive image streaming techniques employing compression are used to transmit images in encoded layers of increasing accuracy and quality. Means is also provided permitting users to view any image queued for transmission at a publication server, regardless of how much of the image has been received by a client computer. This allows images whose data transmission has not even begun yet to be viewed by a user. A user interrupts the normal background process at any time and requests to view a particular image. If the required data is not found locally, it is requested form the publication server and given high priority. The requested data is received, decoded and immediately displayed to the user.

Claims

1. A system for publishing studies over a communication network, comprising:

a study storage device for storing a plurality of studies, each study comprising one or more images;

a publication server coupled to said communications network, said publication server operative to enter an automatic publishing mode wherein one or more studies from among said plurality of studies are automatically sent to a client computer coupled to said communications network as they become available on said study storage device without any intervention by a user;

said client computer comprising;

means for receiving said one or more studies and storing them in a local cache;

means for permitting the user to interrupt said automatic publishing mode at any time for a selected study that has not yet been received in its entirety from said publication server, and immediately entering an interactive mode whereby a dynamic interactive viewing session is initiated between the user and said publication server;

means for streaming image data from said publication server to said client computer during said interactive viewing session using progressive image streaming techniques in response to requests for one or more regions of interest (ROI), said ROIs corresponding to specific portions of an image as determined by the user'"'"'s current viewing parameters and preferences, wherein said progressive image streaming techniques utilize compression to transmit said ROI image data in encoded layers of increasing accuracy and quality whereby the most visually important image data is streamed first;

wherein a search for requested ROI image data is first performed on said local cache, and only if not found, said requested ROI image data is streamed by said publication server to said client computer; and

wherein transmission of ROI image data from said publication server during said interactive mode for said selected study is given higher priority over transmission of study data of non-selected studies which continues at lower priority.

2. The system according to claim 1, wherein said publication server is adapted to send said one or more studies to said client computer in accordance with a set of publication rules.

3. The system according to claim 2, wherein said publication rules comprise instructions for determining, for each new study, which clients are to receive it.

4. The system according to claim 1, wherein said client computer comprises means for using only required data stored in said local storage when said user initiates a viewing session of said selected study after all said required data for said selected study is completely received.

5. The system according to claim 1, wherein said client computer comprises means for using progressive image streaming techniques to retrieve data from said publication server for said selected study when said user initiates a viewing session of said selected study before any data corresponding thereto has been received by said client computer.

6. The system according to claim 1, wherein said client computer comprises data pull means adapted to periodically poll said publication server for new studies that have not yet been retrieved.

7. The system according to claim 1, wherein said client computer comprises data push means adapted to configure said publication server to automatically check for and send new studies that have not yet been transmitted to said client.

8. The system according to claim 1, wherein said publication server is adapted to send said one or more studies to said client using progressive image streaming techniques whereby information is sent in encoded layers wherein each successive layer has higher accuracy and quality than the layer previous thereto.

9. The system according to claim 1, wherein said client computer comprises means whereby if said user initiates a viewing session of said selected study after data is completely received by said client, then said client utilizes said data to provide instant rendering of images within said selected study.

10. The system according to claim 1, farther comprising means for permitting said user to freely switch back and forth between automatic mode and interactive mode without the need to switch protocols.

11. The system according to claim 1, wherein said progressive image streaming techniques are performed utilizing JPEG2000 standard.

12. An image publication system for use on a client computer coupled to a communications network, comprising:

first means for entering an automatic publishing mode whereby new studies are sent automatically from a publication server to said client computer over said communications network as they become available without requiring any intervention by a user;

a local cache for storing said studies;

second means for receiving said studies and storing them in said local cache;

third means for permitting the user to interrupt said automatic publishing mode at any time for a selected study that has not yet been received in its entirety from said publication server, and immediately entering an interactive mode whereby a dynamic interactive viewing session is initiated between the user and said publication server;

fourth means for streaming image data from said publication server to said client computer during said interactive viewing session using progressive image streaming techniques in response to requests for one or more regions of interest (ROI), said ROIs corresponding to specific portions of an image as determined by the user'"'"'s current viewing parameters and preferences, wherein said progressive image streaming techniques utilize compression to transmit said ROI image data in encoded layers of increasing accuracy and quality whereby the most visually important image data is streamed first;

wherein a search for requested ROI image data is first performed on said local cache, and only if not found, said requested ROI image data is streamed by said publication server to said client computer;

wherein transmission of ROI image data from said publication server during said interactive mode for said selected study is given higher priority over transmission of study data of non-selected studies which continues at lower priority; and

fifth means for decoding and displaying data received from said publication server in response to said requests for one or more ROIs.

13. The system according to claim 12, wherein said publication server is adapted to send said studies to said client computer in accordance with a set of publication rules.

14. The system according to claim 12, wherein said publication server is adapted to send said studies while in said automatic mode using progressive image streaming techniques whereby information is sent in encoded layers wherein each successive layer has higher accuracy and quality than the layer previous thereto.

15. The system according to claim 12, wherein said client computer comprises means for using only data stored in said local cache when a user initiates a viewing session of said selected study after all data for said selected study is completely received.

16. The system according to claim 12, wherein said client computer comprises means for using progressive image streaming techniques to retrieve data from said publication server for said selected study when a user initiates a viewing session of said selected study before any data corresponding thereto has been received by said client computer.

17. The system according to claim 12, wherein said client computer comprises data pull means adapted to periodically poll said publication server for new studies that have not yet been retrieved.

18. The system according to claim 12, wherein said client computer comprises data push means adapted to configure said publication server to automatically check for and send new studies that have not yet been transmitted to said client.

19. The system according to claim 12, wherein said publication server is adapted to send said one or more studies to said client while in interactive mode using progressive image streaming techniques whereby information is sent in encoded layers wherein each successive layer has higher accuracy and quality than the layer previous thereto.

20. The system according to claim 12, wherein said client computer comprises means whereby when said user initiates a viewing session of said selected study after data is completely received by said client, then said client utilizes said data to provide instant rendering of images within said selected study.

21. The system according to claim 12, further comprising means for permitting said user to freely switch back and forth between said automatic mode and said interactive mode without the need to switch protocols.

22. The system according to claim 12, wherein said progressive image streaming techniques are performed utilizing JPEG2000 standard.

23. An image publication system for use on a publication server computer coupled to a communications network, comprising:

first means for configuring said publication server computer in an automatic publishing mode in response to a command received from a client computer coupled to said communications network whereby new studies are automatically sent to said client computer as they become available without requiring any intervention by a user;

second means for halting said automatic publishing mode at any time for a selected study that has not yet been transmitted in its entirety to said client computer, and immediately entering an interactive mode whereby a dynamic interactive viewing session is initiated between a user and said publication server computer;

third means for streaming image data from said publication server computer to said client computer during said interactive viewing session using progressive image streaming techniques in response to requests from said client computer for one or more regions of interest (ROI), said ROIs corresponding to specific portions of an image as determined by the user'"'"'s current viewing parameters and preferences, wherein said progressive image streaming techniques utilize compression to transmit said ROI image data in encoded layers of increasing accuracy and quality whereby the most visually important image data is streamed first;

wherein said requested ROI image data is streamed by said publication server to said client computer only if said requested ROI image data is not found during a search of local cache on said client computer; and

wherein transmission of ROI image data from said publication server during said interactive mode for said selected study is given higher priority over transmission of study data of non-selected studies which continues at lower priority.

24. The system according to claim 23, wherein said publication server computer is adapted to send said one or more studies to said client computer using progressive image streaming techniques whereby information is sent in encoded layers wherein each successive layer has higher accuracy and quality than the layer previous thereto.

25. The system according to claim 24, wherein said progressive image streaming techniques are performed utilizing JPEG2000 standard.

26. The system according to claim 23, wherein said publication server computer is adapted to send one or more of said new studies to said client computer in accordance with a set of publication rules.

27. A computer program product for use in a client computer coupled to a communication network, said computer program product comprising:

a computer readable medium having computer readable program code means embodied in said medium for receiving and displaying studies from a publication server coupled to said communications network, said computer program product comprising;

computer readable program code means for entering an automatic publishing mode whereby new studies are sent automatically from said publication server to said client computer over said communications network as they become available without requiring any intervention by a user;

computer readable program code means for receiving said studies and storing them in a local cache;

computer readable program code means for permitting the user to interrupt said automatic publishing mode at any time for a selected study that has not yet been received in its entirety from said publication server, and immediately entering an interactive mode whereby a dynamic interactive viewing session is initiated between the user and said publication server

computer readable program code means for streaming image data from said publication server to said client computer during said interactive viewing session using progressive image streaming techniques in response to requests for one or more regions of interest (ROI), said ROIs corresponding to specific portions of an image as determined by the user'"'"'s current viewing parameters and preferences, wherein said progressive image streaming techniques utilize compression to transmit said ROI image data in encoded layers of increasing accuracy and quality whereby the most visually import ant image data is streamed first, wherein a search for requested ROI image data is first performed on said local cache, and only if not found, said requested ROI image data is streamed by said publication server to said client computer, wherein transmission of ROI image data from said publication server during said interactive mode for said selected study is given higher priority over transmission of study data of non-selected studies which continues at lower priority; and

computer readable program code means for decoding data received from said publication server in response to requests for one or more ROIs.

28. A computer program product for use in a publication server computer coupled to a communication network, said computer program product comprising:

a computer readable medium having computer readable program code means embodied in said medium for publishing studies to a client computer coupled to said communications network, said computer program product comprising;

computer readable program code means for configuring said publication server computer in an automatic publishing mode in response to a command received from a client computer coupled to said communications network whereby new studies are automatically sent to said client computer as they become available without requiring any intervention by a user;

computer readable program code means for halting said automatic publishing mode at any time for a selected study that has not yet been transmitted in its entirety to said client computer, and immediately entering an interactive mode whereby a dynamic interactive viewing session is initiated between a user and said publication server computer; and

computer readable program code means for streaming image data from said publication server computer to said client computer during said interactive viewing session using progressive image streaming techniques in response to requests from said client computer for one or more regions of interest (ROI), said ROIs corresponding to specific portions of an image as determined by the user'"'"'s current viewing parameters and preferences, wherein said progressive image streaming techniques utilize compression to transmit said ROI image data in encoded layers of increasing accuracy and quality whereby the most visually import ant image data is streamed first, wherein said requested ROI image data is streamed by said publication server to said client computer only if said requested ROI image data is not found during a search of local cache on said client computer, wherein transmission of ROI image data from said publication server during said interactive mode for said selected study is given higher priority over transmission of study data of non-selected studies which continues at lower priority.