Teleradiology systems for rendering and visualizing remotely-located volume data sets

• US RE44,336 E1
• Filed: 11/21/2011
• Issued: 07/02/2013
• Est. Priority Date: 11/05/1999
• Status: Expired due to Term

• Current Assignee: Vital Images Incorporated (Canon Inc.)
• Original Assignee: Vital Images Incorporated (Canon Inc.)
• Inventors: Hu, Hui, Zhang, Jun
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US13/301,600
• Time in Patent Office: 589 Days
• Field of Search: 382/128, 382/100, 382/134, 382/206, 128/904, 128/922, 600/382, 324/309, 324/323, 345/418, 345/700, 434/262, 348/65, 348/77
• US Class Current: 382/128
• CPC Class Codes: G06F 19/321 Management of medical image data, e.g. communication or archiving systems such as picture archiving and communication systems [PACS] or related medical protocols such as digital imaging and communications in medicine protocol [DICOM]; Editing of medical image data, e.g. adding diagnosis information image data processing in general G06T, image data processing related to 3D objects G06F17/00; biomedical image inspection G06T7/0012

Abstract

A teleradiology system provides the capability of rendering and studying of a remotely located volume data without requiring transmission of the entire data to the user'"'"'s local computer. The system comprises: receiving station (300) under the control of a user (400); transmitting station (100); the connecting network (200); the user interface (32) with functionality of controlling volume data rendering, transmission, and display; and the interface with patient data source (10). The teleradiology system of the invention provides an integrated functionality of data transmission of current teleradiology systems and volume data rendering/visualization of current volume data rendering/visualization systems. The system may be readily used with an intranet, the internet (including the internet2) or via a direct dial-up using a telephone line with a modem, and can serve as an enterprise-wide PACS and may be readily integrated with other PACS and image distribution systems. Software of this system can be centrally installed and managed and can be provided to the user'"'"'s local computer on an as-needed basis. Furthermore, the software for the user'"'"'s computer is developed to use with standard web browser. This system provides a secure, cost-effective, widely-accessible solution for data rendering and visualization. It provides a suitable image distribution method for medical image data, for medical data repository, and for the electronic medical record (or the computerized patient record). It allows healthcare providers (e.g., radiologists, other physicians, and supporting staffs) to render and study remotely located patient data at the locations of their choices.

Claims

1. A post-processing system for remotely accessing patient information and data previously acquired and electronically stored, and for remotely generating a volume data rendering result, comprising:

at least one receiving station controllable by at least one user of said system;

at least one transmitting station physically separated from said receiving station for communicatively coupling to said receiving station through at least one network;

user interface means provided at said receiving station for enabling a user to specify at least one patient volume data set previously acquired and stored in said transmitting station, and to specify at least one request for volume data rendering comprising specifying a volume data rendering method and rendering parameters to be applied on said volume data set;

an image processor at said transmitting station interactively controllable at said receiving station to generate a partial or complete volume data rendering result in real time by processing said volume data set using said volume data rendering method and rendering parameters specified by said user;

a data transmitter provided at said transmitting station for transmitting said processed result to said receiving station; and

display means for displaying the requested rendering result and rendering parameters at said receiving station.

2. The system of claim 1 further including:

security and data management means for preventing an unauthorized user from gaining access to said data set from said system.

3. The system of claim 2 wherein:

said security and data management means further include means for employing firewalls during the data transmission and/or for encrypting demographic of said data set.

4. The system of claim 1 further including:

Means included in said transmitting station for compressing data to be transmitted;

means for transmitting said compressed data from said transmitting station to said receiving station through said network; and

means included in said receiving station for decompressing said transmitted data.

5. The system of claim 4 wherein:

said compressing means and decompressing means are operable in accordance with each of a plurality of compression/decompression methods, the particular method used being alternatively selected by said user through said user interface, or by an automated computer program.

6. The system of claim 1 wherein:

said receiving station includes means for computing the remaining part of said rendering result.

7. The system of claim 1 wherein:

said system'"'"'s software is installed, managed and upgraded at one of said stations, the software for the other station being alternatively supplied at each time of use over said network or on a permanent basis.

8. The system of claim 1 further including:

management and software distribution means included in said system for charging the use of said system alternatively on per license basis or on per use basis.

9. The system of claim 1 wherein:

said system has a plurality of operation modes, the particular operation mode used being alternatively selected by said user through said user interface, or by an automated computer program.

10. The system of claim 1 wherein:

said receiving station is provided with software which is usable with a web browser.

11. The system of claim 1 wherein:

said receiving stations comprises one of multiple receiving stations interconnected by said network so that the input and the display at one of said receiving stations can be viewed by other of said receiving stations.

12. The system of claim 1 further including:

data transmission means for transmitting images with progressive refinement.

13. The system of claim 1 wherein:

said user interface means includes image processing tools and data editing tools for editing said data set.

14. The system of claim 1 wherein:

the data transmission is controlled by the transmission parameters, said transmission parameters being alternatively selected by said user through said user interface, or by an automated program.

15. The system of claim 1 wherein:

said user interface means comprises means for enabling said user to specify different data rendering requests resulting from different rendering parameters, different rendering methods, and/or different data sets from one or multiple data acquisition methods, and

to specify a method to integrate said different data rendering results into at least one composite rendering result; and

said display means for presenting at said receiving station said composite rendering result and a plurality of parameters used for generating said composite rendering result.

16. The system of claim 1, wherein said display means, user interface means and image processor are configured for enabling said user to interactively view said displayed requested rendering result and parameters and specify adjusted volume data rendering methods and parameters to generate updated rendering results.

17. The system of claim 1, wherein said transmitting station and said image processor are couplable to a plurality of receiving stations for serving multiple receiving stations concurrently.

18. The system of claim 1, wherein said transmitting station is implemented with a plurality of computers.

19. A method for locally generating a volume data rendering result in accordance with a remote request for processing of previously acquired and locally stored patient information and data, comprising:

locally storing at least one patient volume data set;

locally receiving an identification of at least one specified patient volume data set and at least one request for volume data rendering from a remote user, the request for volume data rendering comprising a volume data rendering method and rendering parameters to be applied on said specified patient volume data set;

locally generating a partial or complete volume data rendering result in real time by processing said specified patient volume data set using said volume data rendering method and rendering parameters received from said remote user; and

locally transmitting said processed result for remotely displaying said requested rendering result and said rendering parameters.

20. The method of claim 19, further comprising:

locally receiving new requests for volume data rendering interactively issued by said remote user based on feedback from said displayed requested rendering result and said rendering parameters, said new requests comprising an adjusted volume data rendering method and adjusted rendering parameters;

locally generating an updated partial or complete volume data rendering result in real time by processing said specified patient volume data set using said adjusted volume data rendering method and adjusted rendering parameters; and

repeating said new requests for volume data rendering and said generation of said updated partial or complete volume data rendering result until a desired rendering result is achieved.

21. A method, comprising:

locally receiving, at a computer system from a remote user, a request for volume data rendering for medical imaging volume data, the request including an identification of;

a volume data set, a volume data rendering method, and a rendering parameter to be applied on the volume data set, the request generated from a user interface operated by the remote user enabling specification of at least one of a plurality of different rendering parameters, at least one of a plurality of different rendering methods, at least one of a plurality of different data sets from one or multiple data acquisition methods, and a method for integration of the request with at least one additional request into a complete volume data rendering result;

locally generating, at the computer system, the complete volume data rendering result by processing the volume data set using the volume data rendering method and the rendering parameter received from the remote user; and

locally transmitting, from the computer system, the complete volume data rendering result to a remote machine for remotely displaying the complete volume data rendering result, the remote machine configured for displaying the complete volume data rendering result and a plurality of parameters used for generating the complete volume data rendering result.

22. The method of claim 21, further comprising:

locally generating, at the computer system, an updated volume data rendering result in real time by processing the volume data set using at least one of a received adjusted volume data rendering method and a received adjusted rendering parameter.

23. The method of claim 21, wherein locally generating the complete volume data rendering result occurs in real time in response to the request for volume data rendering.

24. The method of claim 21, wherein receiving the request for volume data rendering permits specifying, by the remote user, of a particular volume data rendering method by selecting from a plurality of available volume data rendering methods.

25. The method of claim 24, wherein the available volume data rendering methods include multiplanar reformation (MPR), maximum intensity projection (MIP), and surface rendering.

26. The method of claim 21, further comprising:

receiving, at the computer system, a new additional request for volume data rendering that is interactively issued by a remote user as a result of viewing the complete volume data rendering result, the new additional request for volume data rendering including a new different volume data rendering method;

locally generating, at the computer system, a new volume data rendering result by processing the new additional request for volume data rendering using the new different volume data rendering method; and

locally transmitting, from the computer system, the new volume data rendering result to the remote machine for remotely displaying the new volume data rendering result.

27. A system comprising:

at least one transmitting station operating as a server, the transmitting station including an image processor interactively controllable by at least one remote client receiving station over a network to generate and provide in a data transmission to the remote client receiving station a complete medical image volume data rendering result in response to a volume data rendering request received by the transmitting station from the remote client receiving station, the volume data rendering request specifying at least one volume data rendering method and at least one rendering parameter to be applied on a volume data set by the transmitting station, wherein the volume data rendering request is generated from a user interface provided by the remote client receiving station enabling specification of at least one of a plurality of different rendering parameters, at least one of a plurality of different rendering methods, and at least one of a plurality of different data sets from one or multiple data acquisition methods, and wherein the volume data rendering request specifies a method to integrate the request into at least one composite rendering result.

28. The system of claim 27, wherein the image processor is operable to implement a plurality of available rendering methods, and wherein the image processor generates the rendering result using the at least one volume data rendering method specified in the volume data rendering request received from the remote client receiving station.

29. The system of claim 28, wherein the plurality of available rendering methods of the image processor include multiplanar reformation (MPR), maximum intensity projection (MIP), and surface rendering.

30. The system of claim 27, wherein the image processor is operable to generate the rendering result by applying a combination of multiple rendering methods on the volume data set.

31. The system of claim 27, wherein the image processor is operable to interactively compute and provide in real-time a first partial or complete rendering result in response to a first volume data rendering request from the remote client receiving station, according to a first volume data rendering method specified in the first volume data rendering request, and wherein the image processor is operable to compute and provide in real-time a second partial or complete rendering result in response to a second volume data rendering request from the remote client receiving station, according to a second volume data rendering method specified in the second volume data rendering request, wherein the first and second volume data rendering requests specify the same or different first and second volume data rendering methods.

32. The system of claim 27, wherein the system is operable to generate the volume data rendering result in real time.

33. The system of claim 27, wherein the data transmission is controlled by at least one transmission parameter, the transmission parameter being alternatively selected by a user through the user interface, or by an automated program.

34. The system of claim 27, wherein the system is operable to receive and process different data rendering requests resulting from different rendering parameters, different rendering methods, or different data sets from one or multiple data acquisition methods, and is operable to integrate the different data rendering results into at least one composite rendering result.

35. A method comprising:

sending from a client computing system to a remote server a request for volume data rendering, the request including an identification of a volume data set, a volume data rendering method, and a rendering parameter to be applied on the volume data set, the request generated from a user interface provided by the client computing system enabling specification of at least one of a plurality of different rendering parameters, at least one of a plurality of different rendering methods, at least one of a plurality of different data sets from one or multiple data acquisition methods, and a method for integration of the request with at least one additional request into a rendering result;

receiving at the client computing system from the remote server the rendering result, the rendering result including an at least partial volume data rendering result obtained by processing the volume data set at the remote server using the volume data rendering method and the rendering parameter; and

displaying the rendering result by the client computing system in a collaborative mode, wherein at least a portion of user input at the client is provided by at least one additional client operating in the collaborative mode.

36. A system, comprising:

at least one receiving station controllable by at least one user of the system, the receiving station comprising one of multiple receiving stations interconnected by at least one network, and the receiving station communicatively coupled to at least one transmitting station physically separated from the receiving station through the network;

a user interface provided at the receiving station and enabling a user to specify at least one medical imaging volume data set previously acquired and stored in the transmitting station, and to specify at least one request for volume data rendering specifying a volume data rendering method and rendering parameters to be applied on the volume data set, wherein the volume data rendering request is issued from the user interface and provides specification of;

at least one of a plurality of different rendering parameters, at least one of a plurality of different rendering methods, at least one of a plurality of different data sets from one or multiple data acquisition methods, and a method for integration of the request with at least one additional request into a requested rendering result; and

a display configured to output the requested rendering result and rendering parameters at the receiving station;

wherein the multiple receiving stations are interconnected by the network so that the output of the display at the receiving station can be viewed by other of the multiple receiving stations.

37. The system of claim 36, wherein the user interface at the receiving station provides interactive control of an image processor at the transmitting station to generate a partial or complete volume data rendering result in real time at the transmitting station by processing the volume data set using the volume data rendering method and rendering parameters specified by the user.

38. The system of claim 36, wherein the system has a plurality of operation modes, the particular operation mode used being alternatively selected by the user through the user interface, or by an automated computer program, and wherein the plurality of operation modes includes a collaborative mode.

39. The system of claim 36, wherein the user interface enables the user to specify different data rendering requests resulting from different rendering parameters, different rendering methods, or different data sets from one or multiple data acquisition methods, and to specify a method to integrate the different data rendering results into at least one composite rendering result;

and wherein the display is further configured to output the composite rendering result at the receiving station.

40. The system of claim 36, wherein the display, user interface, and image processor are configured to enable the user to interactively view the requested rendering result and parameters and to specify adjusted volume data rendering methods and parameters to generate updated rendering results.

41. The system of claim 36, wherein the transmitting station and the image processor are coupleable to a plurality of receiving stations for serving multiple receiving stations concurrently.

42. The system of claim 36, wherein the user interface provided at the receiving station permits the user to specify a first volume data rendering method of a plurality of available volume data rendering methods, to display a first rendering result using the first volume data rendering method on the volume data set, and based on viewing the displayed first rendering result, to then specify a second volume data rendering method of the plurality of available volume data rendering methods, and to display a second rendering result using the second volume data rendering method on the volume data set.

43. The system of claim 36, wherein the user interface provided at the receiving station permits the user to select one of several different volume data rendering methods for use on the volume data set, and wherein the user interface provided at the receiving station receives commands from an input device that permits the user to combine the different volume rendering methods used on the volume data set.

44. The system of claim 36, wherein cursor and axial, sagittal, and coronal display images are concurrently displayed and interactively updated on the display as a cursor position moves in the user interface.

45. The system of claim 36, wherein the display permits images from different volume rendering methods or different image data acquisition methods to be simultaneously displayed.

46. A system comprising:

at least one receiving station controllable by at least one user of the system, the receiving station configured to be communicatively coupled through at least one network to at least one transmitting station that is physically separated from the receiving station, the receiving station including;

a user interface, provided for execution and presentation at the receiving station, configured to enable the at least one user to interactively specify at least one medical imaging volume data set stored at the transmitting station, and to specify at least one volume data rendering method and at least one rendering parameter to be applied on a volume data set by the transmitting station to generate a volume data rendering result for transmitting from the transmitting station to the receiving station, wherein the user interface enables the at least one user to specify different data rendering requests resulting from different rendering parameters, different rendering methods, or different data sets from one or multiple data acquisition methods, and to specify integration of the different data rendering requests into at least one composite rendering result; and

a display device, at the receiving station, to display the rendering result, wherein the display device displays the composite rendering result and a plurality of parameters used for generating the composite rendering result.

47. The system of claim 46, wherein the user interface provided for execution at the receiving station is provided at least in part within a web browser.

48. The system of claim 47, wherein software for operation at the receiving station is provided as a plug-in or client applet executing within the web browser.

49. The system of claim 46, wherein the receiving station is provided with software that is installed, managed and upgraded by the transmitting station, the software being supplied over the network.

50. The system of claim 46, wherein computation operations to create the rendering result are performed exclusively by the transmitting station.

51. A system comprising:

at least one transmitting station operating as a server, the transmitting station comprising an image processor interactively controllable by at least one remote client receiving station over a network;

wherein the image processor is configured to;

generate and provide to the receiving station a partial or complete volume data rendering result in response to a volume data rendering request received by the transmitting station from the receiving station, the volume data rendering request specifying at least one volume data rendering method and at least one rendering parameter to be applied on a medical image volume data set by the transmitting station; and

wherein the transmitting station is configured to;

automatically adjust at least one configuration based on characteristics of the receiving station;

locally receive new requests for volume data rendering interactively issued by a remote user of the receiving station based on feedback from the partial or complete volume data rendering result and the rendering parameters, the new requests including an adjusted volume data rendering method and adjusted rendering parameters, wherein the new requests for volume data rendering are generated from a user interface provided by the receiving station enabling specification of at least one of a plurality of different rendering parameters, at least one of a plurality of different rendering methods, and at least one of a plurality of different data sets from one or multiple data acquisition methods, and wherein the new requests respectively specify a method to integrate respective of the new requests into at least one composite rendering result; and

locally generate an updated partial or complete volume data rendering result in real time by processing the specified medical imaging volume data set using the adjusted volume data rendering method and adjusted rendering parameters.

52. The system of claim 51, wherein the at least one transmitting station provides the remote client receiving station with software at each time of use or on an as-needed basis, the software being provided over the network.

53. The system of claim 51, the transmitting station being further configured to process the new requests for volume data rendering and re-generate the updated partial or complete volume data rendering result until a desired rendering result is achieved.