Method and system for remote and adaptive visualization of graphical image data

• US 20040240752A1
• Filed: 05/12/2004
• Published: 12/02/2004
• Est. Priority Date: 05/13/2003
• Status: Abandoned Application

• Current Assignee: Medical Insight A/S (Canon Inc.)
• Original Assignee: Medical Insight A/S (Canon Inc.)
• Inventors: Olsen, Morten Sylvest, Dobbs, Andrew Bruno, Karaivanov, Alexander Dimitrov, Kjaer, Niels Husted
• Application Number:
  US10/843,420
• Publication Number:
  US 20040240752A1
• Time in Patent Office: Days
• US Class Current: 382/276
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

The invention relates to a method and system for remote visualization and data analysis of graphical data, in particular graphical medical data. A user operates a client machine 21 such as a thin client, a PC, a PDA, etc. and the client machine is connected to a server machine 20 through a computer network. The server machine runs an adaptive streaming module (ASM) which handles the connection between the client and the server. All data and data applications are stored and run on the server. A user at the client side requests data to be shown on the screen of the client, this request 24 is transferred to the server. At the server side the request is interpreted as a request for a particular screen image, and a data application generates the requested screen image and estimates a present available bandwidth 26 of a connection between the client and the server. Based on the estimated available bandwidth, the generated screen image is compressed using a corresponding compression method so that a compressed screen image is formed. The screen image may also be encrypted. The compressed (and possible encrypted) screen image is forwarded 22 to the client, and shown on the screen of the client 23. The compression method depends foremost upon the available bandwidth, however also the type of client machine 28, the type of request, etc. may be taken into account.

Claims

1. A method for transferring graphical data from a first device to an at least second device in a computer-network system, the method comprises the steps of:

generating a request for a screen image,

in the first device, upon receiving the request for the screen image;

generating the requested screen image,

estimating a present available bandwidth of a connection between the first and the at least second device,

based on the estimated available bandwidth, compressing the generated screen image using a corresponding compression method so that a compressed screen image is formed, and

forwarding the compressed screen image to the at least second device.

2. A method according to claim 1, wherein the first device without receiving the request from the at least second device is:

generating a non-requested screen image,

estimating the present available bandwidth of the connection between the first and the at least second device,

based on the estimated available bandwidth, compressing the generated screen image using the corresponding compression method so that the compressed screen image is formed, and

forwarding the compressed screen image to the at least second device.

3. A method according to claim 1, wherein the generation of the screen image is further conditioned upon a type of the at least second device.

4. A method according to claim 1, wherein the compression method used is further conditioned upon a type of the request.

5. A method according to claim 1, wherein the compression method used is further conditioned upon a type of the at least second device.

6. A method according to claim 1, wherein the graphical data that is transmitted between the first device and the at least second device is encrypted.

7. A method according to claim 1, wherein the graphical data is graphical medical data.

8. A method according to claim 1, wherein the graphical data and a multitude of applications for data analysis and visualization are stored/run on the first device, or on a device which is in computer-network connection with the first device.

9. A method according to claim 1, wherein different compression methods are applied according to a required compression rate.

10. A method according to claim 1, wherein the compression method is either selected manually at session start or chosen automatically by the software.

11. A method according to claim 1, wherein control components are uploaded to the at least second device from the first device.

12. A method according to claim 1, wherein a frame sizer at the first device side sets a frame buffer resolution at the at least second device in accordance with the estimated available bandwidth, and optionally also in accordance with specifications of the at least second device.

13. A method according to claim 1, wherein an object subsampler sets the visualization and rendering parameters in accordance with the estimated available bandwidth, and optionally also in accordance with the specifications of the at least second device.

14. A method according to claim 1, wherein an I/O-manager at the first device side sends sized, subsampled, compressed and possibly encrypted frame buffer data to the at least second device, and wherein an I/O-manager at the at least second device side receives the graphical data.

15. A method according to claim 1, wherein the screen image generated at the at least second device side is either based on a screen image received from the first device, on the content of the frame buffer of the at least second device, or on a combination of the received screen image and the contents of the frame buffer.

16. A method according to claim 1, wherein the computer network connection occupies variable amounts of bandwidth, and wherein minimal bandwidth is occupied when data is not transferred from the first device to the at least second device.

17. A method according to claim 1, wherein the at least second device and the first device communicate via a common network connection, such as an Internet connection or an intranet connection, e.g. an Ethernet connection, either through a cable connection or through a wireless connection.

18. A method according to claim 17, wherein the connection protocol is a TCP/IP protocol.

19. A method according to claim 1, wherein the generation of the screen image is based on data which conforms to the DICOM, the HL7 or the EDIFACT standards implemented on PACS systems.

20. A method according to claim 1, wherein an RGB-color graphical image or a gray-scale graphical image is compressed, said compression method comprises the steps of:

subdividing the graphical image into cells containing 4×

4 pixels,

determining an average cell color for each cell,

in the case that the average cell color is a gray-scale color, 1 bit is used to mark the cell as gray scaled and 7 bits are used to represent the gray-scale color, or

in the case that the average cell color is not a gray-scale color, 1 bit is used to mark the cell as non-gray scaled and 15 bits are used to represent the color.

21. A computer program adapted to perform the method of claim 1, when said program is run on a computer-network system.

22. A computer readable data carrier loaded with a computer program according to claim 21.

30. A method according to claim 9, wherein an RGB-color graphical image or a gray-scale graphical image is compressed, said compression method comprises the steps of:

subdividing the graphical image into cells containing 4×

4 pixels,

determining an average cell color for each cell,

in the case that the average cell color is a gray-scale color, 1 bit is used to mark the cell as gray scaled and 7 bits are used to represent the gray-scale color, or

in the case that the average cell color is not a gray-scale color, 1 bit is used to mark the cell as non-gray scaled and 15 bits are used to represent the color.

31. A method according to claim 10, wherein an RGB-color graphical image or a gray-scale graphical image is compressed, said compression method comprises the steps of:

subdividing the graphical image into cells containing 4×

4 pixels,

determining an average cell color for each cell,

in the case that the average cell color is a gray-scale color, 1 bit is used to mark the cell as gray scaled and 7 bits are used to represent the gray-scale color, or

in the case that the average cell color is not a gray-scale color, 1 bit is used to mark the cell as non-gray scaled and 15 bits are used to represent the color.

23. A system for transferring graphical data between devices in a computer-network system, said system comprises:

at least a second device equipped with means for registering a user input as well as visualization means for visualizing graphical data,

a first device equipped with;

software adapted to generate screen images,

means for estimating an available bandwidth of a connection between the first and the at least second device,

software adapted to compress a screen image using a multitude of compression methods so that a compressed screen image is formed, and

means for forwarding the compressed screen image to the at least second device.

24. A system according to claim 23, wherein the first device further comprises means for encrypting data to be sent via the computer connection between the first device and the at least second device, and wherein the at least second device comprises means for decrypting the received data.

25. A system according to claim 23, wherein the at least second device and the first device communicate via a common network connection.

26. A system according to claims 25, wherein the network connection is a non-dedicated network connection.

27. A system according to claim 23, wherein the first device is computer server system.

28. A system according to claim 23, wherein the at least second device is a thin client, a work station computer, a PC, a lap top computer, a tablet PC, a mobile phone or a wireless handheld device.

29. A system according to claim 23, wherein the first device is, or is part of, a PACS system.