Method and apparatus for transmission and display of a compressed digitalized image

• US 7,474,795 B2
• Filed: 05/29/2007
• Issued: 01/06/2009
• Est. Priority Date: 11/24/1999
• Status: Expired due to Term

• Current Assignee: GE Medical Systems Information Technologies Incorporated (General Electric Company)
• Original Assignee: GE Medical Systems Information Technologies Incorporated (General Electric Company)
• Inventors: Carroll, Joseph M., Sirohey, Saad A., Barnes, Robert D.
• Primary Examiner(s): Chen; Wenpeng
• Application Number:
  US11/807,399
• Publication Number:
  US 20070230829A1
• Time in Patent Office: 588 Days
• Field of Search: 382/240, 382/299
• US Class Current: 382/240
• CPC Class Codes: G06T 3/4076 using the original low-resolution images to iteratively correct the high-resolution images
• CPC Class Codes: G06T 3/4084 in the transform domain, e.g. fast Fourier transform [FFT] domain scaling
• CPC Class Codes: G06T 3/4092 Image resolution transcoding, e.g. by using client-server architectures
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
• CPC Class Codes: H03M 7/3068 Precoding preceding compression, e.g. Burrows-Wheeler transformation
• CPC Class Codes: H04N 1/415 in which the picture-elements are subdivided or grouped into fixed one-dimensional or two-dimensional blocks
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/127 Prioritisation of hardware or computational resources
• CPC Class Codes: H04N 19/13 Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/184 the unit being bits, e.g. of the compressed video stream
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/33 : in the spatial domain
• CPC Class Codes: H04N 19/36 : Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/46 : Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/593 : involving spatial prediction techniques
• CPC Class Codes: H04N 19/63 : using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 21/234327 : by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/25808 : Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2662 : Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/440263 : by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/4516 : involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
• CPC Class Codes: H04N 21/454 : Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4621 : Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6373 : for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10

Abstract

The present technique selectively handles image data, which is decomposed into a plurality of resolution levels. In one embodiment, an image resolution suitable for display in a desired viewport is selected via an iterative process including determining whether scaling of one of the different image resolutions of the plurality of different image resolutions by a predetermined scaling threshold would result in a scaled image resolution that is less than or equal to the resolution of the desired viewport. A portion of the plurality of data sets may be selectively requested for recomposition of the image at the image resolution. Additional systems, methods, and devices for handling image data are also disclosed.

Claims

1. A method for selectively transferring image data, the method comprising:

selecting an image resolution suitable for display in a desired viewport from a plurality of different image resolutions, wherein the image resolution corresponds to one set of a plurality of data sets decomposed from an image by wavelet decomposition, and wherein the image resolution is determined via an iterative process that comprises determining whether scaling of one of the different image resolutions of the plurality of different image resolutions by a predetermined scaling threshold would result in a scaled image resolution that is less than or equal to the resolution of the desired viewport; and

selectively requesting a portion of the plurality of data sets for recomposition of the image at the image resolution.

2. The method of claim 1, wherein the plurality of data sets forms at least part of an image data file that is wavelet decomposed and stored in a compressed form on a server.

3. The method of claim 2, wherein the image data file is wavelet decomposed and stored in a losslessly compressed form on the server.

4. The method of claim 3, wherein the image data file is wavelet decomposed in a lossless manner.

5. The method of claim 2, wherein the image data file is wavelet decomposed and stored in the compressed form on the server independent of any request from a client for data of the plurality of data sets.

6. The method of claim 1, wherein the wavelet decomposition comprises lossless wavelet decomposition.

7. The method of claim 6, wherein the lossless wavelet decomposition comprises lossless integer wavelet decomposition.

8. The method of claim 1, wherein the portion of the plurality of data sets is smaller than the plurality of data sets, and selectively requesting the portion comprises requesting a data stream comprising the plurality of data sets arranged sequentially in a desired order based upon the wavelet decomposition.

9. The method of claim 1, wherein selecting the image resolution comprises selecting the image resolution from a plurality of progressively higher resolution levels, each corresponding to one of the plurality of data sets.

10. The method of claim 9, wherein selecting the image resolution comprises identifying a lowest suitable one of the plurality of progressively higher resolution levels that does not require upward scaling beyond the scaling threshold for display in the desired viewport.

11. The method of claim 10, wherein identifying the lowest suitable one comprises evaluating a highest local resolution level of the plurality of progressively higher resolution levels.

12. The method of claim 11, wherein selectively requesting the portion comprises recalling the highest local resolution level, which is the lowest suitable one.

13. The method of claim 11, wherein selectively requesting the portion comprises remotely retrieving the lowest suitable one, and any resolution levels between the highest local resolution level and the lowest suitable one, from remote storage.

14. The method of claim 1, wherein selecting the image resolution comprises zooming the desired viewport toward a desired viewport resolution.

15. A method for selectively transferring image data, the method comprising:

determining a viewport resolution of a client viewport;

identifying a highest local resolution level corresponding to one local set of a plurality of decomposed image sets generated from an image by wavelet decomposition;

selecting an acceptable image resolution for display in the client viewport by comparing the viewport resolution against progressively higher resolution levels corresponding to the plurality of decomposed image sets, wherein the acceptable image resolution is selected via an iterative process that comprises determining whether scaling of one of the progressively higher resolution levels by a predetermined scaling threshold would result in a scaled image resolution that is less than or equal to the viewport resolution; and

remotely retrieving desired sets of the plurality of decomposed image sets for recomposing the image at the acceptable image resolution.

16. The method of claim 15, wherein selecting the acceptable image resolution comprises identifying a lowest suitable one of the progressively higher resolution levels that does not require upward scaling beyond the scaling threshold for display in the desired viewport.

17. The method of claim 16, wherein remotely retrieving desired sets comprises locally accessing the highest local resolution level if the lowest suitable one is less than or equal to the highest local resolution level.

18. The method of claim 16, wherein remotely retrieving desired sets comprises remotely retrieving the lowest suitable one and any intermediate sets having resolution levels between the highest local resolution level and the lowest suitable one.

19. The method of claim 15, wherein selecting the acceptable image resolution comprises selecting the highest local resolution level as the acceptable image resolution if the highest local resolution level does not require unacceptable scaling to equal the viewport resolution.

20. The method of claim 15, wherein remotely retrieving the desired sets comprises requesting a data stream comprising the desired sets of the plurality of decomposed image sets arranged sequentially in order of increasing resolution.

21. The method of claim 20, wherein the acts of determining the viewport resolution, identifying the highest local resolution level, selecting the acceptable image resolution, and remotely retrieving desired sets are executed automatically as a user interacts with the client viewport.

22. A system comprising:

a viewport analysis module configured for determining a viewport resolution of a client viewport;

a data selection module, comprising;

a local data identifier configured for identifying a highest local resolution level corresponding to one local set of a plurality of decomposed image sets generated from an image by wavelet decomposition; and

a desired data identifier configured for identifying an acceptable image resolution for display in the client viewport via an iterative process that comprises determining whether scaling of one resolution level corresponding to one decomposed image set of the plurality of decomposed image sets by a predetermined scaling threshold would result in a scaled image resolution that is less than or equal to the viewport resolution; and

a data retrieval module configured for remotely retrieving desired sets of the plurality of decomposed image sets for recomposing the image at the acceptable image resolution.

23. The system of claim 22, wherein the desired data identifier comprises a resolution comparator configured for comparing the viewport resolution against progressively higher resolution levels corresponding to the plurality of decomposed image sets.

24. The system of claim 23, wherein the resolution comparator comprises a minimum acceptable resolution identifier configured for identifying a lowest suitable one of the progressively higher resolution levels that does not require upward scaling beyond the scaling threshold for display in the client viewport.

25. The system of claim 24, wherein the data retrieval module comprises a local data access module configured for locally accessing the highest local resolution level if the lowest suitable one is less than or equal to the highest local resolution level.

26. The system of claim 24, wherein the desired data identifier is configured to identify a desired data group comprising the lowest suitable one and any intermediate sets having resolution levels between the highest local resolution level and the lowest suitable one.

27. A device comprising:

a computer-readable medium;

a computer program stored on the computer-readable medium, the computer program comprising;

a viewport analysis module stored on the computer-readable medium and configured for determining a viewport resolution of a client viewport; and

a data selection module stored on the computer-readable medium, the data selection module comprising;

a local data identifier configured for identifying a highest local resolution level corresponding to one local set of a plurality of decomposed image sets generated from an image by wavelet decomposition; and

a desired data identifier configured for identifying an acceptable image resolution for display in the client viewport via an iterative process that comprises determining whether scaling of one resolution level corresponding to one decomposed image set of the plurality of decomposed image sets by a predetermined scaling threshold would result in a scaled image resolution that is less than or equal to the viewport resolution.

28. The device of claim 27, wherein the desired data identifier comprises a resolution comparator configured for comparing the viewport resolution against progressively higher resolution levels corresponding to the plurality of decomposed image sets.

29. The device of claim 28, wherein the resolution comparator comprises a minimum acceptable resolution identifier configured for identifying a lowest suitable one of the progressively higher resolution levels that does not require upward scaling beyond the scaling threshold for display in the client viewport.