Content and display device dependent creation of smaller representation of images

• US 7,095,907 B1
• Filed: 01/10/2002
• Issued: 08/22/2006
• Est. Priority Date: 01/10/2002
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Berkner, Kathrin, Wolff, Gregory J., Hart, Peter E., Boliek, Martin, Neelamani, Ramesh
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): Kassa, Yosef
• Application Number:
  US10/044,603
• Time in Patent Office: 1,685 Days
• Field of Search: 382/190, 382/282, 382/293, 382/295, 382/298, 382/299, 382/240, 382/243, 382/244, 382/274, 382/275, 358/1.2, 358/3.26, 358/3.27, 358/451, 348/607, 348/608
• US Class Current: 382/298
• CPC Class Codes: G06T 3/4084 in the transform domain, e.g. fast Fourier transform [FFT] domain scaling
• CPC Class Codes: G09G 2340/0414 Vertical resolution change
• CPC Class Codes: G09G 2340/0421 Horizontal resolution change
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 5/373 for modifying the size of the graphic pattern
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/393 Enlarging or reducing
• CPC Class Codes: H04N 19/119 Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/134 characterised by the element, parameter or criterion affecting or controlling the adaptive coding
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/18 the unit being a set of transform coefficients
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/647 using significance based coding, e.g. Embedded Zerotrees of Wavelets [EZW] or Set Partitioning in Hierarchical Trees [SPIHT]
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

A method and apparatus to receive an image and to create a smaller representation of the image from a wavelet representation of the image is described. The size of the smaller representation of the image is selected to compensate for the content of the image and physical properties of the display device to display the smaller representation of the image.

Claims

1. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein the at least one physical property includes at least one selected from a group consisting of dots per inch resolution, absolute pixel resolution, contrast ratio, viewing distance, pixels per viewing angle, and gain function.

2. The method defined in claim 1 further comprising selecting an output shape for the smaller representation based on content of the image and at least one physical property of a display device to display the smaller representation of the image.

3. The method defined in claim 1 further comprising selecting an output application for the smaller representation based on content of the image and at least one physical property of a display device to display the smaller representation of the image.

4. The method defined in claim 1 further comprising selecting an output shape and application for the smaller representation based on content of the image and at least one physical property of a display device to display the smaller representation of the image.

5. The method defined in claim 1 further comprising selecting an output resolution for the smaller representation based on content of the image and at least one physical property of a display device to display the smaller representation of the image.

6. The method defined in claim 1 further comprising selecting an output shape, resolution and application for the smaller representation based on content of the image and at least one physical property of a display device to display the smaller representation of the image.

7. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times large enough to cause an entirety of the smaller representation of the image to be visible on the display device.

8. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes varying display window size of a segment of the image for a given fixed segment shape.

9. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes varying display window size of a segment of the image for a given fixed segment resolution.

10. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes varying segment shape of a segment of the image for a given fixed display window size.

11. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes varying resolution of a segment of the image for a given fixed display window size.

12. The method of claim 1, wherein the size of the smaller representation of the image depends on pixels per viewing angle of the display device.

13. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes partitioning the image into segments and downsampling each of the segments a number of times.

14. The method of claim 13 wherein partitioning the image into segments includes partitioning the image by JPEG2000 code units.

15. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes partitioning the wavelet domain into cells.

16. The method of claim 15, wherein cells comprise JPEG 2000 units.

17. The method defined in claim 1 further comprising displaying only parts of the image that are associated with a particular display scale.

18. The method defined in claim 17 further comprising selecting segments for display that are grouped into connected components.

19. The method defined in claim 17 further comprising displaying only some of the segments of an image based on whether selected segments are contained in a bounding box.

21. The method of claim 1, wherein creating a smaller representation of the image from a wavelet representation of the image includes suppression of noisy wavelet coefficients.

20. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times dependent proportionately on a ratio of coarse structures in the image to fine structures in the image.

22. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times according to a ratio of wavelet coefficients in a class of significant features to wavelet coefficients in a class of insignificant features.

23. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling a segment of the image a number of times to approximate a given fixed size window.

24. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling a segment of the image a number of times to approximate a given fixed shape.

25. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling a segment of the image to arrive at which a resolution for the segment that approximates a given fixed resolution.

26. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein the size of the smaller representation of the image depends on dots per inch resolution of the display device.

27. The method of claim 26, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times so as to cause a number of dots in a diameter of the object to be at least as large as a number of dots in the minimal visible object diameter.

28. A method comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times at which a trend changes from an importance measure increasing each time to the importance measure decreasing each time.

29. The method of claim 28, wherein the importance measure is energy.

30. The method of claim 28, wherein the importance measure is entropy.

31. The method of claim 28, wherein the importance measure is an importance measure of wavelet coefficients in a selected subband.

32. The method of claim 28, wherein the importance measure is an importance measure of a sum of wavelet coefficients in weighted subbands.

33. The method of claim 28, wherein the importance measure is a maximum importance measure of wavelet coefficients from all subbands.

34. A machine-readable medium that provides instructions that, when executed by a machine, cause the machine to perform operations comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein the at least one physical property includes at least one selected from a group consisting of dots per inch resolution, absolute pixel resolution, contrast ratio, viewing distance, pixels per viewing angle, and gain function.

35. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times large enough to cause the smaller representation of the image to be entirely visible on the display device.

36. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes suppression of noisy wavelet coefficients.

37. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling a segment of the image a number of times to approximate a given fixed size window.

38. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling a segment of the image a number of times to approximate a given fixed shape.

39. The machine-readable medium of claim 38, wherein the importance measure is a maximum importance measure of wavelet coefficients from all subbands.

40. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling a segment of the image a number of times to approximate a given fixed resolution.

41. The machine-readable medium of claim 34, wherein the size of the smaller representation of the image depends on a number of dots depends proportionately on a pixels per viewing angle of the display device.

42. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times at which a trend changes from an importance measure increasing each time to the importance measure decreasing each time.

43. The machine-readable medium of claim 42, wherein the importance measure is energy.

44. The machine-readable medium of claim 42, wherein the importance measure is entropy.

45. The machine-readable medium of claim 44, wherein partitioning the image into segments includes partitioning the image by JPEG 2000 code units.

46. The machine-readable medium of claim 42, wherein the importance measure is an importance measure of wavelet coefficients in a selected subband.

47. The machine-readable medium of claim 42, wherein the importance measure is an importance measure of a sum of wavelet coefficients in weighted subbands.

48. The machine-readable medium of claim 34, wherein creating a smaller representation of the image from a wavelet representation of the image includes partitioning the image into segments and downsampling each cell a number of times.

49. A machine-readable medium that provides instructions that, when executed by a machine, cause the machine to perform operations comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times dependent proportionately on a ratio of coarse structures in the image to fine structures in the image.

50. A machine-readable medium that provides instructions that, when executed by a machine, cause the machine to perform operations comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times according to a ratio of wavelet coefficients in a class of significant features to wavelet coefficients in a class of insignificant features is highest.

51. The machine-readable medium of claim 50, wherein creating a smaller representation of the image from a wavelet representation of the image includes downsampling the image a number of times so as to cause a number of dots in a diameter of the object to be at least as large as a number of dots in the minimal visible object diameter.

52. A machine-readable medium that provides instructions that, when executed by a machine, cause the machine to perform operations comprising:

receiving an image; and

creating a smaller representation of the image from a wavelet representation of the image, including selecting display size of the smaller representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein the size of the smaller representation of the image depends on a number of dots depends proportionately on a dots per inch resolution of the display device.

53. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein the at least one physical property includes at least one selected from a group consisting of dots per inch resolution, absolute pixel resolution, contrast ratio, viewing distance, pixels per viewing angle, and given function.

54. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples the image a number of times large enough to cause an entirety of the smaller representation of the image to be visible on the display device.

55. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples the image a number of times dependent proportionately on a ratio of coarse structures in the image to fine structures in the image.

56. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit performs suppression of noisy wavelet coefficients.

57. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples the image a number of times according to a ratio of wavelet coefficients in a class of significant features to wavelet coefficients in a class of insignificant features is highest.

58. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples a segment of the image a number of times to approximate a given fixed size.

59. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples a segment of the image a number of times to approximate a given fixed shape.

60. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples a segment of the image a number of times to approximate a given fixed resolution.

61. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein the size of the smaller representation of the image depends on dots per inch resolution of the display device.

62. The apparatus of claim 61, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples the image a number of times so as to cause a number of dots in a diameter of the object to be at least as large as a number of dots in the minimal visible object diameter.

63. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit downsamples the image a number of times at which a trend changes from an importance measure increasing each time to the importance measure decreasing each time.

64. The apparatus of claim 63, wherein the importance measure is energy.

65. The apparatus of claim 63, wherein the importance measure is entropy.

66. The apparatus of claim 63, wherein the importance measure is an importance measure of wavelet coefficients in a selected subband.

67. The apparatus of claim 63, wherein the importance measure is an importance measure of a sum of wavelet coefficients in weighted subbands.

68. The apparatus of claim 63, wherein the importance measure is a maximum importance measure of wavelet coefficients from all subbands.

69. An apparatus comprising:

a receiving unit to receive an image; and

a processing unit coupled with the receiving unit, the processing unit to create a smaller representation of the image from a wavelet representation of the image based on content of the image and at least one physical property of a display device to display the smaller representation of the image, wherein, to create a smaller representation of the image from a wavelet representation of the image, the processing unit is to partition the image into segments and downsample each cell a number of times.

70. The apparatus of claim 69, wherein, to partition the image into segments, the processing unit is to partition the image by JPEG2000 code units.