Method, program and apparatus for image processing capable of effectively performing image transmission, and a medium storing the program

• US 7,508,988 B2
• Filed: 03/08/2005
• Issued: 03/24/2009
• Est. Priority Date: 03/09/2004
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Yamagata, Hideaki, Miyazawa, Toshio, Hasegawa, Fumihiro, Nagatsuka, Hiroaki, Hara, Junichi
• Primary Examiner(s): Le; Brian Q
• Assistant Examiner(s): BEKELE, MEKONEN T
• Application Number:
  US11/074,080
• Publication Number:
  US 20050201624A1
• Time in Patent Office: 1,477 Days
• Field of Search: 382/232, 382/233, 382/236, 382/243, 382/251, 709/231
• US Class Current: 382/232
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/647 using significance based coding, e.g. Embedded Zerotrees of Wavelets [EZW] or Set Partitioning in Hierarchical Trees [SPIHT]

Abstract

An image processing apparatus includes a receiving mechanism configured to receive a request, from at least one different image processing apparatus connected via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region being hierarchically compressed and stored in the image processing apparatus, a decomposing mechanism configured to decompose a codestream and retrieve the codestream in a component unit, an extracting mechanism configured to extract a target region from the codestream, a primary priority assigning mechanism configured to assign priority to the target region extracted by the extracting mechanism, and a primary transmitting mechanism configured for transmission of the codestream, decomposed in a component unit corresponding to the target region, to the different image processing apparatus requesting transmission of the codestream based on the priority assigned by the primary priority assigning mechanism.

Claims

1. An image processing apparatus, comprising:

a receiving mechanism configured to receive a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region and each region is hierarchically compressed and stored in the image processing apparatus;

a decomposing mechanism configured to decompose the codestream and to retrieve the codestream in a component unit;

an extracting mechanism configured to extract a target region from the codestream;

a primary priority assigning mechanism configured to assign priority to the target region extracted by the extracting mechanism;

a primary transmitting mechanism configured for transmission of the codestream, decomposed in a component unit corresponding to the target region, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the primary priority assigning mechanism;

a primary decoding mechanism configured to decode the codestream of the target region having a high priority assigned by the primary priority assigning mechanism;

an image processing mechanism configured to perform an image processing operation with respect to the image data decoded by the primary decoding mechanism; and

a primary encoding mechanism configured to hierarchically encode the image data processed by the image processing mechanism,

wherein the primary transmitting mechanism transmits the codestream, decomposed in a component unit corresponding to the target region encoded after the image processing operation, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the primary priority assigning mechanism.

2. The image processing apparatus according to claim 1, wherein the extracting mechanism separates an image into graphic image data and text image data, and extracts the target region based on a separation result.

3. The image processing apparatus according to claim 1, wherein the extracting mechanism separates an image into graphic image data and text image data, and extracts a region of the separated text image data as the target region, and wherein the primary priority assigning mechanism assigns priority to text data considered by the extracting mechanism to be a title in the separated text image data.

4. The image processing apparatus according to claim 1, wherein the extracting mechanism separates an image into graphic image data and text image data, and extracts the separated text image data as the target region, and wherein the primary priority assigning mechanism assigns priority to text image data having a large text size in the separated text image data.

5. The image processing apparatus according to claim 1, wherein the extracting mechanism separates an image into graphic image data and text image data, and extracts the separated graphic image data as the target region, and wherein the primary priority assigning mechanism assigns priority to graphic image data having a large graphic image size in the separated graphic image data.

6. The image processing apparatus according to claim 1, wherein the primary priority assigning mechanism assigns higher priority to a low resolution image of a region extracted as the target region, and assigns a same priority as a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

7. The image processing apparatus according to claim 1, wherein the primary priority assigning mechanism assigns higher priority to a low resolution image of a region extracted as the target region, and assigns a lower priority than a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

8. The image processing apparatus according to claim 1, wherein the primary priority assigning mechanism assigns priority to an important image region based on a quantitative index with respect to a visibility importance in the target region.

9. The image processing apparatus according to claim 1, wherein the primary priority assigning mechanism performs a priority assigning operation according to a rendering area of the different image processing apparatus requesting transmission of the codestream.

10. The image processing apparatus according to claim 1, wherein the image processing mechanism performs at least one operation of contrast conversion, color toner conversion, color intensity conversion, noise reduction and smoothing.

11. A method of processing an image by an image processing apparatus, comprising in a processor of the image processing apparatus:

receiving a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region being hierarchically compressed and stored in the image processing apparatus;

decomposing the codestream and retrieving the codestream in a component unit;

extracting a target region from the codestream;

assigning priority to the target region extracted by the extracting step;

transmitting the codestream, decomposed in a component unit corresponding to the target region, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the assigning step;

decoding the codestream of the target region having a high priority assigned by the assigning step;

performing an image processing operation with respect to the image data decoded by the decoding step; and

hierarchically encoding the image data processed by the performing step,

wherein the transmitting step transmits the codestream, decomposed in a component unit corresponding to the target region encoded after the image processing operation, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the assigning step.

12. The method according to claim 11, wherein the extracting step separates an image into graphic image data and text image data, and extracts the target region based on a separation result.

13. The method according to claim 11, wherein the extracting step separates an image into graphic image data and text image data, and extracts a region of the separated text image data as the target region, and wherein the assigning step assigns priority to text data responsive to whether the separated text image data includes title data.

14. The method according to claim 11, wherein the extracting step separates an image into graphic image data and text image data, and extracts the separated text image data as the target region, and wherein the assigning steps assigns priority to text image data having a large text size in the separated text image data.

15. The method according to claim 11, wherein the extracting step separates an image into graphic image data and text image data, and extracts the separated graphic image data as the target region, and wherein the assigning step assigns priority to graphic image data having a large graphic image size in the separated graphic image data.

16. The method according to claim 11, wherein the assigning step assigns higher priority to a low resolution image of a region extracted as the target region, and assigns a same priority as a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

17. The method according to claim 11, wherein the assigning step assigns higher priority to a low resolution image of a region extracted as the target region, and assigns a lower priority than a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

18. The method according to claim 11, wherein the assigning step assigns priority to an important image region based on a quantitative index with respect to a visibility importance in the target region.

19. The method according to claim 11, wherein the assigning step performs a priority assigning operation according to a rendering area of the at least one different image processing apparatus requesting transmission of the codestream.

20. The method according to claim 11, wherein the performing step includes the performance of at least one operation of contrast conversion, color toner conversion, color intensity conversion, noise reduction and smoothing.

21. A computer program product stored on a computer readable storage medium for carrying out an image processing method, when running on an image processing apparatus, the image processing method comprising:

receiving a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region being hierarchically compressed and stored in the image processing apparatus;

decomposing the codestream and retrieving the codestream in a component unit;

extracting a target region from the codestream;

assigning priority to the target region extracted by the extracting step;

transmitting the codestream, decomposed in a component unit corresponding to the target region, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the assigning step;

decoding the codestream of the target region having a high priority assigned by the assigning step;

performing an image processing operation with respect to the image data decoded by the decoding step; and

hierarchically encoding the image data processed by the performing step,

wherein the transmitting step transmits the codestream, decomposed in a component unit, corresponding to the target region encoded after the image processing operation, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the assigning step.

22. The product according to claim 21, wherein the extracting step separates an image into graphic image data and text image data, and extracts the target region based on a separation result.

23. The product according to claim 21, wherein the extracting step separates an image into graphic image data and text image data, and extracts a region of the separated text image data as the target region, and wherein the assigning step assigns priority to text data responsive to whether the separated text image data includes title data.

24. The product according to claim 21, wherein the extracting step separates an image into graphic image data and text image data, and extracts the separated text image data as the target region, and wherein the assigning steps assigns priority to text image data having a large text size in the separated text image data.

25. The product according to claim 21, wherein the extracting step separates an image into graphic image data and text image data, and extracts the separated graphic image data as the target region, and wherein the assigning step assigns priority to graphic image data having a large graphic image size in the separated graphic image data.

26. The product according to claim 21, wherein the assigning step assigns higher priority to a low resolution image of a region extracted as the target region, and assigns the same priority as a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

27. The product according to claim 21, wherein the assigning step assigns higher priority to a low resolution image of a region extracted as the target region, and assigns a lower priority than a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

28. The product according to claim 21, wherein the assigning step assigns priority to an important image region based on a quantitative index with respect to a visibility importance in the target region.

29. The product according to claim 21, wherein the assigning step performs a priority assigning operation according to a rendering area of the at least one different image processing apparatus requesting transmission of the codestream.

30. The product according to claim 21, wherein the performing step includes the performance of at least one operation of contrast conversion, color toner conversion, color intensity conversion, noise reduction and smoothing.

31. A computer readable recoding medium storing computer instructions for performing an image processing method, the method comprising:

receiving a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region being hierarchically compressed and stored in the image processing apparatus;

decomposing the codestream and retrieving the codestream in a component unit;

extracting a target region from the codestream;

assigning priority to the target region extracted by the extracting step;

transmitting the codestream, decomposed in a component unit corresponding to the target region, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the assigning step;

decoding the codestream of the target region having a high priority assigned by the assigning step;

performing an image processing operation with respect to the image data decoded by the decoding step; and

hierarchically encoding the image data processed by the performing step,

wherein the transmitting step transmits the codestream, decomposed in a component unit, corresponding to the target region encoded after the image processing operation, to the at least one different image processing apparatus requesting transmission of the codestream based on the priority assigned by the assigning step.

32. The storage medium according to claim 31, wherein the extracting step separates an image into graphic image data and text image data, and extracts the target region based on a separation result.

33. The storage medium according to claim 31, wherein the extracting step separates an image into graphic image data and text image data, and extracts a region of the separated text image data as the target region, and wherein the assigning step assigns priority to text data responsive to whether the separated text image data includes title data.

34. The storage medium according to claim 31, wherein the extracting step separates an image into graphic image data and text image data, and extracts the separated text image data as the target region, and wherein the assigning steps assigns priority to text image data having a large text size in the separated text image data.

35. The storage medium according to claim 31, wherein the extracting step separates an image into graphic image data and text image data, and extracts the separated graphic image data as the target region, and wherein the assigning step assigns priority to graphic image data having a large graphic image size in the separated graphic image data.

36. The storage medium according to claim 31, wherein the assigning step assigns higher priority to a low resolution image of a region extracted as the target region, and assigns the same priority as a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

37. The storage medium according to claim 31, wherein the assigning step assigns higher priority to a low resolution image of a region extracted as the target region, and assigns a lower priority than a region other than the target region to an image other than the low resolution image of the region extracted as the target region.

38. The storage medium according to claim 31, wherein the assigning step assigns priority to an important image region based on a quantitative index with respect to a visibility importance in the target region.

39. The storage medium according to claim 31, wherein the assigning step performs a priority assigning operation according to a rendering area of the at least one different image processing apparatus requesting transmission of the codestream.

40. The storage medium according to claim 31, wherein the performing step includes the performance of at least one operation of contrast conversion, color toner conversion, color intensity conversion, noise reduction and smoothing.

41. An image processing apparatus, comprising:

a receiving mechanism configured to receive a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region and each region hierarchically compressed and stored in the image processing apparatus;

an extracting mechanism configured to extract a target region from a first codestream;

a secondary decoding mechanism configured to decode a second codestream corresponding to the target region extracted by the extracting mechanism;

a normalization mechanism configured to normalize each line in an image according to a height of the text line of the extracted target region decoded by the secondary decoding mechanism;

an aggregation mechanism configured to aggregate the target region normalized by the normalization mechanism into a new image;

a secondary encoding mechanism configured to divide the new image aggregated by the aggregation mechanism into target regions, and to hierarchically encode the divided target region into a third codestream; and

a secondary transmitting mechanism configured for transmission of a fourth codestream having an image size of the at least one different image processing apparatus requesting transmission of the codestream, to the at least one different image processing apparatus, the fourth codestream being extracted from the third codestream and encoded according to a rendering area of the at least one different image processing apparatus.

42. The image processing apparatus according to claim 41, further comprising:

a secondary priority assigning mechanism configured to assign priority to the target region extracted by the extracting mechanism.

43. The image processing apparatus according to claim 41, further comprising:

an image processing mechanism configured to perform an image processing operation with respect to the image data decoded by the secondary decoding mechanism; and

wherein the secondary transmitting mechanism transmits the fourth codestream to the at least one different image processing apparatus.

44. A method of processing an image by an image processing apparatus, comprising in a processor of the image processing apparatus:

receiving a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region hierarchically compressed and stored in the image processing apparatus;

extracting a target region from a first codestream;

decoding a second codestream corresponding to the target region extracted by the extracting step;

normalizing each line in an image according to a height of the text line of the extracted target region decoded by the decoding step;

aggregating the target region normalized by the normalizing step into a new image;

dividing the new image aggregated by the aggregating step into target regions, and hierarchically encoding the divided target region into a third codestream; and

transmitting a fourth codestream to the at least one different image processing apparatus, the fourth codestream being encoded from the third codestream according to a rendering area of the at least one different image processing apparatus.

45. The method according to claim 44, further comprising:

assigning priority to the target region extracted by the extracting step.

46. The method according to claim 44, further comprising:

performing an image processing operation with respect to the image data decoded by the decoding step; and

wherein the fourth codestream is encoded by the encoding step after the image processing operation is performed by the performing step.

47. A computer program product stored on a computer readable storage medium for carrying out an image processing method, when run on an image processing apparatus, the image processing method comprising:

receiving a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region hierarchically compressed and stored in the image processing apparatus;

extracting a target region from a first codestream;

decoding a second codestream corresponding to the target region extracted by the extracting step;

normalizing each line in an image according to a height of the text line of the extracted target region decoded by the decoding step;

aggregating the target region normalized by the normalizing step into a new image;

dividing the new image aggregated by the aggregating step into target regions, and hierarchically encoding the divided target region into a third codestream; and

transmitting a fourth codestream to the at least one different image processing apparatus, the fourth codestream being encoded from the third codestream according to a rendering area of the at least one different image processing apparatus.

48. The product according to claim 47, further comprising:

assigning priority to the target region extracted by the extracting step.

49. The product according to claim 47, further comprising:

performing an image processing operation with respect to the image data decoded by the decoding step; and

wherein the fourth codestream is encoded by the encoding step after the image processing operation is performed by the performing step.

50. A computer readable recoding medium storing computer instructions for performing an image processing method, the method comprising:

receiving a request, from at least one different image processing apparatus connected with the image processing apparatus via a network, for transmission of a codestream generated in a way such that image data is divided into at least one region, each region hierarchically compressed and stored in the image processing apparatus;

extracting a target region from a first codestream;

decoding a second codestream corresponding to the target region extracted by the extracting step;

normalizing each line in an image according to a height of the text line of the extracted target region target region decoded by the decoding step;

aggregating the target region normalized by the normalizing step into a new image;

dividing the new image aggregated by the aggregating step into target regions, and hierarchically encoding the divided target region into a third codestream; and

transmitting a fourth codestream to the at least one different image processing apparatus, the fourth codestream being encoded from the third codestream according to a rendering area of the at least one different image processing apparatus.

51. The storage medium according to claim 50, further comprising:

assigning priority to the target region extracted by the extracting step.

52. The storage medium according to claim 50, further comprising:

performing an image processing operation with respect to the image data decoded by the decoding step; and

wherein the fourth codestream is encoded by the encoding step after the image processing operation is performed by the performing step.