Captured image processing system and recording medium

• US 8,587,818 B2
• Filed: 08/06/2010
• Issued: 11/19/2013
• Est. Priority Date: 08/07/2009
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Imaizumi, Daisaku, Hayasaki, Makoto, Hamada, Kazuyuki
• Primary Examiner(s): Poon, King
• Assistant Examiner(s): WILLS, LAWRENCE E
• Application Number:
  US12/851,839
• Publication Number:
  US 20110032570A1
• Time in Patent Office: 1,201 Days
• Field of Search: 358/1.15, 358/1.18, 358/537, 358/538, 348/207.99, 348/207.2, 348/222.1
• US Class Current: 358/1.18
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/3878 Skew detection or correction

Abstract

A captured image processing system is provided. The captured image processing system includes a portable terminal apparatus and an image output apparatus, each of which are communicable with the other. The portable terminal apparatus captures an image of an object and transmits output target image data obtained by capturing the image to the image output apparatus so as to cause output of this captured image from the image output apparatus. The image output apparatus carries out image processing to the received output target image data, and outputs (a) corrected image data, or (b) an image indicated by the corrected image data. The captured image processing system allows easy output of necessary regions included in an image captured by the portable terminal apparatus, and allows output of an image having no geometric distortion even if image capture is carried out obliquely with respect to a captured image object.

Claims

1. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other, said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data, wherein

the portable terminal apparatus includes;

the designation information accepting section;

the output target region determination section;

an image extraction section for cutting out, from the captured image data, designated region image data indicative of an image of the output target region determined by the output target region determination section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region; and

a transmission section for transmitting the designated region image data and correction information to the image output apparatus, and

the image output apparatus includes;

the corrected-data preparation section;

the output section;

the mapping preparation section; and

a receiving section for receiving the designated region image data and the correction information, each of which is transmitted from the transmission section,

the mapping preparation section obtaining the mapping based on the correction information received by the receiving section, and

the corrected-data preparation section preparing the corrected image data by carrying out, by use of the mapping prepared by the mapping preparation section, coordinate conversion with respect to the designated region image data received by the receiving section.

2. The captured image processing system according to claim 1, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

3. The captured image processing system according to claim 1, further comprising:

a display section for displaying the output target region.

4. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other, said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data, wherein

the portable terminal apparatus includes;

the designation information accepting section;

the output target region determination section; and

a transmission section for transmitting, to the image output apparatus, the captured image data and output target region information indicative of a location of the output target region determined by the output target region determination section, and

the image output apparatus includes;

the corrected-data preparation section;

the output section;

the mapping preparation section;

a receiving section for receiving the captured image data and the output target region information, each of which is transmitted from the transmission section; and

a correction information preparation section for detecting, from the captured image indicated by the captured image data that is received by the receiving section, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region,

the mapping preparation section obtaining the mapping based on the correction information prepared by the correction information preparation section, and

the corrected-data preparation section preparing the corrected image data by (i) cutting out, from the captured image data received by the receiving section, designated region image data indicative of an image of the output target region, the output target region being indicated by the output target region information received by the receiving section, and (ii) carrying out coordinate conversion to the designated region image data, by use of the mapping prepared by the mapping preparation section.

5. The captured image processing system according to claim 4, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

6. The captured image processing system according to claim 4, further comprising:

a display section for displaying the output target region.

7. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other, said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data, wherein

the portable terminal apparatus includes;

the designation information accepting section;

the output target region determination section; and

a transmission section for transmitting, to the image output apparatus, the captured image data and output target region information indicative of a location of the output target region determined by the output target region determination section, and

the image output apparatus includes;

the corrected-data preparation section;

the output section;

the mapping preparation section;

a receiving section for receiving the captured image data and the output target region information, each of which is transmitted from the transmission section; and

a correction information preparation section for detecting, from the captured image indicated by the captured image data that is received by the receiving section, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region having the edge pixel groups serving as its sides,

the mapping preparation section obtaining the mapping based on the correction information prepared by the correction information preparation section, and

the corrected-data preparation section preparing the corrected image data by (i) carrying out coordinate conversion based on the mapping prepared by the mapping preparation section, to the captured image data and the output target region information, each of which is received by the receiving section, and (ii) cutting out, from the captured image data to which the coordinate conversion is carried out, an output target region indicated by the output target region information to which the coordinate conversion processing is carried out.

8. The captured image processing system according to claim 7, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

9. The captured image processing system according to claim 7, further comprising:

a display section for displaying the output target region.

10. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other, said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data, wherein

the portable terminal apparatus includes;

the designation information accepting section;

the output target region determination section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region having the edge pixel groups serving as its sides; and

a transmission section for transmitting, to the image output apparatus, the captured image data, output target region information indicative of a location of the output target region determined by the output target region determination section, and the correction information, and

the image output apparatus includes;

the corrected-data preparation section;

the output section;

the mapping preparation section; and

a receiving section for receiving the captured image data, the output target region information and the correction information, each of which is transmitted by the transmission section,

the mapping preparation section obtaining the mapping based on the correction information received by the receiving section, and

the corrected-data preparation section preparing the corrected image data by (i) cutting out, from the captured image data received by the receiving section, designated region image data indicative of an image of the output target region, the output target region being indicated by the output target region information received by the receiving section, and (ii) carrying out coordinate conversion to the designated region image data, by use of the mapping prepared by the mapping preparation section.

11. The captured image processing system according to claim 10, wherein:

the corrected-data preparation, section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

12. The captured image processing system according to claim 10, further comprising:

a display section for displaying the output target region.

13. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other, said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data, wherein

the portable terminal apparatus includes;

the designation information accepting section;

the output target region determination section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region having the edge pixel groups serving as its sides; and

a transmission section for transmitting, to the image output apparatus, the captured image data, output target region information indicative of a location of the output target region determined by the output target region determination section, and the correction information, and

the image output apparatus includes;

the corrected-data preparation section;

the output section;

the mapping preparation section; and

a receiving section for receiving the captured image data, the output target region information and the correction information, each of which is transmitted by the transmission section,

the mapping preparation section obtaining the mapping based on the correction information received by the receiving section, and

the corrected-data preparation section preparing the corrected image data by (i) carrying out coordinate conversion based on the mapping prepared by the mapping preparation section, to the captured image data and the output target region information, each of which is received by the receiving section, and (ii) cutting out, from the captured image data to which the coordinate conversion is carried out, an output target region indicated by the output target region information to which the coordinate conversion processing is carried out.

14. The captured image processing system according to claim 13, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

15. The captured image processing system according to claim 13, further comprising:

a display section for displaying the output target region.

16. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other, said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data,

the portable terminal apparatus including at least the designation information accepting section, and the image output apparatus including at least the corrected-data preparation section and the output section, wherein

the designation information accepting section accepts, as the designation information, information indicative of locations of four designated points that serve as angular points of the designated region having a quadrangle shape, and

the output target region determination section (i) determines, for each of the four designated points accepted by the designation information accepting section, whether or not a plurality of edge pixels connected to form a given shape including one corner section is included in a respective one of blocks of the captured image, the blocks being of a given size and containing a respective one of the designated points, and in a case where the block includes the plurality of edge pixels, a point in the corner section is determined as a respective corrected point, and in a case where the block includes no plurality of the edge pixels, the respective one of the designated points is determined as the respective corrected point, and (ii) determines a quadrangle-shaped region having the four corrected points serving as its angular points, as the output target region.

17. The captured image processing system according to claim 16, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

18. The captured image processing system according to claim 16, further comprising:

a display section for displaying the output target region.