CAPTURED IMAGE PROCESSING SYSTEM AND RECORDING MEDIUM

• US 20110032570A1
• Filed: 08/06/2010
• Published: 02/10/2011
• Est. Priority Date: 08/07/2009
• Status: Active Grant

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Imaizumi, Daisaku, Hamada, Kazuyuki, Hayasaki, Makoto
• Granted Patent: US 8,587,818 B2
• Time in Patent Office: Days
• US Class Current: 358/1.15
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/3878 Skew detection or correction

Abstract

A captured image processing system includes: a designation information accepting section for accepting designation information indicative of a location of a designated region in a captured image; a region determination section for determining an output target region in the captured image based on the designation information; and a corrected data preparation section for (i) obtaining a mapping for converting (a) coordinates of pixels in a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment to (b) coordinates of pixels in a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, and (ii) preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, which corrected image data has been subjected to coordinate conversion based on the mapping prepared by the mapping preparation section. This allows easy output of necessary regions included in an image captured by a portable terminal apparatus, and allows output of an image having no geometric distortion even if image capture is carried out obliquely with respect to a captured image object.

Claims

1. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other,

said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) a quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in a form of a line segment, to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each pixel within the quadrangle-shaped region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data,

the portable terminal apparatus including at least the designation information accepting section, and the image output apparatus including at least the corrected-data preparation section and the output section.

3. The captured image processing system according to claim 1, wherein:

the portable terminal apparatus further includes;

the output target region determination section;

an image extraction section for cutting out, from the captured image data, designated region image data indicative of an image of the output target region determined by the output target region determination section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region; and

a transmission section for transmitting the designated region image data and correction information to the image output apparatus, and

the image output apparatus further includes;

a receiving section for receiving the designated region image data and the correction information, each of which is transmitted from the transmission section; and

the mapping preparation section,

the mapping preparation section obtaining the mapping based on the correction information received by the receiving section, and

the corrected-data preparation section preparing the corrected image data by carrying out, by use of the mapping prepared by the mapping preparation section, coordinate conversion with respect to the designated region image data received by the receiving section.

4. The captured image processing system according to claim 1, wherein:

the portable terminal apparatus further includes;

the output target region determination section; and

a transmission section for transmitting, to the image output apparatus, the captured image data and output target region information indicative of a location of the output target region determined by the output target region determination section, and

the image output apparatus further includes;

a receiving section for receiving the captured image data and the output target region information, each of which is transmitted from the transmission section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data that is received by the receiving section, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region; and

the mapping preparation section,

the mapping preparation section obtaining the mapping based on the correction information prepared by the correction information preparation section, and

the corrected-data preparation section preparing the corrected image data by (i) cutting out, from the captured image data received by the receiving section, designated region image data indicative of an image of the output target region, the output target region being indicated by the output target region information received by the receiving section, and (ii) carrying out coordinate conversion to the designated region image data, by use of the mapping prepared by the mapping preparation section.

5. The captured image processing system according to claim 1, wherein:

the portable terminal apparatus further includes;

the output target region determination section; and

a transmission section for transmitting, to the image output apparatus, the captured image data and output target region information indicative of a location of the output target region determined by the output target region determination section, and

the image output apparatus further includes;

a receiving section for receiving the captured image data and the output target region information, each of which is transmitted from the transmission section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data that is received by the receiving section, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region having the edge pixel groups serving as its sides; and

the mapping preparation section,

the mapping preparation section obtaining the mapping based on the correction information prepared by the correction information preparation section, and

the corrected-data preparation section preparing the corrected image data by (i) carrying out coordinate conversion based on the mapping prepared by the mapping preparation section, to the captured image data and the output target region information, each of which is received by the receiving section, and (ii) cutting out, from the captured image data to which the coordinate conversion is carried out, an output target region indicated by the output target region information to which the coordinate conversion processing is carried out.

6. The captured image processing system according to claim 1, wherein:

the portable terminal apparatus further includes;

the output target region determination section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region having the edge pixel groups serving as its sides; and

a transmission section for transmitting, to the image output apparatus, the captured image data, output target region information indicative of a location of the output target region determined by the output target region determination section, and the correction information, and

the image output apparatus further includes;

a receiving section for receiving the captured image data, the output target region information and the correction information, each of which is transmitted by the transmission section; and

the mapping preparation section,

the mapping preparation section obtaining the mapping based on the correction information received by the receiving section, and

the corrected-data preparation section preparing the corrected image data by (i) cutting out, from the captured image data received by the receiving section, designated region image data indicative of an image of the output target region, the output target region being indicated by the output target region information received by the receiving section, and (ii) carrying out coordinate conversion to the designated region image data, by use of the mapping prepared by the mapping preparation section.

7. The captured image processing system according to claim 1, wherein:

the portable terminal apparatus further includes;

the output target region determination section;

a correction information preparation section for detecting, from the captured image indicated by the captured image data, the quadrangle-shaped region having four edge pixel groups, detected in the captured image, serving as sides of the quadrangle-shaped region, the four edge pixel groups each being in the form of a line segment, in order to prepare correction information indicative of a location of the quadrangle-shaped region having the edge pixel groups serving as its sides; and

a transmission section for transmitting, to the image output apparatus, the captured image data, output target region information indicative of a location of the output target region determined by the output target region determination section, and the correction information, and

the image output apparatus further includes;

a receiving section for receiving the captured image data, the output target region information and the correction information, each of which is transmitted by the transmission section; and

the mapping preparation section,

the mapping preparation section obtaining the mapping based on the correction information received by the receiving section, and

the corrected-data preparation section preparing the corrected image data by (i) carrying out coordinate conversion based on the mapping prepared by the mapping preparation section, to the captured image data and the output target region information, each of which is received by the receiving section, and (ii) cutting out, from the captured image data to which the coordinate conversion is carried out, an output target region indicated by the output target region information to which the coordinate conversion processing is carried out.

8. The captured image processing system according to claim 1, wherein:

the designation information accepting section accepts, as the designation information, information indicative of locations of four designated points that serve as angular points of the designated region having a quadrangle shape, and

the output target region determination section (i) determines, for each of the four designated points accepted by the designation information accepting section, whether or not a plurality of edge pixels connected to form a given shape including one corner section is included in a respective one of blocks of the captured image, the blocks being of a given size and containing a respective one of the designated points, and in a case where the block includes the plurality of edge pixels, a point in the corner section is determined as a respective corrected point, and in a case where the block includes no plurality of the edge pixels, the respective one of the designated points is determined as the respective corrected point, and (ii) determines a quadrangle-shaped region having the four corrected points serving as its angular points, as the output target region.

10. The captured image processing system according to claim 1, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

12. The captured image processing system according to claim 1, further comprising:

a display section for displaying the output target region.

13. The captured image processing system according to claim 12, further comprising:

an editing processing section for editing the output target region in accordance with an entry by the user with respect to the output target region displayed on the display section.

16. A computer-readable recording medium in which a program is recorded for causing a captured image processing system recited in claim 1 to operate, the program causing a computer to function as each section of the captured image processing system.

2. A captured image processing system including (i) a portable terminal apparatus including an image capture section and (ii) an image output apparatus, the portable terminal apparatus and the image output apparatus being communicable with each other,

said captured image processing system comprising:

a designation information accepting section for accepting entry of designation information from a user, the designation information being indicative of a location of a designation region which is a quadrangle-shaped partial region of a captured image indicated by captured image data, the captured image data being obtained by carrying out image capture using the image capture section;

an output target region determination section for determining an output target region in the captured image based on the designation information, the output target region being a quadrangle-shaped region to be outputted from the image output apparatus;

a mapping preparation section for obtaining a mapping to be used to convert (a) the quadrangle-shaped output target region determined by the output target region determination section to (b) a rectangular region of a given size and having upper and lower sides of the rectangular region being substantially parallel in a horizontal direction, the mapping being used for converting coordinates of each of pixel electrodes within the output target region to coordinates of respective pixels in the rectangular region;

a corrected-data preparation section for preparing corrected image data with respect to image data corresponding to the output target region in the captured image data, the corrected image data at least been subjected to coordinate conversion by use of the mapping prepared by the mapping preparation section; and

an output section for outputting the corrected image data or an image indicated by the corrected image data,

the portable terminal apparatus including at least the designation information accepting section, and the image output apparatus including at least the corrected-data preparation section and the output section.

9. The captured image processing system according to claim 2, wherein:

the designation information accepting section accepts, as the designation information, information indicative of locations of four designated points that serve as angular points of the designated region having the quadrangle shape, and

the output target region determination section (i) determines, for each of the four designated points accepted by the designation information accepting section, whether or not a plurality of edge pixels connected to form a given shape including one corner section is included in a respective one of blocks of the captured image, the blocks being of a given size and containing a respective one of the designated points, and in a case where the block includes the plurality of edge pixels, a point in the corner section is determined as a respective corrected point, and in a case where the block includes no plurality of the edge pixels, the respective one of the designated points is determined as the respective corrected point, and (ii) determines a quadrangle-shaped region having the four corrected points serving as its angular points, as the output target region.

11. The captured image processing system according to claim 2, wherein:

the corrected-data preparation section prepares, with respect to image data corresponding to the output target region in the captured image data, corrected image data that has been subjected to (i) coordinate conversion based on mapping prepared by the mapping preparation section and (ii) high resolution correction, the high resolution correction correcting a resolution of the captured image data to a higher resolution.

14. The captured image processing system according to claim 2, further comprising:

a display section for displaying the output target region.

15. The captured image processing system according to claim 14, further comprising:

an editing processing section for editing the output target region in accordance with an entry by the user with respect to the output target region displayed on the display section.

17. A computer-readable recording medium in which a program is recorded for causing a captured image processing system recited in claim 2 to operate, the program causing a computer to function as each section of the captured image processing system.