Image photographing method, apparatus, and terminal

• US 10,863,077 B2
• Filed: 09/12/2016
• Issued: 12/08/2020
• Est. Priority Date: 09/12/2016
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Inventors: Qin, Chao, Gao, Wenmei
• Primary Examiner(s): Daniels, Anthony J
• Application Number:
  US16/332,701
• Publication Number:
  US 20190222744A1
• Time in Patent Office: 1,548 Days
• Field of Search: 348345
• CPC Class Codes: G06F 9/3004 to perform operations on memory
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G06T 3/10 Selection of transformation methods according to the characteristics of the input images
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]
• CPC Class Codes: G06V 20/00 Scenes; Scene-specific elements control of digital cameras H04N23/60
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

An image photographing method is provided, including: based on a photographing instruction, selecting at least one focus in a quadrangular image, and photographing at least one initial image based on the at least one focus, where the quadrangular image includes a first pair of opposite sides and a second pair of opposite sides, an included angle between the opposite sides of the first pair of opposite sides is less than that of the second pair of opposite sides, a first side is a shorter side of the first pair of opposite sides, the at least one focus includes a first focus, and the first focus is in the quadrangular image and in a partial region including the first side; adjusting a quadrangular image to a rectangular image; and obtaining a final image and outputting the final image.

Claims

1. An image photographing method for a terminal with a camera, the method comprising:

entering a photographing mode and detecting a quadrangular image in a preview image, wherein the quadrangular image comprises a first pair of opposite sides and a second pair of opposite sides, wherein an included angle between the first pair of opposite sides is less than an included angle between the second pair of opposite sides, and wherein a first side is a shorter side of the first pair of opposite sides;

based on a photographing instruction, selecting at least one focus in the quadrangular image, wherein the at least one focus comprises a first focus, and wherein the first focus is in the quadrangular image and in a partial region comprising the first side;

photographing at least one initial image based on the at least one focus,

wherein selecting the at least one focus in the quadrangular image and photographing the at least one initial image based on the at least one focus comprise selecting the first focus in the quadrangular image, and photographing an initial image based on the first focus, and wherein selecting the first focus in the quadrangular image comprises;

determining a first point and a second point respectively on a second side and a third side of the quadrangular image, wherein the second side and the third side are adjacent to the first side, wherein a distance between the first point and a vertex at which the first side and the second side intersect is less than or equal to a distance between the first point and a vertex at which the second side and a fourth side intersect, wherein a distance between the second point and a vertex at which the first side and the third side intersect is less than or equal to a distance between the second point and a vertex at which the third side and the fourth side intersect, and wherein the fourth side is an opposite side of the first side;

determining, as the partial region comprising the first side, a first region formed by connecting the vertex at which the first side and the second side intersect, the vertex at which the first side and the third side intersect, the second point, and the first point in order; and

selecting a point in the first region as the first focus;

adjusting the quadrangular image in each of the at least one initial image to a rectangular image;

obtaining a final image based on the rectangular image; and

outputting the final image.

2. The method according to claim 1, wherein selecting the point in the first region as the first focus comprises either:

selecting an intersection point of diagonals of the first region as the first focus;

or

selecting an intersection point of lines connecting midpoints of opposite sides of the first region as the first focus.

3. The method according to claim 1, wherein obtaining the final image based on the rectangular image and outputting the final image comprise:

outputting the rectangular image as the final image.

4. The method according to claim 1, wherein selecting the at least one focus in the quadrangular image and photographing the at least one initial image based on the at least one focus comprise:

selecting at least two focuses in the quadrangular image, wherein the at least two focuses comprise at least one first focus or at least one second focus, and wherein the at least one second focus is different from the at least one first focus; and

photographing at least two initial images based on the at least two focuses respectively.

5. The method according to claim 4, wherein selecting at least two focuses in the quadrangular image comprises:

selecting, as a second focus of the at least one second focus, a point in a partial region comprising fourth side.

6. The method according to claim 5, wherein selecting, as a second focus of the at least one second focus, in a partial region comprising the fourth side comprises:

determining a third point and a fourth point respectively on the second side and the third side of the quadrangular image, wherein the second side and the third side are adjacent to the first side, wherein a distance between the third point and the vertex at which the first side and the second side intersect is greater than or equal to a distance between the third point and the vertex at which the second side and the fourth side intersect, and wherein a distance between the fourth point and the vertex at which the first side and the third side intersect is greater than or equal to a distance between the fourth point and the vertex at which the third side and the fourth side intersect;

determining, as the partial region the fourth first side, a second region formed by connecting the vertex at which the second side and the fourth side intersect, the vertex at which the third side and the fourth side intersect, the fourth point, and the third point in order; and

selecting a point in the second region as the second focus of the at least one second focus.

7. The method according to claim 4,

wherein adjusting the quadrangular image in each of the at least one initial image to the rectangular image comprises:

adjusting quadrangular images in the at least two initial images respectively to at least two rectangular images, and

wherein obtaining the final image based on the rectangular image and outputting the final image comprises;

combining the at least two rectangular images to obtain the final image.

8. The method according to claim 7, wherein combining the at least two rectangular images to obtain the final image comprises:

performing feature point alignment on the at least two rectangular images;

determining, based on distribution of definitions of each aligned rectangular image, a plurality of to-be-combined regions in the final image; and

combining the to-be-combined regions based on definitions of each rectangular image to obtain the final image.

9. The method according to claim 8, wherein combining the to-be-combined regions to obtain the final image comprises either:

obtaining, from each rectangular image, one region with a highest definition corresponding to the to-be-combined region, and stitching the obtained regions to obtain the final image;

or

obtaining, from each rectangular image, at least two regions corresponding to the to-be-combined region, and performing pixel fusion based on definition weights, to obtain the final image.

10. The method according to claim 4, wherein the terminal has at least two cameras, and wherein photographing at least one initial image based on the at least one focus comprises:

controlling each camera to photograph at least one initial image based on a different focus.

11. The method according to claim 1, further comprising:

before photographing at least one initial image based on the at least one focus, determining a quantity of to-be-photographed initial images.

12. The method according to claim 11, wherein determining the quantity of to-be-photographed initial images comprises:

determining the quantity of to-be-photographed initial images based on either the included angle between the first pair of opposite sides in the quadrangular image detected in the preview image, or a distribution curve of definitions in a direction from the first side to the fourth side.

13. A terminal comprising:

at least one camera;

one display;

a non-transitory memory comprising instructions;

at least one processor in communication with the memory, wherein the at least one processor execute instructions to;

enter a photographing mode and detect a quadrangular image in a preview image,

wherein the quadrangular image comprises a first pair of opposite sides and a second pair of opposite sides, wherein an included angle between the first pair of opposite sides is less than an included angle between the second pair of opposite sides, and a first side is a shorter side of the first pair of opposite sides;

based on a photographing instruction, select at least one focus in the quadrangular image, wherein the at least one focus comprises a first focus, and wherein the first focus is in the quadrangular image and in a partial region comprising the first side;

photograph at least one initial image based on the at least one focus,

wherein the instructions to select the at least one focus in the quadrangular image and to photograph the at least one initial image based on the at least one focus comprise the instructions to select the first focus in the quadrangular image and to photograph an initial image based on the first focus, and wherein the instruction to select the first focus in the quadrangular image comprises instructions to;

determine a first point and a second point respectively on a second side and a third side of the quadrangular image, wherein the second side and the third side are adjacent to the first side, wherein a distance between the first point and a vertex at which the first side and the second side intersect is less than or equal to a distance between the first point and a vertex at which the second side and a fourth side intersect, wherein a distance between the second point and a vertex at which the first side and the third side intersect is less than or equal to a distance between the second point and a vertex at which the third side and the fourth side intersect, and wherein the fourth side is an opposite side of the first side;

determining, as the partial region comprising the first side, a first region formed by connecting the vertex at which the first side and the second side intersect, the vertex at which the first side and the third side intersect, the second point, and the first point in order; and

selecting a point in the first region as the first focus;

adjust the quadrangular image in each of the at least one initial image to a rectangular image;

obtain a final image based on the rectangular image; and

output the final image.

14. The terminal according to claim 13, wherein the instruction to select a point in the first region as the first focus comprises either an instruction to:

select an intersection point of diagonals of the first region as the first focus;

or

select an intersection point of lines connecting midpoints of opposite sides of the first region as the first focus.

15. The terminal according to claim 13, wherein the instructions to obtain the final image based on the rectangular image and to output the final image comprise:

an instruction to output the rectangular image as the final image.

16. The terminal according to claim 13, wherein the instructions to select the at least one focus in the quadrangular image and to photograph the at least one initial image based on the at least one focus comprise:

an instruction to select at least two focuses in the quadrangular image, wherein the at least two focuses comprise at least one first focus and at least one second focus, and wherein the at least one second focus is different from the at least one first focus;

instructions to photograph at least two initial images based on the at least two focuses respectively.

17. An image photographing method for a terminal with a camera, the method comprising:

entering a photographing mode and detecting a quadrangular image in a preview image,

wherein the quadrangular image comprises a first pair of opposite sides and a second pair of opposite sides, wherein an included angle between the first pair of opposite sides is less than an included angle between the second pair of opposite sides, and wherein a first side is a shorter side of the first pair of opposite sides;

based on a photographing instruction, selecting at least two focuses in the quadrangular image, wherein the at least two focuses comprise a first focus, and wherein selecting the first focus comprises;

determining first point and a second point respectively on a second side and a third side of the quadrangular image, wherein the second side and the third side are adjacent to the first side, wherein a distance between the first point and a vertex at which the first side and the second side intersect is greater than or equal to a distance between the first point and a vertex at which the second side and a fourth side of the quadrangular image intersect, wherein a distance between the second point and a vertex at which the first side and the third side intersect is greater than or equal to a distance between the second point and a vertex at which the third side and the fourth side intersect, and wherein the fourth side is an opposite side of the first side;

determining, as a partial region, a region formed by connecting the vertex at which the second side and the fourth side intersect, the vertex at which the third side and the third fourth side intersect, the second point, and the first point in order; and

selecting a point in the formed region as the first focus;

photographing at least two initial images based on the at least two focuses;

adjusting quadrangular images in each of the at least two initial images to at least two rectangular images;

obtaining a final image based on the at least two rectangular images; and

outputting the final image.

18. The method according to claim 17, wherein the partial region comprises the fourth side.

19. The method according to claim 17,

wherein obtaining the final image based on the at least two rectangular images and outputting the final image comprises:

combining the at least two rectangular images to obtain the final image.

20. The method according to claim 17, wherein the terminal has at least two cameras, and wherein photographing the at least two initial images based on the at least two focuses comprises:

controlling each camera to photograph at least one initial image based on a different focus.