Electronic device and method for capturing images using rear camera device

• US 9,729,783 B2
• Filed: 07/08/2015
• Issued: 08/08/2017
• Est. Priority Date: 10/14/2014
• Status: Active Grant

• Current Assignee: Chiun Mai Communication Systems, Inc. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Chiun Mai Communication Systems, Inc. (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Lin, Chin-Yu
• Primary Examiner(s): Cutler, Albert
• Application Number:
  US14/794,377
• Publication Number:
  US 20160105603A1
• Time in Patent Office: 762 Days
• Field of Search: None
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body

Abstract

A method of capturing images includes obtaining a first image of a user captured by a front camera device of an electronic device. First coordinates of two eyes of the user in the first image are identified. A preview image of the user from a rear camera device of the electronic device is obtained, and second coordinates of the two eyes of the user in the preview image are identified. At least one difference value is calculated according to the first coordinates and the second coordinates of the two eyes of the user. Once each of the at least one difference value is within a corresponding predetermined range, the rear camera device is controlled to capture a second image of the user.

Claims

1. An image capturing method executed by at least one processor of an electronic device, comprising:

obtaining a first image of a user captured by a front camera device of the electronic device;

identifying first coordinates of two eyes of the user in the first image;

obtaining a preview image of the user captured by a rear camera device of the electronic device;

identifying second coordinates of the two eyes of the user in the preview image;

calculating at least one difference value according to the first coordinates and the second coordinates of the two eyes of the user, wherein each of the at least one difference value is corresponding to a predetermined range;

prompting the user to move the electronic device according to the at least one difference value; and

controlling the rear camera device to capture a second image of the user when each of the at least one difference value is within the corresponding predetermined range;

wherein the at least one difference value comprises a horizontal coordinate difference value and a vertical coordinate difference value between the first coordinates and the second coordinates of the two eyes of the user;

wherein the horizontal coordinate difference value and the vertical coordinate difference value are obtained by;

calculating a first average coordinate of the first coordinates of the two eyes of the user in the first image;

calculating a second average coordinate of the second coordinates of the two eyes of the user in the preview image;

obtaining the horizontal coordinate difference value by subtracting a horizontal coordinate of the second average coordinate from a horizontal coordinate of the first average coordinate; and

obtaining the vertical coordinate difference value by subtracting a vertical coordinate of the second average coordinate from a vertical coordinate of the first average coordinate.

2. The method according to claim 1, wherein the at least one difference value comprises a distance difference value obtained by subtracting a first distance value between the two eyes of the user in the first image from a second distance value between the two eyes of the user in the preview image, the predetermined range corresponding to the distance difference value is a predetermined distance difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to adjust a distance between the user and the electronic device according to the distance difference value when the distance difference value is not within the predetermined distance difference range.

3. The method according to claim 1, wherein the predetermined range corresponding to the horizontal coordinate difference value is a predetermined horizontal coordinate difference range, the predetermined range corresponding to the vertical coordinate difference value is a predetermined vertical coordinate difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to move the electronic device according to the horizontal coordinate difference value when the horizontal coordinate difference value is not within the predetermined horizontal coordinate difference range; and

prompting the user to move the electronic device according to the vertical coordinate difference value when the vertical coordinate difference value is not within the predetermined vertical coordinate difference range.

4. The method according to claim 1, wherein the at least one difference value comprises an orientation angle difference value obtained by calculating an angle between a first line connecting the first coordinates of the two eyes of the user and a second line connecting the second coordinates of the two eyes of the user, the predetermined range corresponding to the orientation angle difference value is a predetermined orientation angle difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to rotate the electronic device according to the orientation angle difference value when the orientation angle difference value is not within the predetermined orientation angle difference range.

5. The method according to claim 1, wherein the at least one difference value comprises an orientation angle difference value obtained by subtracting a first orientation angle of the electronic device relative to a predetermined orientation obtained when the front camera device captures the first image from a second orientation angle of the electronic device relative to the predetermined orientation obtained when the rear camera device captures the preview image, the predetermined range corresponding to the orientation angle difference value is a predetermined orientation angle difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to rotate the electronic device according to the orientation angle difference value when the orientation angle difference value is not within the predetermined orientation angle difference range.

6. An electronic device comprising:

a front camera device and a rear camera device;

at least one processor;

a storage device that stores images, the storage device being configured to store one or more programs that, when executed by the at least one processor, cause the at least one processor to;

obtain a first image of a user captured by the front camera device;

identify first coordinates of two eyes of the user in the first image;

obtain a preview image of the user captured by the rear camera device;

identify second coordinates of the two eyes of the user in the preview image;

calculate at least one difference value according to the first coordinates and the second coordinates of the two eyes of the user, wherein each of the at least one difference value is corresponding to a predetermined range;

prompt the user to move the electronic device according to the at least one difference value; and

control the rear camera device to capture a second image of the user when each of the at least one difference value is within the corresponding predetermined range;

wherein the at least one difference value comprises a horizontal coordinate difference value and a vertical coordinate difference value between the first coordinates and the second coordinates of the two eyes of the user;

wherein the horizontal coordinate difference value and the vertical coordinate difference value are obtained by;

calculating a first average coordinate of the first coordinates of the two eyes of the user in the first image;

calculating a second average coordinate of the second coordinates of the two eyes of the user in the preview image;

obtaining the horizontal coordinate difference value by subtracting a horizontal coordinate of the second average coordinate from a horizontal coordinate of the first average coordinate; and

obtaining the vertical coordinate difference value by subtracting a vertical coordinate of the second average coordinate from a vertical coordinate of the first average coordinate.

7. The electronic device according to claim 6, wherein the at least one difference value comprises a distance difference value obtained by subtracting a first distance value between the two eyes of the user in the first image from a second distance value between the two eyes of the user in the preview image, the predetermined range corresponding to the distance difference value is a predetermined distance difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to adjust a distance between the user and the electronic device according to the distance difference value when the distance difference value is not within the predetermined distance difference range.

8. The electronic device according to claim 6, wherein the predetermined range corresponding to the horizontal coordinate difference value is a predetermined horizontal coordinate difference range, the predetermined range corresponding to the vertical coordinate difference value is a predetermined vertical coordinate difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to move the electronic device according to the horizontal coordinate difference value when the horizontal coordinate difference value is not within the predetermined horizontal coordinate difference range; and

prompting the user to move the electronic device according to the vertical coordinate difference value when the vertical coordinate difference value is not within the predetermined vertical coordinate difference range.

9. The electronic device according to claim 6, wherein the at least one difference value comprises an orientation angle difference value obtained by calculating an angle between a first line connecting the first coordinates of the two eyes of the user and a second line connecting the second coordinates of the two eyes of the user, the predetermined range corresponding to the orientation angle difference value is a predetermined orientation angle difference range, the step of prompting the user to more the electronic device comprises:

prompting the user to rotate the electronic device according to the orientation angle difference value when the orientation angle difference value is not within the predetermined orientation angle difference range.

10. The electronic device according to claim 6, wherein the at least one difference value comprises an orientation angle difference value obtained by subtracting a first orientation angle of the electronic device relative to a predetermined orientation obtained when the front camera device captures the first image from a second orientation angle of the electronic device relative to the predetermined orientation obtained when the rear camera device captures the preview image, the predetermined range corresponding to the orientation angle difference value is a predetermined orientation angle difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to rotate the electronic device according to the orientation angle difference value when the orientation angle difference value is not within the predetermined orientation angle difference range.

11. A non-transitory storage medium having stored thereon instructions that, when executed by a processor of an electronic device, causes the processor to perform a method for capturing images, the electronic device comprising a front camera device and a rear camera device, wherein the method comprises:

obtaining a first image of a user captured by the front camera device;

identifying first coordinates of two eyes of the user in the first image;

obtaining a preview image of the user captured by the rear camera device;

identifying second coordinates of the two eyes of the user in the preview image;

calculating at least one difference value according to the first coordinates and the second coordinates of the two eyes of the user, wherein each of the at least one difference value is corresponding to a predetermined range;

prompting the user to move the electronic device according to the at least one difference value; and

controlling the rear camera device to capture a second image of the user when each of the at least one difference value is within the corresponding predetermined range;

wherein the at least one difference value comprises a horizontal coordinate difference value and a vertical coordinate difference value between the first coordinates and the second coordinates of the two eyes of the user;

wherein the horizontal coordinate difference value and the vertical coordinate difference value are obtained by;

calculating a first average coordinate of the first coordinates of the two eyes of the user in the first image;

calculating a second average coordinate of the second coordinates of the two eyes of the user in the preview image;

obtaining the horizontal coordinate difference value by subtracting a horizontal coordinate of the second average coordinate from a horizontal coordinate of the first average coordinate; and

obtaining the vertical coordinate difference value by subtracting a vertical coordinate of the second average coordinate from a vertical coordinate of the first average coordinate.

12. The non-transitory storage medium according to claim 11, wherein the at least one difference value comprises a distance difference value obtained by subtracting a first distance value between the two eyes of the user in the first image from a second distance value between the two eyes of the user in the preview image, the predetermined range corresponding to the distance difference value is a predetermined distance difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to adjust a distance between the user and the electronic device according to the distance difference value when the distance difference value is not within the predetermined distance difference range.

13. The non-transitory storage medium according to claim 11, wherein the predetermined range corresponding to the horizontal coordinate difference value is a predetermined horizontal coordinate difference range, the predetermined range corresponding to the vertical coordinate difference value is a predetermined vertical coordinate difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to move the electronic device according to the horizontal coordinate difference value when the horizontal coordinate difference value is not within the predetermined horizontal coordinate difference range; and

prompting the user to move the electronic device according to the vertical coordinate difference value when the vertical coordinate difference value is not within the predetermined vertical coordinate difference range.

14. The non-transitory storage medium according to claim 11, wherein the at least one difference value comprises an orientation angle difference value obtained by calculating an angle between a first line connecting the first coordinates of the two eyes of the user and a second line connecting the second coordinates of the two eyes of the user, the predetermined range corresponding to the orientation angle difference value is a predetermined orientation angle difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to rotate the electronic device according to the orientation angle difference value when the orientation angle difference value is not within the predetermined orientation angle difference range.

15. The non-transitory storage medium according to claim 11, wherein the at least one difference value comprises an orientation angle difference value obtained by subtracting a first orientation angle of the electronic device relative to a predetermined orientation obtained when the front camera device captures the first image from a second orientation angle of the electronic device relative to the predetermined orientation obtained when the rear camera device captures the preview image, the predetermined range corresponding to the orientation angle difference value is a predetermined orientation angle difference range, the step of prompting the user to move the electronic device comprises:

prompting the user to rotate the electronic device according to the orientation angle difference value when the orientation angle difference value is not within the predetermined orientation angle difference range.