Storage medium recording information processing program for face recognition process

• US 8,982,229 B2
• Filed: 07/05/2011
• Issued: 03/17/2015
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Suzuki, Toshiaki
• Primary Examiner(s): FOSSELMAN, JOEL W
• Application Number:
  US13/176,181
• Publication Number:
  US 20120081568A1
• Time in Patent Office: 1,351 Days
• Field of Search: 348/222.1, 348/208.15, 348/207.1, 348/207.99
• US Class Current: 348/222.1
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals

Abstract

An information processing device, which acquires a face image of a person to be imaged that is captured by an imaging device, executes: a determination step of determining whether a distance between a face of the person to be imaged and the imaging device is within a predetermined range; and a display step of, if the distance between the face of the person to be imaged and the imaging device is determined to be within the predetermined range in the determination step, displaying, on a display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

Claims

1. A non-transitory storage medium recording an information processing program that is executed in an information processing device that acquires a face image of a person to be imaged that is captured by an imaging device,

wherein the information processing program causes the information processing device to execute:

determining whether a distance between a face of the person to be imaged and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the face of the person to be imaged and the imaging device is determined to be within said predetermined range, displaying, on a display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not displaying, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

2. The non-transitory storage medium recording an information processing program according to claim 1,

wherein, the determination is performed on the basis of the face image of the person to be imaged that is captured by the imaging device.

3. The non-transitory storage medium recording an information processing program according to claim 2,

wherein, the determination is performed on the basis of a distance between two feature points in the face image of the person to be imaged that is captured by the imaging device.

4. The non-transitory storage medium recording an information processing program according to claim 3,

wherein in the displaying, there is displayed target positions for alignment of the two feature points used in the determining and another feature point that is not used in the determining.

5. The non-transitory storage medium recording an information processing program according to claim 1,

wherein in the determining, whether the distance between the face of the person to be imaged and the imaging device is within the predetermined range is determined by determining whether a distance between center points of left and right eyes acquired from the face image of the person to be imaged as captured by the imaging device is within a predetermined error range with respect to a predetermined reference value.

6. The non-transitory storage medium recording an information processing program according to claim 5, wherein the information processing program further causes the information processing device to execute:

guidance for, when the distance between the face of the person to be imaged and the imaging device is determined not to be within the predetermined range, outputting a prompting for adjustment of the distance.

7. The non-transitory storage medium recording an information processing program according to claim 6,

wherein in the guidance, if the distance between the center points of the left and right eyes is smaller than a minimum value of the predetermined error range with respect to the predetermined reference value, a message urging shortening of the distance between the face of the person to be imaged and the imaging device is displayed on the display device.

8. The non-transitory storage medium recording an information processing program according to claim 6,

wherein in the guidance, if the distance between the center points of the left and right eyes is greater than a maximum value of the predetermined error range with respect to the predetermined reference value, a message urging lengthening of the distance between the face of the person to be imaged and the imaging device is displayed on the display device.

9. The non-transitory storage medium recording an information processing program according to claim 1,

wherein in the determining, whether the distance between the face of the person to be imaged and the imaging device is within the predetermined range is determined by determining whether an area of a triangle that joins center points of left and right eyes and a center point of a mouth acquired from the face image of the person to be imaged as captured by the imaging device is within a predetermined error range with respect to a predetermined reference value.

10. The non-transitory storage medium recording an information processing program according to claim 1, wherein the information processing program further causes the information processing device to execute:

imaging for imaging a face of the person to be imaged if the at least one feature point contained in the face image of the person to be imaged as captured by the imaging device is positioned within a predetermined range having the target position as a reference point.

11. The non-transitory storage medium recording an information processing program according to claim 10,

wherein the target position corresponds to the at least one feature point of a face model that is held beforehand in a storage device, and

the information processing program further causes the information processing device to execute:

generating an object by pasting the face image of the person to be imaged that is captured in the imaging in such a manner that the at least one feature point in the face image corresponds to the at least one feature point in the face model.

12. The non-transitory storage medium recording an information processing program according to claim 1, wherein the information processing program further causes the information processing device to execute:

acquiring a sex determination result and an age determination result of the person to be imaged, and

in the displaying, at least one from among the sex determination result and the age determination result of the face image of the person to be imaged is further displayed.

13. An information processing method for causing an information processing device that acquires a face image of a person to be imaged that is captured by an imaging device, to execute:

determining whether a distance between a face of the person to be imaged and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the face of the person to be imaged and the imaging device is determined to be within said predetermined range, displaying, on a display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined ranged, not displaying, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

14. An information processing system, comprising:

a display device; and

one or more computer processors configured to;

determine whether a distance between a face of a person to be imaged that is captured by an imaging device and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the face of the person to be imaged and the imaging device is determined to be within said predetermined range display, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not display, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

15. An information processing device that acquires a face image of a person to be imaged that is captured by an imaging device, comprising:

a display device; and

one or more computer processors configured to;

determine whether a distance between a face of the person to be imaged and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the face of the person to be imaged and the imaging device is determined to be within said predetermined range display, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not display, on the display device, a target position for alignment of at least one feature point cointained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

16. A non-transitory storage medium recording an information processing program that is executed in an information processing device that acquires an image of an imaging target that is captured by an imaging device,

wherein the information processing program causes the information processing device to execute:

determining whether a distance between the imaging target and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the imaging target and the imaging device is determined to be within said predetermined range, displaying, on a display device, a target position for alignment of at least one feature point contained in the image of the imaging target, together with the image of the imaging target repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not displaying, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

17. An information processing method for causing an information processing device that acquires an image of an imaging target that is captured by an imaging device, to execute:

determining whether a distance between the imaging target and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the imaging target and the imaging device is determined to be within said predetermined range, displaying, on a display device, a target position for alignment of at least one feature point contained in the image of the imaging target, together with the image of the imaging target repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not displaying, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

18. An information processing system, comprising:

a display device; and

one or more computer processors configured to;

determine whether a distance between an imaging target that is captured by an imaging device and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the imaging target and the imaging device is determined to be within said predetermined range display, on the display device, a target position for alignment of at least one feature point contained in the image of the imaging target, together with the image of the imaging target repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not display, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.

19. An information processing device that acquires an image of an imaging target that is captured by an imaging device, comprising:

a display device; and

one or more computer processors configured to;

determine whether a distance between the imaging target and the imaging device is within a finite, non-zero predetermined range; and

if the distance between the imaging target and the imaging device is determined to be within said predetermined range display, on the display device, a target position for alignment of at least one feature point contained in the image of the imaging target, together with the image of the imaging target repeatedly captured by the imaging device, and if the distance between the face of the person to be imaged and the imaging device is determined to be outside said predetermined range, not display, on the display device, a target position for alignment of at least one feature point contained in the face image of the person to be imaged, together with the face image of the person to be imaged repeatedly captured by the imaging device.