INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, AND PROGRAM

• US 20170201677A1
• Filed: 04/28/2015
• Published: 07/13/2017
• Est. Priority Date: 06/20/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: OTANI, TAKAHIDE
• Granted Patent: US 10,462,358 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/20216 Image averaging
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

This information processing apparatus includes a control unit that acquires two images including a face of a user as an object, the two images being picked up from different positions in a vertical direction of the face of the user, determines whether or not each face in the two images is a face of the same person, and operates a mode in which on the basis of an image of an eye part in one of the two images, a line-of-sight correction image obtained by modifying an image of an eye part of the other of the two images is generated when each face in the two images is the face of the same person.

Claims

1. An information processing apparatus, comprising

a control unit that determines, on the basis of two images including a face of a person, whether or not each face in the two images is a face of the same person, the two images being picked up from different positions, and generates, on the basis of an image of an eye part in one of the two images, a line-of-sight correction image obtained by modifying an image of an eye part of the other of the two images when each face in the two images is the face of the same person.

2. The information processing apparatus according to claim 1, wherein

the control unit is configured to acquire two images including a face of a user as the object, the two images being picked up from different positions in a vertical direction of the face of the user by a first imaging unit and a second imaging unit.

3. The information processing apparatus according to claim 2, wherein

the control unit is configured

to determine, in a mode in which the line-of-sight correction image is generated, whether or not a direction in which the first imaging unit and the second imaging unit are arranged is right with respect to horizontal and vertical orientations of the face of the user as the object, and

to output an alert when the direction is wrong.

4. The information processing apparatus according to claim 3, wherein

the control unit is configured to output, as the alert, information for leading to correction of the direction in which the first imaging unit and the second imaging unit are arranged.

5. The information processing apparatus according to claim 2, wherein

the first imaging unit is an upper imaging unit in the vertical direction of the face of the user as the object, and the second imaging unit is a lower imaging unit in the vertical direction of the face of the user as the object, and

image quality of an image picked up by the first imaging unit is higher than that of the second imaging unit.

6. The information processing apparatus according to claim 5, wherein

the control unit is configured

to determine whether or not a vertical positional relationship between the first imaging unit and the second imaging unit in the vertical direction of the face of the user as the object is right in a mode in which the line-of-sight correction image is generated, and

to output an alert when the vertical positional relationship is wrong.

7. The information processing apparatus according to claim 6, wherein

the control unit is configured to output, as the alert, information for leading to correction of the vertical positional relationship between the first imaging unit and the second imaging unit.

8. The information processing apparatus according to claim 2, wherein

the first imaging unit is incorporated in the information processing apparatus, and

the second imaging unit is a separate imaging unit detachably mounted on the information processing apparatus.

9. The information processing apparatus according to claim 1, wherein

the control unit is configured to edit the generated line-of-sight correction image.

10. An information processing apparatus, comprising:

an imaging unit that picks up an image of a face of a person from different positions; and

a control unit that determines, on the basis of two images including a face of the user, whether or not each face in the two images is a face of the same person, the two images being picked up by the imaging unit, and generates, on the basis of an image of an eye part in one of the two images, a line-of-sight correction image obtained by modifying an image of an eye part of the other of the two images when each face in the two images is the face of the same person.

11. An information processing method, comprising by a control unit

determining, on the basis of two images including a face of the user, whether or not each face in the two images is a face of the same person, the two images being picked up by the imaging unit, and generating, on the basis of an image of an eye part in one of the two images, a line-of-sight correction image obtained by modifying an image of an eye part of the other of the two images when each face in the two images is the face of the same person.

12. An information processing system, comprising

a control unit that determines, on the basis of two images including a face of a person, whether or not each face in the two images is a face of the same person, the two images being picked up from different positions, and generates, on the basis of an image of an eye part in one of the two images, a line-of-sight correction image obtained by modifying an image of an eye part of the other of the two images when each face in the two images is the face of the same person.

13. A program that causes a computer to function as

a control unit that determines, on the basis of two images including a face of a person, whether or not each face in the two images is a face of the same person, the two images being picked up from different positions, and generates, on the basis of an image of an eye part in one of the two images, a line-of-sight correction image obtained by modifying an image of an eye part of the other of the two images when each face in the two images is the face of the same person.