Face detection for video calls
First Claim
1. A method, comprising:
- accessing one or more frames from a video call, the one or more frames comprising a frame view containing a face;
performing face detection to detect dimensions and a position of the face in the one or more frames, the video call configured to perform a cropping of the frame view based on the dimensions detected in the face detection and a centering of at least the face in the frame view based on the position detected in the face detection;
determining that the face has shifted such as to be oriented to look at an area outside of the frame view and that the frame view has moved to include both the face and the area to which the face is oriented to look; and
refraining from performing at least one of the cropping or the centering in subsequent frames based on the determination that the face is positioned to look at the area outside of the frame view and that the frame view has moved.
2 Assignments
0 Petitions
Accused Products
Abstract
Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).
-
Citations
14 Claims
-
1. A method, comprising:
-
accessing one or more frames from a video call, the one or more frames comprising a frame view containing a face; performing face detection to detect dimensions and a position of the face in the one or more frames, the video call configured to perform a cropping of the frame view based on the dimensions detected in the face detection and a centering of at least the face in the frame view based on the position detected in the face detection; determining that the face has shifted such as to be oriented to look at an area outside of the frame view and that the frame view has moved to include both the face and the area to which the face is oriented to look; and refraining from performing at least one of the cropping or the centering in subsequent frames based on the determination that the face is positioned to look at the area outside of the frame view and that the frame view has moved. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A non-transitory computer-readable medium storing instructions configured to cause one or more processors to:
-
access one or more frames from a video call, the one or more frames comprising a frame view containing a face; perform face detection to detect dimensions and a position of the face in the one or more frames; perform a cropping of the frame view based on the dimensions detected in the face detection; perform a centering of at least the face in the frame view based on the position detected in the face detection; determine that the face has shifted such as to be oriented to look at an area outside of the frame view and that the frame view has moved to include both the face and the area to which the face is oriented to look; refrain from performing at least one of the cropping or the centering in subsequent frames based on the determination that the face is positioned to look at the area outside of the frame view and that the frame view has moved. - View Dependent Claims (7, 8, 9, 10)
-
-
11. An apparatus comprising:
-
a non-transitory computer readable medium configured to store instructions for facilitating a video conversation; and a processor configured to execute the instructions, the instructions configured to cause the processor to; access one or more frames from the video conversation, the one or more frames comprising a frame view containing a face; perform face detection to detect dimensions and a position of the face in the frame view; perform a cropping of the frame view based on the dimensions detected in the face detection; perform a centering of at least the face in the frame view based on the position detected in the face detection; determine that the face has shifted such as to be oriented to look at an area outside of the frame view and that the frame view has moved to include both the face and the area to which the face is oriented to look; and refrain from performing at least one of the cropping or the centering in subsequent frames based on the determination that the face is positioned to look at the area outside of the frame view and that the frame view has moved. - View Dependent Claims (12, 13, 14)
-
Specification