A VIDEOCONFERENCING SERVER WITH CAMERA SHAKE DETECTION
First Claim
1. A video conferencing server for immersive video conferencing, said video conferencing server being adapted to receive and combine video streams captured by cameras of plural video clients and to generate immersive video streams for delivery to and play-out by said plural video clients,wherein said video conferencing server comprises:
- a cut-out module adapted to generate a foreground mask for a video frame received from a conferencing client;
a camera shake detector adapted to determine a displacement vector for a subset of features in said video frame, said displacement vector representing a two-dimensional motion of said subset of features between a background mask obtained by inverting said foreground mask and a previous background mask generated for a previous video frame received from said conferencing client;
a camera shake correcting module adapted to apply a displacement opposite to said displacement vector to said foreground mask before use thereof in said immersive video streams to thereby correct camera shake effects of said conferencing client; and
a signalling unit adapted to generate a shake indication into an immersive video stream delivered to said conferencing client.
2 Assignments
0 Petitions
Accused Products
Abstract
A video conferencing server (100) receives and combines video streams captured by cameras of plural video clients (101) and generates immersive video streams (124, 125) for delivery to and play-out by these video clients (101). A cut-out module (102) in the video conferencing server (100) generates a foreground mask (122) for a video frame (121) received from a conferencing client (101). A camera shake detector (103) determines a displacement vector (123) for a subset of features in the video frame (121). The displacement vector (123) represents a two-dimensional motion of the subset of features between a background mask and a previous background mask for a previous video frame received from the same conferencing client (101). A camera shake correcting module (102, 104) applies a displacement opposite to the displacement vector (123) to the foreground mask (122) before use thereof in the immersive video streams (124, 125) for conferencing clients (101), and a signalling unit (104) generates a shake indication (311, 312) into the immersive video stream (124) delivered to the conferencing client (101) whose camera is shaking.
8 Citations
9 Claims
-
1. A video conferencing server for immersive video conferencing, said video conferencing server being adapted to receive and combine video streams captured by cameras of plural video clients and to generate immersive video streams for delivery to and play-out by said plural video clients,
wherein said video conferencing server comprises: -
a cut-out module adapted to generate a foreground mask for a video frame received from a conferencing client; a camera shake detector adapted to determine a displacement vector for a subset of features in said video frame, said displacement vector representing a two-dimensional motion of said subset of features between a background mask obtained by inverting said foreground mask and a previous background mask generated for a previous video frame received from said conferencing client; a camera shake correcting module adapted to apply a displacement opposite to said displacement vector to said foreground mask before use thereof in said immersive video streams to thereby correct camera shake effects of said conferencing client; and a signalling unit adapted to generate a shake indication into an immersive video stream delivered to said conferencing client. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method for camera shake detection in a video conferencing server being adapted to receive and combine video streams captured by cameras of plural video clients and to generate immersive video streams for delivery to and play-out by said plural video clients,
wherein said method comprises: -
generating a foreground mask for a video frame received from a conferencing client; determining a displacement vector for a subset of features in said video frame, said displacement vector representing a two-dimensional motion of said subset of features between a background mask obtained by inverting said foreground mask and a previous background mask generated for a previous video frame received from said conferencing client; applying a displacement opposite to said displacement vector to said foreground mask before use thereof in said immersive video streams to thereby correct camera shake effects of said conferencing client; and generating a shake indication into an immersive video stream delivered to said conferencing client. - View Dependent Claims (7, 8, 9)
-
Specification