METHOD FOR THE REAL-TIME COMPOSITION OF A VIDEO

• US 20110090307A1
• Filed: 06/29/2009
• Published: 04/21/2011
• Est. Priority Date: 06/30/2008
• Status: Active Grant

• Current Assignee: Thomson Licensing (Vantiva SA)
• Original Assignee: Thomson Licensing (Vantiva SA)
• Inventors: Marvie, Jean-Eudes, Briand, Gerard
• Granted Patent: US 9,082,221 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/172 image signals comprising non-image signal components, e.g. headers or format information
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps

Abstract

The invention relates to a method for live construction of a video sequence comprising a modelled 3D object, the method comprising the following steps:

• • pre-calculating data representative of at least one first image of a three-dimensional environment and a first item of associated depth information,
  • live calculation of:
    • data representative of at least one second image representing said modelled object on which is mapped a current image of a live video stream, and
    • a second item of depth information associated with said at least one second image, and
  • composing live said sequence by combining said at least one first image and said at least one second image according to said first and second items of depth information.

Claims

1. Method for live construction of a video sequence, said sequence comprising an object modelled in three dimensions, wherein the method comprises steps for:

pre-calculating data representative of at least one first image of a three-dimensional environment and a first item of depth information associated with said image,

live calculation of;

data representative of at least one second image representing said modelled object on which is mapped a current image of a live video stream, said current image forming the texture of the modelled object, and

a second item of depth information associated with said at least one second image, and

live composition of said sequence by combining said at least one first image and at least one second image according to said first and second items of depth information.

2. Method according to claim 1, wherein it comprises the steps of:

initializing a destination buffer of said at least one second image with the data representative of said at least one first image, and

initializing a destination buffer of said second item of depth information with said first item of depth information.

3. Method according to claim 1, wherein at least one occlusion test is carried out for each pixel of said sequence during said composition.

4. Method according to claim 1, wherein said environment is a video pre-calculated with a fixed camera.

5. Method according to claim 1, wherein said environment is a video pre-calculated with a mobile camera.