HYBRID FOREGROUND-BACKGROUND TECHNIQUE FOR 3D MODEL RECONSTRUCTION OF DYNAMIC SCENES
First Claim
1. A processor-implemented method for 3-dimensional (3D) model reconstruction, the method comprising:
- receiving, by a processor-based system, a plurality of static images of a scene, each static image generated by a static camera, the static camera positioned at a fixed location and oriented at a fixed viewing angle;
receiving, by the processor-based system, a plurality of dynamic images of the scene, each dynamic image generated by a movable camera;
performing, by the processor-based system, 3D reconstruction of a foreground of the scene, based on the static images;
performing, by the processor-based system, 3D reconstruction of a background of the scene, based on the static images and the dynamic images; and
superimposing, by the processor-based system, the reconstructed 3D foreground and 3D background, with alignment based on calibration parameters of the static and movable cameras, to provide a hybrid 3D reconstruction of the scene, the calibration parameters including at least one of focal length of the cameras, principal point of the cameras, rotation matrix of the cameras, and translation vector of the cameras.
0 Assignments
0 Petitions
Accused Products
Abstract
Techniques are provided for 3D model reconstruction of dynamic scenes using hybrid foreground-background processing. A methodology implementing the techniques according to an embodiment includes receiving multiple static images of a scene. Each static image is generated by a static camera, positioned at a fixed location and oriented at a fixed viewing angle. The method also includes receiving multiple dynamic images of the scene, each dynamic image generated by a movable camera. The method further includes performing 3D reconstruction of the scene foreground, based on the static images, and performing 3D reconstruction of the scene background, based on the static images and the dynamic images. The method further includes superimposing the reconstructed 3D foreground and 3D background, with alignment based on calibration parameters (e.g., focal length, principal point, rotation, or translation) of the static and movable cameras, to provide a hybrid 3D reconstruction of the scene for 3D rendering.
-
Citations
24 Claims
-
1. A processor-implemented method for 3-dimensional (3D) model reconstruction, the method comprising:
-
receiving, by a processor-based system, a plurality of static images of a scene, each static image generated by a static camera, the static camera positioned at a fixed location and oriented at a fixed viewing angle; receiving, by the processor-based system, a plurality of dynamic images of the scene, each dynamic image generated by a movable camera; performing, by the processor-based system, 3D reconstruction of a foreground of the scene, based on the static images; performing, by the processor-based system, 3D reconstruction of a background of the scene, based on the static images and the dynamic images; and superimposing, by the processor-based system, the reconstructed 3D foreground and 3D background, with alignment based on calibration parameters of the static and movable cameras, to provide a hybrid 3D reconstruction of the scene, the calibration parameters including at least one of focal length of the cameras, principal point of the cameras, rotation matrix of the cameras, and translation vector of the cameras. - View Dependent Claims (2, 3, 6, 7, 8)
-
-
4. (canceled)
-
5. (canceled)
-
9. A system for 3-dimensional (3D) model reconstruction, the system comprising:
-
a foreground reconstruction circuit to perform 3D reconstruction of a foreground of a scene based on a plurality of static images of the scene, each static image generated by a static camera, each static camera positioned at a fixed location and oriented at a fixed viewing angle; a background reconstruction circuit to perform 3D reconstruction of a background of the scene, based on the static images and further based on a plurality of dynamic images of the scene, each dynamic image generated by a movable camera; and an integration circuit to superimpose the reconstructed 3D foreground and 3D background, with alignment based on calibration parameters of the static and movable cameras, to provide a hybrid 3D reconstruction of the scene, the calibration parameters including at least one of camera focal length, camera principal point, camera rotation matrix, and camera translation vector. - View Dependent Claims (10, 11, 14, 15, 16)
-
-
12. (canceled)
-
13. (canceled)
-
17. At least one non-transitory computer readable storage medium having instructions encoded thereon that, when executed by one or more processors, result in the following operations for 3-dimensional (3D) model reconstruction, the operations comprising:
-
receiving a plurality of static images of a scene, each static image generated by a static camera, each static camera positioned at a fixed location and oriented at a fixed viewing angle; receiving a plurality of dynamic images of the scene, each dynamic image generated by a movable camera; performing 3D reconstruction of a foreground of the scene, based on the static images; performing 3D reconstruction of a background of the scene, based on the static images and the dynamic images; and superimposing the reconstructed 3D foreground and 3D background, with alignment based on calibration parameters of the static and movable cameras, to provide a hybrid 3D reconstruction of the scene, the calibration parameters including at least one of camera focal length, camera principal point, camera rotation matrix, and camera translation vector. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
Specification