METHOD AND SYSTEMS FOR MULTI-VIEW HIGH-SPEED MOTION CAPTURE
First Claim
1. A device comprising:
- a processing circuit that receives input associated with a three dimension (3D) scene, wherein the input includes information associated with a first frame sequence at a first frame rate corresponding to a first camera and information associated with a second frame sequence at a second frame rate corresponding to a second camera;
the first frame rate is faster than the second frame rate, wherein temporally synchronized image frames recorded in the first frame sequence and the second frame sequence at given timestamps are aligned, a three dimensional (3D) model for a dynamic scene at the first frame rate is created, and synthesized image frame sequences associated with a plurality of additional viewpoints are generated at the first frame rate; and
a memory that stores information for the processing circuit.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods that facilitate an efficient and effective multi-view hybrid system for high-speed motion analysis are presented. The multi-view hybrid system can include a mix of relatively few high-speed cameras (e.g., 1000 fps, etc.) and a greater number of regular-speed cameras (e.g., 30 fps, etc.) that are utilized to provide more high speed views than high speed cameras included in the system. The new multi-view hybrid approach exploits spatial-temporal coherence in sampled images from both the regular-speed cameras and high-speed cameras to increase the number of high speed motion viewpoints. In one embodiment, the high-speed motion captured from one or a few high-speed cameras is “transferred” to other viewpoints to create a set of virtual high-speed camera viewpoints that provide the ability to obtain high-speed motion information (e.g., synthesized image frame sequences) from multiple viewpoints in addition to viewpoints of the physical high speed cameras in the system.
26 Citations
20 Claims
-
1. A device comprising:
-
a processing circuit that receives input associated with a three dimension (3D) scene, wherein the input includes information associated with a first frame sequence at a first frame rate corresponding to a first camera and information associated with a second frame sequence at a second frame rate corresponding to a second camera;
the first frame rate is faster than the second frame rate, wherein temporally synchronized image frames recorded in the first frame sequence and the second frame sequence at given timestamps are aligned, a three dimensional (3D) model for a dynamic scene at the first frame rate is created, and synthesized image frame sequences associated with a plurality of additional viewpoints are generated at the first frame rate; anda memory that stores information for the processing circuit. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method comprising:
-
calibrating a first video frame sequence at a first frame rate from a first camera and a second video frame sequence at a second frame rate from a second camera, wherein the first frame rate is faster than the second frame rate; creating a three dimension (3D) model based upon 3D key frame reconstruction, constrained 3D motion estimation, and 3D key frame interpolation; and generating a plurality of synthesized image frame sequences at the first frame rate, wherein the plurality of synthesized image frame sequences are associated with a plurality of viewpoints different from a viewpoint associated with the first camera. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
-
16. A system comprising:
-
a first camera that captures images at a first speed; a second camera that captures images at a second speed, the second speed is slower than the first speed; a multi-view system for simulating a plurality of viewpoints at the first speed in addition to a viewpoint of the first camera, wherein image results of the first camera capture and the second camera capture are utilized to sample respective temporal appearance discrepancies, and spatial-temporal coherence in the sampled image results are utilized to synthesis video streams at the first speed from a viewpoint different than the viewpoint of the first camera. - View Dependent Claims (17, 18, 19, 20)
-
Specification