SYSTEMS AND METHODs FOR PRODUCING PANORAMIC AND STEREOSCOPIC VIDEOS

• US 20160344999A1
• Filed: 12/15/2014
• Published: 11/24/2016
• Est. Priority Date: 12/13/2013
• Status: Abandoned Application

• Current Assignee: 8702209 Canada Incorporated
• Original Assignee: 8702209 Canada Incorporated
• Inventors: LAJEUNESSE, Flix, RAPHAL, Paul
• Application Number:
  US15/104,216
• Publication Number:
  US 20160344999A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A system and associated method for capturing panoramic and stereoscopic image data can be utilized to produce panoramic and stereoscopic videos for use in conjunction with suitable virtual reality display devices. The system utilizes a camera arrangement consisting of a plurality of camera pairs positioned to capture a 360° environment. Each camera pair comprises a left-eye camera and a right-eye camera and the camera pair planes of each camera pair substantially parallel to each other. The camera pairs can be arranged in levels of varying heights in order to accommodate a greater number of camera pairs, thereby enhancing the resulting image data. Once the image data has been captured, left and right-eye panoramic videos are generated by merging the corresponding images from each left-eye camera at each time point, and each right-eye camera at each time point. The resulting videos can then be output for panoramic and stereoscopic viewing.

Claims

1. A camera arrangement for filming videos enabled for stereoscopic and panoramic effects, the camera arrangement comprising:

a plurality of camera pairs, each one of the plurality of camera pairs comprising a left-eye camera and a right-eye camera, each one of the left-eye cameras and each one of the right-eye cameras having a longitudinal axis, whereby the longitudinal axis of the left-eye camera and the longitudinal axis of the right-eye camera of as given camera pair define a camera pair plane for each one of the plurality of camera pairs, and wherein each one of the camera pair planes is substantially parallel to each other.

2. The camera arrangement of claim 1, wherein the left-eye, camera and the right-eye camera of each one of the plurality of camera pairs are positioned side-by-side.

3. The camera arrangement of claim 1, wherein each one of the plurality of camera pairs further comprises a central axis which is substantially parallel to each of the longitudinal axis of the left-eye camera and the longitudinal axis of the right-eye camera.

4. The camera arrangement of claim 3, the spatial separation between the left-eye camera and the right-eye camera of each one of the plurality of camera pairs is substantially constant along the central axis.

5. The camera arrangement of claim 4, wherein the value of the spatial separation between the left-eye camera and the right-eye camera of each one of the plurality of camera pairs is approximately 6.5 centimeters.

6. The camera arrangement of claim 1, wherein each of the left-eye cameras and the right eye cameras of each camera pair include a rear nodal point positioned substantially along the longitudinal axis of each camera, and wherein the rear nodal points of each left-eye camera and each right-eye cameras of each camera pair substantially coincide.

7. The camera arrangement of claim 1, wherein the combined field of view of the plurality of camera pairs is 360 degrees.

8. The camera arrangement of claim 1, further comprises an at least one camera having a longitudinal axis which substantially coincides with the central axis, wherein the at least one camera is positioned above the center of the camera arrangement for capturing overhead images.

9. The camera arrangement of claim 1, wherein a portion of the plurality of camera pairs are positioned on a first level, and a portion of the plurality of camera pairs are positioned on a second level.

10. The camera arrangement of claim 9, wherein the first level comprises four camera pairs positioned approximately 90°

apart and the second level comprises four camera pairs positioned approximately 90°

apart.

11. The camera arrangement of claim 10, wherein each camera pair on the second level is displaced approximately 45°

from the next closest camera pair 100 on the first level.

12. A method for producing a video enabled for stereoscopic and panoramic effects, the method comprising the steps of:

filming using a plurality of camera pairs, each one of the camera pairs comprising a left-eye camera and a right-eye camera;

for each one of a plurality of time steps, generating a left-eye panorama by merging the images from each one of the left-eye cameras at the each one of the plurality of time steps and a right-eye panorama by merging the images from each one of the right-eye cameras at the each one of the plurality of time steps; and

outputting a left-eye video stream comprising the left-eye panoramas at the plurality of time steps and a right-eye video stream comprising the right-eye panoramas at the plurality of time steps, for display on a device enabled for panoramic and stereoscopic viewing.