Light-field camera
First Claim
1. A light-field camera for capturing multiple views of a scene, the multiple views representing samples of a light-field, the light-field camera comprising:
- a primary camera configured for capturing a primary digital two-dimensional image of the scene;
a two-dimensional camera array comprising a plurality of secondary cameras, wherein each of the secondary cameras is configured for capturing a secondary digital two-dimensional image of the scene in order to produce at least one set of secondary digital two-dimensional images of the scene;
a semitransparent mirror arranged in such way that an incident light beam originating from the scene is split up in a first partial light beam, which is directed to the primary camera, and a second partial light beam, which is directed to the camera array; and
a circuitry or processor configured for;
receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corresponding to the primary digital two-dimensional image based on the set of secondary digital two-dimensional images;
simultaneously rectifying of the secondary digital two-dimensional images of the set of secondary digital two-dimensional images and the primary digital two-dimensional image by using feature points or checkerboards in order to produce a set of rectified secondary digital two-dimensional images and a rectified primary digital two-dimensional image; and
warping the rectified primary digital two-dimensional image to a warped rectified primary digital two-dimensional image corresponding to a virtual camera position of the primary camera by using the depth information.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention provides a light-field camera for capturing multiple views of a scene, representing samples of a light-field, having: a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array having a plurality of secondary cameras, each of the secondary cameras being configured for capturing a secondary digital two-dimensional image of the scene to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged such that an incident light beam originating from the scene is split up in a first partial light beam, directed to the primary camera, and a second partial light beam, directed to the camera array; and a processing unit configured for receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corresponding to the primary digital two-dimensional image based on the set of secondary digital two-dimensional images.
20 Citations
23 Claims
-
1. A light-field camera for capturing multiple views of a scene, the multiple views representing samples of a light-field, the light-field camera comprising:
-
a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array comprising a plurality of secondary cameras, wherein each of the secondary cameras is configured for capturing a secondary digital two-dimensional image of the scene in order to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged in such way that an incident light beam originating from the scene is split up in a first partial light beam, which is directed to the primary camera, and a second partial light beam, which is directed to the camera array; and a circuitry or processor configured for; receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corresponding to the primary digital two-dimensional image based on the set of secondary digital two-dimensional images; simultaneously rectifying of the secondary digital two-dimensional images of the set of secondary digital two-dimensional images and the primary digital two-dimensional image by using feature points or checkerboards in order to produce a set of rectified secondary digital two-dimensional images and a rectified primary digital two-dimensional image; and warping the rectified primary digital two-dimensional image to a warped rectified primary digital two-dimensional image corresponding to a virtual camera position of the primary camera by using the depth information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method for capturing multiple views of a scene, the multiple views representing samples of a light-field, the method comprising:
-
capturing a primary digital two-dimensional image of the scene using a primary camera; producing at least one set of secondary digital two-dimensional images of the scene using a two-dimensional camera array comprising a plurality of secondary cameras, wherein each of the secondary cameras is configured for capturing a secondary digital two-dimensional image of the scene; providing a semitransparent mirror arranged in such way that an incident light beam originating from the scene is split up in a first partial light beam, which is directed to the primary camera, and a second partial light beam, which is directed to the camera array; and receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corresponding to the primary digital two-dimensional image based on the set of secondary digital two-dimensional images using a processing unit; using a rectification module of the processing unit for simultaneously rectifying of the secondary digital two-dimensional images of the set of secondary digital two-dimensional images and the primary digital two-dimensional image by using feature points or checkerboards in order to produce a set of rectified secondary digital two-dimensional images and a rectified primary digital two-dimensional image; and using a primary image warping module of a post-processing unit of the light-field camera for warping the rectified primary digital two-dimensional image to a warped rectified primary digital two-dimensional image corresponding to a virtual camera position of the primary camera by using the depth information. - View Dependent Claims (23)
-
Specification