Image capture and viewing system and method for generating a synthesized image
First Claim
1. An image capture system for providing an image of a subject comprising:
- a single, fixed planar surface of a planar background;
a first camera positioned to capture a first subject image of a live subject positioned between the single, fixed planar surface and the first camera;
a second camera spaced from the first camera, the second camera positioned to capture a second subject image of the live subject located between the single, fixed planar surface and the second camera; and
a control module configured to generate a synthesized image of the live subject from a virtual viewpoint using a fixed, relative position of the first camera, the second camera, and only the single, fixed planar surface,wherein the first camera, the second camera, and the single, fixed planar surface have the same fixed relative position during a calibration of the first camera and the second camera.
2 Assignments
0 Petitions
Accused Products
Abstract
An image capture and viewing system is disclosed. In one embodiment, the present invention provides an image capture system for providing an image of a subject. The image capture system includes a planar surface, a first camera, a second camera and a control module. The first camera is positioned to capture a first subject image of a subject positioned between the planar surface and the first camera. The second camera is spaced from the first camera. The second camera is positioned to capture a second subject image of the subject. The control module is configured to generate a synthesized image of the subject from a virtual view point using the relative positioning of the first camera, the second camera, and a planar surface.
57 Citations
30 Claims
-
1. An image capture system for providing an image of a subject comprising:
-
a single, fixed planar surface of a planar background; a first camera positioned to capture a first subject image of a live subject positioned between the single, fixed planar surface and the first camera; a second camera spaced from the first camera, the second camera positioned to capture a second subject image of the live subject located between the single, fixed planar surface and the second camera; and a control module configured to generate a synthesized image of the live subject from a virtual viewpoint using a fixed, relative position of the first camera, the second camera, and only the single, fixed planar surface, wherein the first camera, the second camera, and the single, fixed planar surface have the same fixed relative position during a calibration of the first camera and the second camera. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An image capture system comprising:
-
a planar background having a single, fixed planar surface; a plurality of cameras including; a first camera positioned to capture a first subject image of a live subject positioned between the single, fixed planar surface of the planar background and the first camera; a second camera spaced from the first camera, the second camera positioned to capture a second subject image of the subject; and a first central processing unit coupled to each of the plurality of cameras, the first central processing unit configured to utilize a fixed relative position of the first camera, the second camera, and only the single, fixed planar surface of the planar background to convert the first subject image and the second subject image into a synthesized image of the live subject from a virtual viewpoint, wherein the virtual viewpoint is positioned between the first camera and the second camera, wherein the first camera, the second camera, and the single, fixed planar surface have the same fixed relative position during a calibration of the first camera and the second camera. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. A method of viewing synthesized images derived from actual images, the method comprising:
-
providing a plurality of visual characteristics for a first subject image of a live image and a second subject image of a live image, the first subject image being captured by a first camera and the second subject image being captured by a second camera spaced from the first camera, wherein the first subject image is related to the second subject image based on a predetermined spatial relationship of each respective first and second camera relative to a single, fixed planar surface of a planar background; calibrating the first and second camera while maintaining the same fixed relative position of the first camera, second camera, and the single, fixed planar surface; selecting a virtual viewpoint positioned between the first camera and the second camera; generating a synthesized image by interpolating a plurality of visual characteristics of the synthesized image from the plurality of visual characteristics of the first subject image and the second subject image based on a position of the virtual viewpoint with respect to the first camera the second camera, and the single, fixed planar surface of a planar background wherein the synthesized image represents an image that would have been captured from the virtual viewpoint; and displaying the synthesized image to a user. - View Dependent Claims (19, 20, 21)
-
-
22. A computer-readable medium having computer-executable instructions for performing a method of viewing synthesized images derived from actual images comprising:
-
providing a plurality of visual characteristics for a first subject image of a live image and a second subject image of a live image, the first subject image being captured by a first camera and the second subject image being captured by a second camera spaced from the first camera, wherein the first subject image is related to the second subject image based on a predetermined spatial relationship of each respective first and second camera relative to a single, fixed planar surface of a planar background; calibrating the first and second camera while maintaining the same fixed relative position of the first camera, second camera and the single, fixed planar surface; selecting a virtual viewpoint positioned between the first camera and the second camera; generating a synthesized image by interpolating a plurality of visual characteristics of the synthesized image from the plurality of visual characteristics of the first subject image and the second subject image based on a position of the virtual viewpoint with respect to the first camera, the second camera, and the single, fixed planar surface of a planar background wherein the synthesized image represents an image that would have been captured from the virtual viewpoint; and displaying the synthesized image to a user.
-
-
23. A computer-readable medium having computer-executable instructions for performing a method of image capture for generation of a synthesized image comprising:
-
directing a plurality of cameras toward a planar background, wherein the plurality of cameras includes a first camera and a second camera spaced from the first camera; capturing a first calibration image with the first camera, the first calibration image being of a calibration pattern, the calibration pattern having a plurality of known robust features and being positioned on the planar background; capturing a second calibration image with the second camera, the second calibration image being of the calibration pattern; determining a spatial relationship between the first camera, the second camera, and the planar background by analyzing the first calibration image and the second calibration image with respect to the robust features of the calibration pattern; placing a subject between the planar background and the first and second cameras; capturing a first subject image of the subject with the first camera and a second subject image of the subject with the second camera; comparing each point in the first subject image to a corresponding object point of the second subject image for a color discrepancy, any object points having the color discrepancy are classified as an extracted object point; and deriving a representation of the shape and color for each of the extracted object points.
-
-
24. A method of image capture for subsequent generation of a synthesized image, the method comprising:
-
directing a plurality of cameras toward a planar background, wherein the plurality of cameras includes a first camera and a second camera spaced from the first camera; capturing a first calibration image with the first camera, the first calibration image being of a calibration pattern, the calibration pattern having a plurality of known robust features and being positioned on the planar background; capturing a second calibration image with the second camera, the second calibration image being of the calibration pattern; determining a spatial relationship between the first camera, the second camera, and the planar background by analyzing the first calibration image and the second calibration image with respect to the robust features of the calibration pattern; placing a subject between the planar background and the first and second cameras; capturing a first subject image of the subject with the first camera and a second subject image of the subject with the second camera; comparing each point in the first subject image to a corresponding object point of the second subject image for a color discrepancy, any object points having the color discrepancy are classified as an extracted object point; and deriving a representation of the shape and color for each of the extracted object points. - View Dependent Claims (25, 26, 27, 28, 29, 30)
-
Specification