Image processing method with viewpoint compensation and apparatus therefor
First Claim
1. An image processing method comprising:
- a data generating step of generating images of an object obtained from a plurality of positions and for converting the images so generated into image data;
a viewpoint detecting step of detecting the viewpoint of an observer;
a selecting step of selecting those parts of the image data which corresponds to the images which exist on lines passing through points on an image outputting device and the position of the viewpoint of the observer;
a composing step for composing the parts of the image data which are selected in said selecting step, so as to generate an image from the position of the viewpoint of the observer; and
an outputting step for outputting the image data of the image generated in said composing step to said image outputting device, wherein the selecting step does not rely on coordinate values in a three-dimensional space for points on the image.
0 Assignments
0 Petitions
Accused Products
Abstract
There are provided a multi-viewpoint image database for holding images from a plurality of different viewpoints, a viewpoint detector for detecting a position of the observer'"'"'s viewpoint, and a viewpoint parameter calculating portion for obtaining a viewpoint parameter from an output from the viewpoint detector. Further, a pixel value producing portion is provided for calculating a parameter necessary for reconstruction of image from the type of display screen and the viewpoint parameter, calculating with the parameter to which pixel in the images in the multi-viewpoint image database each pixel in a reconstructed image corresponds, and extracting corresponding pixels from the multi-viewpoint image database.
-
Citations
22 Claims
-
1. An image processing method comprising:
-
a data generating step of generating images of an object obtained from a plurality of positions and for converting the images so generated into image data;
a viewpoint detecting step of detecting the viewpoint of an observer;
a selecting step of selecting those parts of the image data which corresponds to the images which exist on lines passing through points on an image outputting device and the position of the viewpoint of the observer;
a composing step for composing the parts of the image data which are selected in said selecting step, so as to generate an image from the position of the viewpoint of the observer; and
an outputting step for outputting the image data of the image generated in said composing step to said image outputting device, wherein the selecting step does not rely on coordinate values in a three-dimensional space for points on the image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
calculating a parameter necessary for reconstruction of an image from the position of the eyes of the observer and the type of the image outputting device;
calculating to which pixel in said input images each pixel in an image to be reconstructed corresponds, using said parameter; and
extracting corresponding pixels from said input images to reconstruct an image.
-
-
8. A method according to claim 1, wherein said image data is output to a stereo display.
-
9. A method according to claim 1, wherein said image outputting device includes a head-mounted display.
-
10. A method according to claim 1, wherein said image outputting device includes a lenticular display.
-
11. An image processing method according to claim 1, wherein the position of said image outputting device is determined on the basis of the position of the viewpoint of the observer and a direction of the line of sight of the observer.
-
12. Image processing apparatus comprising:
-
means for generating images of an object obtained from a plurality of positions and for converting the images so generated into image data; and
means for detecting the viewpoint of an observer;
and characterized by calculating means adapted to select those parts of the image data which corresponds to the images which exist on lines passing through points on an image outputting device and the position of the viewpoint of the observer as detected;
and for composing the parts of the image data which have been so selected, so as to generate an image from the position of the viewpoint of the observer, wherein the calculating means does not rely on coordinate values in a three-dimensional space for points on the image. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
calculating to which pixel in said input images each pixel in an image to be reconstructed corresponds, using said parameter; and
extracting corresponding pixels from said input images to reconstruct the image to be output to the observer.
-
-
19. Apparatus according to claim 12, including a stereo display to which the generated image data is output.
-
20. Apparatus according to claim 12, wherein said image outputting device includes a head-mounted display.
-
21. Apparatus according to claim 12, wherein said image outputting device comprises a lenticular display.
-
22. Apparatus according to claim 12, including means for determining the position of said image outputting device on the basis of the position of the viewpoint of the observer and the direction of the line of sight of the observer.
Specification