3D Image Display Method

• US 20080043014A1
• Filed: 06/27/2005
• Published: 02/21/2008
• Est. Priority Date: 12/28/2004
• Status: Active Grant

• Current Assignee: Japan Science And Technology Agency
• Original Assignee: Japan Science And Technology Agency
• Inventors: Endo, Tomohiro, Tachi, Susumu, Kawakami, Naoki
• Granted Patent: US 7,961,182 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G02B 30/27 involving lenticular arrays
• CPC Class Codes: G02B 30/30 involving parallax barriers
• CPC Class Codes: G02B 30/54 the 3D volume being generated by moving a 2D surface, e.g. by vibrating or rotating the 2D surface
• CPC Class Codes: G03B 35/04 with movement of beam-selecting members in a system defining two or more viewpoints
• CPC Class Codes: G03B 35/18 by simultaneous viewing
• CPC Class Codes: G03B 37/00 Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/393 the volume being generated by a moving, e.g. vibrating or rotating, surface

Abstract

A stereoscopic image display method capable of stereoscopic display of a photographed image. One two-dimensional image is selected, and one pixel capable of being viewed from a corresponding viewpoint position is selected from a plurality of pixels. A virtual surface with the selected two-dimensional image pasted thereon is assumed, and the virtual surface is arranged so that an image center point of the two-dimensional image corresponding to a center of an object coincides with a center of a display surface. Next, a virtual extension that extends from the viewpoint position to the virtual surface through the selected pixel is assumed. A color on the two-dimensional image assumed to have been pasted on the virtual surface, corresponding to a point of intersection between the virtual extension and the virtual surface is determined as a display color of the pixel positioned in a direction extending from the pixel to the viewpoint position.

Claims

1. A stereoscopic image display method that uses a three-dimensional display apparatus to present a stereoscopic image, which can be visually recognized by naked eyes, to a person located outside the three-dimensional display apparatus having a cylindrical display surface defined therein, the display surface being formed of a plurality of pixels respectively configured to emit light of different color and brightness as defined according to an angle at which the pixel is viewed on a horizontal plane, the method comprising:

a first step of defining a center point of an object to be displayed as the stereoscopic image, and photographing the object by a photographic device in all directions from an outside of the object, centering on the center point of the object to thereby obtain a plurality of two-dimensional images, or creating by computer graphics technology a plurality of two-dimensional pseudo images comparable to the two-dimensional images to be obtained by photographing the object from the all directions from the outside of the object, centering on the center point of the object, and using the two-dimensional pseudo images as the two-dimensional images;

a second step of selecting from among the two-dimensional images one two-dimensional image and selecting from among the pixels one pixel which can be viewed from a viewpoint position corresponding to the one two-dimensional image which has been selected;

a third step of assuming a imaginary plane onto which the one two-dimensional image selected is pasted, and arranging the imaginary plane so that an image center point of the one two-dimensional image corresponding to the center point of the object may coincide with the center of a cylindrical space for the cylindrical display surface and that an angle formed between the imaginary plane and a straight line connecting the viewpoint position and the center of the cylindrical space for the cylindrical display surface matches an angle formed between an image pickup surface of the photographic device and a straight line connecting the center point of the object and a principal point of the lens of the photographic device;

a fourth step of assuming an imaginary extended line which extends from the viewpoint position to the imaginary plane through the one pixel selected;

a fifth step of determining a display color of the one pixel as viewed from the viewpoint position, based on a color of a point on the two-dimensional image assumed to have been pasted on the imaginary plane, the point corresponding to a point of intersection of the imaginary extended line and the imaginary plane;

a sixth step of executing the second through fifth steps on the plurality of pixels which can be viewed from the viewpoint position to thereby determine display colors of the plurality of pixels;

a seventh step of executing the second through sixth steps on all of the plurality of two-dimensional images; and

an eighth step of controlling the three-dimensional display apparatus to change the color of the light emitted from the pixel according to the angle at which the pixel is viewed on the horizontal plane, so that when the display surface is viewed from the viewpoint positions respectively corresponding to the two-dimensional images, the pixels may respectively have the display colors determined in the first through seventh steps.

2. The stereoscopic image display method according to claim 1, wherein the three-dimensional display apparatus comprises:

a light-emitting element array structure including a plurality of one-dimensional light-emitting element arrays arranged at predetermined intervals in a circumferential direction of the three-dimensional display apparatus, one-dimensional light-emitting element arrays each including a plurality of light-emitting elements longitudinally arranged to form an array; and

a light-shielding portion structure arranged outside the light-emitting element array structure, the light shielding portion structure including a plurality of light-shielding portions arranged at predetermined intervals in the circumferential direction so as to make the light-shield portion structure have a plurality of slits arranged at predetermined intervals in the circumferential direction; and

wherein the light-emitting element array structure and the light-shielding portion structure are rotated in mutually opposite directions, and light emission of the light-emitting elements included in the one-dimensional light-emitting element arrays is controlled, to thereby form the display surface formed of the pixels in a space between the light-emitting element array structure and the light-shielding portion structure.

3. The stereoscopic image display method according to claim 1, wherein the first step and the second through seventh steps are executed in real-time.

4. The stereoscopic image display method according to claim 1, wherein when an image formation surface of the two-dimensional image is not a simple plane, the imaginary plane is defined as having the same shape as the image formation surface.

5. The stereoscopic image display method according to claim 1, wherein in the fifth step, a weighted average operation is performed to determine the display color of the one pixel according to a distance between the point of intersection and each of neighboring points around the point of intersection, based on the color of the point, corresponding to the point of intersection for the imaginary extended line and the imaginary plane, on the two-dimensional image assumed to have been pasted on the imaginary plane, and colors of points, corresponding to the neighboring points, on the two-dimensional image assumed to have been pasted on the imaginary plane.

6. The stereoscopic image display method according to claim 5, wherein the three-dimensional display apparatus comprises:

a light-emitting element array structure including a plurality of one-dimensional light-emitting element arrays arranged at predetermined intervals in a circumferential direction of the three-dimensional display apparatus, one-dimensional light-emitting element arrays each including a plurality of light-emitting elements longitudinally arranged to form an array; and

a light-shielding portion structure arranged outside the light-emitting element array structure, the light shielding portion structure including a plurality of light-shielding portions arranged at predetermined intervals in the circumferential direction so as to make the light-shield portion structure have a plurality of slits arranged at predetermined intervals in the circumferential direction; and

wherein the light-emitting element array structure and the light-shielding portion structure are rotated in mutually opposite directions, and light emission of the light-emitting elements included in the one-dimensional light-emitting element arrays are controlled, to thereby form the display surface formed of the pixels in a space between the light-emitting element array structure and the light-shielding portion structure.

7. The stereoscopic image display method according to claim 5, wherein the first step and the second through seventh steps are executed in real-time.

8. A stereoscopic image display method that uses a three-dimensional display apparatus to present a stereoscopic image, which can be visually recognized by naked eyes, to a person located outside the three-dimensional display apparatus,

the three-dimensional display apparatus comprising:

a light-emitting element array structure including a plurality of one-dimensional light-emitting element arrays arranged at predetermined intervals in a circumferential direction of the three-dimensional display apparatus, one-dimensional light-emitting element arrays each including a plurality of light-emitting elements longitudinally arranged to form an array; and

a light-shielding portion structure arranged outside the light-emitting element array structure, the light shielding portion structure including a plurality of light-shielding portions arranged at predetermined intervals in the circumferential direction so as to make the light-shield portion structure have a plurality of slits arranged at predetermined intervals in the circumferential direction,

the three-dimensional display apparatus having a cylindrical display surface formed of a plurality of pixels, the display surface being defined by rotating the light-emitting element array structure and the light-shielding portion structure at a constant rotational speed ratio, and controlling light emission of the light-emitting elements included in the one-dimensional light-emitting element arrays, the method comprising;

a first step of defining a center point of an object to be displayed as the stereoscopic image, and photographing the object by a photographic device in all directions from an outside of the object, centering on the center point of the object to thereby obtain a plurality of two-dimensional images, or creating by computer graphics technology a plurality of two-dimensional pseudo images comparable to the two-dimensional images to be obtained by photographing the object from the all directions from the outside of the object, centering on the center point of the object, and using the two-dimensional pseudo images as the two-dimensional images;

a second step of selecting from among the two-dimensional images one two-dimensional image and selecting from among the pixels one pixel which can be viewed from a viewpoint position corresponding to the one two-dimensional image which has been selected;

a third step of assuming a imaginary plane onto which the one two-dimensional image selected is pasted, and arranging the imaginary plane so that an image center point of the one two-dimensional image corresponding to the center point of the object may coincide with the center of a cylindrical space for the cylindrical display surface and that an angle formed between the imaginary plane and a straight line connecting the viewpoint position and the center of the cylindrical space for the cylindrical display surface matches an angle formed between an image pickup surface of the photographic device and a straight line connecting the center point of the object and a lens'"'"'s principal point of the photographic device;

a fourth step of assuming a imaginary extended line which extends from the viewpoint position to the imaginary plane through the one pixel selected;

a fifth step of determining a display color of the one pixel as viewed from the viewpoint position, based on a color of a point on the two-dimensional image assumed to have been pasted on the imaginary plane, the point corresponding to a point of intersection of the imaginary extended line and the imaginary plane;

a sixth step of executing the second through fifth steps on the plurality of pixels which can be viewed from the viewpoint position to thereby determine display colors of the plurality of pixels;

a seventh step of executing the second through sixth steps on all of the plurality of two-dimensional images; and

an eighth step of controlling the three-dimensional display apparatus to change the color of the light emitted from the pixel according to the angle at which the pixel is viewed on the horizontal plane, so that when the display surface is viewed from the viewpoint positions respectively corresponding to the two-dimensional images, the pixels may respectively have the display colors determined in the first through seventh steps.

9. A stereoscopic image display method that uses a three-dimensional display apparatus to present a stereoscopic image, which can be visually recognized by naked eyes, to a person located outside the three-dimensional display apparatus,

the three-dimensional display apparatus comprising:

a light-emitting element array structure including a plurality of light-emitting elements two-dimensionally arranged on a cylindrical surface; and

a light-shielding portion structure arranged outside the light-emitting element array structure, the light shielding portion structure including a plurality of light-shielding portions arranged at predetermined intervals in a circumferential direction so as to make the light-shield portion structure have a plurality of slits arranged at predetermined intervals in the circumferential direction,

the three-dimensional display apparatus having a cylindrical display surface formed of a plurality of pixels, the display surface being defined by rotating the light-emitting element array structure and controlling light emission of the light-emitting elements included in the light-emitting element array structure, the method comprising;

a first step of defining a center point of an object to be displayed as the stereoscopic image, and photographing the object by a photographic device in all directions from an outside of the object, centering on the center point of the object to thereby obtain a plurality of two-dimensional images, or creating by computer graphics technology a plurality of two-dimensional pseudo images comparable to the two-dimensional images to be obtained by photographing the object from the all directions from the outside of the object, centering on the center point of the object, and using the two-dimensional pseudo images as the two-dimensional images;

a second step of selecting from among the two-dimensional images one two-dimensional image and selecting from among the pixels one pixel which can be viewed from a viewpoint position corresponding to the one two-dimensional image which has been selected;

a third step of assuming a imaginary plane onto which the one two-dimensional image selected is pasted, and arranging the imaginary plane so that an image center point of the one two-dimensional image corresponding to the center point of the object may coincide with the center of a cylindrical space for the cylindrical display surface and that an angle formed between the imaginary plane and a straight line connecting the viewpoint position and the center of the cylindrical space for the cylindrical display surface matches an angle formed between an image pickup surface of the photographic device and a straight line connecting the center point of the object and a lens'"'"'s principal point of the photographic device;

a fourth step of assuming a imaginary extended line which extends from the viewpoint position to the imaginary plane through the one pixel selected;

a fifth step of determining a display color of the one pixel as viewed from the viewpoint position, based on a color of a point on the two-dimensional image assumed to have been pasted on the imaginary plane, the point corresponding to a point of intersection of the imaginary extended line and the imaginary plane;

a sixth step of executing the second through fifth steps on the plurality of pixels which can be viewed from the viewpoint position to thereby determine display colors of the plurality of pixels;

a seventh step of executing the second through sixth steps on all of the plurality of two-dimensional images; and

an eighth step of controlling the three-dimensional display apparatus to change the color of the light emitted from the pixel according to the angle at which the pixel is viewed on the horizontal plane, so that when the display surface is viewed from the viewpoint positions respectively corresponding to the two-dimensional images, the pixels may respectively have the display colors determined in the first through seventh steps.