Method and apparatus for processing three-dimensional images

• US 8,254,668 B2
• Filed: 01/07/2011
• Issued: 08/28/2012
• Est. Priority Date: 03/27/2002
• Status: Expired due to Fees

• Current Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Inventors: Mashitani, Ken, Hamagishi, Goro, Takemoto, Satoshi
• Primary Examiner(s): Liew, Alex
• Application Number:
  US12/986,453
• Publication Number:
  US 20110102427A1
• Time in Patent Office: 599 Days
• Field of Search: 382/154, 348 42- 60, 356 12- 14
• US Class Current: 382/154
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A three-dimensional sense adjusting unit displays three-dimensional images to a user. If a displayed reaches a limit of parallax, the user responds to the three-dimensional sense adjusting unit. According to acquired appropriate parallax information, a parallax control unit generates parallax images to realize the appropriate parallax in the subsequent stereo display. The control of parallaxes is realized by optimally setting camera parameters by going back to three-dimensional data. Functions to realize the appropriate parallax are made into and presented by a library.

Claims

1. A three-dimensional image displaying apparatus for displaying a three-dimensional image perceived by one or more users based on two-dimensional viewpoint images corresponding respectively to right and left eyes of the one or more users, the apparatus comprising:

a storage unit having pre-stored front and back boundary positions of a three-dimensional object perceived by the user, the front boundary position being a limit up to where the three-dimensional object appears to be maximally close to the user and the back boundary position being a limit up to where the three-dimensional object appears to be maximally distant from the user;

a receiving unit configured to receive a user instruction selecting front and back boundary positions from the pre-stored front and back boundary positions; and

a control unit configured to;

receive a single two-dimensional image having information for generating the two-dimensional viewpoint images from the received single two-dimensional image;

generate the two-dimensional viewpoint images from the received single two-dimensional image based on the received information; and

adjust parallax between or among the two-dimensional viewpoint images based on a parallax amount corresponding to the user instruction before the three-dimensional image is displayed so that the three-dimensional object to be perceived by the user appears between the front and back boundary positions selected by the user instruction.

2. The apparatus according to claim 1, wherein

the parallax amount is stored in a recording area, and

the control unit adjusts the parallax between or among the two-dimensional viewpoint images based on the parallax amount in the recording area.

9. The three-dimensional image displaying apparatus according to claim 1, wherein the information is depth information.

3. A three-dimensional image processing apparatus for processing a three-dimensional image perceived by one or more users based on two-dimensional viewpoint images corresponding respectively to right and left eyes of the one or more users, the apparatus comprising:

a storage unit having pre-stored front and back boundary positions of a three-dimensional object perceived by the user, the front boundary position being a limit up to where the three-dimensional object appears to be maximally close to the user and the back boundary position being a limit up to where the three-dimensional object appears to be maximally distant from the user;

a receiving unit configured to receive a user instruction selecting front and back boundary positions from the pre-stored front and back boundary positions; and

a control unit configured to;

receive a single two-dimensional image having information for generating the two-dimensional viewpoint images from the received single two-dimensional image;

generate the two-dimensional viewpoint images from the received single two-dimensional image based on the received information; and

adjust parallax between or among the two-dimensional viewpoint images based on a parallax amount corresponding to the user instruction before the three-dimensional image is displayed so that the three-dimensional object to be perceived by the user appears between the front and back boundary positions selected by the user instruction.

4. The apparatus according to claim 3, wherein

the parallax amount is stored in a recording area, and

the control unit adjusts the parallax between or among the two dimensional viewpoint images based on the parallax amount in the recording area.

5. A three-dimensional image processing method for displaying a three-dimensional image perceived by one or more users based on two-dimensional viewpoint images corresponding respectively to right and left eyes of the one or more users, the method comprising the steps of:

receiving a user instruction selecting front and back boundary positions from pre-stored front and back boundary positions of a three-dimensional object perceived by the user, the front boundary position being a limit up to where the three-dimensional object appears to be maximally close to the user and the back boundary position being a limit up to where the three-dimensional object appears to be maximally distant from the user; and

receiving a single two-dimensional image having information for generating the two-dimensional viewpoint images from the received single two-dimensional image;

generating the two-dimensional viewpoint images from the received single two-dimensional image based on the received information; and

adjusting parallax between or among the two-dimensional viewpoint images based on a parallax amount corresponding to the user instruction before the three-dimensional image is displayed so that the three-dimensional object to be perceived by the user appears between the front and back boundary positions selected by the user instruction.

6. The method according to claim 5, wherein

the parallax amount is stored in a recording area, and

the adjusting step adjusts the parallax between or among the two-dimensional viewpoint images based on the parallax amount in the recording area.

7. The three-dimensional image processing method according to claim 5, wherein

the steps are implemented as library functions for use in a three-dimensional display, and

the library functions are called as functions of a plurality of programs.

8. A non-transitory tangible computer-readable medium having a program for displaying a three-dimensional image perceived by one or more users based on two-dimensional viewpoint images corresponding respectively to right and left eyes of the one or more users, the program, when executed, controlling a computer to perform the steps of:

receiving a user instruction selecting front and back boundary positions from pre-stored front and back boundary positions of a three-dimensional object perceived by the user, the front boundary position being a limit up to where the three-dimensional object appears to be maximally close to the user and the back boundary position being a limit up to where the three-dimensional object appears to be maximally distant from the user; and

receiving a single two-dimensional image having information for generating the two-dimensional viewpoint images from the received single two-dimensional image;

generating the two-dimensional viewpoint images from the received single two-dimensional image based on the received information; and

adjusting parallax between or among the two-dimensional viewpoint images based on a parallax amount corresponding to the user instruction before the three-dimensional image is displayed so that the three-dimensional object to be perceived by the user appears between the front and back boundary positions selected by the user instruction.

10. A three-dimensional image displaying apparatus for displaying a three-dimensional image perceived by one or more users based on two-dimensional viewpoint images corresponding respectively to right and left eyes of the one or more users, the apparatus comprising:

a storage unit having pre-stored front and back boundary positions of a three-dimensional object perceived by the user, the front boundary position being a limit up to where the three-dimensional object appears to be maximally close to the user and the back boundary position being a limit up to where the three-dimensional object appears to be maximally distant from the user;

a receiving unit configured to receive a user instruction selecting front and back boundary positions from the pre-stored front and back boundary positions; and

a control unit configured to;

receive a single two-dimensional image;

generate the two-dimensional viewpoint images from the received single two-dimensional image; and

adjust parallax between or among the two-dimensional viewpoint images based on a parallax amount corresponding to the user instruction before the three-dimensional image is displayed so that the three-dimensional object to be perceived by the user appears between the front and back boundary positions selected by the user instruction.

11. The apparatus according to claim 10, wherein

the parallax amount is stored in a recording area, and

the control unit adjusts the parallax between or among the two-dimensional viewpoint images based on the parallax amount in the recording area.

12. The Three-dimensional image displaying apparatus according to claim 10, wherein

the single two-dimensional image has information for generating the two-dimensional viewpoint images from the received single two-dimensional image, and

the control unit is further configured to generate the two-dimensional viewpoint images from the received single two-dimensional image based on the received information.

13. The Three-dimensional image displaying apparatus according to claim 12, wherein the information is depth information.

14. A three-dimensional image displaying apparatus for displaying a three-dimensional image perceived by one or more users based on two-dimensional viewpoint images corresponding respectively to right and left eyes of the one or more users, the apparatus comprising:

a storage unit having pre-stored front and back boundary positions of a three-dimensional object perceived by the user, the front boundary position being a limit up to where the three-dimensional object appears to be maximally close to the user and the back boundary position being a limit up to where the three-dimensional object appears to be maximally distant from the user;

a receiving unit configured to receive a parallax amount representing a user'"'"'s preference; and

a control unit configured to;

receive a single two-dimensional image having information for generating the two-dimensional viewpoint images from the received single two-dimensional image;

generate the two-dimensional viewpoint images from the received single two-dimensional image based on the received information; and

adjust parallax between or among the two-dimensional viewpoint images based on the parallax amount received by the receiving unit before the three-dimensional image is displayed so that the three-dimensional object to be perceived by the user appears between the front and back boundary positions.