Method and apparatus for processing three-dimensional images

• US 20050089212A1
• Filed: 09/27/2004
• Published: 04/28/2005
• Est. Priority Date: 03/27/2002
• Status: Active Grant

• Current Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Inventors: Mashitani, Ken, Takemoto, Satoshi, Hamagishi, Goro
• Granted Patent: US 8,369,607 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A three-dimensional sense adjusting unit displays three-dimensional images to a user. If a displayed reaches a limit of parallax, the user responds to the three-dimensional sense adjusting unit. According to acquired appropriate parallax information, a parallax control unit generates parallax images to realize the appropriate parallax in the subsequent stereo display. The control of parallaxes is realized by optimally setting camera parameters by going back to three-dimensional data. Functions to realize the appropriate parallax are made into and presented by a library.

Claims

1. A three-dimensional image processing apparatus characterized in that it includes:

an instruction acquiring unit which acquires a response of a user to a three-dimensional image displayed on the basis of a plurality of viewpoint images corresponding to different parallaxes; and

a parallax specifying unit which specifies an appropriate parallax on the user based on the acquired response.

2. An apparatus according to claim 1, further including a parallax control unit which performs a processing so that the specified appropriate parallax is also realized in displaying other images.

3. An apparatus according to claim 2, wherein the other images are three-dimensional images generated from three-dimensional data and wherein said parallax control unit determines a plurality of viewpoints from which the three-dimensional image is generated according to the appropriate parallax.

4. An apparatus according to claim 2, wherein said parallax control unit determines distances among the plurality of viewpoints and positions at which optical axes projected from the viewpoints intersect.

5. An apparatus according to claim 2, wherein said parallax control unit performs control so that the appropriate parallax is realized on a predetermined basic three-dimensional space to be displayed.

6. An apparatus according to claim 3, wherein said parallax control unit performs control so that the appropriate parallax is realized on a predetermined basic three-dimensional space to be displayed.

7. An apparatus according to claim 4, wherein said parallax control unit performs control so that the appropriate parallax is realized on a predetermined basic three-dimensional space to be displayed.

8. An apparatus according to claim 2, wherein said parallax control unit performs control so that the appropriate parallax is realized on coordinates of an object disposed closest in a three-dimensional space and coordinates of an object disposed farthest therein.

9. An apparatus according to claim 3, wherein said parallax control unit performs control so that the appropriate parallax is realized on coordinates of an object disposed closest in a three-dimensional space and coordinates of an object disposed farthest therein.

10. An apparatus according to claim 4, wherein said parallax control unit performs control so that the appropriate parallax is realized on coordinates of an object disposed closest in a three-dimensional space and coordinates of an object disposed farthest therein.

11. An apparatus according to claim 2, wherein the other images are a plurality of two-dimensional images to which parallax has already been given and wherein said parallax control unit determines shift amounts of the plurality of two-dimensional images in a horizontal direction according to the appropriate parallax.

12. An apparatus according to claim 2, wherein the other images are plane images to which depth information is given and wherein said parallax control unit adjusts the depth information on the plane images according to the appropriate parallax.

13. An apparatus according to claim 2, further including a parallax storage unit which records the appropriate parallax, wherein said parallax control unit loads the appropriate parallax at a predetermined timing and with the thus loaded value as an initial value the processing is performed.

14. An apparatus according to claim 3, further including a parallax storage unit which records the appropriate parallax, wherein said parallax control unit loads the appropriate parallax at a predetermined timing and with the thus loaded value as an initial value the processing is performed.

15. An apparatus according to claim 4, further including a parallax storage unit which records the appropriate parallax, wherein said parallax control unit loads the appropriate parallax at a predetermined timing and with the thus loaded value as an initial value the processing is performed.

16. An apparatus according to claim 1, further including:

an object specifying unit which receives from a user a specification of a predetermined object contained in the three-dimensional image; and

an optical axis intersecting position setting unit which associates intersecting positions of optical axes associated with the respective plurality of viewpoint images with an specified object and which sets the intersecting positions of the optical axes so that the specified object is expressed in the vicinity of a display screen on which the three-dimensional images are displayed.

17. An apparatus according to claim 2, further including:

an object specifying unit which receives from a user a specification of a predetermined object contained in the three-dimensional image; and

an optical axis intersecting position setting unit which associates intersecting positions of optical axes associated with the respective plurality of viewpoint images with an specified object and which sets the intersecting positions of the optical axes so that the specified object is expressed in the vicinity of a display screen on which the three-dimensional images are displayed.

18. An apparatus according to claim 3, further including:

an object specifying unit which receives from a user a specification of a predetermined object contained in the three-dimensional image; and

an optical axis intersecting position setting unit which associates intersecting positions of optical axes associated with the respective plurality of viewpoint images with an specified object and which sets the intersecting positions of the optical axes so that the specified object is expressed in the vicinity of a display screen on which the three-dimensional images are displayed.

19. An apparatus according to claim 16, wherein the specified object has a predetermined boundary face and wherein said optical axis intersecting position setting unit associates the intersecting positions of the optical axes on the boundary face.

20. An apparatus according to claim 16, further including a specified information adding unit which associates the specified object with the intersecting positions of the optical axes and which associates optical axis corresponding information with the object where the optical axis corresponding information indicates that the object is expressed in the vicinity of a position of a display screen.

21. An apparatus according to claim 19, further including a specified information adding unit which associates the specified object with the intersecting positions of the optical axes and which associates optical axis corresponding information with the object where the optical axis corresponding information indicates that the object is expressed in the vicinity of a position of a display screen.

22. A three-dimensional processing apparatus according to claim 20, wherein said optical axis intersecting position setting unit acquires the optical axis corresponding information and associates the intersecting position of the optical axis with an object described in the acquired optical axis corresponding information and wherein the object to which intersecting position of the optical axis is associated is expressed in the vicinity of a position of a display screen on which the three-dimensional image is displayed.

23. An apparatus according to claim 1, further including:

an identification information acquiring unit which acquires identification information, associated with image data used in generating the three-dimensional image, that contains information on whether or not the object is to be expressed in a basic representation space that contains an object to be three dimensionally displayed; and

a parallax control unit which reflects a parallax amount upon an object based on the acquired identification information.

24. An apparatus according to claim 2, further including:

an identification information acquiring unit which acquires identification information, associated with image data used in generating the three-dimensional image, that contains information on whether or not the object is to be expressed in a basic representation space that contains an object to be three dimensionally displayed; and

a parallax control unit which reflects a parallax amount upon an object based on the acquired identification information.

25. An apparatus according to claim 3, further including:

an identification information acquiring unit which acquires identification information, associated with image data used in generating the three-dimensional image, that contains information on whether or not the object is to be expressed in a basic representation space that contains an object to be three dimensionally displayed; and

a parallax control unit which reflects a parallax amount upon an object based on the acquired identification information.

26. An apparatus according to claim 1, wherein said parallax control unit controls a ratio of the width to the depth of an object expressed within the three-dimensional image so that a parallax formed thereby does not exceed a parallax range properly perceived by human eyes.

27. An apparatus according to claim 2, wherein said parallax control unit controls a ratio of the width to the depth of an object expressed within the three-dimensional image so that a parallax formed thereby does not exceed a parallax range properly perceived by human eyes.

28. An apparatus according to claim 3, wherein said parallax control unit controls a ratio of the width to the depth of an object expressed within the three-dimensional image so that a parallax formed thereby does not exceed a parallax range properly perceived by human eyes.

29. An apparatus according to claim 1, further including:

a camera placement setting unit which sets of a plurality of virtual camera disposition to generate a plurality of viewpoint images when original data from which the three-dimensional image is generated are inputted;

an object area determining unit which determines whether an area is generated or not in which information on an object to be displayed does not exist in viewpoint images generated corresponding to the respective virtual cameras; and

a camera parameter adjusting unit which adjusts, in a case when the area in which information on an object to be displayed is not available is generated, at least one of an angle of view of the virtual camera, a camera interval and an intersecting position of an optical axis so that there is no longer any area in which information on an object to be displayed does not exist.

30. An apparatus according to claim 2, further including:

a camera placement setting unit which sets of a plurality of virtual camera disposition to generate a plurality of viewpoint images when original data from which the three-dimensional image is generated are inputted;

an object area determining unit which determines whether an area is generated or not in which information on an object to be displayed does not exit in viewpoint images generated corresponding to the respective virtual cameras; and

a camera parameter adjusting unit which adjusts, in a case when the area in which information on an object to be displayed is not available is generated, at least one of an angle of view of the virtual camera, a camera interval and an intersecting position of an optical axis so that there is no longer any area in which information on an object to be displayed does not exist.

31. An apparatus according to claim 3, further including:

a camera placement setting unit which sets of a plurality of virtual camera disposition to generate a plurality of viewpoint images when original data from which the three-dimensional image is generated are inputted;

an object area determining unit which determines whether an area is generated or not in which information on an object to be displayed does not exist in viewpoint images generated corresponding to the respective virtual cameras; and

a camera parameter adjusting unit which adjusts, in a case when the area in which information on an object to be displayed is not available is generated, at least one of an angle of view of the virtual camera, a camera interval and an intersecting position of an optical axis so that there is no longer any area in which information on an object to be displayed does not exist.

32. An apparatus according to claim 1, wherein, in a case when the three-dimensional images are generated from three-dimensional data, said parallax control unit performs control so that when a parameter, for camera disposition, which is set for generating parallax images is to be changed, the camera parameter falls within a range of threshold values which is provided beforehand for a variation of the parameter.

33. An apparatus according to claim 2, wherein, in a case when the three-dimensional images are generated from three-dimensional data, said parallax control unit performs control so that when a parameter, for camera disposition, which is set for generating parallax images is to be changed, the camera parameter falls within a range of threshold values which is provided beforehand for a variation of the parameter.

34. An apparatus according to claim 2, wherein, in a case when the three-dimensional images are generated from three-dimensional data, said parallax control unit performs control so that when a parameter, for camera disposition, which is set for generating parallax images is to be changed, the camera parameter falls within a range of threshold values which is provided beforehand for a variation of the parameter.

35. An apparatus according to claim 1, wherein, in a case when the three-dimensional images are generated from two-dimensional moving images to which depth information are given, said parallax control unit performs control so that a variation, caused by progression of the two-dimensional moving images, in a maximum value or minimum value of depth contained in the depth information falls within a range of threshold values provided beforehand.

36. An apparatus according to claim 2, wherein, in a case when the three-dimensional images are generated from two-dimensional moving images to which depth information are given, said parallax control unit performs control so that a variation, caused by progression of the two-dimensional moving images, in a maximum value or minimum value of depth contained in the depth information falls within a range of threshold values provided beforehand.

37. An apparatus according to claim 1, wherein, in a case when the three-dimensional images are generated from two-dimensional moving images to which depth information are given, said parallax control unit performs control so that a variation, caused by progression of the two-dimensional moving images, in a maximum value or minimum value of depth contained in the depth information falls within a range of threshold values provided beforehand.

38. An apparatus according to claim 1, further including an image determining unit which analyzes the three-dimensional image in units of scene.

39. An apparatus according to claim 2, further including an image determining unit which analyzes the three-dimensional image in units of scene.

40. An apparatus according to claim 3, further including an image determining unit which analyzes the three-dimensional image in units of scene.

41. A method for processing three-dimensional images, the method including:

displaying to a user a plurality of three-dimensional images due to different parallaxes; and

specifying an appropriate parallax for the user based on a user'"'"'s response to the displayed three-dimensional images.

43. A method according to claim 41, wherein said each step is implemented as a library function for use in three-dimensional display and wherein configuration is such that the library function can be called up as a function from a plurality of programs.

45. A method according to claim 41, further including changing moving velocity of an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed in the three-dimensional image, in a nearer-positioned or farther-positioned direction.

47. A method according to claim 43, further including the changing moving velocity of an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed in the three-dimensional image, in a nearer-positioned or farther-positioned direction.

48. A method according to claim 41, further including the adjusting the appropriate parallax in such a manner that an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed is expressed so as to fall within a predetermined parallax range and, simultaneously, at least one of forefront surface and rearmost surface of the basic representation space is set to a position where no object exists.

50. A method according to claim 43, further including adjusting the appropriate parallax in such a manner that an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed is expressed so as to fall within a predetermined parallax range and, simultaneously, at least one of forefront surface and rearmost surface of the basic representation space is set to a position where no object exists.

42. A method for processing three-dimensional images, the method including:

acquiring an appropriate parallax that depends on a user; and

carrying out a processing to images prior to displaying the images to realize the acquired appropriate parallax.

44. A method according to claim 42, wherein said each step is implemented as a library function for use in three-dimensional display and wherein configuration is such that the library functions can be called up as a function from a plurality of programs.

46. A method according to claim 42, further including the changing moving velocity of an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed in the three-dimensional image, in a nearer-positioned or farther-positioned direction.

49. A method according to claim 42, further including adjusting the appropriate parallax in such a manner that an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed is expressed so as to fall within a predetermined parallax range and, simultaneously, at least one of forefront surface and rearmost surface of the basic representation space is set to a position where no object exists.

51. A program executable by a computer, the program including the functions of:

displaying to a user a plurality of three-dimensional images due to different parallaxes; and

specifying an appropriate parallax for the user based on a user'"'"'s response to the displayed three-dimensional images.

52. A three-dimensional image processing apparatus, the apparatus including:

a parallax control unit which corrects parallaxes among a plurality of viewpoint images by which to display three-dimensional images; and

a map storage unit which stores a correction map to be referred to by said parallax control unit at the time of a correction processing,

wherein the correction map is described in a manner such that the parallaxes are corrected based on position within the viewpoint images.

53. An apparatus according to claim 52, wherein said parallax control unit diminishes a parallax at the periphery of the plurality of viewpoint images or changes the parallax so that an object is perceived farther from a user.

54. An apparatus according to claim 52, wherein said parallax control unit varies the parallax by selectively performing a processing on any of the plurality of viewpoints images.

55. An apparatus according to claim 53, wherein said parallax control unit varies the parallax by selectively performing a processing on any of the plurality of viewpoints images.

56. An apparatus according to claim 52, wherein the plurality of viewpoint images are generated from three-dimensional data and wherein when generating the plurality of viewpoint images, said parallax control unit varies the parallax by controlling camera parameters.

57. An apparatus according to claim 53, wherein the plurality of viewpoint images are generated from three-dimensional data and wherein when generating the plurality of viewpoint images, said parallax control unit varies the parallax by controlling camera parameters.

58. An apparatus according to claim 54, wherein the plurality of viewpoint images are generated from three-dimensional data and wherein when generating the plurality of viewpoint images, said parallax control unit varies the parallax by controlling camera parameters.

59. An apparatus according to claim 52, wherein the plurality of viewpoint images are generated from three-dimensional data and wherein when generating the plurality of viewpoint images, said parallax control unit varies the parallax by distorting three-dimensional space itself.

60. An apparatus according to claim 53, wherein the plurality of viewpoint images are generated from three-dimensional data and wherein when generating the plurality of viewpoint images, said parallax control unit varies the parallax by distorting three-dimensional space itself.

61. An apparatus according to claim 52, wherein the plurality of viewpoint images are ones generated from plane images to which depth information is given and wherein said parallax control unit varies the parallax by manipulating the depth information.

62. An apparatus according to claim 53, wherein the plurality of viewpoint images are ones generated from plane images to which depth information is given and wherein said parallax control unit varies the parallax by manipulating the depth information.

63. A method for processing three-dimensional images, the method including:

acquiring a plurality of viewpoint images to display three-dimensional images; and

varying parallax among the acquired plurality of viewpoint images, based on positions in the viewpoint images.

64. A method according to claim 63, wherein said each step is implemented as a library function for use in three-dimensional display and wherein configuration is such that the library function can be called up as a function from a plurality of programs.

65. A program executable by a computer, the program including the functions of:

acquiring a plurality of viewpoint images to display three-dimensional images; and

varying parallax among the acquired plurality of viewpoint images, based on positions in the viewpoint images.

66. A method for processing three-dimensional images, the method including:

reading a user'"'"'s appropriate parallax acquired by a first display apparatus into a second display apparatus;

adjusting parallax of parallax images by the second display apparatus according to the appropriate parallax; and

outputting from the second display apparatus the parallax images whose parallax has been adjusted by said adjusting.

67. A method according to claim 66, further including:

reading information on hardware of the first display apparatus into the second display apparatus; and

correcting according to the appropriate parallax the parallax image whose parallax has been adjusted by said adjusting parallax of parallax images, by the second display apparatus, based on the read-in information on hardware of the first display apparatus and information on hardware of the second display apparatus.

68. A method according to claim 67, wherein the information on hardware includes the size of a display screen.

69. A method according to claim 67, wherein the information on hardware includes optimum observation distances of the display apparatuses.

70. A method according to claim 68, wherein the information on hardware includes optimum observation distances of the display apparatuses.

71. A method according to claim 67, wherein the information on hardware includes information on image separability of the display apparatus.

72. A method according to claim 68, wherein the information on hardware includes information on image separability of the display apparatus.

73. A method according to claim 69, wherein the information on hardware includes information on image separability of the display apparatus.

74. A three-dimensional image processing apparatus, the apparatus including a first display apparatus, a second display apparatus and a server which are connected to one another via a network,

wherein the first display apparatus sends user'"'"'s appropriate parallax information acquired by said three-dimensional image processing apparatus to the server,

said server receives the appropriate parallax information and records this in association with a user, and

when the user requests output of image data at the display apparatus, said three-dimensional image processing apparatus reads out appropriate parallax information for the user from the sever, adjusts parallax thereof and then outputs a parallax image.

75. A three-dimensional image processing apparatus characterized in that an appropriate parallax to display a parallax image three-dimensionally is once converted to a form of representation which does not depend on hardware of a display apparatus, and the appropriate parallax by the form of representation is distributed among different display apparatuses.

76. A three-dimensional image processing apparatus, the apparatus including:

an instruction acquiring unit which acquires a user'"'"'s instruction for a three-dimensional image displayed from a plurality of viewpoint images;

a parallax control unit which varies, according to the user instruction acquired by said instruction acquiring unit, parallax amounts among the plurality of viewpoint images by shifting synthesis positions of the plurality of viewpoint images; and

a parallax amount write unit which writes finally determined synthesis positions into a predetermined recording area.

84. An apparatus according to claim 76, wherein the recording area is any header of the plurality of viewpoint images.

88. An apparatus according to claim 76, further including an image edge adjusting unit which reduces loss of pixels caused as a result of displaying the three-dimensional image.

96. An apparatus according to claim 76, wherein if the plurality of viewpoint images are synthesized in a single image, the recording area is a header of the image.

77. A three-dimensional image processing apparatus, the apparatus including:

a parallax amount detecting unit which detects a first parallax amount caused as a result of displaying a three-dimensional image from a plurality of viewpoint images;

a parallax control unit which varies parallax amounts of the plurality of viewpoint images by shifting synthesis positions of the plurality of viewpoint images so that the first parallax amount falls within a range of a second parallax amount which is a user'"'"'s permissible parallax amount.

78. An apparatus according to claim 77, wherein said parallax amount detecting unit detects a maximum value of the first parallax amount and said parallax control unit varies the parallax amounts of the plurality of viewpoint images in a manner such that the maximum value of the first parallax amount does not exceed a maximum value of the second parallax amount.

79. An apparatus according to claim 77, wherein said parallax amount detecting unit detects the first parallax amount by computing matching of corresponding points among the plurality of viewpoint images.

80. An apparatus according to claim 78, wherein said parallax amount detecting unit detects the first parallax amount by computing matching of corresponding points among the plurality of viewpoint images.

81. An apparatus according to claim 77, wherein said parallax amount detecting unit detects and reads out the first parallax amount recorded beforehand in any header of the plurality of viewpoint images.

82. An apparatus according to claim 78, wherein said parallax amount detecting unit detects and reads out the first parallax amount recorded beforehand in any header of the plurality of viewpoint images.

83. An apparatus according to claim 79, wherein said parallax amount detecting unit detects and reads out the first parallax amount recorded beforehand in any header of the plurality of viewpoint images.

85. An apparatus according to claim 77, wherein the recording area is any header of the plurality of viewpoint images.

86. An apparatus according to claim 78, wherein the recording area is any header of the plurality of viewpoint images.

89. An apparatus according to claim 77, further including an image edge adjusting unit which reduces loss of pixels caused as a result of displaying the three-dimensional image.

90. An apparatus according to claim 78, further including an image edge adjusting unit which reduces loss of pixels caused as a result of displaying the three-dimensional image.

97. An apparatus according to claim 77, wherein if the plurality of viewpoint images are synthesized in a single image, the recording area is a header of the image.

98. An apparatus according to claim 78, wherein if the plurality of viewpoint images are synthesized in a single image, the recording area is a header of the image.

87. A three-dimensional image processing apparatus, the apparatus including:

an instruction acquiring unit which acquires a user'"'"'s instruction for a three-dimensional image displayed from a plurality of viewpoint images; and

a parallax control unit which varies, according to the acquired instruction, parallax amounts among the plurality of viewpoint images,

wherein said parallax control unit varies the parallax amounts among the plurality of viewpoint images by adjusting depth information that serves as a basis for generating the plurality of viewpoint images.

91. A method for processing three-dimensional images, the method including:

acquiring a user'"'"'s instruction for a three-dimensional image displayed based on a plurality of viewpoint images;

varying, according to the acquired instruction, parallax amounts among the plurality of viewpoint images by shifting synthesis positions of the plurality of viewpoint images; and

writing finally determined synthesis positions into a predetermined recording area.

93. A method according to claim 91, wherein said each step is implemented as a library function for use in three-dimensional display and wherein configuration is such that the library function can be called up as a function from a plurality of programs.

92. A method for processing three-dimensional images, the method including:

detecting a first parallax amount caused when a three-dimensional image is displayed from a plurality of viewpoint images;

varying parallax amounts of the plurality of viewpoint images by shifting synthesis positions of the plurality of viewpoint images by so that the first parallax amount falls within a range of a second parallax amount which is a user'"'"'s permissible parallax amount.

writing finally determined synthesis positions into a predetermined recording area.

94. A method according to claim 92, wherein said each step is implemented as a library function for use in three-dimensional display and wherein configuration is such that the library function can be called up as a function from a plurality of programs.

95. A program executable by a computer, the program including the functions of:

acquiring a user'"'"'s instruction for a three-dimensional image displayed based on a plurality of viewpoint images;

varying, according to the instruction, parallax amounts among the plurality of viewpoint images by shifting synthesis positions of the plurality of viewpoint images; and

writing finally determined synthesis positions into a predetermined recording area.

99. A three-dimensional image processing apparatus for displaying three-dimensional images based on a plurality of viewpoint images corresponding to different parallaxes, the display apparatus including:

a recommended parallax acquiring unit which acquires a parallax range recommended in the event that the three-dimensional image is displayed by utilizing said display apparatus; and

a parallax control unit which sets parallax so that the three-dimensional image is displayed within the recommended parallax range acquired by said recommended parallax acquiring unit.

100. An apparatus according to claim 99, further including:

an object specifying unit which receives, from a user, specification of a predetermined object contained in the three-dimensional image; and

an optical axis intersecting position setting unit which associates intersecting positions of optical axes associated with the respective plurality of viewpoint images with specified object positions and which sets the intersecting positions of optical axes so that the specified object is expressed in the vicinity of a position of a display screen on which the three-dimensional image is displayed.

101. An apparatus according to claim 100, further including a specified information adding unit which associates, with the object, optical axis corresponding information indicating that for the specified object the object is associated with the intersecting position of the optical axis and the object is expressed in the vicinity of the display screen.

102. An apparatus according to claim 101, wherein said optical axis intersecting position setting unit acquires the optical axis corresponding information, associates the intersecting position of the optical axis with the object described in the acquired optical corresponding information and the object associated with the intersecting position of optical axis is expressed in the vicinity of the position of the display screen on which the three-dimensional image is displayed.

103. An apparatus according to claim 100, wherein the specified object has a predetermined boundary face and said optical axis intersecting position setting unit associates the intersecting position of optical axis on the boundary face.

104. An apparatus according to claim 101, wherein the specified object has a predetermined boundary face and said optical axis intersecting position setting unit associates the intersecting position of axis on the boundary face.

105. An apparatus according to claim 102, wherein the specified object has a predetermined boundary face and said optical axis intersecting position setting unit associates the intersecting position of axis on the boundary face.

106. An apparatus according to any claim 99, wherein the three-dimensional image is generated from three-dimensional data.

107. An apparatus according to any claim 100, wherein the three-dimensional image is generated from three-dimensional data.

108. An apparatus according to any claim 101, wherein the three-dimensional image is generated from three-dimensional data.

109. A three-dimensional image processing apparatus according to claim 99, further including an identification information acquiring unit which acquires identification information, associated with image data used in generating the three-dimensional image, that contains information on whether or not the object is to be expressed within a basic representation space containing an object to be three-dimensionally displayed,

wherein said parallax control unit causes the acquired identification information to be reflected when the object is expressed in a three-dimensional image.

110. An apparatus according to claim 100, further including an identification information acquiring unit which acquires identification information, associated with image data used in generating the three-dimensional image, that contains information on whether or not the object is to be expressed within a basic representation space containing an object to be three-dimensionally displayed,

wherein said parallax control unit causes the acquired identification information to be reflected when the object is expressed in a three-dimensional image.

111. An apparatus according to claim 101, further including an identification information acquiring unit which acquires identification information, associated with image data used in generating the three-dimensional image, that contains information on whether or not the object is to be expressed within a basic representation space containing an object to be three-dimensionally displayed,

wherein said parallax control unit causes the acquired identification information to be reflected when the object is expressed in a three-dimensional image.

112. A three-dimensional image processing apparatus according to claim 99, wherein the identification information contains information on timing at which the object is expressed in the basic representation space and wherein when the object is expressed in a three-dimensional image, said identification information acquiring unit reflects the acquired timing.

113. A three-dimensional image processing apparatus according to claim 100, wherein the identification information contains information on timing at which the object is expressed in the basic representation space and wherein when the object is expressed in a three-dimensional image, said identification information acquiring unit reflects the acquired timing.

114. A three-dimensional image processing apparatus according to claim 101, wherein the identification information contains information on timing at which the object is expressed in the basic representation space and wherein when the object is expressed in a three-dimensional image, said identification information acquiring unit reflects the acquired timing.

116. A method according to claim 103, wherein the boundary face is a thin plate.

117. A method according to claim 106, wherein the boundary face is a thin plate.

141. An apparatus according to any one of claim 100, wherein the recording area is any header of the plurality of viewpoint images.

143. A three-dimensional image processing apparatus according to claim 141, wherein if the plurality of viewpoint images are synthesized into a single piece of image, the recording area is a header of the image.

145. An apparatus according to claim 141, further including an image edge adjusting unit which reduces loss of pixels caused by displaying the three-dimensional image.

115. A method, for processing three-dimensional images, characterized in that in the vicinity of a display screen where an three-dimensional image generated based on a plurality of viewpoint images corresponding to different parallaxes a boundary face that separates one space from another is set as part of the three-dimensional image and the three-dimensional image is drawn with the boundary face being as boundary of nearer-position space and farther-position space.

118. A method for processing three-dimensional images, the method including changing moving velocity of an object which is contained in a three-dimensional image generated based on a plurality of viewpoint images corresponding to different parallaxes and which is to be drawn in a basic representation space that contains an object to be three-dimensionally displayed, in nearer-position or farther-position direction.

119. A method, for processing three-dimensional images, characterized in that when a three-dimensional image is generated based on a plurality of viewpoint images corresponding to different parallaxes, an object to be expressed within a basic representation space that contains an object to be three-dimensionally displayed is expressed so as to fall within a predetermined parallax range and, simultaneously, at least one of forefront surface and rearmost surface of the basic representation space is set to a position where no object exists.

120. A method, for processing three-dimensional images, characterized in that when parallax of an object to be drawn within a basic representation space that contains an object to be three-dimensionally displayed is calculated in the event that a three-dimensional image is generated based on a plurality of viewpoint images corresponding to different parallaxes, the parallax of an object is calculated as size that contains an extended area in front of the object in place of actual size of the object.

121. A method for processing three-dimensional images according to claim 120, wherein after the object moves further backward in such a form as to contain the extended area in front thereof and then the object is positioned in rearmost surface of the basic representation space, the object is expressed in such a manner as to move the extended area in back thereof.

122. A method, for processing three-dimensional images, characterized in that when parallax of an object to be drawn within a basic representation space that contains an object to be three-dimensionally displayed is calculated in the event that a three-dimensional image is generated based on a plurality of viewpoint images corresponding to different parallaxes, the parallax of an object is calculated as size that contains an extended area to the rear of the object in place of actual size of the object.

123. A method for processing three-dimensional images according to claim 122, wherein if the object is positioned in rearmost surface of the basic representation space after the object moves further backward in such a form as to contain the extended area in front thereof, the object is expressed in such a manner as to move the extended area in back thereof.

124. A three-dimensional image processing apparatus, the apparatus including a parallax control unit which controls a ratio of the width to the depth of an object expressed within a three-dimensional image when the three-dimensional image is generated from three-dimensional data so that a parallax formed thereby does not exceed a parallax range properly perceived by human eyes.

125. A three-dimensional image processing apparatus, the apparatus including a parallax control unit which controls a ratio of the width to the depth of an object expressed within a three-dimensional image when the three-dimensional image is generated from a two-dimensional image to which depth information is given so that a parallax formed thereby does not exceed a parallax range properly perceived by human eyes.

126. A three-dimensional image processing apparatus characterized in that if a parameter on camera placement which is set for generating parallax images is to be changed when three-dimensional images are generated from three-dimensional data, control is performed so that the camera parameter falls within a range of threshold values which is provided beforehand for a variation of the parameter.

127. A three-dimensional image processing apparatus characterized in that in a case when moving images of three-dimensional images are generated from two-dimensional moving images to which depth information are given, control is performed so that a variation, caused by progression of the two-dimensional moving images, in a maximum value or minimum value of depth contained in the depth information falls within a range of threshold values provided beforehand.

128. A three-dimensional image processing apparatus, the apparatus including:

an image determining unit which performs frequency analysis on a three-dimensional image to be displayed based on a plurality of viewpoint images corresponding to different parallaxes; and

a parallax control unit which adjusts a parallax amount according to an amount of high frequency component determined by the frequency analysis.

129. A three-dimensional image processing apparatus according to claim 128, wherein if the amount of high frequency component is large, said parallax control unit adjusts the parallax amount by making it larger.

130. A three-dimensional image processing apparatus according, to claim 128, wherein a result in which the three-dimensional image has been frequency-analyzed is associated with the three-dimensional image.

131. A three-dimensional image processing apparatus according to claim 129, wherein a result in which the three-dimensional image has been frequency-analyzed is associated with the three-dimensional image.

132. A three-dimensional image processing apparatus, the apparatus including:

an image determining unit which detects movement of a three-dimensional image displayed based on a plurality of viewpoint images corresponding to different parallaxes; and

a parallax control unit which adjusts a parallax amount according to an amount of movement of the thee-dimensional image.

133. A three-dimensional image processing apparatus according to claim 132, wherein if the amount of movement of the three-dimensional image is small, said parallax control unit adjusts the parallax amount by making it smaller.

134. A three-dimensional image processing apparatus according to claim 132, wherein a result in which the movement of the three-dimensional image has been detected is associated with the three-dimensional image.

135. A three-dimensional image processing apparatus according to claim 133, wherein a result in which the movement of the three-dimensional image has been detected is associated with the three-dimensional image.

136. A method, for processing three-dimensional images, characterized in that viewpoints of a three-dimensional image displayed based on a plurality of viewpoint images corresponding to different parallaxes are set for each scene.

137. A method, for processing three-dimensional images, characterized in that viewpoints of a three-dimensional image displayed based on a plurality of viewpoint images corresponding to different parallaxes is set at predetermined time intervals.

138. A three-dimensional image processing apparatus, the apparatus including:

a camera placement setting unit which sets a plurality of virtual camera dispositions to generate a plurality of viewpoint images when original data from which a three-dimensional image is generated are inputted;

an object area determining unit which determines whether an area in which information on an object to be displayed does not exist is caused or not in viewpoint images generated corresponding to virtual cameras; and

a camera parameter adjusting unit which adjusts, in a case when an area in which information on an object to be displayed is not available is caused, at least one of an angle of view of the virtual camera, a camera interval and an intersecting position of an optical axis so that there is no longer any area in which the information on an object to be displayed does not exist.

139. A method, for processing three-dimensional images, characterized in that if there occurs an area where no object exists within viewpoint images when a plurality of virtual cameras are disposed based on and the viewpoint images corresponding thereto respectively are generated from original data even though there is no region, where the object is not displayed, in the original data from which a three-dimensional image is generated, parameters of the cameras are varied so that there is no area in which the object is not displayed.

140. A three-dimensional image processing apparatus, the apparatus including:

a parallax amount readout unit which reads out information on synthesis positions for three-dimensional images displayed from a plurality of viewpoint images, from a predetermined recording area; and

a parallax control unit which varies a parallax amount, according to the read-out information, parallax amounts among the plurality of viewpoint images by shifting the synthesis positions of the plurality of viewpoint images.

142. A three-dimensional image processing apparatus according to claim 140, wherein if the plurality of viewpoint images are synthesized into a single piece of image, the recording area is a header of the image.

144. An apparatus according to claim 140, further including an image edge adjusting unit which reduces loss of pixels caused by displaying the three-dimensional image.

146. An apparatus according to claim 142, further including an image edge adjusting unit which reduces loss of pixels caused by displaying the three-dimensional image.

147. A method, for processing three-dimensional images, the method including:

acquiring information on synthesis positions for three-dimensional images displayed from a plurality of viewpoint images, from a predetermined recording area; and

varying a parallax amount, according to the acquired information, parallax amounts among the plurality of viewpoint images by shifting the synthesis positions of the plurality of viewpoint images.

148. A program executable by a computer, the program including the functions of:

acquiring information on synthesis positions for three-dimensional images displayed from a plurality of viewpoint images, from a predetermined recording area; and

varying a parallax amount, according to the acquired information, parallax amounts among the plurality of viewpoint images by shifting the synthesis positions of the plurality of viewpoint images.