Image transforming method, image transforming device and multiprojection system

• US 20050271299A1
• Filed: 05/31/2005
• Published: 12/08/2005
• Est. Priority Date: 05/31/2004
• Status: Abandoned Application

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Ohsawa, Kenro, Ishizawa, Takanori, Ajito, Takeyuki
• Application Number:
  US11/140,709
• Publication Number:
  US 20050271299A1
• Time in Patent Office: Days
• US Class Current: 382/293
• CPC Class Codes: G06T 3/08 Projecting images onto non-planar surfaces, e.g. geodetic screens

Abstract

An image transforming device wherein one input image or a plurality of input images captured or created under different condition are geometrically transformed to create an output image, including: an input geometrical profile calculating section to calculate an input geometrical profile directing to a coordinate relation between pixel positions of the input image and polar coordinate positions of the input image in view of a given observing position; an output geometrical profile calculating section to calculate an output geometrical profile directing to a coordinate relation between pixel positions of the output image and polar coordinate positions of the output image in view of the observing position; and geometrical transforming section to geometrically transform the input image on the input geometrical profile and the output geometrical profile, thereby calculating the output image.

Claims

1. An image transforming method comprising the steps of:

obtaining one input image or a plurality of input images captured or created under different condition, and

geometrically transforming said one input image or said plurality of input images to create an output image,

wherein said geometrical transformation is carried out on an input geometrical profile directing to a coordinate relation between pixel positions of said input image and polar coordinate positions of said input image in view of a given observing position and an output geometrical profile directing to a coordinate relation between pixel positions of said output image and polar coordinate positions of said output image in view of said observing position, thereby calculating said output image.

2. The image transforming method as defined in claim 1, wherein said input geometrical profile includes at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said input image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said output geometrical profile includes at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said output image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said geometrical transformation is carried out on at least one selected from a coordinate transformation using a table transformation with said two-dimensional look-up table, a projecting transformation using said projective transformation, a polar coordinate transformation using said polar coordinate transforming coefficient, a cylindrical transformation using said cylindrical coordinate transforming coefficient and a polynomial coordinate transformation using said polynomial transforming coefficient of said input geometrical profile and said output geometrical profile, thereby calculating said output image.

3. The image transforming method as defined in claim 1, further comprising the step of calculating an input-output geometrical profile directing to a coordinate relation between a coordinate position of said input image and a coordinate position of said output image from said input geometrical profile and said output geometrical profile,

wherein said geometrical transformation is carried out on said input-output geometrical profile, thereby calculating said output image.

4. The image transforming method as defined in claim 2, further comprising the step of calculating an input-output geometrical profile directing to a coordinate relation between a coordinate position of said input image and a coordinate position of said output image from said input geometrical profile and said output geometrical profile,

wherein said geometrical transformation is carried out on said input-output geometrical profile, thereby calculating said output image.

5. The image transforming method as defined in claim 1, further comprising the steps of:

obtaining coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile, and

cutting images from said input image on said coordinate positions of said input image to create cutting images,

wherein said geometrical transformation is carried out for said cutting images, thereby calculating said output image.

6. The image transforming method as defined in claim 2, further comprising the steps of:

obtaining coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile, and

cutting images from said input image on said coordinate positions of said input image to create cutting images,

wherein said geometrical transformation is carried out for said cutting images, thereby calculating said output image.

7. The image transforming method as defined in claim 3, further comprising the steps of:

obtaining coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile, and

cutting images from said input image on said coordinate positions of said input image to create cutting images,

wherein said geometrical transformation is carried out for said cutting images, thereby calculating said output image.

8. The image transforming method as defined in claim 4, further comprising the steps of:

obtaining coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile, and

cutting images from said input image on said coordinate positions of said input image to create cutting images,

wherein said geometrical transformation is carried out for said cutting images, thereby calculating said output image.

9. An image transforming device wherein one input image or a plurality of input images captured or created under different condition are geometrically transformed to create an output image, comprising:

an input geometrical profile calculating section to calculate an input geometrical profile directing to a coordinate relation between pixel positions of said input image and polar coordinate positions of said input image in view of a given observing position,

an output geometrical profile calculating section to calculate an output geometrical profile directing to a coordinate relation between pixel positions of said output image and polar coordinate positions of said output image in view of said observing position, and

geometrical transforming section to geometrically transform said input image on said input geometrical profile and said output geometrical profile, thereby calculating said output image.

10. The image transforming device as defined in claim 9, wherein said output geometrical profile calculates a plurality of output geometrically profiles for corresponding image output devices, and said geometrical transforming device calculates output images for said geometrical profiles, respectively.

11. The image transforming device as defined in claim 9, wherein said input geometrical profile calculating section calculates an input geometrical profile including at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said input image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said output geometrical profile calculating section calculates an output geometrical profile including at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said output image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said geometrical transforming section includes at least one selected from a coordinate transformation using a table transformation with said two-dimensional look-up table, a projecting transformation using said projective transformation, a polar coordinate transformation using said polar coordinate transforming coefficient, a cylindrical transformation using said cylindrical coordinate transforming coefficient and a polynomial coordinate transformation using said polynomial transforming coefficient of said input geometrical profile and said output geometrical profile.

12. The image transforming device as defined in claim 10, wherein said input geometrical profile calculating section calculates an input geometrical profile including at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said input image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said output geometrical profile calculating section calculates an output geometrical profile including at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said output image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said geometrical transforming section includes at least one selected from a coordinate transformation using a table transformation with said two-dimensional look-up table, a projecting transformation using said projective transformation, a polar coordinate transformation using said polar coordinate transforming coefficient, a cylindrical transformation using said cylindrical coordinate transforming coefficient and a polynomial coordinate transformation using said polynomial transforming coefficient of said input geometrical profile and said output geometrical profile.

13. The image transforming device as defined in claim 9, further comprising an input-output geometrical profile calculating section to calculate an input-output geometrical profile to define a coordinate relation between a coordinate position of said input image and a coordinate position of said output image on said input geometrical profile and said output geometrical profile,

wherein said input image is geometrically transformed on said input-output geometrical profile, thereby calculating said output image.

14. The image transforming device as defined in claim 10, further comprising an input-output geometrical profile calculating section to calculate an input-output geometrical profile to define a coordinate relation between a coordinate position of said input image and a coordinate position of said output image on said input geometrical profile and said output geometrical profile,

wherein said input image is geometrically transformed on said input-output geometrical profile, thereby calculating said output image.

15. The image transforming device as defined in claim 11, further comprising an input-output geometrical profile calculating section to calculate an input-output geometrical profile to define a coordinate relation between a coordinate position of said input image and a coordinate position of said output image on said input geometrical profile and said output geometrical profile,

wherein said input image is geometrically transformed on said input-output geometrical profile, thereby calculating said output image.

16. The image transforming device as defined in claim 12, further comprising an input-output geometrical profile calculating section to calculate an input-output geometrical profile to define a coordinate relation between a coordinate position of said input image and a coordinate position of said output image on said input geometrical profile and said output geometrical profile,

wherein said input image is geometrically transformed on said input-output geometrical profile, thereby calculating said output image.

17. The image transforming device as defined in claim 9, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

18. The image transforming device as defined in claim 10, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

19. The image transforming device as defined in claim 11, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

20. The image transforming device as defined in claim 12, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

21. The image transforming device as defined in claim 13, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

22. The image transforming device as defined in claim 14, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

23. The image transforming device as defined in claim 15, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

24. The image transforming device as defined in claim 16, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

25. A multiprojection system wherein one input image or a plurality of input images captured or created under different condition are geometrically transformed by an image transforming device to create a plurality of output images which are projected on a screen by corresponding image projecting devices and combined with one another to create a large-sized image,

wherein said image transforming device comprises:

an input geometrical profile calculating section to calculate an input geometrical profile directing to a˜

coordinate relation between pixel positions of said input image and polar coordinate positions of said input image in view of a given observing position,

an output geometrical profile calculating section to calculate an output geometrical profile directing to a coordinate relation between pixel positions of said output image and polar coordinate positions of said output image in view of said observing position, and

geometrical transforming section to geometrically transform said input image on said input geometrical profile and said output geometrical profile, thereby calculating said output image.

26. The multiprojection system as defined in claim 25, wherein said input geometrical profile calculating section calculates an input geometrical profile including at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said input image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said output geometrical profile calculating section calculates an output geometrical profile including at least one selected from the group consisting of a two-dimensional look-up table to define a coordinate relation per pixel of said output image, a projective transformation to define a projection transforming coordinate relation from a plane coordinate into another plane coordinate, a polar coordinate transforming coefficient to define a polar coordinate transforming coordinate relation from a plane coordinate into a polar coordinate, a cylindrical coordinate transforming coefficient to define a cylindrical coordinate transforming coordinate relation from a plane coordinate into a cylindrical coordinate and a polynomial transforming coefficient to define coordinate transforming coordinate relation using two or more polynomial equations,

wherein said geometrical transforming section includes at least one selected from a coordinate transformation using a table transformation with said two-dimensional look-up table, a projecting transformation using said projective transformation, a polar coordinate transformation using said polar coordinate transforming coefficient, a cylindrical transformation using said cylindrical coordinate transforming coefficient and a polynomial coordinate transformation using said polynomial transforming coefficient of said input geometrical profile and said output geometrical profile.

27. The multiprojection system as defined in claim 25, further comprising an input-output geometrical profile calculating section to calculate an input-output geometrical profile to define a coordinate relation between a coordinate position of said input image and a coordinate position of said output image on said input geometrical profile and said output geometrical profile,

wherein said input image is geometrically transformed on said input-output geometrical profile, thereby calculating said output image.

28. The multiprojection system as defined in claim 26, further comprising an input-output geometrical profile calculating section to calculate an input-output geometrical profile to define a coordinate relation between a coordinate position of said input image and a coordinate position of said output image on said input geometrical profile and said output geometrical profile,

wherein said input image is geometrically transformed on said input-output geometrical profile, thereby calculating said output image.

29. The multiprojection system as defined in claim 25, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

30. The multiprojection system as defined in claim 26, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

31. The multiprojection system as defined in claim 27, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

32. The multiprojection system as defined in claim 28, further comprising an image cutting means to obtain coordinate positions of said input image corresponding to coordinate positions for pixels of said output image at calculated boundary of said output image on said input geometrical profile and said output geometrical profile and to cut images from said input image on said coordinate positions of said input image to create cutting images,

wherein said cutting images are geometrically transformed, thereby calculating said output image.

33. The multiprojection system as defined in claim 25, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

34. The multiprojection system as defined in claim 26, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

35. The multiprojection system as defined in claim 27, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

36. The multiprojection system as defined in claim 28, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

37. The multiprojection system as defined in claim 29, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

38. The multiprojection system as defined in claim 30, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

39. The multiprojection system as defined in claim 31, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

40. The multiprojection system as defined in claim 32, further comprising:

a test pattern image outputting means to provide test pattern images for said image projecting devices, and

a calibration image acquiring means to capture test pattern projecting images on said screen by said image projecting devices,

wherein said output geometrical profile calculating section calculates an output geometrical profile directing at a coordinate relation between coordinate positions of said test pattern projecting images acquired by said calibration image acquiring means and said polar coordinate positions of said output image in view of said observing position.

41. The multiprojection system as defined in claim 25, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

42. The multiprojection system as defined in claim 26, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

43. The multiprojection system as defined in claim 27, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

44. The multiprojection system as defined in claim 28, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

45. The multiprojection system as defined in claim 29, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

46. The multiprojection system as defined in claim 30, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

47. The multiprojection system as defined in claim 31, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

48. The multiprojection system as defined in claim 32, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

49. The multiprojection system as defined in claim 33, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

50. The multiprojection system as defined in claim 34, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

51. The multiprojection system as defined in claim 35, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

52. The multiprojection system as defined in claim 36, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

53. The multiprojection system as defined in claim 37, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

54. The multiprojection system as defined in claim 38, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

55. The multiprojection system as defined in claim 39, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.

56. The multiprojection system as defined in claim 40, further comprising a geometrical profile combining means to combine and output or store said input image and said input geometrical profile or to combine and output or store an output image transformed by said image transforming device and said output geometrical profile.