Apparatus and method for performing geometric transformations on an input image

• US 5,528,194 A
• Filed: 05/01/1992
• Issued: 06/18/1996
• Est. Priority Date: 05/13/1991
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ohtani, Shingo, Yasuda, Mikita
• Primary Examiner(s): Mancuso, Joseph
• Assistant Examiner(s): NOT, DEFINED
• Application Number:
  US07/877,104
• Time in Patent Office: 1,509 Days
• Field of Search: 382/44, 382/45, 382/46, 382/41, 382/293, 382/154, 382/276, 382/295, 382/296, 358/209, 358/227, 358/22, 358/160, 348/147, 348/580, 348/581, 348/583
• US Class Current: 382/293
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image

Abstract

An image transforming apparatus comprising a means for holding an input image signal, a means for holding geometric parameters for the image signal in a photographing mode, a processing means for geometrically transforming the image signal by the use of such geometric parameters, and a means for outputting the image signal transformed geometrically by the processing means. There is also provided a method of transforming an input image by employing the above apparatus to realize a tilting process and a depth-effect emphasizing process for the image obtained from a video camera, an electronic still camera or the like.

Claims

1. An image transforming apparatus for transforming an image received at a focal plane of a camera comprising:

parameter generating means for generating geometric parameter signals including information representative of a focal length of the camera and a relative angle between the camera and a subject viewed by the camera during a photographing mode;

an image input means for inputting an input image signal representative of an image incident upon said focal plane of said camera during said photographing mode;

an image processing means coupled to receive said input image signal and said geometric parameter signals;

wherein

said image processing means performs a geometric coordinate tilt transformation of said input image signal based on said focal length and relative angle information provided in said geometric parameter signals such that the coordinates of pixel data in said input image signal are projected from said focal plane to a tilt plane rotated by said relative angle from said focal plane, and provides an output image signal representative of the geometric coordinate transform of said input image signal

wherein said subject comprises a substantially rectangular object having an image, which image is incident as a trapezoidal form in the focal plane of the camera;

said parameter generating means calculates focal length, relative angle, and viewing angle information based upon the dimensions of said trapezoidal form in said image input signal, wherein said parameter generating means calculates a focal length f, relative angle θ

, and viewing angle ψ

₁ information based upon the dimensions of said trapezoidal form in said image input signal utilizing the following equations;

##EQU28## wherein said focal plane is defined by an x-y plane with an origin, y_t and y_b are the respective distances from the origin to the top and bottom of the image plane of the camera and y is the distance along the y axis of the image forming focal plane, g_o, g_t, and g_b are respective widths of the trapezoidal form of the input image signal as measured at the origin and projected to the top and bottom of the image forming focal plane; and

R is set as R=g_o /g_b when g_b <

g_o and R=g_o /g_t when g_b >

g_o.

2. The apparatus according to claim 1, wherein said input image signal is a still image signal obtained from a video camera;

and said geometric parameter signals further comprise a view angle data signal.

3. The apparatus according to claim 2, wherein

said focal length data signal of said video camera in the photographing mode is calculated by said parameter generating means based on a known shape of the subject.

4. The apparatus according to claim 2, wherein

said relative angle data signal is calculated by said parameter generating mean based on a known shape of the subject.

5. The apparatus according to claim 1, wherein said image processing means for geometrically transforming the image signal by the use of said geometric parameter signals includes a means for inputting a depth-effect emphasizing data signal representative of a viewing perspective different from the viewing perspective of the camera during said photographic mode and executes a geometric transformation of said input image signal, in combination with said tilt transformation, based on said depth-effect emphasizing data signal to emphasize the shape of the subject image as viewed from the different viewing perspective.

6. The apparatus according to claim 5, wherein said depth-effect emphasizing data signal comprises a viewing distance data signal and a focal length, said viewing distance data signal and focal length defining said different viewing perspective.

7. The apparatus according to claim 5, wherein said geometric parameter signals are calculated from feature points of said subject.

8. The apparatus according to claim 1, wherein said image processing means further comprises means for interpolating said geometrically transformed image input signal.

9. The apparatus according to claim 1, wherein said parameter generating means further comprises means for inputting at least one quanta of information selected from the group consisting of said focal length and relative angle.

10. The apparatus according to claim 9, wherein said means for inputting in said parameter generating means comprises at least one sensor selected from the group consisting of a global position sensor, detecting position and azimuth, so as to determine said at least one quanta of information selected from the group consisting of said focal length and relative angle and a geomagnetism sensor, measuring azimuth, so as to determine said relative angle.

11. The apparatus according to claim 1, wherein said parameter generating means receives geometric data for use in generating said geometric parameter signals from at least one device selected from the group consisting of said camera, a sensor means, and a console.

12. The apparatus according to claim 1, further comprising a geometric data input changer emphasizing a portion of the image by changing geometric data being input to said parameter generating means.

13. The apparatus according to claim 1, wherein said parameter generating means receives information regarding the viewing angle and focal-plane size of the camera and calculates said focal length of the camera based upon the viewing angle and focal-plane size information.

14. The apparatus according to claim 1, wherein said parameter generating means calculates said widths g_o, g_t, and g_b according to the following equations:

##EQU29## where a, b, c, and d are the lengths of the upper side, lower side, distance along the y axis from the origin to the upper side, and distance along the y axis from the origin to the lower side, respectively, of the trapezoidal form of the input image signal.

15. The apparatus according to claim 1, wherein said geometric coordinate transform for tilting the focal plane is calculated as follows:

##EQU30## wherein x,y denote coordinates for pixel data on the focal plane, f denotes a focal length, θ

denotes relative angle, and u,v denote coordinates for pixel data transformed to the tilt plane.

16. The apparatus according to claim 1, wherein said image processing means performs rotations about two-dimensional coordinate axes.

17. The apparatus according to claim 5, wherein said image processing means includes means for performing a depth-effect process comprising

means for inputting feature points of the subject and at least one absolute position value;

means for calculating geometric parameters including viewing position coordinates, rotation angles, focal length, and subject size based upon said feature points and absolute position value;

means for inputting depth-effect information including viewing-position displacement and focal length change; and

said image processing performs a geometric coordinate transformation of said input image signal based on said geometric parameters input by said calculating means and obtains a transformed image.

18. The apparatus according to claim 1, wherein, said camera comprises a lens having a focal point at said focal length and detector means positioned at said focal point;

and wherein, said tilt plane comprises a plane rotated by said relative angle from said focal plane about said focal point.

19. The apparatus according to claim 17, wherein, said apparatus further comprises a lens and said subject being viewed is positioned away from said lens at a distance equal to or less than said focal length.

20. The apparatus according to claim 1, wherein said image processing means for geometrically transforming the image signal by the use of said geometric parameter signals includes a means for inputting a depth-effect emphasizing data signal representative of a viewing perspective different from the viewing perspective of the camera during said photographic mode and executes a geometric transformation of said input image signal, independent of said tilt transformation, based on said depth-effect emphasizing data signal to emphasize the shape of the subject image as viewed from the different viewing perspective.

21. The apparatus according to claim 20, wherein said depth-effect emphasizing data signal comprises a viewing distance data signal and a focal length, said viewing distance data signal and focal length defining said different viewing perspective.

22. The apparatus according to claim 1, wherein said image processing means performs rotations about three-dimensional coordinate axes.