Method and system for spacially transforming images

• US 4,631,750 A
• Filed: 07/24/1984
• Issued: 12/23/1986
• Est. Priority Date: 04/11/1980
• Status: Expired due to Term

• Current Assignee: Ampex Corporation (Delta Information Systems, Inc.)
• Original Assignee: Ampex Corporation (Delta Information Systems, Inc.)
• Inventors: Evans, Lawrence J., Gabriel, Steven A.
• Primary Examiner(s): Boudreau, Leo H.
• Application Number:
  US06/634,177
• Time in Patent Office: 882 Days
• Field of Search: 382/41-47, 382/49, 364/725-727, 364/826-827, 364/731, 364/815, 340/723-728, 340/731, 358/11, 358/21-22, 358/77, 358/140-141, 358/154, 358/180, 358/183, 358/160, 358/280, 358/287
• US Class Current: 382/277
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A system for spatially transforming images by separate transformation of each dimension of the image is exemplified by a raster scan television system which includes for each color component a transposing memory providing a change of scan direction from horizontal to vertical, a vertical transformation system transforming in the vertical direction the vertically scanned video information, a second transposing memory coupled to receive vertically transformed video information and provide a change of scan direction from vertical back to horizontal, and a horizontal transformation system coupled to horizontally transform the horizontally scanned video signal to produce a color component output signal. The transformation system is controlled by a transform composer and factorizor which receives input commands designating X and Y pretranslations, X and Y size control, Z axis rotation angles, and X and Y post translations to produce a commanded composite transformation which is then factored into horizontal and vertical components.

Claims

1. A method of electronically transforming input data samples corresponding to picture elements of an image, said transforming corresponding to transformation of said picture elements of said image from a source location to a target location according to a dimensionally interdependent spatial transformation in a multidimensional coordinate system in which a plurality of coordinates indicate position in respective coordinate directions, said method comprising

factoring said interdependent transformation into a plurality of factors each corresponding to a transformation providing repositioning of picture elements in a respective single said coordinate direction, at least one of said factors being a function of a plurality of said coordinates,

successively and separately electronically applying each of said factors to said data samples to produce transformed data samples according to the respective transformation corresponding to repositioning of respective picture elements in the respective coordinate direction for said factor without repositioning in another coordinate direction, any succeeding application of a said factor being made to said data samples as transformed according to the preceding application.

2. A method of electronically transforming input data samples according to claim 1 comprising

developing a set of electronic signals corresponding to each of said plurality of factors, said factors being the factors of said interdependent transformation and their product being said interdependent transformation, said factors being applied to said data samples by successively and separately electronically applying each respective said set of electronic signals to said data samples.

3. A method of electronically transforming input data samples according to claim 2

wherein said coordinate system is two dimensional and has first and second coordinates, and said sets of electronic signals are first and second sets corresponding to respective first and second said factors, and

wherein said applying each of said sets of electronic signals comprises

electronically applying the first of said sets of electronic signals to said input data samples to produce partially transformed data samples according to a respective partial transformation and corresponding to repositioning respective picture elements in the respective coordinate direction for said first factor without repositioning in the other coordinate direction, and

electronically applying the second of said sets of electronic signals to said partially transformed data samples to produce fully transformed data samples corresponding to repositioning of respective picture elements in the respective coordinate direction for said second factor to said target location without repositioning in the other coordinate direction.

7. A method of electronically transforming data samples according to any one of claims 1 to 6 wherein said input data samples correspond to picture elements of a video image presented in raster scan order, and said directions correspond to vertical and horizontal scan directions.

8. A method of electronically transforming input data samples according to claim 7 wherein the coordinate directions of said target image are changed from the coordinate directions of said source image.

9. A method of electronically transforming input data samples according to claim 8 wherein at least one of said first and second factors includes transformation of said coordinate directions, and said applying of at least one of said sets of electronic signals effects a change in said coordinate directions between said source image and said target image to maintain substantial resolution of said data samples upon said repositioning.

10. A method of electronically transforming input data samples according to any one of claims 1 to 6 wherein the coordinate directions of said target image are changed from the coordinate directions of said source image.

11. A method of electronically transforming input data samples according to claim 10 wherein at least one of said first and second factors includes transformation of said coordinate directions, and said applying of at least one of said sets of electronic signals effects a change in said coordinate directions between said source image and said target image to maintain substantial resolution of said data samples upon said repositioning.

12. A method according to any one of claims 1 to 6 wherein the application of a factor to data samples effects a change in data sampling rate and data sample position in the respective direction in accordance with the respective transformation.

13. A method of electronically transforming input data samples according to any one of claims 1 to 6 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

14. A method of electronically transforming input data samples according to claim 13 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

15. A method of electronically transforming input data samples according to claim 7 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

16. A method of electronically transforming input data samples according to claim 15 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

17. A method of electronically transforming input data samples according to claim 8 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

18. A method of electronically transforming input data samples according to claim 17 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

19. A method of electronically transforming input data samples according to claim 9 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

20. A method of electronically transforming input data samples according to claim 19 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

21. A method of electronically transforming input data samples according to claim 10 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

22. A method of electronically transforming input data samples according to claim 21 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

23. A method of electronically transforming input data samples according to claim 11 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

24. A method of electronically transforming input data samples according to claim 23 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

25. A method of electronically transforming input data samples according to claim 12 wherein respective said picture elements correspond to respective coordinate locations in the source and the target, respectively, said method comprising in each coordinate direction interpolating data samples being transformed to produce transformed data samples wherein each transformed data sample is a filtered function of a plurality of the data samples being transformed corresponding to locations neighboring, in the respective coordinate direction, the coordinate location corresponding to the coordination location of the transformed data sample.

26. A method of electronically transforming input data samples according to claim 25 wherein said filtered function is a function of the position, relative to said neighboring locations, of said coordinate location corresponding to the coordinate location of the transformed data sample.

4. A method of electronically transforming input data samples corresponding to picture elements of an image, said transforming corresponding to transformation of said picture elements of said image from a source location to a target location according to a dimensionally interdependent spatial transformation in a two dimensional coordinate system in which first and second coordinates indicate position in two respective coordinate directions, said method comprising

developing first and second sets of electronic signals corresponding to respective first and second factors of said interdependent transformation, the product of said first and second factors being said interdependent transformation, each of said first and second factors being a function of both said first and second coordinates and corresponding to a partial transformation repositioning picture elements in a respective single said coordinate direction,

electronically applying the first of said sets of electronic signals to said input data samples to produce partially transformed data samples according to the respective partial transformation and corresponding to repositioning respective picture elements in the respective coordinate direction for said first factor without repositioning in the other coordinate direction, and

electronically applying the second of said sets of electronic signals to said partially transformed data samples to produce fully transformed data samples corresponding to repositioning of respective picture elements in the respective coordinate direction for said second factor to said target location without repositioning in the other coordinate direction.

5. A method of electronically transforming input data samples according to claim 4 wherein said data samples correspond to picture elements of said image arranged in rows in respective coordinate directions, and said sets of electronic signals are applied to data samples in respect to each row in a respective direction independently of data samples corresponding to picture elements of other rows in the same direction.

6. A method of electronically transforming input data samples according to claim 5 comprising

storing input data samples corresponding to said source location in a first memory,

retrieving said stored input data signals from said first memory in order for each said row in a respective coordinate direction corresponding to said first factor,

storing said partially transformed data samples in a second memory, and

retrieving said stored partially transformed data samples from said second memory in order for each said row in a respective direction corresponding to said second factor,

and wherein the application of said first set of electronic signals is to said data samples retrieved from said first memory, and the application of said second set of electronic signals is to said partially transformed data samples retrieved from said second memory.

27. A method of transforming data arrays defining input data values from source locations to target locations, said locations being defined by a multidimensional coordinate system in which a plurality of coordinates indicate location in respective coordinate directions, said method comprising

performing a transformation of input data values in a selected single coordinate direction to produce transformed data values corresponding to a transformed data array;

and

performing a transformation of previously transformed data values for each additional one of the coordinate directions in sequence until a transformation has been performed for all coordinate directions to produce transformed data values at target locations corresponding to a fully transformed data array,

at least one of the transformations of data values being a function of a plurality of said coordinates of the multidimensional coordinate system,

said transformed data values produced by each transformation having the same coordinates they had prior to said transformation other than in the respective coordinate direction.

28. A method of transforming according to claim 27

wherein the data values correspond to picture elements defining an image;

wherein each transformation of data values is a function of a plurality of said coordinates of the multidimensional coordinate system; and

wherein each succeeding transformation of data values after the transformation of input data values is performed with respect to data values as transformed according to an immediately preceding transformation.

29. A method of transforming according to claim 28

wherein said coordinate system is two dimensional, having first and second coordinates;

wherein the transformation of input data values is in the first coordinate direction and produces first transformed data values defining a partially transformed image; and

wherein the succeeding transformation step is performed with respect to said first transformed data values in the second coordinate direction to produce second transformed data values at target locations corresponding to the fully transformed image.

30. A method according to any one of claims 27 to 29 wherein said transformations provide repositioning of data values in respective coordinate directions.

31. A method of electronically executing a perspective projection transformation of data samples corresponding to picture elements of a two dimensionl source image to a two dimensional target image, each dimension corresponding to a respective direction, said method comprising the steps of

electronically forming data samples corresponding to a partially transformed intermediate target image by electronically generating a sequence of data samples corresponding to picture elements along each of a plurality of first direction intermediate target rows, the sequence of data samples in respect to each first direction intermediate target row being a function of a sequence of data samples corresponding to picture elements in a respective first direction source image row in accordance with a transformation according to a predetermined perspective projection of the source image;

and

electronically forming data samples corresponding to a fully transformed final target image by electronically generating a sequence of data samples corresponding to picture elements along each of a plurality of second direction target rows transverse to the first direction rows, the sequence of data samples in respect to each second direction target row being a function of a sequence of data samples corresponding to picture elements in a respective second direction intermediate target row in accordance with said transformation according to said predetermined perspective projection.

32. A system for electronically transforming input data samples corresponding to picture elements of an image, said transforming corresponding to transformation of said picture elements of said image from a source location to a target location according to a dimensionally interdependent spatial transformation in a multidimensional coordinate system in which a plurality of coordinates indicate position in respective coordinate directions, said system comprising

transform means for providing a set of electronic signals corresponding to each of a plurality of factors each corresponding to a transformation providing repositioning of picture elements in a respective single said coordinate direction, said factors being factors of said interdependent transformation and their product being said interdependent transformation, at least one of said factors being a function of a plurality of said coordinates,

a plurality of application means successively and separately electronically applying respective ones of said sets of electronic signals to said data samples to produce transformed data samples according to the respective transformation corresponding to repositioning of respective picture elements in the respective coordinate direction for a said factor without repositioning in another coordinate direction, said application means being coupled in cascade whereby any succeeding application of a said set of electronic signals is made to said data samples as transformed according to the preceding application.

35. A system for electronically transforming data samples according to any one of claims 32 to 34 wherein said input data samples correspond to picture elements of a video image arranged in rows in respective said directions and presented in raster scan order, and said directions correspond to vertical and horizontal scan directions.

44. A system for electronically transforming input data samples according to any one of claims 32 to 34 or any one of claims 36 to 41 wherein at least one of said first and second factors includes transformation of said coordinate directions, and at least one of said first and second application means includes means for effecting a change in said coordinate directions between said source image and said target image to maintain substantial resolution of said data samples upon said repositioning.

33. A system for electronically transforming input data samples corresponding to picture elements of an image, said transforming corresponding to transformation of said picture elements of said image from a source location to a target location according to a dimensionally interdependent spatial transformation in a two dimensional coordinate system in which first and second coordinates indicate position in two respective coordinate directions, said system comprising

transform means for providing first and second sets of electronic signals corresponding to respective first and second factors of said interdependent transformation, the product of said first and second factors being said interdependent transformation, each of said first and second factors being a function of both said first and second coordinates and corresponding to a partial transformation repositioning picture elements in a respective single said coordinate direction,

first application means for electronically applying the first of said sets of electronic signals to said input data samples to produce partially transformed data samples according to the respective partial transformation and corresponding to repositioning respective picture elements in the respective coordinate direction for said first factor without repositioning in the other coordinate direction, and

second application means for electronically applying the second of said sets of electronic signals to said partially transformed data samples to produce fully transformed data samples corresponding to repositioning of respective picture elements in the respective coordinate direction for said second factor to said target location without repositioning in the other coordinate direction.

34. A system for electronically transforming input data samples according to claim 33 wherein said data samples correspond to picture elements of said image arranged in rows in respective coordinate directions, and first and second application means apply respective said sets of electronic signals to data samples in respect to each row in a respective direction independently of data samples corresponding to picture elements of other rows in the same direction.

36. A system for electronically transforming input data samples according to claim 34 comprising

first memory means for storing input data samples corresponding to said source location,

first addressing means for retrieving said stored input data signals from said first memory means in order for each said row in a respective coordinate direction corresponding to said first factor,

second memory means for storing said partially transformed data samples, and

second addressing means for retrieving said stored partially transformed data samples from said second memory means in order for each said row in a respective direction corresponding to said second factor,

wherein said first application means is connected to apply said first set of electronic signals to said data samples retrieved from said first memory means, and said second application means is connected to apply said second set of electronic signals to said partially transformed data samples retrieved from said second memory means.

37. A system for electronically transforming data samples according to claim 36 wherein said input data samples correspond to picture elements of a video image arranged in rows in respective said directions and presented in raster scan order, and said directions correspond to vertical and horizontal scan directions.

38. A system for electronically transforming data samples according to claim 37 wherein

said first application means is coupled to receive the data samples retrieved from the first memory means and produce partially transformed data samples in sequences corresponding to vertical rows of a partially transformed video image,

said second memory means includes a vertical to horizontal transposing memory coupled to receive said partially transformed data samples in sequences corresponding to vertical rows of the partially transformed video image,

said second addressing means retrieves said partially transformed data samples in sequences corresponding to horizontal rows of the partially transformed video image, and

said second application means is coupled to receive the partially transformed data samples retrieved from the vertical to horizontal transposing memory and produce fully transformed data samples in sequences corresponding to horizontal rows of a fully transformed video image in raster scan order.

39. A system for electronically transforming data samples according to claim 38 wherein

said first memory means includes a horizontal to vertical transposing memory coupled to receive data samples in sequences corresponding to horizontal rows of a source video image in raster scan order,

said first addressing means retrieves said data samples from said first memory means in sequences corresponding to rows of the video image in a selected direction determined by at least one of said factors, and

said first application means is coupled to receive the data samples retrieved from the horizontal to vertical transposing memory.

40. A system for electronically transforming data samples according to claim 39 wherein said first addressing means retrieves said data samples from said first memory means in sequences corresponding to vertical rows of the video image for certain transformations and in sequences corresponding to horizontal rows of the video image for other transformations.

41. A system for electronically transforming data samples according to claim 36 wherein

said input data samples correspond to picture elements of a video image arranged in rows in respective said directions and presented in raster scan order,

said directions correspond to vertical and horizontal scan directions,

said first memory means includes a horizontal to vertical transposing memory coupled to receive first video information representing horizontal rows of a source video image in a raster scan order,

said first addressing means retrieves said video information as vertical rows of the video image in a raster scan order,

said first application means is coupled to receive the first video information output by the horizontal to vertical transposing memory and perform thereon a vertical transformation to produce second video information representing vertical rows of a partially transformed video image in raster scan order as a function of the first video information,

said second memory means includes a vertical to horizontal transposing memory coupled to receive said second video information as vertical rows of the partially transformed video image in the raster scan order,

said second addressing means retrieves said partially transformed video image as horizontal rows of the partially transformed video image in a raster scan order, and

said second application means is coupled to receive the second video information output by the vertical to horizontal transposing memory and perform thereon a horizontal transformation to produce third video information representing horizontal rows of a fully transformed video image in raster scan order as a function of said second video information.

42. A system for electronically transforming data samples according to any one of claims 36 to 41 wherein said second memory means has a capacity sufficient for storing at least a frame of video information.

43. A system for electronically transforming data samples according to claim 41 wherein said first memory means has a capacity sufficient for storing at least a frame of video information.

45. A system for transforming data arrays defining input data values from source locations to target locations, said locations being defined by a multidimensional coordinate system in which a plurality of coordinates indicate location in respective coordinate directions, said system comprising

first transform means for performing a transformation of input data values in a selected single coordinate direction to produce transformed data values corresponding to a transformed data array;

and

further transform means for performing a transformation of previously transformed data values for each additional one of the coordinate directions to produce transformed data values corresponding to respective transformed data arrays; and

means for coupling said first and further transform means in cascade to perform transformations for all coordinate directions to produce transformed data values at target locations corresponding to a fully transformed data array,

at least one of the transformations of data values being a function of a plurality of said coordinates of the multidimensional coordinate system,

said transformed data values produced by each transformation having the same coordinates they had prior to said transformation other than in the respective coordinate directions.

46. A system according to claim 45 wherein said transformations provide repositioning of data values in respective coordinate directions.

47. A system for electronically transforming input data samples corresponding to picture elements of a video image arranged in rows in respective horizontal and vertical directions and presented in raster scan order, said transforming corresponding to spatial transformation from a source location to a target location, said system comprising

a horizontal to vertical transposing memory coupled to receive data samples corresponding to said source location received in sequences corresponding to horizontal rows of a source video image in raster scan order and to store such data samples,

vertical addressing means for retrieving said stored input data samples from said horizontal to vertical transposing memory in sequences corresponding to either horizontal or vertical rows of the video image as selected for a respective transformation,

vertical transform means for applying selected electronic signals to said data samples retrieved from said horizontal to vertical transposing memory according to a vertical transformation factor to produce partially transformed data samples in sequences corresponding to vertical rows of a partially transformed video image,

a vertical to horizontal transposing memory coupled to receive said partially transformed data samples and to store such partially transformed data samples,

horizontal addressing means for retrieving said stored partially transformed data samples in sequences corresponding to horizontal rows of the partially transformed video image,

horizontal transform means for applying selected electronic signals to said partially transformed data samples retrieved from said vertical to horizontal transposing memory according to a horizontal transformation factor to produce fully transformed data samples in sequences corresponding to horizontal rows of a fully transformed video image in raster scan order.

48. A digital transformation system comprising

first, second and third transposing memories adapted to receive and store respective data samples corresponding Y, I and Q video components of sequential fields of an interlaced color television video signal, the first, second and third memories including address circuitry connected to control the storage of video data samples in horizontal raster scan order and retrieval of video data samples in sequences corresponding to vertical or horizontal scanning directions as selected for a respective transformation;

first, second and third deinterlace filters coupled to receive, respectively, Y, I and Q video data samples from respectively the first, second and third transposing memories and to output at the field rate a complete frame of video data samples for each field of video data samples received;

first, second and third interpolation decimation filters coupled to receive, respectively, Y, I and Q video data samples and a sequence of addresses indicating a sequence of data samples within the received video data samples from which video data samples are to be selected for output, and to output Y, I and Q data samples as a function of a plurality of video data samples disposed about each addressed data sample;

fourth, fifth and sixth transposing memories adapted to receive and store, respectively, Y, I and Q data samples of sequential fields of video data samples from the first, second and third interpolation decimation filters, respectively, in sequences corresponding to vertical rows and to output said data samples in sequences corresponding to horizontal rows;

fourth, fifth and sixth interpolation decimation filters coupled to receive, respectively, Y, I and Q video data samples and a sequence of addresses indicating a sequence of data samples within the received video data samples from which video data samples are to be selected for output, and to output Y, I and Q video data samples as a function of a plurality of video data samples disposed about each addressed data sample to generate a sequence of Y, I and Q video data samples representing a transformed video image in raster scan order; and

control circuitry coupled to receive commands indicating a commanded image transformation and in response to the received commands to generate the sequence of addresses for the first, second and third interpolation decimation filters and to generate the sequence of addresses for the fourth, fifth and sixth interpolation decimation filters to control the selection of data samples to obtain the commanded transformation.