Method of and apparatus for performing perspective transformation of visible stimuli

• US 5,936,630 A
• Filed: 03/07/1997
• Issued: 08/10/1999
• Est. Priority Date: 12/14/1992
• Status: Expired due to Term

• Current Assignee: Grandeye Limited (Oncam Global Group AG)
• Original Assignee: Ford Oxaal
• Inventors: Oxaal, Ford
• Primary Examiner(s): FETTING, ANTON W
• Application Number:
  US08/813,873
• Time in Patent Office: 886 Days
• Field of Search: 345/427, 345/439, 345/127, 345/136, 345/927, 345/139
• US Class Current: 345/427
• CPC Class Codes: G03B 37/02 with scanning movement of lens or cameras
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The principle purpose of the present invention is to provide an image processing system which uses the two methods to form visible stimuli which depict visual shape. In particular, the present invention either transforms a first visible configuration to a second visible configuration that depicts (in one of the two possible ways given) the visual shapes induced by the first visible configuration, or it determines the visible configuration necessary to depict the desired visual configuration. Using the present invention, it is possible to transform a full 360 degrees of visible space (i.e., front, back, up, down, right and left directional views) onto a single display surface.

Claims

1. In a video game machine including a calculator for generating line data defining line position with respect to a viewpoint, line length and line angular rotation, an image processor and a display device for displaying a MindsEyeView™

video image, the improvement characterized by;

a memory for storing data relating said line data in a first coordinate system to curve data in a second coordinate system;

first means receiving line data on a first line for causing said memory to output corresponding first curve data;

second means receiving said line data on said first line for adjusting arc length of said first curve data with respect to end points of said first line; and

third means for adjusting curve angular rotation of said first curve data with respect to line angular rotation of said first line;

whereby said image processor draws first curve data adjusted for said arc length and said curve angular rotation of said first curve on said display device.

2. In an image processing system, a method of transforming an input visible image, which induces first visual stimuli, into a scaled output visible image, which induces second visual stimuli, the method comprising the steps of:

(a) specifying a plurality of first points defining a first visible image corresponding to the input visible image in a first coordinate system;

(b) locating a viewpoint corresponding to a user'"'"'s eye with respect to said first points;

selecting a focal point on said first visible image;

(c) selecting a focal point on said first visible image;

(d) determining a direction of vision from said viewpoint toward said focal point;

(e) determining a scaling factor;

(f) calculating a plurality of second points in a second coordinate system defining a first visual image with respect to said first points, said viewpoint, said direction of vision, and said scaling factor, wherein said focal point is a center one of said second points, and wherein said second points are calculated with respect to said focal point;

(g) generating a plurality of third points respectively corresponding to said second points by scaling each of said second points to generate one of said third points;

(h) mapping said plurality of third points into said first coordinate system as a plurality of fourth points; and

(i) projecting said fourth points on a display device to produce said output visible image, said output visible image inducing said second visual stimuli having visual similarity to said first visual stimuli,

wherein said step (g) further comprises generating said plurality of third points respectively corresponding to said second points by scaling each component of said second points by a predetermined constant to generate one of said third points, wherein said predetermined constant is any real number excluding 0.0 and 1.0.

3. The method of claim 2, wherein said predetermined constant is any real number excluding 2.0.

4. The method of claim 2, wherein said predetermined constant is any real number excluding ∞

.

5. The method of claim 2, wherein said display device has a non-planar surface for displaying said output visible image, said first coordinate system is a spherical coordinate system, and said second coordinate system is a polar coordinate system.

6. An image processing system for producing a visual transformation of a plurality of input images while maintaining visual similarity in a resultant image, the system comprising:

first through sixth image input devices, each of said devices having a respective direction of vision orthogonal to all other respective directions of vision, said first through sixth image input devices generating a set of first points defining a substantially spherical image space;

means for defining a focal point, a focal length defining an offset distance from said focal point, and a scaling factor with respect to said first points;

means for calculating a plurality of second points with respect to said first points, said focal point, said focal length, said direction of vision and said scaling factor, wherein said focal point is a center one of said second points; and

sixth means for projecting said second points on a display device to produce said resultant image,

wherein said calculating means comprises means for calculating said plurality of second points with respect to said first points, said focal point, said focal length, said direction of vision and said scaling factor, wherein said focal point is a center one of said second points and wherein said scaling factor is any real number excluding 0.0 and 1.0.

7. The image processing system of claim 6, wherein said first and second image input devices define a first axis, wherein said third and fourth image input devices define a second axis, wherein said first and second axes are perpendicular to one another, wherein said fifth and sixth image input devices define a third axis, wherein said third axis is perpendicular to a plane defined by said first and second axes, and wherein said first axis, said second axis and said third axis intersect at only one point.

8. The image processing system of claim 7, wherein said only one point is said viewpoint.

9. The image processing system of claim 7, wherein each of said first through sixth image input devices has a respective device viewpoint, said image processing system further comprising processing means for offsetting each respective device viewpoint to produce respective offset viewpoints, wherein each of said respective offset viewpoints is coincident with said only one point.

10. The image processing system of claim 6, wherein said scaling factor is any real number excluding 2.0.

11. The image processing system of claim 6, wherein said scaling factor is any real number excluding ∞

.

12. The image processing system of claim 6, wherein said first and said second points are substantially equal in number.

13. In an image processing system a method of producing an output visible image as an external manifestation of visual stimuli in response to an input visible image, the method comprising the steps of:

(a) specifying a plurality of first points defining a first visible image corresponding to the input visible image;

(b) locating a viewpoint corresponding to a user'"'"'s eve with respect to said first points;

(c) selecting a focal point on said first visible image;

(d) determining a direction of vision from said viewpoint toward said focal point;

(e) determining a scaling factor;

(f) calculating a plurality of second points in two-dimensional coordinates defining a first visual image with respect to said first points as scaled by said scaling factor, said viewpoint and said direction of vision, wherein said focal point is a center one of said second points, and wherein said second points are calculated with respect to said focal point;

(g) mapping said plurality of second points on a display device to produce said output visible image, said output visible image being an external manifestation of the visual stimuli induced in the mind of the user in response to said input visible image,

wherein said scaling factor is any real number excluding 0.0 and 1.0.

14. The method of claim 13, wherein said scaling factor is approximately equal to infinity and said output visible image is a 360 degree perspective of said input visible image.

15. The method of claim 14, wherein said display has a flat planar picture surface that outputs said output visible image as a circle on the flat picture surface.

16. The method of claim 13, wherein said scaling factor is any real number excluding 2.0.

17. The method of claim 13, wherein said scaling factor is any real number excluding ∞

.

18. A method for generating a resultant image from a visible configuration, said method comprising steps:

(a) determining a first visible configuration comprised of vectors V1 with a respective first direction of vision;

(b) selecting a second direction of vision relative to first direction of vision;

(c) generating a plurality of vectors V2 relative to said second direction of vision corresponding to a plurality of pixels in a rectangular region perpendicular to said second direction of vision;

(d) when image size adjustment is required, performing transform scaling on said vectors V2 to thereby alter their angular magnitude in relation to said second direction of vision so as to selectively enlarge or shrink the resultant image;

(e) given the relation between said first and second directions of vision and given the relation between the vectors V2 and the second direction of vision, determining a corresponding relation of said vectors V2 to said first direction of vision; and

(f) relating a first color for each of said pixels corresponding to said vector V2, respectively, with a second color corresponding to said vector V1.

19. The method as recited in claim 18, wherein said step (e) further comprises:

(e) given the relation between said first and second directions of vision and given the relation between said vectors V2 and the second direction of vision, determining a corresponding relation of said vectors V2 to said first direction of vision using transforms in a predetermined coordinate system.