Method and apparatus for reproducing video images to simulate movement within a multi-dimensional space

• US 4,752,836 A
• Filed: 09/07/1984
• Issued: 06/21/1988
• Est. Priority Date: 09/07/1984
• Status: Expired due to Fees

• Current Assignee: IVEX Corporation
• Original Assignee: IVEX Corporation
• Inventors: Sinclair, Michael J., Blanton, Keith A., Tumblin, John E., Finlay, William M.
• Primary Examiner(s): MCELHENY JR, DONALD E
• Application Number:
  US06/648,725
• Time in Patent Office: 1,383 Days
• Field of Search: 358/335, 358/342, 358/310, 358/104, 360/33.1, 364/521, 364/410, 364/522, 340/728, 340/731, 340/747
• US Class Current: 386/201
• CPC Class Codes: A63F 13/44 involving timing of operations, e.g. performing an action within a time slot
• CPC Class Codes: A63F 13/47 involving branching, e.g. choosing one of several possible scenarios at a given point in time
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/60 Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 13/95 Storage media specially adapted for storing game information, e.g. video game cartridges
• CPC Class Codes: A63F 2300/206 Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/63 for controlling the execution of the game in time
• CPC Class Codes: A63F 2300/632 by branching, e.g. choosing one of several possible story developments at a given point in time
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: A63F 2300/6638 for simulating particle systems, e.g. explosion, fireworks
• CPC Class Codes: A63F 2300/8017 Driving on land or water; Flying
• CPC Class Codes: G09B 9/301 by computer-processed or -generated image
• CPC Class Codes: H04N 5/262 Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
• CPC Class Codes: Y10S 345/96 Iterative display of preconfigured images

Abstract

A method and apparatus for simulating movement within a multi-dimensional space by selecting and reproducing a particular one of a plurality of selectable sequences of video images subsequent to a given sequence of video images. The apparatus comprises an interactive random access video disc system for storing the sequences of video images. Video image windowing means provides as a video output only a predetermined "window" portion of each retrieved video image. The window portion of an ending image of a given retrieved sequence substantially duplicates the window portion of a starting image of a retrieved sequence reproduced immediately subsequent to the given sequence, thereby providing a relatively imperceptible transition between sequences. A method for numbering frames on the video disc ensures that a jump between images in any sequence or to an image in a subsequent sequence can be accomplished within a predetermined number of tracks and within a predetermined time, in order to prevent pauses or blankings of the output video images.

Claims

1. Video image reproducing apparatus, comprising:

addressable video image storage means for retrievably storing a plurality of selectable sequences of video images in addressable locations on a storage medium,

each of said sequences including a starting image and an ending image,

each of said video images representing a panoramic projection of a scene viewable by an operator;

address control means for addressing said storage means and providing retrieved sequences of images;

video image windowing means responsive to said retrieved sequences of images for providing as an output a predetermined window portion of each image of said retrieved sequences,

said predetermined window portion comprising a portion of said video image less than the entire stored video image,

said predetermined window portion of an ending image of a given retrieved sequence being substantially duplicative of said predetermined window portion of a starting image of a retrieved sequence immediately subsequent to said given sequence to provide a relatively imperceptible transition between sequences; and

display means responsive to the output of said video image windowing means for providing full screen continuous video displays corresponding only to said predetermined window portion of each of said video images in sequences corresponding to each of said retrieved sequences so as to simulate continuous movement.

2. The apparatus of claim 1, wherein said display means comprises television monitor means for displaying said sequences of images.

3. The apparatus of claim 1, wherein said addressable video image storage means comprises an addressable video disc.

4. The apparatus of claim 1, further comprising operator control means for providing operator control signals indicative of operator selection of sequences, and

wherein said windowing means is responsive to said operator control signals to adjust said predetermined window portion.

5. The apparatus of claim 1, wherein each of said video images comprises a single video frame having a predetermined number of horizontal lines and a predetermined number of pixels per line.

6. The apparatus of claim 5, wherein said windowing means is operative to provide as said output a second predetermined number of horizontal lines per frame fewer than said predetermined number of horizontal lines.

7. The apparatus of claim 5, wherein said windowing means is operative to provide as said output a third predetermined number of pixels per line fewer than said predetermined number of pixels per line.

8. The apparatus of claim 1, wherein each of said video images comprises a single video frame, wherein each of said video frames represents panoramic cylindrical projection of a view portrayed by said frame, and wherein said windowing means is operative to select portions of said panoramic projection as said output.

9. The apparatus of claim 8, further comprising means for preprocessing video images to create said panoramic projection prior to storage of said images on said storage medium.

10. A method for reproducing video images to simulate movement within a multidimensional imaginary space, comprising the steps of:

storing on a storage medium a plurality of sequences of video images, each of said sequences portraying a plurality of views seen by an operator moving from a given particular one of a plurality of points within said multidimensional space to another one of said plurality of points within said multidimensional space spaced apart from said given point,

each of said video images representing a panoramic projection of a scene viewable by the operator within said multidimensional space,

each of said sequences including a starting image associated with said given particular point and an ending image associated with said other spaced apart point;

retrieving from said storage medium a first one of said sequences associated with simulated movement from a first point within said multidimensional space to a second point;

displaying as a full screen on a video display stored video image data corresponding to only a predetermined window portion of each image of said first sequence, said predetermined window portion comprising a portion of each stored video image in said first sequence less than the entire stored video image;

adjusting the spatial relationship of said predetermined window portion with respect to each of said stored video images as a function of an operator input as said images of said first sequence are displayed so as to select different portions of said video images for display;

selecting and retrieving from said storage medium a second one of said sequences associated with simulated movement from said second point to a third point spaced apart from said second point as a function of said operator input, for display subsequent to said first sequence; and

displaying on said video display a predetermined window portion of each image of said second sequence, said predetermined window portion comprising a portion of each video image in said second sequence less than the entire stored video image,

said predetermined window portion of an ending image of said first sequence being substantially duplicative of said predetermined window portion of a starting image of said second sequence to provide a relatively imperceptible transition from said first sequence to said second sequence.

11. The method of claim 10, wherein each of said plurality of points within said space is associated with a particular predetermined number of spaced apart points by the same number of unique sequences of video images, and

wherein said stored video images comprise image data such that the predetermined window portion of the ending image of any given sequence associated with a given point is substantially duplicative of said predetermined window portion of the starting image of each of said unique sequences associated with said given point.

12. The method of claim 10, wherein said storage medium employed in the storing step comprises a video disk.

13. The method of claim 10, wherein each of said plurality of points are arranged in orthogonal space so that each point adjacent to a given point is associated with said given point by a plurality of selectable second sequences of video images extending orthogonally or collinearly from a given first sequence ending at said given point.

14. The method of claim 10, wherein each of said plurality of points is arranged in diagonally connected orthogonal space so that each point adjacent to a given point is associated with said given point by a plurality of selectable second sequences of video images extending angularly at about forty five or ninety degrees or collinearly from a given first sequence ending at said given point.

15. The method of claim 10, wherein the method is employed to simulate flight within said multi-dimensional space.

16. The method of claim 10, wherein said plurality of points are arranged in horizontal planes in said multi-dimensional space of varying density so that sequences of video images in a plane having a lower density of points have more video images than sequences of video images in a plane having a higher density of points.

17. The method of claim 10, wherein said plurality of points are arranged in horizontal planes in said multi-dimensional space of varying density so that sequences of video images in a plane having a lower density of points are longer in duration than sequences of video images in a plane having a higher density of points.

18. The method of claim 10, wherein said plurality of points are arranged in horizontal planes in said multi-dimensional space of varying apparent density, and further comprising the step of reproducing video images from a sequence in a plane having a lower density of points at a lower rate of display than images from a sequence in a plane having a higher density of points,

whereby the simulation of movement at a high attitude provides the simulated effect of lower apparent velocity with respect to distant objects.

19. The method of claim 10, wherein each of said video images comprises a single video frame having about 525 horizontal video lines and about 640 pixels per line.

20. The method of claim 19, wherein each of said video frames represents a panoramic cylindrical projection of a view.

21. The method of claim 19, wherein the step of displaying a predetermined window portion of each image comprises displaying a predetermined number of horizontal lines fewer than 525 and a predetermined number of pixels per line fewer than 640.

22. The method of claim 21, wherein said predetermined portion is about 240 video lines per frame.

23. The method of claim 21, wherein said predetermined window portion is about 320 pixels per line.

24. The method of claim 19, wherein the step of retrieving video image sequences from said storage medium and displaying said predetermined window portion of each image comprises:

retrieving a video frame from a video disc video line by video line;

digitizing each video line into a first predetermined number of digital samples;

storing each digital sample in a digital line buffer memory;

retrieving a second predetermined number of stored digital samples from said buffer memory, said second predetermined number being less than said first predetermined number;

converting said second predetermined number of retrieved digital samples into an analog video signal representing a single video line; and

displaying said analog video signal as a single video line.

25. The method of claim 19, wherein the step of retrieving video image sequences from said storage medium and displaying said predetermined window portion of each image comprises:

retrieving a video frame from a video disc video line by video line;

counting each video line as retrieved;

when a first predetermined line count has been reached, displaying only the lines of said video frame subsequent to said first line count; and

when a second predetermined line count has been reached, ceasing to display the lines of said video frame subsequent to said second line count.

26. The method of claim 25, further comprising the steps of:

stripping vertical synchronization pulses from each video frame as retrieved; and

recreating vertical synchronization pulses to cause vertical retrace subsequent to said second line count.

27. The method of claim 10, wherein said predetermined window portion of a plurality of images toward the end of said first sequence is substantially duplicative of said predetermined window portion of a plurality of images toward the beginning of said second sequence.

28. The method of claim 10, wherein said third point is angularly displaced to the right of said second point with respect to a line connecting said first point and said second point, and wherein an extreme rightward window portion of an ending image of said first sequence is substantially duplicative of an extreme leftward portion of a starting image of said second sequence.

29. Apparatus for reproducing video images to simulate movement within a multidimensional space, comprising:

video image storage means for retrievably storing a plurality of selectable sequences of video images on a storage medium, each of said images of each of said sequences portraying a view seen by an operator moving from a given particular one of a plurality of points within said space toward another one of said plurality of points within said space,

each of said sequences including a starting image associated with said given point and an ending image associated with said other point;

means for retrieving from said storage medium a first one of said sequences associated with simulated movement from a first point within said space toward a second point spaced apart from said first point;

means responsive to said retrieving means for displaying on a video display a predetermined window portion of each image of a sequence of images on a video monitor, said predetermined window portion comprising a portion of each video image in said sequence less than the entire stored video image;

operator control means for providing operator control signals indicative of operator selection of direction of simulated movement within said multidimensional space;

means for adjusting the spatial relationship of said predetermined window portion with respect to each of said stored video images as a function of said operator control signals as said images of said first sequence are displayed so as to select different portions of said video images for display; and

selection means responsive to said operator control signals for selecting a second one of said sequences associated with simulated movement from said second point to a third point spaced apart from said second point as a function of said operator control signals, for display subsequent to said first sequence,

said predetermined window portion of an ending image of said first sequence being substantially duplicative of said predetermined window portion of a starting image of said second sequence to provide a relatively imperceptible transition in view from said first sequence to said selected second sequence.

30. The apparatus of claim 29, wherein said video image storage means comprises a video disc.

31. The apparatus of claim 29, wherein said apparatus comprises a flight simulator, and wherein said operator control means comprises pilot flight controls.

32. The apparatus of claim 29, wherein each of said video images comprises a single video frame having a predetermined number of horizontal video lines and a predetermined number of pixels per line.

33. The apparatus of claim 32, wherein each of said video frames represents a panoramic cylindrical projection of a view, and wherein said adjusting means adjusts said window portion to select portions of said panoramic projection.

34. The apparatus of claim 33, further comprising means for preprocessing video images to create said panoramic projection prior to storage of said images on said storage means.

35. The apparatus of claim 32, wherein said window portion displaying means is operative to display a second predetermined number of horizontal lines fewer than said predetermined number of horizontal lines, and to display a third predetermined number of pixels per line fewer than said predetermined number of pixels per line.

36. The apparatus of claim 35, wherein said second predetermined number is about 240 video lines per frame.

37. The apparatus of claim 35, wherein said third predetermined number is about 320 pixels per line.

38. The apparatus of claim 29, wherein each of said video images comprises a video frame, wherein said retrieving means retrieves a video frame from a video disc video line by video line, and wherein said displaying means comprises:

analog to digital (A/D) converter means for digitizing each video line into a first predetermined number of digital samples;

a digital line buffer memory for storing said first predetermined number of digital samples provided by said A/D converter means;

memory control means for retrieving a second predetermined number of stored digital samples from said buffer memory, said second predetermined number of samples being less than said first predetermined number; and

digital to analog (D/A) converter means for converting said second predetermined number of retrieved digital samples into an analog video signal representing a single horizontal line of one of said video images of one of said sequences.

39. The apparatus of claim 38, further comprising:

horizontal synchronization pulse stripping means for removing horizontal synchronization information from each line of an input video frame; and

horizontal synchronization pulse insertion means for creating and inserting horizontal synchronization pulses into said video signal to cause horizontal retrace subsequent to conversion of said second predetermined number of retrieved digital samples into said analog video signal.

40. The apparatus of claim 38, wherein said memory control means is operative to retrieve and provide said second predetermined number of stored digital samples to said D/A converter at a rate corresponding to a single horizontal video line.

41. The apparatus of claim 29, wherein said retrieving means retrieves a video frame from a video disc video line by video line, and wherein said displaying means comprises:

a counter for counting each retrieved video line;

means responsive to a first predetermined line count of said counter for displaying only the lines of said retrieved video frame subsequent to said first line count; and

means responsive to a second predetermined line count of said counter for stopping the display of lines of said retrieved video frame subsequent to said second line count.

42. The apparatus of claim 41, further comprising:

vertical synchronization pulse stripping means for removing vertical synchronization information from each video frame after retrieval, and

vertical synchronization pulse insertion means for creating and inserting vertical synchronization pulses to cause vertical retrace subsequent to said second line count.

43. The apparatus of claim 41, wherein the lines of said retrieved video frame prior to said first line count and subsequent to said second line count are overscanned on said video monitor.