System and method for a virtual reality system having a frame buffer that stores a plurality of view points that can be selected and viewed by the user

• US 6,351,261 B1
• Filed: 08/31/1993
• Issued: 02/26/2002
• Est. Priority Date: 08/31/1993
• Status: Expired due to Term

• Current Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Original Assignee: Sun Microsystems Incorporated (Oracle Corporation)
• Inventors: Reichlen, Bruce A., Sutherland, Ivan E.
• Primary Examiner(s): Vo, Cliff N.
• Application Number:
  US08/114,546
• Time in Patent Office: 3,101 Days
• Field of Search: 395/127, 395/161-164, 395/152, 395/118-119, 395/129, 395/135, 345/119, 345/427, 345/419, 345/433, 345/435, 345/473, 345/474, 345/355, 345/357, 348/7, 348/8, 348/10, 434/43, 434/40
• US Class Current: 345/427
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00

Abstract

A computer video display system and method is disclosed. The computer video display system includes a frame buffer for storing a multiplicity of view points of a model to be displayed, a measurement device for measuring an aspect of the user'"'"'s movement, a view point device for ascertaining a point of view of the model to be displayed in response to the measurement device, a computational device for modifying the view point according to a predefined algorithm, an access device for accessing the appropriate display information from the frame buffer, and a head mounted display for displaying the selected view point of the model. During operation, the measuring device, the view point device, and the computational device continuously update the view points of the model in response to movements of the user. In response thereto, the access device traverses the frame buffer and provides the updated display information to the head mounted display. The image, as seen through the head mounted display, appears to be continuous, fluid and natural.

Claims

1. The method of displaying information generated by a computer, comprising the steps of:

storing information related to a multiplicity of view points of a model to be displayed in a frame buffer;

selecting one of the view points based on an input from a user;

accessing the information related to the selected one of the view points from the frame buffer;

displaying the information related to the selected one of the view points on a display device;

providing a virtual view space;

mapping the information related to the multiplicity of view points of the model to be displayed and stored in the frame buffer to the virtual view space;

mapping the entire virtual view space into the frame buffer;

displaying the information related to the selected on of the view points in a view window within the virtual view space.

2. The method of claim 1, further comprising the step of converting the information related to the multiplicity of view points to a ready for display format prior to the storing step.

3. The method of claim 1, wherein the selection of one of the view points further comprises a step of measuring a movement of the user.

4. The method of claim 3, wherein the measuring step further comprises transmitting a position signal from the user to a receiver located at a fixed reference point.

5. The method of claim 4, wherein the position signal includes at least one of the following:

yaw information;

pitch information;

or forward/backward information.

6. The method of claim 1, further comprising the step of modifying the selected view point according to a predefined algorithm prior to the access step.

7. The method of claim 6, wherein the modification is linear.

8. The method of claim 6, wherein the modification is non-linear.

9. The method of claim 6, wherein the modification is non-scaler.

10. The method of claim 6, wherein the modification includes a relationship between the time of selection of the selected view point and the time the selected view point is displayed.

11. The method of claim 1, further comprising the steps of:

selecting a second of the view points based on a change of the input from the user;

accessing the information related to the selected second view point from the frame buffer; and

displaying the information related to the selected second view point on the display device.

12. The method of claim 1, wherein the access step further comprises:

ascertaining a memory location in the frame buffer corresponding to the selected one of the view points;

defining a view port around the corresponding memory location in the frame buffer;

dividing the view port into a plurality of scan lines, each scan line including a fixed number of memory locations in the frame buffer; and

for each scan line;

accessing a predetermined number of words from the frame buffer containing the scan line; and

truncating any of the memory locations from the accessed words falling outside the dimensions of the view port.

13. The method of claim 12, further comprising the steps of creating a view window in the display device from the plurality of truncated scan lines.

14. The method of claim 1, further comprising the step of generating scroll bars in the view window.

15. An apparatus for displaying a model generated by a computer, comprising:

a frame buffer configured to store ready for display information related to a multiplicity of view points of a model to be displayed;

an input device to select one of the view points;

a graphics system, coupled to the input device, to access from the frame buffer a subset of the information related to the selected one of the view points;

a display device, coupled to the graphics system, to display the subset of display information related to the selected one of the view points; and

a virtual view space mapped into the frame buffer and a view window in the virtual view space to display the subset of display information related to the selected one of the view points.

16. The apparatus of claim 15, wherein the virtual view space is 360°

.

17. The apparatus of claim 16, wherein the user is surrounded by the 360°

virtual view space.

18. The apparatus of claim 15, wherein the input device is a position sensor which provides a position signal to the graphics system so that the graphics system can determine the selected one of the view points.

19. The apparatus of claim 18, wherein the position sensor further comprises a receiver at a fixed reference point and a transmitter coupled to a user to transmit user movement information to the receiver at the fixed reference point.

20. The apparatus of claim 15, wherein the display device is a head mounted display.

21. The apparatus of claim 15, wherein the graphics system further comprises a graphics processor to determine a memory location in the frame buffer corresponding to the selected one of the view points.

22. The apparatus of claim 21, wherein the graphics processor defines a view port around the selected memory location in the frame buffer.

23. The apparatus of claim 22, wherein the view port comprises a predetermined number of scan lines, each scan line including a fixed number of memory locations.

24. The apparatus of claim 23, further comprising a scan line generator, coupled to the graphics processor, to access the predetermined number of scan lines of the view port from the frame buffer.

25. The apparatus of claim 24, further comprising a truncator to truncate the memory locations of each scan line that falls outside of the view port.

26. The apparatus of claim 25, wherein the truncated scan lines for the view port are used by the display device to generate the view window in the virtual view space.

27. The apparatus of claim 15, wherein the graphics system further generates scroll bars in the view window.

28. The apparatus of claim 21, further comprising a display timing generator to provide a view window interrupt and a scan line interrupt to the graphics processor.

29. The apparatus of claim 15, further comprising an arbiter to arbitrate access to the frame buffer among the graphics processor, the scan line generator and the graphics processor.