Image-based virtual reality player with integrated 3D graphics objects

• US 6,760,026 B2
• Filed: 01/02/2001
• Issued: 07/06/2004
• Est. Priority Date: 01/02/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Li, Jiang, Shum, Heung-Yeung
• Primary Examiner(s): Vo, Cliff N.
• Application Number:
  US09/754,660
• Publication Number:
  US 20020113791A1
• Time in Patent Office: 1,281 Days
• Field of Search: 345/418, 345/419, 345/426, 345/427
• US Class Current: 345/427
• CPC Class Codes: A63F 2300/6661 for changing the position of the virtual camera
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

A system and process for rendering a virtual reality environment having an image-based background, which allows a viewer to move about and interact with 3D graphic objects in a virtual interaction space of the environment. This is generally accomplished by first rendering an image-based background, and separately rendering geometry-based foreground objects. The foreground objects are then integrated into the background, and a combined image is presented to the viewer.

Claims

1. A computer-implemented process for rendering a virtual reality environment, comprising using a computer to perform the following process actions:

inputting image data defining a 3D scene;

rendering an image-based background from the image data;

rendering one or more geometry-based foreground objects; and

integrating each foreground object into the background.

2. The process of claim 1, wherein the process action of rendering the image-based background comprises an action of defining a virtual space in which the viewer can move by selecting at least one of (i) a viewing position, (ii) a viewing direction, and (iii) a field of view.

3. The process of claim 2, wherein the process action of rendering the image-based background further comprises an action of rendering a view of the portion of the 3D scene that the viewer would see based on the viewer'"'"'s currently selected viewing position, direction, and field of view.

4. The process of claim 2, wherein the process action of rendering the geometry-based foreground objects comprise the action of rendering each object such that it is completely contained within the defined virtual space.

5. The process of claim 2, wherein the process actions of rendering the geometry-based foreground objects comprise the actions of:

rendering a first portion of an object such that it is contained within the virtual space; and

rendering the remaining part of the object outside of the virtual space.

6. The process of claim 5, wherein the process action of rendering the remaining part of the object outside of the virtual space comprises rendering the remaining part such that it is contained within an empty portion of the background in that there are no background elements present in the area where the remaining part of the object is positioned.

7. The process of claim 2, wherein the process action of rendering the geometry-based foreground objects comprise an action of rendering an object such that it is located outside the defined virtual space.

8. The process of claim 7, wherein the process action of rendering the object such that it is located outside the defined virtual space comprises rendering the object such that it is located in an empty portion of the background in that there are no background elements present in the area where the object is positioned.

9. The process of claim 8, wherein the process action of rendering the object such that it is located outside the defined virtual space further comprises rendering the object in a location where once it is integrated into the background it appears to be touching an element depicted in the background.

10. The process of claim 1, wherein integrating each foreground object into the background comprises an action of superimposing each foreground object onto the previously rendered background to create a combined image.

11. The process of claim 1, further comprising the process action of displaying the combined image to a viewer.

12. A system for rendering a virtual reality environment, comprising:

a general purpose computing device;

a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to,

(a) identify the viewer'"'"'s current viewing location and direction;

(b) render a background view of the portion of the scene that the viewer would see based on the viewer'"'"'s current viewing position and direction, and the viewer'"'"'s field of view;

(c) render one or more geometry-based foreground objects, wherein each object is rendered as it would appear from the viewer'"'"'s current viewing position, direction, and field of view;

(d) superimpose each foreground object onto the previously rendered background view to create an image for the viewer;

(e) display the image to the viewer; and

(f) repeat program modules (a) through (e) each time the viewer changes viewing location, direction, or filed of view.

13. A computer-readable medium having computer-executable instructions for rendering a virtual reality environment, said computer-executable instructions comprising:

inputting image data defining a 3D scene;

having a viewer select a desired viewpoint, viewing direction, and field of view if it is not set by default;

rendering from the image data a background view of a portion of the 3D scene that the viewer would see based on the viewer'"'"'s currently selected viewing position, direction, and field of view;

rendering the geometry-based foreground objects, wherein each object is rendered as it would appear from the viewer'"'"'s current viewing position, direction, and field of view; and

superimposing each foreground object onto the previously rendered background view to create an image for the viewer;

displaying the image to the viewer.

14. The computer-readable medium of claim 13, wherein the instruction for rendering the background view comprises an action of defining a virtual space in which a background view can be rendered regardless of the viewpoint, viewing direction, and field of view selecting selected by the viewer, and wherein the viewer is constrained to select a viewing position, viewing direction, and field of view within the virtual space.

15. The computer-readable medium of claim 14, wherein the instruction of rendering the geometry-based foreground objects comprise an action of rendering each object such that it is at least partially located within the defined virtual space.

16. The computer-readable medium of claim 15, further comprising an instruction for allowing a viewer to interact with any portion of the foreground objects located within the defined virtual space.