Sprites with depth

• US 6,215,496 B1
• Filed: 07/23/1998
• Issued: 04/10/2001
• Est. Priority Date: 07/23/1998
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Szeliski, Richard S., Cohen, Michael F.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US09/121,797
• Time in Patent Office: 992 Days
• Field of Search: 345/418, 345/419, 345/421, 345/422, 345/425, 345/113, 345/114
• US Class Current: 345/419
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/10 Geometric effects

Abstract

A sprite data structure includes multiple pixels that each have conventional image information (e.g., color and transparency) relating to the appearance of the sprite. The data structure of each pixel includes a depth component or value representing a displacement of the pixel from a selected plane. In a sprite rendering process, the depth values of an input or source sprite are forward mapped (i.e., warped) to the depth values of an output or a destination sprite. Based upon the forward mapping of the depth values in the destination sprite, a backward mapping is performed on the image information from the source sprite to the destination sprite so that it can be rendered. This provides the destination sprite with parallax-based offsets that can create a very strong impression of three-dimensionality between and within the sprites.

Claims

1. A computer method of determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane;

forward mapping from the source sprite image to forward mapped depths of the selected sprite image; and

backward mapping the selected sprite image to the source sprite image with respect to the forward mapped depths of the selected sprite image.

2. The method of claim 1 in which the pixels of the selected sprite image are at integer pixel addresses and the method further comprises conforming the forward mapped depths of the selected sprite image to the integer pixel addresses.

3. The method of claim 2 in which conforming the forward mapped depths of the selected sprite image to the integer pixel addresses includes a single pixel splat of the forward mapped depths.

4. The method of claim 2 in which conforming the forward mapped depths of the selected sprite image to the integer pixel addresses includes hole filling the forward mapped depths.

5. The method of claim 1 in which the forward mapping includes a two-dimensional planar perspective transformation.

6. The method of claim 5 in which the forward mapping includes forward mapping the depths of the source sprite image.

7. The method of claim 5 in which the forward mapping does not include forward mapping the depths of the source sprite image.

8. The method of claim 1 further comprising rendering the selected sprite image on a computer display screen.

9. A computer readable medium having stored thereon software for determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

software instructions for obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane;

software instructions for forward mapping from the source sprite image to forward mapped depths of the selected sprite image; and

software instructions for backward mapping the selected sprite image to the source sprite image with respect to the forward mapped depths of the selected sprite image.

10. The medium of claim 9 in which the pixels of the selected sprite image are at integer pixel addresses and the medium further comprises software instructions for conforming the forward mapped depths of the selected sprite image to the integer pixel addresses.

11. The medium of claim 9 in which the software instructions for the forward mapping includes a two-dimensional planar perspective transformation.

12. The medium of claim 11 in which the software instructions for the forward mapping includes software instructions for forward mapping the depths of the source sprite image.

13. The medium of claim 11 in which the software instructions for the forward mapping does not include software instructions for forward mapping the depths of the source sprite image.

14. The medium of claim 9 further comprising rendering the selected sprite image on a computer display screen.

15. A computer method of determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane;

forward mapping from the depths of the source sprite image to forward mapped depths of an intermediate sprite image; and

backward mapping the selected sprite image to the intermediate sprite image with respect to the forward mapped depths of the intermediate sprite image.

16. The method of claim 15 in which the pixels of the intermediate sprite image are at integer pixel addresses and the method further comprises conforming the forward mapped depths of the intermediate sprite image to the integer pixel addresses.

17. The method of claim 15 in which the backward mapping includes an inverse of a two-dimensional planar perspective transformation.

18. The method of claim 15 in which the forward mapping includes forward mapping the depths of the source sprite image.

19. The method of claim 15 in which the forward mapping includes division calculations with denominators that include the depths of the source sprite image and the denominators for the division calculations are included in a look-up table based upon the depths of the source sprite image.

20. The method of claim 15 in which the forward mapping is represented by an approximation of an affine transformation.

21. The method of claim 20 in which the source sprite image includes a center and the approximation of the affine transformation is with respect to the center of the source sprite image.

22. The method of claim 15 further comprising rendering the selected sprite image on a computer display screen.

23. A computer readable medium having stored thereon software for determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

software instructions for obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane;

software instructions for forward mapping from the depths of the source sprite image to forward mapped depths of an intermediate sprite image; and

software instructions for backward mapping the selected sprite image to the intermediate sprite image with respect to the forward mapped depths of the intermediate sprite image.

24. The medium of claim 23 in which the pixels of the intermediate sprite image are at integer pixel addresses and the medium further comprises software instructions for conforming the forward mapped depths of the intermediate sprite image to the integer pixel addresses.

25. The medium of claim 23 in which the software instructions for the backward mapping include an inverse of a two-dimensional planar perspective transformation.

26. The medium of claim 23 in which the software instructions for the forward mapping includes software instructions for forward mapping the depths of the source sprite image.

27. The medium of claim 23 in which the software instructions for forward mapping include division calculations with denominators that include the depths of the source sprite image and the denominators for the division calculations are included in a look-up table based upon the depths of the source sprite image.

28. The medium of claim 23 in which the software instructions for forward mapping includes a look-up table for affine displacements as a function of the depths of the source sprite image.

29. The medium of claim 23 further comprising software instructions for rendering the selected sprite image on a computer display screen.

30. A computer method of determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane and motion vectors representing differences between the plural pixels of the source sprite image and plural pixels of an intermediate sprite image in which the plural pixels have addresses;

forward mapping the motion vectors from the source sprite image to the intermediate sprite image; and

backward mapping addresses of pixels in the intermediate sprite image to the selected sprite image with respect to the forward mapped motion vectors.

31. The method of claim 30 further comprising adding a parallax correction to the addresses of pixels in the intermediate sprite image.

32. The method of claim 30 in which the backward mapping includes an approximation of an affine transformation.

33. A computer readable medium having stored thereon software for determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

software instructions for obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane and motion vectors representing differences between the plural pixels of the source sprite image and plural pixels of an intermediate sprite image in which the plural pixels have addresses;

software instructions for forward mapping the motion vectors from the source sprite image to the intermediate sprite image; and

software instructions for backward mapping addresses of pixels in the intermediate sprite image to the selected sprite image with respect to the forward mapped motion vectors.

34. A computer method of determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane;

forward mapping from the depths of the source sprite image to forward mapped depths of plural pixels in an intermediate sprite image in which the plural pixels have addresses;

approximating a backward mapping from the selected sprite image to addresses of pixels in the intermediate sprite image with respect to the forward mapped depths of the intermediate sprite image; and

adding a parallax correction to the addresses of pixels in the intermediate sprite image.

35. The method of claim 34 in which the backward mapping includes an inverse of a two-dimensional planar perspective transformation.

36. The method of claim 34 further comprising retrieved from a look-up table listing displacements as a function of depths final values of the pixels in the source image sprite.

37. A computer readable medium having stored thereon software for determining a selected sprite image that includes plural pixels that have depths relative to a selected plane, comprising:

software instructions for obtaining a source sprite image that is related to the selected sprite image and includes plural pixels that have depths relative to a source plane;

software instructions for forward mapping from the depths of the source sprite image to forward mapped depths of plural pixels in an intermediate sprite image in which the plural pixels have addresses;

software instructions for approximating a backward mapping from the selected sprite image to addresses of pixels in the intermediate sprite image with respect to the forward mapped depths of the intermediate sprite image; and

adding a parallax correction to the addresses of pixels in the intermediate sprite image.