Manifold mosaic hopping for image-based rendering

• US 6,643,413 B1
• Filed: 03/27/2000
• Issued: 11/04/2003
• Est. Priority Date: 03/27/2000
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chai, Jin-Xiang, Wang, Li Feng, Tong, Xin, Shum, Heung-Yeung
• Primary Examiner(s): Mehta, Bhavesh M
• Assistant Examiner(s): Bayat, Ali
• Application Number:
  US09/536,485
• Time in Patent Office: 1,317 Days
• Field of Search: 382/294, 382/295, 382/296, 382/300, 382/284, 382/154, 345/435, 345/619, 345/629, 345/639, 345/634
• US Class Current: 382/284
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration

Abstract

The invention relates to manifold mosaic hopping for image-base rendering (IBR). In one embodiment, a set of manifold mosaics is constructed. Depending on the desired application, the mosaics can be concentric mosaics, parallel mosaics, as well as other types of mosaics. Each mosaic represents a number of unique viewpoints that different from one another in only one direction. From a current camera or viewing position within the set of mosaics, a new position can be moved to, such that the movement is continuous over any one mosaic, and is discrete across the mosaics. An image is rendered by local warping, without interpolation of more than one mosaic.

Claims

1. A computer-implemented method for rendering an image comprising:

constructing a set of manifold mosaics having a predetermined spatial relationship, each mosaic representing a plurality of unique viewpoints that differ from one another in only one direction;

from a current position within the set of manifold mosaics, moving to a new position within the set of manifold mosaics, such that movement is continuous over one mosaic and is discrete across mosaics; and

,

rendering the image based on the new position within the set of manifold mosaics, by locally warping a mosaic represented by the new position within the set of mosaics, without interpolation of more than one mosaic.

2. The method of claim 1, wherein for any two adjacent mosaics of the set of manifold mosaics, there is a maximum distance between the two adjacent mosaics based on a predetermined smooth perception threshold related to a human visual system.

3. The method of claim 1, such that the movement is one of only continuous movement over one mosaic and only discrete movement across mosaics.

4. The method of claim 1, wherein the set of manifold mosaics comprises a set of concentric mosaics, such that the predetermined spatial relationship comprises each of the concentric mosaics having a common center point.

5. The method of claim 4, wherein the plurality of unique viewpoints of each mosaic differ from one another only in an angular direction of a predetermined a (radial direction, angular direction) ray space.

6. The method of claim 5, wherein the movement comprises movement in an angular direction around a fixed point within the set of manifold mosaics.

7. The method of claim 5, wherein for any two adjacent mosaics of the set of manifold mosaics, there is a maximum distance between the two adjacent mosaics represented by $R_0$

sin

(D0+sin-1

rnR0)-rn,

where R₀ represents depth, D₀ represents a predetermined smooth perception threshold, and r_n represents one of the two adjacent mosaics.

8. The method of claim 7, wherein the predetermined smooth perception threshold is based on humanly perceived visual smoothness.

9. The method of claim 1, wherein the set of manifold mosaics comprises a set of parallel mosaics, such that the predetermined spatial relationship comprises the set of parallel mosaics being parallel to one another.

10. The method of claim 9, wherein for any two adjacent mosaics of the set of manifold mosaics, there is a maximum angle between the two adjacent mosaics represented by $(\frac{\pi }{}$

2

β

-1)

D0,

wherein D₀ represents a predetermined smooth perception threshold.

11. The method of claim 1, further comprising displaying the image rendered.

12. A machine-readable medium having instructions stored thereon for execution by a processor to perform a method for rendering an image within a set of manifold mosaics having a predetermined spatial relationship, each mosaic representing a plurality of unique viewpoints that different from one another in only one direction, the method comprising:

from a current position within the set of manifold mosaics, moving to a new position within the set of manifold mosaics, such that movement is continuous over one mosaic and is discrete across mosaics;

rendering the image based on the new position within the set of manifold mosaics, by locally warping a mosaic represented by the new position within the set of manifold mosaics, without interpolation of more than one mosaic; and

,

displaying the image rendered.

13. The medium of claim 12, such that the movement is one of only continuous movement over one mosaic and only discrete movement across mosaics.

14. The medium of claim 12, wherein the set of manifold mosaics comprises a set of concentric mosaics, such that the predetermined spatial relationship comprises each of the concentric mosaics having a common center point.

15. The medium of claim 14, wherein the plurality of unique viewpoints of each mosaic differ from one another only in an angular direction of a predetermined a (radial direction, angular direction) ray space.

16. The medium of claim 15, wherein the movement comprises movement in an angular direction around a fixed point within the set of manifold mosaics.

17. The medium of claim 15, wherein for any two adjacent mosaics of the set of manifold mosaics, there is a maximum distance between the two adjacent mosaics represented by $R_0$

sin

(D0+sin-1

rnR0)-rn,

where R₀ represents depth, D₀ represents a predetermined smooth perception threshold, and r_n represents one of the two adjacent mosaics.

18. The medium of claim 12, wherein the set of manifold mosaics comprises a set of parallel mosaics, such that the predetermined spatial relationship comprises the set of parallel mosaics being parallel to one another.

19. The medium of claim 18, wherein for any two adjacent mosaics of the set of manifold mosaics, there is a maximum angle between the two adjacent mosaics represented by $(\frac{\pi }{}$

2

β

-1)

D0,

wherein D₀ represents a predetermined smooth perception threshold.

20. A computer-implemented method for rendering an image comprising:

constructing a set of concentric manifold mosaics, each mosaic representing a plurality of unique viewpoints that differ from one another in only an angular direction of a (radial direction, angular direction) ray space;

from a current position within the set of concentric manifold mosaics, moving to a new position within the set of concentric manifold mosaics, such that movement is continuous over one mosaic and is discrete across mosaics; and

,

rendering the image based on the new position within the set of concentric manifold mosaics, by locally warping a mosaic represented by the new position within the set of concentric manifold mosaics, without interpolation of more than one mosaic.

21. The method of claim 20, wherein for any two adjacent mosaics of the set of concentric manifold mosaics, there is a maximum distance between the two mosaics based on a predetermined smooth perception threshold related to a human visual system.

22. The method of claim 20, such that the movement is one of only continuous movement over one mosaic and only discrete movement across mosaics.

23. The method of claim 20, wherein the movement comprises movement in an angular direction around a fixed point within the set of concentric manifold mosaics.

24. The method of claim 20, wherein for any two adjacent mosaics of the set of concentric manifold mosaics, there is a maximum distance between the two adjacent mosaics represented by $R_0$

sin

(D0+sin-1

rnR0)-rn,

where R₀ represents depth, D₀ represents a predetermined smooth perception threshold, and r_n represents one of the two adjacent mosaics.

25. The method of claim 20, further comprising displaying the image rendered.