Method and system for panorama viewing

• US 6,192,393 B1
• Filed: 04/07/1998
• Issued: 02/20/2001
• Est. Priority Date: 04/07/1998
• Status: Expired due to Term

• Current Assignee: Tumbleweed Holdings LLC (Equitable IP Corporation)
• Original Assignee: MGI Software Corporation (MelodyVR Group Plc)
• Inventors: Tarantino, Paul, Clifton, Michael
• Primary Examiner(s): Teska, Kevin J.
• Assistant Examiner(s): THOMSON, WILLIAM D
• Application Number:
  US09/057,013
• Time in Patent Office: 1,050 Days
• Field of Search: 382/232, 382/233, 382/299, 709/203, 709/219, 709/204, 709/231, 709/218, 345/425, 345/427, 345/428, 345/429, 345/433, 345/437, 345/439
• US Class Current: 709/203
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image

Abstract

A method and system for viewing panoramas over a server-client network including storing an image in tiled form on a server, receiving at a server from a client a request for at least a portion of the image, transmitting from the server to the client at least one tile corresponding to the at least a portion of the image requested by the client, and carrying out an individual tile-wise perspective correction on said at least one tile.

Claims

1. A method for viewing scenes over a server-client network comprising:

storing multiple resolutions of an environment map of a scene on a server, each resolution being stored as a plurality of image tiles;

receiving at a server from a client a request to view a perspective portion of the scene;

selecting a resolution from the multiple resolutions of the environment map, corresponding to the perspective portion of the scene requested by the client for viewing;

further selecting at least one image tile from the stored plurality of image tiles for the selected resolution of the environment map, corresponding to the perspective portion of the scene requested by the client for viewing;

transmitting from the server to the client the selected at least one image tile; and

carrying out an individual tile-wise perspective correction on the selected at least one image tile.

2. A method for viewing scenes according to claim 1 and wherein said carrying out an individual tile-wise perspective correction takes place at the client.

3. A method for viewing scenes according to claim 1 and wherein said carrying out an individual tile-wise perspective correction includes carrying out a linear transformation of data in each of the selected at least one image tile.

4. A method for viewing scenes according to claim 1 and wherein said carrying out an individual tile-wise perspective correction takes place at the server.

5. A method for viewing scenes according to claim 1 and wherein said carrying out an individual tile-wise perspective correction includes carrying out a linear transformation of data in each of the selected at least one image tile.

6. A method for viewing scenes according to claim 1 and wherein the selected resolution also corresponds to dimensions of a viewing window available to the client.

7. A method for viewing scenes according to claim 2 and wherein the selected resolution also corresponds to dimensions of a viewing window available to the client.

8. A method for viewing scenes according to claim 4 and wherein the selected resolution also corresponds to dimensions of a viewing window available to the client.

9. A method for viewing scenes according to claim 1 and also comprising:

caching image tiles, received from the server, at the client; and

in response to client requests which require at least one image tile of the environment map at a first resolution, temporarily employing at least one image tile of the environment map cached at the client, at a resolution different from said first resolution, until at least one required image tile is received from the server.

19. A method for viewing scenes according to claim 1 further comprising determining a bounding box surrounding a portion of the environment map that is required in order to generate the perspective portion of the scene requested by the client.

20. A method for viewing scenes according to claim 19 further comprising calculating an initial bounding box based on an adjusted perspective portion of the scene, the adjusted perspective portion of the scene corresponding to the perspective portion of the scene requested by the client but having a pitch angle of zero.

21. A method for viewing scenes according to claim 20 wherein the selected resolution corresponds to the initial bounding box.

22. A method for viewing scenes according to claim 21 wherein the selected at least one image tile is at least one image tile for the selected resolution of the environment map that is contained within the bounding box.

23. A method for viewing scenes according to claim 21 wherein the selected at least one image tile is at least one image tile for the selected resolution of the environment map that overlaps with the bounding box.

10. A system for viewing scenes operating over a server-client network, the system comprising:

an image store storing multiple resolutions of an environment map of a scene on a server, each resolution being stored as a plurality of image tiles;

a data processor, operative in response to a client request to view a perspective portion of the scene, to select a resolution from the multiple resolutions of the environment map, and to further select at least one image tile from the stored plurality of image tiles for the selected resolution of the environment map, the selected resolution and the selected at least one image tile corresponding to the perspective portion of the scene requested by the client for viewing;

a transmitter transmitting from the server to the client the selected at least one image tile corresponding to the perspective portion of the scene requested by the client; and

an image processor carrying out an individual tile-wise perspective correction on the selected at least one image tile.

11. A panorama viewing system according to claim 10 and wherein said image processor is situated at the client.

12. A system for viewing scenes according to claim 11 and wherein said image processor carries out a linear transformation of data in each of the selected at least one image tile.

13. A panorama viewing system according to claim 10 and wherein said image processor is situated at the server.

14. A system for viewing scenes according to claim 13 and wherein said image processor carries out a linear transformation of data in each of the selected at least one image tile.

15. A system for viewing scenes according to claim 10 and wherein the selected resolution also corresponds to dimensions of a viewing window available to the client.

16. A system for viewing scenes according to claim 11 and wherein the selected resolution also corresponds to dimensions of a viewing window available to the client.

17. A system for viewing scenes according to claim 13 and wherein the selected resolution also corresponds to dimensions of a viewing window available to the client.

18. A system for viewing scenes according to claim 10 and also comprising:

a cache for caching image tiles, received from the server, at the client; and

a tile substitutor, temporarily employing, in response to client requests which require at least one image tile of the environment map at a first resolution, at least one image tile of the environment map cached at the client, at a resolution different from said first resolution, until at least one required image tile is received from the server.

24. A system for viewing scenes according to claim 10 further comprising a bounding box calculator determining a bounding box surrounding a portion of the environment map that is required in order to generate the perspective portion of the scene requested by the client.

25. A system for viewing scenes according to claim 10 wherein said bounding box calculator calculates an initial bounding box based on an adjusted perspective portion of the scene, the adjusted perspective portion of the scene corresponding to the perspective portion of the scene requested by the client but having a pitch angle of zero.

26. A system for viewing scenes according to claim 25 wherein the selected resolution corresponds to the initial bounding box.

27. A system for viewing scenes according to claim 26 wherein the selected at least one image tile is a tile for the selected resolution of the environment map that is contained within the bounding box.

28. A system for viewing scenes according to claim 26 wherein the selected at least one image tile is a tile for the selected resolution of the environment map that overlaps with the bounding box.