Interactive retrieval and caching of multi-dimensional data using view elements

• US 6,014,671 A
• Filed: 05/15/1998
• Issued: 01/11/2000
• Est. Priority Date: 04/14/1998
• Status: Expired due to Term

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Smith, John Richard, Li, Chung-Sheng, Castelli, Vittorio
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): Coby, Frantz
• Application Number:
  US09/079,986
• Time in Patent Office: 606 Days
• Field of Search: 707/3, 707/100, 707/101, 345/419, 345/139
• US Class Current: 1/1
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

An apparatus and method for representing and retrieving multi-dimensional data such as large satellite images. Images are stored in forms that can be rapidly browsed and retrieved by remote client applications in a drill-down or roll-up fashion. The data can be represented and retrieved using a view element data structure that includes node elements and transition elements between nodes. The data is decomposed (in space or spatial-frequency to construct a tree-based or graph-based data structure) into view elements. A set of view elements is selected, compressed and stored without adversely impacting image view extraction or generation speed. View elements are placed into the node elements of the data structure and the transition elements indicate the processing to generate other view elements in the data structure. In a server-side view construction, the view elements are selectively retrieved from storage, decompressed, and processed to generate the views of the data. In a client-side progressive view construction, the client caches the view elements and processes them in combination with view elements retrieved from the server to generate views of the data. The data reuse at the client reduces data transmission in drill-down or roll-up browsing. Data can be ingested, read and written in units of spatial blocks and decomposed into view elements using the spatial block units. Thus, the ingestion, decomposition, compression, and view retrieval for large images can be done using computer devices that have limited storage and processing capabilities.

Claims

1. A computerized method for constructing one or more views of multi-dimensional data using view elements, the method comprising the steps of:

constructing a view element data structure which includes view elements connected by transition elements;

communicating one or more requests for a view of the data;

selecting a set of view elements from a view element data structure by examining said view in accordance with one or more node elements and the transition elements, in response to said one or more requests;

retrieving selected view elements from storage;

processing the selected view elements in accordance with a transition element of the view element data structure; and

generating said view of the data, in response to said processing step.

2. The method of claim 1, wherein the data includes large satellite images, further comprising the steps of:

said constructing step comprising the step of constructing a space and frequency view element data structure;

said communicating step comprising communicating a request for a view of a satellite image, the request specifying a region of interest in terms of a spatial dimension and a resolution; and

said processing step comprising the step of processing the selected view elements in accordance with the transition elements of the space and frequency graph view element data structure.

3. The method of claim 1, said processing and said generating step further comprising the step of synthesizing said view at a client.

4. The method of claim 1, wherein said generating step further comprises the step of transmitting the view in units of spatial blocks.

5. The method of claim 1, in a client-server system, further comprising the step of a client caching the view elements for reuse in generating views.

6. The method of claim 5, further comprising the steps of:

constructing a client-side view element cache and client-side view element data structure;

the client storing the view elements in the cache;

for subsequent view requests;

the client searching the client-side view element data structure to examine the view elements currently in the cache;

the client application indicating to a server in a subsequent view request, the set of view elements in the cache;

the server selecting the view elements based on the request and the set of view elements in the client-side cache; and

communicating selected view elements to the client.

7. The method of claim 5, further comprising the steps of:

constructing a client-side view element cache and client-side view element data structure;

the client storing the view elements in the cache;

for subsequent view requests;

the client searching the client-side view element data structure to examine the view elements currently in the cache and server storage;

the client selecting a set of view elements, in response to said searching step;

the client communicating a request for selected view elements in the server storage to the server;

the server retrieving the view elements from the server storage and communicating the view elements to the client, in response to the client communicating a request for selected view elements;

the client receiving these view elements and inserting them into the client-side view element data structure.

8. The method of claim 1, wherein said step of constructing a view element structure further comprises the steps of:

decomposing the data into the view elements;

selecting a set of the view elements; and

compressing and storing selected view elements generate a compressed representation of the data.

9. The method of claim 1, wherein said step of generating said view of the data, further comprises the steps of:

retrieving and decompressing selected view elements and inserting the selected view elements into the view element data structure;

extracting the view elements from the view element data structure; and

synthesizing and delivering the view to the client.

10. The method of claim 1, for interactively retrieving said views of multi-dimensional data, further comprising the steps of:

constructing a client-side view element cache;

storing the selected view elements in the client-side cache;

for subsequent view requests, identifying one or more of a client cache source and a server source for obtaining selected view elements;

retrieving selected view elements from the one or more sources, including at least one view element stored in the cache; and

processing said view elements in accordance with the transition elements of the view element data structure.

11. The method of claim 1, wherein the multidimensional data comprises one of images and multi-dimensional lattice data.

12. The method of claim 1, further comprising the step of constructing the view element hierarchy data structure using a space and frequency graph.

13. The method of claim 1, further comprising the step of storing a tiled-wavelet set of view elements to represent the data.

14. The method of claim 1, further comprising the step of selecting the view element sets based on one or more of a compression rate-distortion performance;

an additive cost function;

a view retrieval speed;

storage space constraints; and

client or server processing constraints.

15. The method of claim 1, wherein the views and the view elements are in units of spatial blocks.

16. The method of claim 1, wherein said step of constructing a view element data structure uses one of a one-dimensional spatial quad-tree;

a multi-dimensional spatial quad-tree; and

a wavelet packet-tree.

17. The method of claim 1, wherein said compressing step further comprises the step of compressing the view elements with information loss.

18. The method of claim 1, wherein said compressing step further comprises the step of compressing the view elements without information loss.

19. A computerized method for interactively retrieving the views of large satellite images, comprising the steps of:

communicating a request for a view of the satellite image, the request specifying a region of interest in terms of a spatial dimension and a resolution;

constructing a view element data structure which includes view elements connected by transition elements;

constructing a client-side view element cache;

retrieving view elements from the server and storing them in the client-side cache, in response to said request;

examining subsequent requests for views of the satellite image to select view elements and identify one or more of a client cache source and a server source for obtaining selected view elements;

retrieving selected view elements from the one or more sources, including at least one view element stored in the cache;

processing said view elements in accordance with the transitional elements of the space and frequency graph view element data structure in order to generate said view; and

delivering said view to the client application.