Method and mechanism for reducing client-side memory footprint of transmitted data

• US 8,825,805 B2
• Filed: 04/25/2006
• Issued: 09/02/2014
• Est. Priority Date: 05/29/1998
• Status: Expired due to Term

• Current Assignee: National Chung Hsing University (Government of The Republic of China), Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Gollapudi, Sreenivas, Chatterjee, Debashish
• Primary Examiner(s): Joo, Joshua
• Application Number:
  US11/411,247
• Publication Number:
  US 20060195615A1
• Time in Patent Office: 3,052 Days
• Field of Search: 709/247, 709/206, 709/203, 709217-219
• US Class Current: 709/219
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC

Abstract

The present invention is directed to a method and mechanism for reducing the expense of data transmissions between a client and a server. According to an aspect of data prefetching is utilized to predictably retrieve information between the client and server. Another aspect pertains to data redundancy management for reducing the expense of transmitting and storing redundant data between the client and server. Another aspect relates to moved data structures for tracking and managing data at a client in conjunction with data redundancy management.

Claims

1. A computer-implemented process for increasing data storage efficiency, comprising:

identifying a first set of data;

determining, using a processor, the existence of data redundancies in the first set of data, wherein the existence of data redundancies is determined by calculating row differences between successive rows of the first set of data by consulting a bitmap corresponding to changes between a first row and a second row of the first set of data; and

obtaining a second set of data that is a reduced version of the first set of data, wherein the second set of data does not include the data redundancies determined in the first set of data.

2. The process of claim 1, wherein calculating the row differences between successive rows in the first set of data is performed by identifying identical column values for the successive rows.

3. The process of claim 1, wherein the bitmap comprises a bit having a value of “

1,”

the bit representing the difference between two data in the first set of data.

4. The process of claim 1, wherein the bitmap comprises a bit having a value of “

0,”

the bit representing a redundancy of data in the first set of data.

5. The process of claim 1, wherein consulting the bitmap is performed by evaluating each bit in the bitmap to determine changes between the first row and the second row.

6. The process of claim 1, wherein the second set of data is associated with a first bit map that corresponds with a first row difference between a first row and a second row of data in the first set of data.

7. The process of claim 6, wherein the second set of data is associated with a second bit map that corresponds with a second row difference between the second row and a third row of data in the first set of data.

8. The process of claim 1, wherein the bitmap is a multidimensional bit map.

9. The process of claim 1, where the first and second rows are not consecutive rows.

10. The process of claim 1, wherein the second set of data comprises a smaller memory footprint than the first set of data.

11. A computer program product that includes a volatile or non-volatile computer-usable medium usable by a processor, the medium having stored thereon a sequence of instructions which, when executed by said processor, causes said processor to execute a process for increasing the efficiency of data storage, said process comprising:

identifying a first set of data;

determining the existence of data redundancies in the first set of data, wherein the existence of data redundancies is determined by calculating row differences between successive rows of the first set of data by consulting a bitmap corresponding to changes between a first row and a second row of the first set of data; and

obtaining a second set of data that is a reduced version of the first set of data, wherein the second set of data does not include the data redundancies determined in the first set of data.

12. The product of claim 11, wherein calculating the row differences between successive rows in the first set of data is performed by identifying identical column values for the successive rows.

13. A computer system comprising a server, the computer system configured to increase the efficiency of data storage at the server by:

identifying a first set of data;

determining the existence of data redundancies in the first set of data, wherein the existence of data redundancies is determined by calculating row differences between successive rows of the first set of data by consulting a bitmap corresponding to changes between a first row and a second row of the first set of data; and

obtaining a second set of data that is a reduced version of the first set of data, wherein the second set of data does not include the data redundancies determined in the first set of data.

14. The system of claim 13 wherein calculating the row differences between successive rows in the first set of data is performed by identifying identical column values for the successive rows.

15. A computer-implemented process for increasing data storage efficiency, comprising:

storing a second set of data that is a reduced version of a first set of data, wherein the second set of data does not include data redundancies determined in the first set of data and wherein the data redundancies are determined by calculating row differences between successive rows of the first set of data by consulting a bitmap corresponding to changes between a first row and a second row of the first set of data; and

configuring, using a processor, a plurality of data elements associated with redundant data in the first set of data to point to a same data item in the second set of data such that the same data item is accessed for the plurality of data elements.

16. The process of claim 15, wherein calculating the row differences between successive rows in the first set of data is performed by identifying identical column values for the successive rows.

17. The process of claim 15, wherein the bitmap comprises a bit having a value of “

1,”

the bit representing a difference between two data in the first set of data.

18. The process of claim 15, wherein the bitmap comprises a bit having a value of “

0,”

the bit representing a redundancy of data in the first set of data.

19. The process of claim 15, wherein consulting the bitmap is performed by evaluating each bit in the bitmap to determine changes between the first row and the second row.

20. The process of claim 15, wherein the first and the second rows are not consecutive rows of the database table.

21. The process of claim 15, wherein the second set of data is associated with a first bit map that corresponds with a first row difference between a first row and a second row of data in the first set of data.

22. The process of claim 21, wherein the second set of data is associated with a second bit map that corresponds with a second row difference between the second row and a third row of data in the first set of data.

23. The process of claim 15, wherein the second set of data comprises a smaller memory footprint than the first set of data.

24. A computer program product that includes a volatile or non-volatile computer-usable medium usable by a processor, the medium having stored thereon a sequence of instructions which, when executed by said processor, causes said processor to execute a process for increasing the efficiency of data storage, said process comprising:

storing a second set of data that is a reduced version of a first set of data, wherein the second set of data does not include data redundancies determined in the first set of data and wherein the data redundancies are determined by calculating row differences between successive rows of the first set of data by consulting a bitmap corresponding to changes between a first row and a second row of the first set of data; and

configuring a plurality of data elements associated with redundant data in the first set of data to point to a same data item in the second set of data such that the same data item is accessed for the plurality of data elements.

25. A computer system comprising:

a processor;

a display device and/or a volatile or non-volatile computer-usable medium, wherein the system is configured to

storing a second set of data that is a reduced version of a first set of data, wherein the second set of data does not include data redundancies determined in the first set of data and wherein the data redundancies are determined by calculating row differences between successive rows of the first set of data by consulting a bitmap corresponding to changes between a first row and a second row of the first set of data; and

configuring a plurality of data elements associated with redundant data in the first set of data to point to a same data item in the second set of data such that the same data item is accessed for the plurality of data elements.