Selectively reading data from cache and primary storage

• US 9,361,232 B2
• Filed: 03/15/2013
• Issued: 06/07/2016
• Est. Priority Date: 09/19/2008
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Umamageswaran, Kothanda, Loaiza, Juan R., Panchaksharaiah, Umesh, Tsukerman, Alexander, Shetler, Timothy L., Baddepudi, Bharat C. V., Erlikhman, Boris, Goyal, Kiran B., Choudhury, Nilesh, Fan, Susy, Kumar, Poojan, Aya, Selcuk, Lee, Sue-Kyoung
• Primary Examiner(s): Queler, Adam M
• Assistant Examiner(s): CHAN, TRACY C
• Application Number:
  US13/839,251
• Publication Number:
  US 20130212332A1
• Time in Patent Office: 1,180 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0811 with multilevel cache hierarchies
• CPC Class Codes: G06F 12/084 with a shared cache
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/0888 using selective caching, e.g. bypass
• CPC Class Codes: G06F 16/24552 Database cache management
• CPC Class Codes: G06F 16/24557 Efficient disk access during query execution

Abstract

Techniques are provided for using an intermediate cache to provide some of the items involved in a scan operation, while other items involved in the scan operation are provided from primary storage. Techniques are also provided for determining whether to service an I/O request for an item with a copy of the item that resides in the intermediate cache based on factors such as a) an identity of the user for whom the I/O request was submitted, b) an identity of a service that submitted the I/O request, c) an indication of a consumer group to which the I/O request maps, or d) whether the intermediate cache is overloaded. Techniques are also provided for determining whether to store items in an intermediate cache in response to the items being retrieved, based on logical characteristics associated with the requests that retrieve the items.

Claims

1. A method comprising:

receiving, from a software application that is executing on a server machine, at a storage system that is distinct from the server machine, a single I/O request to retrieve items involved in an operation that targets a plurality of items that reside on a primary storage that is managed by the storage system;

wherein the primary storage is persistent storage;

wherein the single I/O request specifies storage locations, of the items involved in the operation, on the persistent storage;

wherein an intermediate cache, managed by the storage system, is logically positioned between local memory of the software application and the primary storage;

wherein the plurality of items targeted by the operation includes a first set of items and a second set of items; and

in response to the single I/O request, the storage system performing steps of;

retrieving the first set of items from the primary storage; and

retrieving the second set of items from the intermediate cache.

2. The method of claim 1 wherein a copy of at least one item in the first set of items resides in the intermediate cache at the time the at least one item is retrieved from the primary storage in response to the single I/O request.

3. The method of claim 1 wherein at least a portion of the step of retrieving the first set of items from the primary storage is performed concurrently with performance of the step of retrieving the second set of items from the intermediate cache managed by the storage system.

4. The method of claim 1 wherein, in response to the single I/O request, requests are sent, at the same time, to both the primary storage for the first set of items and the intermediate cache for the second set of items.

5. The method of claim 1 wherein:

the first set of items includes a particular item that does not reside in the intermediate cache;

the method further comprises selecting which item, within the intermediate cache, to replace with a copy of the particular item; and

which item is selected for replacement is based, at least in part, on which items within the intermediate cache are designated as KEEP items.

6. The method of claim 5 wherein which item is selected for replacement is further based, at least in part, on whether the particular item is designated as a KEEP item.

7. The method of claim 1 wherein:

the first set of items includes a particular item that does not reside in the intermediate cache; and

the method further comprises determining whether to store the particular item in intermediate cache based, at least in part, on whether the item is a NONE item.

8. The method of claim 1 wherein:

the software application is a database server;

the first set of items includes a particular item that does not reside in the intermediate cache; and

the method further comprises determining whether to store the particular item in intermediate cache based, at least in part, on whether the operation is a scan operation.

9. The method of claim 1 wherein:

the software application is a database server;

the first set of items includes a particular item that does not reside in the intermediate cache; and

the method further comprises determining whether to store the particular item in intermediate cache based, at least in part, on which type of block the particular item is stored in.

10. The method of claim 1 wherein:

the software application is a database server;

the method further comprises;

the storage system determining that the operation is a scan of a database object that resides on the primary storage and is cached in the intermediate cache; and

in response to determining that the operation is a scan of a database object that resides on the primary storage and is cached in the intermediate cache, the storage system breaking up the single I/O request into a first request sent to the primary storage and a second request sent to the intermediate cache.

11. One or more non-transitory computer-readable media storing instructions which, when executed by one or more processors, cause:

receiving, from a software application that is executing on a server machine, at a storage system that is distinct from the server machine, a single I/O request to retrieve items involved in an operation that targets a plurality of items that reside on a primary storage that is managed by the storage system;

wherein the primary storage is persistent storage;

wherein the single I/O request specifies storage locations, of the items involved in the operation, on the persistent storage;

wherein an intermediate cache, managed by the storage system, is logically positioned between local memory of the software application and the primary storage;

wherein the plurality of items targeted by the operation includes a first set of items and a second set of items; and

in response to the single I/O request, the storage system performing steps of;

retrieving the first set of items from the primary storage; and

retrieving the second set of items from the intermediate cache.

12. The one or more non-transitory computer-readable media of claim 11 wherein a copy of at least one item in the first set of items resides in the intermediate cache at the time the at least one item is retrieved from the primary storage in response to the single I/O request.

13. The one or more non-transitory computer-readable media of claim 11 wherein at least a portion of the step of retrieving the first set of items from the primary storage is performed concurrently with performance of the step of retrieving the second set of items from the intermediate cache managed by the storage system.

14. The one or more non-transitory computer-readable media of claim 11 wherein, in response to the single I/O request, requests are sent, at the same time, to both the primary storage for the first set of items and the intermediate cache for the second set of items.

15. The one or more non-transitory computer-readable media of claim 11 wherein:

the first set of items includes a particular item that does not reside in the intermediate cache;

the instructions include instructions for selecting which item, within the intermediate cache, to replace with a copy of the particular item; and

which item is selected for replacement is based, at least in part, on which items within the intermediate cache are designated as KEEP items.

16. The one or more non-transitory computer-readable media of claim 15 wherein which item is selected for replacement is further based, at least in part, on whether the particular item is designated as a KEEP item.

17. The one or more non-transitory computer-readable media of claim 11, wherein:

the first set of items includes a particular item that does not reside in the intermediate cache; and

the instructions include instructions for determining whether to store the particular item in intermediate cache based, at least in part, on whether the item is a NONE item.

18. The one or more non-transitory computer-readable media of claim 11, wherein:

the software application is a database server;

the first set of items includes a particular item that does not reside in the intermediate cache; and

the instructions include instructions for determining whether to store the particular item in intermediate cache based, at least in part, on whether the operation is a scan operation.

19. The one or more non-transitory computer-readable media of claim 11, wherein:

the software application is a database server;

the first set of items includes a particular item that does not reside in the intermediate cache; and

the instructions include instructions for determining whether to store the particular item in intermediate cache based, at least in part, on which type of block the particular item is stored in.

20. The one or more non-transitory computer-readable media of claim 11, wherein:

the software application is a database server;

the instructions include instructions for;

the storage system determining that the operation is a scan of a database object that resides on the primary storage and is cached in the intermediate cache; and

in response to determining that the operation is a scan of a database object that resides on the primary storage and is cached in the intermediate cache, the storage system breaking up the single I/O request into a first request sent to the primary storage and a second request sent to the intermediate cache.