System and method for interacting with a plurality of data sources

• US 9,116,946 B2
• Filed: 03/31/2011
• Issued: 08/25/2015
• Est. Priority Date: 04/02/2010
• Status: Active Grant

• Current Assignee: Ignite ScaleArc Solutions, Inc.
• Original Assignee: ScaleBase, Inc. (Ignite Technologies Incorporated)
• Inventors: Levari, Doron, Zelkha, Liran
• Primary Examiner(s): Mofiz, Apu
• Assistant Examiner(s): Nguyen, Cindy
• Application Number:
  US13/077,526
• Publication Number:
  US 20110246480A1
• Time in Patent Office: 1,608 Days
• Field of Search: 707/999.005, 707/770
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2255 Hash tables
• CPC Class Codes: G06F 16/244 Grouping and aggregation
• CPC Class Codes: G06F 16/24556 Aggregation; Duplicate elimination
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]

Abstract

System and method for interacting with a plurality of data sources are provided. A request may be parsed and an identification parameter identifying a data set may be determined. A field included in the request may be designated as a distribution key. At least one data source may be selected based on a value associated with the distribution key. At least a portion of the request may be sent to a selected data source. Other embodiments are described and claimed.

Claims

1. A method of processing a request, the method comprising:

parsing a request received from a client to determine a data set identification parameter;

determining, based on the data set identification parameter, the associated data set is a distributed data set;

designating, by a receiver of the request, a field included in the request as a distribution key;

selecting, based on a value of the distribution key, at least one data source; and

sending at least a portion of the request to a selected data source;

wherein the method further comprises determining, based on the data set identification parameter, whether the associated data set is a non-distributed data set and, if the data set is a non-distributed data set then;

if the request is related to a retrieval of data, then selecting a data source based on a load balancing scheme, and

if the request is related to an update of information, then sending the request to all data sources associated with the data set.

2. The method of claim 1, comprising dynamically associating a plurality of values with the distribution key and respectively selecting a respective plurality of data sources to receive at least a portion of the request.

3. The method of claim 1, comprising associating a data source with a range of values and, if the value of the distribution key is included in the range of values, then sending the request to the associated data source.

4. The method of claim 1, wherein a selected data source is one of:

a master data source, a mirrored data source and a distributed data source.

5. The method of claim 1, comprising calculating an index based on the value of the distribution key and sending the request to a data source associated with the index.

6. The method of claim 1, wherein designating a field as a distribution key is based on an association of a data set identification parameter with a field included in the request.

7. The method of claim 5, wherein calculating the index comprises providing the value of the distribution key as input to a hash function.

8. The method of claim 5, comprising using a mapping table to associate the index with the selected data source.

9. The method of claim 5, comprising using the value of the distribution key as an index.

10. The method of claim 1, comprising generating a request to a data source by replacing a grouping operator in the received request by a sorting operator.

11. An article comprising a non-transitory computer-readable storage medium, having stored thereon instructions, that when executed on a computer, cause the computer to:

parse a request received from a client to determine a data set identification parameter;

determine, based on the data set identification parameter, the associated data set is a distributed data set;

designate a field included in the request as a distribution key;

select, based on a value of the distribution key, at least one data source; and

send at least a portion of the request to a selected data source;

wherein the instructions when executed further result in determining, based on the data set identification parameter, whether the associated data set is a non-distributed data set and, if the data set is a non-distributed data set then;

if the request is related to a retrieval of data then selecting a data source based on a load balancing scheme, and

if the request is related to an update of information, then sending the request to all data sources associated with the data set.

12. The article of claim 11, wherein the instructions when executed further result in dynamically associating a plurality of values with the distribution key and respectively selecting a respective plurality of data sources to receive at least a portion of the request.

13. The article of claim 11, wherein the instructions when executed further result in associating a data source with a range of values and, if the value of the distribution key is included in the range of values, then sending the request to the associated data source.

14. The article of claim 11, wherein a selected data source is one of:

a master data source, a mirrored data source and a distributed data source.

15. The article of claim 11, wherein the instructions when executed further result in calculating an index based on the value of the distribution key and sending the request to a data source associated with the index.

16. The article of claim 11, wherein the instructions when executed further result in designating a field as a distribution key is based on an association of a data set identification parameter with a field included in the request.

17. The article of claim 15, wherein calculating the index comprises providing the value of the distribution key as input to a hash function.

18. The article of claim 15, comprising using a mapping table to associate the index with the selected data source.

19. The article of claim 11, comprising using the value of the distribution key as an index, the index identifying a data source.

20. The article of claim 11, comprising generating a request to a data source by replacing a grouping operator in the received request by a sorting operator.