Method and system for managing data transaction requests

• US 7,650,338 B2
• Filed: 05/12/2004
• Issued: 01/19/2010
• Est. Priority Date: 07/03/2003
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: eBay Inc.
• Inventors: Seitz, Greg, Kasten, Christopher J., Grossfeld, Elena, Lockert, Thorsten, Widjojo, Surjatini, Wigginton, Kenneth Randall
• Primary Examiner(s): Corrielus; Jean M
• Application Number:
  US10/562,459
• Publication Number:
  US 20060294038A1
• Time in Patent Office: 2,078 Days
• Field of Search: 707/10, 707/3, 707/104.1, 707/101, 707/103, 707/4, 707/102, 707/103.R, 717/108, 717/126, 717/127, 719/319, 709/203, 709/207
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: Y10S 707/966 Distributed
• CPC Class Codes: Y10S 707/968 Partitioning
• CPC Class Codes: Y10S 707/969 Horizontal partitioning

Abstract

A method and system is provided to process data transactions in a data store including a plurality of databases. The system may comprise a computer interface module to receive a data transaction request from at least one requesting computer and a data store interface module to interface the system to the plurality of databases. The system also includes a data access layer defining an abstraction layer to identify at least one database of the plurality of databases. The data transaction request may be an object orientated request and the plurality of databases may be horizontally distributed wherein the data access layer defines an object orientated abstraction layer between the computer interface module and the plurality of databases. In one embodiment a data dependent routing module is provided that generates a query to a database that is identified based on content of the data in the data transaction request.

Claims

1. A computer system to process data transactions in a data store including a plurality of databases, the system comprising:

a processor-implemented computer interface module to receive a data transaction request from at least one requesting computer, wherein the data transaction request is an object oriented request;

a processor-implemented data store interface module to interface to the plurality of databases, wherein the plurality of databases are horizontally distributed; and

a processor-implemented data access layer to identify a plurality of different databases from the plurality of databases and to split the data transaction request into a plurality of data transaction requests to the different databases, the data access layer being operatively in data communication with the computer interface module and the data store interface module and defining an abstraction layer between the processor-implemented computer interface module and the processor-implemented data store interface module,

wherein the data access layer defining an object oriented abstraction layer between the computer interface module and the plurality of databases;

a processor-implemented data dependent routing module to identify a data type from the data transaction request, map the data transaction request to an associated physical host, and generate a query to at least one of the plurality of different databases that is identified based on content of the data in the data transaction request;

communicate at least part of the plurality of data transaction requests to the at least one database of the plurality of different databases identified;

gathering a plurality of results received from the different databases; and

presenting the plurality of results to the at least one requesting computer.

2. The system of claim 1, wherein the processor-implemented data access layer comprises a plurality of logical hosts and a plurality of physical hosts, wherein the logical host is derived from the data transaction request and mapped to a physical host that identifies at least one of the plurality of databases.

3. The system of claim 2, wherein the processor-implemented data access layer comprises at least one logical table and at least one physical table, wherein the logical table being identified from the data transaction request and mapped to the physical table which identifies a corresponding logical host.

4. The system of claim 1, wherein the at least one rule includes at least one attribute that is used identify the physical host.

5. The system of claim 1, wherein the processor-implemented data dependent routing module identifying at least one database for the data transaction request.

6. The system of claim 1, wherein the processor-implemented data dependent routing module maps the object oriented request to a physical host that identifies an associated database of the plurality of databases.

7. The system of claim 1, wherein the data transaction requests being communicated between any one of a plurality of client machines and the system via the Internet.

8. A method of processing data transactions in a data store including a plurality of databases, the method comprising:

using one or more processors to perform the following acts of;

receiving a data transaction request from at least one requesting computer, wherein the data transaction request is an object oriented request;

using a data access layer that defines an abstraction layer to identify at least one database a plurality of different databases from the plurality of databases, wherein the plurality of databases are horizontally distributed;

wherein the data access layer;

defining an object oriented abstraction layer between the computer interface module and the plurality of databases;

splitting the data transaction request into a plurality of data transaction requests;

identifying a data type from the data transaction request;

mapping the data transaction request to an associated physical host; and

generate a query to at least one of the plurality of different databases that is identified based on content of the data in the data transaction request;

communicating at least part of the plurality of data transaction requests to at least one database of the plurality of different databases identified;

gathering a plurality of results received from the different databases; and

presenting the plurality of results to the at least one requesting computer.

9. The method of claim 8, wherein the data access layer comprises a plurality of logical hosts and a plurality of physical host, the method comprising deriving a logical host from the data transaction request and mapping the logical host to a physical host that identifies at least one of the plurality of different databases.

10. The method of claim 9, wherein the processor-implemented data access layer comprising at least one logical table and at least one physical table, wherein the logical table being identified from the data transaction request and mapped to the physical table which identifies a corresponding logical host.

11. The method of claim 8, wherein the processor-implemented data access layer optionally changing the at least one rule in real-time.

12. The method of claim 8, wherein the processor-implemented data access layer identifying if the data transaction request has an associated rule;

retrieving the associated rule when the data transaction request has a rule associated therewith; and

mapping the data transaction request to a physical host based on the associated rule.

13. The method of claim 12, wherein the processor-implemented data access layer mapping the data transaction request to a physical host includes:

mapping the data transaction request to a logical host based on the associated rule; and

mapping the logical host to a physical host identifying one of the plurality of databases.

14. The method of claim 8, wherein the at least one rule includes an attribute that is used identify a physical host.

15. The method of claim 8, wherein data associated with a user is split across the plurality of databases, wherein the plurality of databases identifying at least one database associated with the user from the data transaction request.

16. The method of claim 8, wherein the data transaction request is an object-oriented request, wherein the object-oriented mapping to a physical host that identifies an associated database of the plurality of databases.

17. The method of claim 8, wherein the data transaction request determining if at least one of the plurality of different databases identified is down and, if so, mapping the data transaction request to an alternative database of the plurality of different databases.

18. The method of claim 8, wherein the data transaction request is selected from the group consisting of a create transaction, a read transaction, an update transaction, and a delete transaction and the data access layer is programmable to define in which database of the plurality of databases the transaction is to be performed in.

19. The method of claim 8, wherein the data transaction request monitoring status of the plurality of databases;

and using the data access layer to balance a load on the plurality of databases in response to the monitored status.

20. A computer system to process data transactions in a data store including a plurality of databases, the system comprising:

means for receiving a data transaction request from at least one requesting computer, wherein the data transaction request is an object oriented request;

means for using a data access layer that defines an abstraction layer to identify a plurality of different databases from the plurality of databases and to split the data transaction request into a plurality of data transaction requests, wherein the plurality of databases are horizontally distributed, and

wherein the data access layer;

defining an object oriented abstraction layer between the means for receiving a data transaction request and the plurality of databases;

identifying a data type from the data transaction request;

mapping the data transaction request to an associated physical host; and

generating a query to at least one of the plurality of different databases that is identified based on content of the data in the data transaction request;

means for communicating at least part of the plurality of data transaction request to the at least one database of the plurality of different databases identified;

means for using a data dependent routing module to

gathering a plurality of results received from the different databases; and

presenting the plurality of results to the at least one requesting computer.

21. The system of claim 20, wherein the data access layer comprises at least one logical table and at least one physical table, wherein the a logical table being identified from the data transaction request and mapped to the a physical table which identifies a corresponding logical host.

22. A machine-readable storage medium comprises executable instructions, said executable instructions when executed by a machine, causes a processor to perform the operations to:

receive a data transaction request from at least one requesting computer, wherein the data transaction request is an object oriented request;

use a data access layer that defines an abstraction layer to identify at least one database from the plurality of databases and to split the data transaction request into a plurality of data transaction requests, wherein the plurality of databases are horizontally distributed, and

wherein the data access layer;

defining an object oriented abstraction layer between the data transaction request and the plurality of databases;

identifying a data type from the data transaction request;

mapping the data transaction request to an associated physical host; and

generating a query to at least one of the plurality of different databases that is identified based on content of the data in the data transaction request;

communicate at least part of the plurality of data transaction requests to the at least one database of the plurality of different databases identified;

gathering a plurality of results received from the different databases; and

presenting the plurality of results to the at least one requesting computer.