Multi-dimensional surrogates for data management

• US 7,778,976 B2
• Filed: 08/23/2005
• Issued: 08/17/2010
• Est. Priority Date: 02/07/2005
• Status: Expired due to Fees

• Current Assignee: Mimosa Systems Incorporated (Iron Mountain Incorporated)
• Original Assignee: Mimosa Incorporated
• Inventors: Mehta, Sanjay, Pandit, Bhushan, Ravi, Thirumalai Muppur, D'Souza, Roy P.
• Primary Examiner(s): Jalil; Neveen Abel
• Assistant Examiner(s): Syed; Farhan M
• Application Number:
  US11/211,056
• Publication Number:
  US 20060179061A1
• Time in Patent Office: 1,820 Days
• Field of Search: None
• US Class Current: 707/665
• CPC Class Codes: G06F 16/283 Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

Multi-dimensional surrogation systems and methods are provided that generate at least one data surrogate using information of data and numerous data changes received from at least one data source. The multi-dimensional surrogation transforms data of each data surrogate from a format of the data source to at least one alternative format. Original metadata is extracted from each data surrogate. New metadata is generated by combining portions of the original metadata and components of each data surrogate. The multi-dimensional surrogation generates an extended data surrogate comprising the data surrogate and the new metadata.

Claims

1. A method comprising:

A method comprising;

generating at least one data surrogate using information of received data and a plurality of data changes received from at least one data source, wherein the data surrogate is application-aware relative to an application corresponding to the received data and the plurality of data changes, the generating including generating additional data surrogates corresponding in part to data changes received from additional data sources;

extracting original metadata of each data surrogate;

identifying relationships among portions of the original metadata and components of each data surrogate;

generating new metadata based in part on the identified relationships among the portions of the original metadata and components of each data surrogate by combining the portions of the original metadata and the components of each data surrogate;

generating an extended data surrogate comprising the data surrogate and one of the original metadata and new metadata;

archiving at least one instance of the data surrogate and the extended data surrogate in at least one storage site, wherein the archiving includes active archiving, wherein active archiving includes at least one of performing at least one operation on the data surrogate and placing at least one of the data surrogate and the extended data surrogate in the at least one storage site as appropriate to a corresponding application; and

controlling access to data of at least one of the data surrogate and the extended data surrogate by at least one of applications and servers.

2. The method of claim 1, further comprising updating the at least one data surrogate using information of at least one additional data change received from at least one data source.

3. The method of claim 2, wherein the updating is performed at least one of upon receipt of the at least one additional data change, subsequent to receipt of a plurality of additional data changes, and following processing operations on the at least one additional data change.

4. The method of claim 1, further comprising transforming data of at least one of the data surrogate and the extended data surrogate among a plurality of density formats.

5. The method of claim 1, wherein the extended data surrogate includes the new metadata.

6. The method of claim 1, further comprising:

detecting a data format of at least one of the applications;

transforming data of at least one of the data surrogate and the extended data surrogate in accordance with detected data format.

7. The method of claim 1, further comprising:

detecting a data content of at least one of the applications;

transforming data of at least one of the data surrogate and the extended data surrogate in accordance with detected data content.

8. The method of claim 1, wherein the at least one storage site includes a plurality of storage sites.

9. The method of claim 1, further comprising archiving difference information of changes made in at least one of the data surrogate and the extended data surrogate.

10. The method of claim 1, wherein the archiving includes passive archiving, wherein passive archiving includes archiving as reference data at least one instance of at least one of the data surrogate and the extended data surrogate in at least one storage site.

11. The method of claim 1, wherein the archiving includes deep archiving, wherein deep archiving includes archiving a plurality of instances of at least one of the data surrogate and the extended data surrogate in at least one storage site, wherein data archived by deep archiving is accessed in accordance with at least one privilege.

12. The method of claim 1, further comprising integrating at least one of the data surrogate and the extended data surrogate with at least one of the applications.

13. The method of claim 12, wherein the applications include authentication applications, authorization applications, access control applications, tamper detection applications, tamper prevention applications, and audit applications.

14. The method of claim 12, wherein at least one of the applications regulate access to the data surrogate by at least one of users, administrators, auditors, and policy managers.

15. The method of claim 1, further comprising transferring a portion of data of at least one of the data surrogate and the extended data surrogate to at least one server.

16. The method of claim 15, wherein the transferring includes at least one of quality of service mechanisms, remote change detection mechanisms, batching of data transfers, and optimizing of transfer schedules, wherein the transferring preserves bandwidth and optimizes latency.

17. The method of claim 15, wherein the transferring includes at least one of applying privacy mechanisms and tamper resistance mechanisms.

18. The method of claim 15, wherein the transferring complies with at least one of legal requirements and compliance requirements of retention, disposition, monitoring and supervision when multiple copies of at least one of the data surrogate and the extended data surrogate result from the transferring.

19. The method of claim 15, wherein the at least one server includes at least one of local servers, remote servers, messaging servers, electronic mail servers, instant messaging servers, voice-over-Internet Protocol servers, collaboration servers, portals, customer relationship management (CRM) servers, enterprise resource planning (ERP) servers, business-to-business servers, content management servers, and database servers.

20. The method of claim 1, further comprising transferring a portion of data of at least one of the data surrogate and the extended data surrogate to at least one client application, wherein the at least one client application includes local client applications and remote client applications.

21. The method of claim 20, further comprising enforcing access to at least one of the data surrogates and extended data surrogates through at least one of authentication, authorization, access control and non-repudiation in a manner that is integrated with at least one coupled enterprise.

22. The method of claim 20, further comprising controlling access to at least one of the data surrogates and the extended data surrogates and maintaining privacy and tamper resistance of the data during the transferring and at rest.

23. The method of claim 1, further comprising storing at least one of the data surrogate and the extended data surrogate in at least one storage site in accordance with at least one application with which the data surrogate and the extended data surrogate is associated.

24. The method of claim 1, further comprising controlling access by at least one user to at least one of the data surrogate and the extended data surrogate.

25. The method of claim 1, further comprising moving at least one of the data surrogate and the extended data surrogate across a plurality of storage devices in accordance with at least one parameter including source, content, key words, age, size, user, policies, and frequency of access.

26. The method of claim 1, further comprising restoring data of the data surrogate on a target server, wherein the target server is a source server of the received data.

27. The method of claim 1, further comprising redirecting data of the data surrogate to a target server, wherein the target server is restored is a different server than the source server of the received data.

28. The method of claim 27, wherein the target server is at least one of on a different network and located at a different site from the source server.

29. The method of claim 1, wherein generating at least one of the data surrogate and the extended data surrogate is in response to at least one of an automatic trigger, a timer notification, an event notification, a poll, and a request.

30. The method of claim 29, wherein the automatic trigger includes a trigger automatically initiated in response to at least one pre-specified parameter.

31. The method of claim 30, wherein the automatic trigger includes content of at least one of the data surrogate and the extended data surrogate.

32. The method of claim 29, wherein the timer notification includes notifications corresponding to scheduled events including at least one of maintenance operations, user activities, server activities, and data population operations.

33. The method of claim 29, wherein the event notification includes notifications corresponding to changes to data of the data source.

34. The method of claim 29, wherein the request includes at least one of access attempts and configuration attempts by the users, servers or applications.

35. The method of claim 1, further comprising:

determining at least one parameter of the received data, the at least one parameter including at least one of size, age, frequency of access, and time of last access of the received data; and

replacing the received data with at least one pointer to at least one copy of the received data in the data surrogate in accordance with the parameter.

36. The method of claim 35, further comprising:

intercepting subsequent access to received data by at least one of applications, servers, and users using the at least one pointer; and

providing the subsequent access by splicing data from at least one of the data surrogate and the extended data surrogate.

37. A method comprising:

generating a number of data surrogates using information of received data and a plurality of data changes of a number of data sources, each data surrogate comprising an application consistent temporal replica of production data;

transforming data of each data surrogate from a format of a corresponding data source to at least one alternative format;

extracting original metadata of each data surrogate;

identifying relationships of the original metadata and the corresponding data surrogate;

generating new metadata based in part on identified relationships including using portions of the original metadata and components of the corresponding data surrogates;

generating a number of extended data surrogates, wherein each extended data surrogate includes corresponding new metadata and the corresponding data surrogate;

storing instances of each data surrogate and each extended data surrogate as part of preserving archive data, wherein the archiving includes active archiving, wherein active archiving includes at least one of performing at least one operation on the data surrogate and placing at least one of the data surrogate and the extended data surrogate in the at least one storage site as appropriate to a corresponding application; and

using at least one of the instances of each data surrogate and each extended data surrogate as part of restoring services.