Data store including a file location attribute

• US 8,656,454 B2
• Filed: 12/01/2010
• Issued: 02/18/2014
• Est. Priority Date: 12/01/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Gunawardena, Dinan Srilal, Harper, Richard, Thereska, Eno
• Primary Examiner(s): LOUIE, OSCAR A
• Application Number:
  US12/957,957
• Publication Number:
  US 20120144448A1
• Time in Patent Office: 1,175 Days
• Field of Search: None
• US Class Current: 726/1
• CPC Class Codes: G06F 16/1752 based on file chunks
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A data store including a file location attribute is described. In an embodiment, the location attribute for a data element, such as a file or database record, is stored with the bytes of data and records the geographic location of the data element. Writing to this attribute is limited to a single trusted entity, such as an operating system, to ensure that the location data can be trusted and when a data element is moved or replicated, the attribute is updated to reflect the new location of the data element. This location data is made available to users and applications by a metadata service which tracks the locations of data elements and responds to requests from users. Access control policies can been defined in terms of location and stored at the metadata service and the metadata service can then enforce these policies when responding to requests.

Claims

1. A data storage system comprising:

a data store arranged to store a plurality of data elements, each data element having an associated location attribute identifying a geographical location of the data element and wherein the location attribute is stored in a location which is co-located with the data element; and

a hardware processor configured to;

determine whether an access policy associated with a data element of the plurality of data elements is satisfied based on both a location of a user making a request regarding the data element and a location of the data element;

determine whether the access policy associated with the data element is satisfied based on a relative location of the user and the data element;

determine whether the access policy associated with the data element is satisfied based on a location of at least one other user;

determine whether the access policy associated with the data element is satisfied based on at least one of a location of the user and a location of a primary replica of the data element and, if the access policy is not satisfied, identifying a second replica of the data element, the second replica having a location which would satisfy the access policy and migrating the primary replica to the second replica, and, if the access policy is satisfied, provide contact information comprising location information for the primary replica of the data element in response to the request;

or

select a replica from a set of replicas of the data element based on a location attribute associated with each replica of the data element and provide contact information comprising location information for the selected replica of the data element in response to the request.

2. A data storage system according to claim 1, arranged such that each location attribute can only be written by a single trusted entity.

3. A data storage system according to claim 2, further comprising an operating system and wherein the operating system is arranged to write the location attribute associated with a data element and to update the location attribute when the data element is moved to a new geographical location.

4. A data storage system according to claim 1, wherein a single location attribute is associated with a group of co-located data elements.

5. A data storage system according to claim 1, further comprising a metadata service arranged to track locations of data elements and to respond to location requests received from clients.

6. A data storage system according to claim 5, wherein the metadata service is further arranged to store access control policies associated with data elements.

7. A data storage system according to claim 5, wherein the metadata service is further arranged to store data placement policies associated with data elements and to control storage of a data element in accordance with any associated data placement policy.

8. A data storage system according to claim 7, wherein the system comprises a cloud computing system and wherein the system is arranged to only store a data element in a location specified within the data element'"'"'s associated data placement policy.

9. A data storage system according to claim 1, wherein the system comprises a New Technology File System and wherein the location attribute for a data element is stored as a file location Attribute Type.

10. A data storage system according to claim 1, wherein the system comprises an SOL server, each data element comprises a database record and the location attribute for each database record is stored in a location column.

11. A method comprising:

tracking location of data elements using a location attribute associated with each data element, the location attribute identifying a geographical location of the data element and being stored with the data element;

receiving a user request to locate a data element;

making a decision, by one or more hardware processors, based on at least one of a location of the user and a location of the data element; and

based on result of the decision, providing location information for the data element in response to the user request,

wherein;

determining if an access policy associated with the data element is satisfied based on at least one of a location of the user and a location of the data element comprises;

determining if an access policy associated with the data element is satisfied based on both a location of the user and a location of the data element;

determining if an access policy associated with the data element is satisfied based on both a location of the user and a location of the data element comprises;

determining if an access policy associated with the data element is satisfied based on a relative location of the user and the data element;

determining if an access policy associated with the data element is satisfied is further based on a location of at least one other user;

making a decision based on at least one of a location of the user and a location of the data element comprises;

determining if an access policy associated with the data element is satisfied based on at least one of a location of the user and a location of a primary replica of the data element, and

if the access policy is not satisfied, identifying a second replica of the data element, the second replica having a location which would satisfy the access policy and migrating the primary replica to the second replica,

and wherein providing location information for the data element in response to the user request based on result of the decision comprises;

if the access policy is satisfied, providing contact information comprising location information for the primary replica of the data element in response to the user request;

or

making a decision based on at least one of a location of the user and a location of the data element comprises;

selecting a replica from a set of replicas of the data element based on a location attribute associated with each replica of the data element,

and wherein providing location information for the data element in response to the user request based on result of the decision comprises;

providing contact information comprising location information for the selected replica of the data element in response to the user request.

12. A method according to claim 11, wherein making a decision based on at least one of a location of the user and a location of the data element comprises:

determining if an access policy associated with the data element is satisfied based on at least one of a location of the user and a location of the data element; and

if the access policy is not satisfied, refusing access to the data element,

and wherein providing location information for the data element in response to the user request based on result of the decision comprises;

if the access policy is satisfied, providing contact information comprising location information for the data element in response to the user request.

13. A method according to claim 11, wherein determining if an access policy associated with the data element is satisfied based on at least one of a location of the user and a location of the data element comprises:

determining if an access policy associated with the data element is satisfied based on both a location of the user and a location of the data element.

14. A method according to claim 13, wherein determining if an access policy associated with the data element is satisfied based on both a location of the user and a location of the data element comprises:

determining if an access policy associated with the data element is satisfied based on a relative location of the user and the data element.

15. A method according to claim 11, wherein determining if an access policy associated with the data element is satisfied is further based on a location of at least one other user.

16. A method according to claim 11, wherein making a decision based on at least one of a location of the user and a location of the data element comprises:

determining if an access policy associated with the data element is satisfied based on at least one of a location of the user and a location of a primary replica of the data element; and

if the access policy is not satisfied, identifying a second replica of the data element, the second replica having a location which would satisfy the access policy and migrating the primary replica to the second replica;

and wherein providing location information for the data element in response to the user request based on result of the decision comprises;

if the access policy is satisfied, providing contact information comprising location information for the primary replica of the data element in response to the user request.

17. A method according to claim 11, wherein making a decision based on at least one of a location of the user and a location of the data element comprises:

selecting a replica from a set of replicas of the data element based on a location attribute associated with each replica of the data element,

and wherein providing location information for the data element in response to the user request based on result of the decision comprises;

providing contact information comprising location information for the selected replica of the data element in response to the user request.

18. A data storage system comprising:

a data store arranged to store a plurality of data elements, each data element comprising a location attribute identifying a geographical location of the data element;

a metadata service arranged to provide access to location attribute data in response to requests received from other entities;

a hardware processor;

a memory arranged to store executable instructions, which when executed, cause the processor to write data representative of the geographical location of a data element to the location attribute within the data element and to prevent other software programs from writing to the location attribute within a data element,

the processor being configured to;

determine whether an access policy associated with a data element of the plurality of data elements is satisfied based on both a location of an entity of the other entities making a request regarding the data element and a location of the data element;

determine whether the access policy associated with the data element is satisfied based on a relative location of the entity and the data element;

determine whether the access policy associated with the data element is satisfied based on a location of at least one other entity;

determine whether the access policy associated with the data element is satisfied based on at least one of a location of the entity and a location of a primary replica of the data element and, if the access policy is not satisfied, identifying a second replica of the data element, the second replica having a location which would satisfy the access policy and migrating the primary replica to the second replica, and, if the access policy is satisfied, provide contact information comprising location information for the primary replica of the data element in response to the request;

or

select a replica from a set of replicas of the data element based on a location attribute associated with each replica of the data element and provide contact information comprising location information for the selected replica of the data element in response to the request.

19. A data storage system according to claim 18, wherein the metadata service is further arranged to store an access control policy for a data element, the policy being defined in terms of geographical location of the data element and at least one of the data store and the metadata service being arranged to control access to data elements in accordance with the access control policy.

20. A data storage system according to claim 18, wherein the metadata service is further arranged to store a data placement policy for a data element, the policy being defined in terms of geographical location of the data element and at least one of the data store and the metadata service being arranged to control storage of data elements in accordance with the data placement policy.