APPLICATION-CENTRIC OBJECT CONFIGURATION

• US 20160217176A1
• Filed: 01/25/2016
• Published: 07/28/2016
• Est. Priority Date: 01/25/2015
• Status: Active Grant

• Current Assignee: Iguazio Systems Ltd.
• Original Assignee: Iguazio Systems Ltd.
• Inventors: Haviv, Yaron, Modai, Ori, Nissan-Messing, Orit
• Granted Patent: US 11,269,832 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0897 with two or more cache hierarchy levels with multilevel cache hierarchies G06F12/0811
• CPC Class Codes: G06F 16/122 using management policies backup systems G06F11/1446; file migration policies for HSM systems G06F16/185
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/174 Redundancy elimination performed by the file system management of the data involved in backup or backup restore using de-duplication of the data G06F11/14
• CPC Class Codes: G06F 16/211 Schema design and management
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 2212/60 Details of cache memory
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

Systems, methods, and related technologies for application-centric object storage and configuration are described. In certain aspects, a processing device can receive, from an application, one or more requests with respect to a data object. The processing device can process the one or more requests to determine one or more data utilization characteristics of the application with respect to the data object. The processing device can configure one or more aspects of the data object in view of the one or more data utilization characteristics.

Claims

1. A method comprising:

receiving, from an application, one or more requests with respect to a data object;

processing, by a processing device, the one or more requests to determine one or more data utilization characteristics of the application with respect to the data object; and

configuring one or more aspects of the data object in view of the one or more data utilization characteristics.

2. The method of claim 1, wherein configuring one or more aspects of the data object comprises configuring one or more aspects of a storage of the data object.

3. The method of claim 1, wherein configuring one or more aspects of the data object comprises adding one or more attributes to the one or more requests.

4. The method of claim 3, wherein the one or more attributes comprise at least one of:

a preferred data placement of one or more elements of the data object, an amount of data caching to be performed with respect to one or more elements of the data object, a priority of data caching to be performed with respect to one or more elements of the data object, or a read-ahead window to be applied with respect to one or more elements of the data object.

5. The method of claim 4, wherein configuring one or more aspects of the data object further comprises selecting a storage tier with respect to the data object in view of at least one of:

a performance of the storage tier, a speed of the storage tier, a capacity of the storage tier, a physical location of the storage tier, a geographical location of the storage tier, an access protocol associated with the storage tier, an availability of the storage tier, or one or more functional properties of the storage tier.

6. The method of claim 5, wherein the one or more functional properties of the storage tier comprise at least one of encryption or compression.

7. The method of claim 1, wherein the data object comprises one or more data objects.

8. The method of claim 7, wherein configuring one or more aspects of the data object comprises configuring one or more aspects of a storage of the one or more data objects.

9. The method of claim 8, wherein configuring one or more aspects of the storage of the one or more data objects comprises adding one or more transaction semantics and one or more identifiers to the one or more requests.

10. The method of claim 7, wherein configuring one or more aspects of the data object comprises configuring one or more aspects of a storage of at least one of the one or more data objects.

11. The method of claim 1, wherein configuring one or more aspects of the data object comprises adding one or more transaction semantics and one or more identifiers to the one or more requests.

12. The method of claim 11, further comprising:

associating the one or more requests with one or more operations; and

performing the one or more operations in a sequence as dictated by at least one of the transaction semantics or API semantics.

13. The method of claim 1, wherein configuring one or more aspects of the data object comprises providing one or more data layouts and one or more APIs with respect to the application.

14. The method of claim 13, wherein the one or more data layouts and the one or more APIs enable the application to access one or more elements of the data object based on one or more identifiers.

15. The method of claim 14, wherein the one or more identifiers comprise at least one of:

one or more record identifiers or one or more chronological identifiers.

16. The method of claim 13, wherein the one or more data layouts and the one or more APIs enable another application to access one or more elements of the data object.

17. The method of claim 1, wherein configuring one or more aspects of the data object comprises:

determining that one or more elements of the data object are redundant;

extracting the one or more elements determined to be redundant from the data object; and

storing the remaining elements of the data object.

18. The method of claim 1, wherein the one or more requests comprise one or more filtering rules and wherein configuring one or more aspects of the data object comprises providing one or more elements of the data object in view of the one or more filtering rules.

19. The method of claim 1, wherein configuring one or more aspects of the data object comprises marking one or more elements of the object with one or more tags.

20. The method of claim 19, wherein the one or more tags are generated in view of an inspection of metadata associated with the one or more requests.

21. The method of claim 19, wherein the one or more tags are generated in view of an inspection of one or more elements of the data object.

22. The method of claim 1, wherein configuring one or more aspects of the data object comprises adding one or more elements to the data object.

23. The method of claim 22, wherein the one or more elements comprise one or more fields.

24. The method of claim 22, wherein adding one or more elements to the data object comprises adding one or more fields to the data object based on a reference in the data object to the one or more fields.

25. The method of claim 1, wherein configuring one or more aspects of the data object comprises invoking one or more stored procedures with respect to the data object.

26. The method of claim 1, wherein configuring one or more aspects of the data object comprises providing one or more virtual objects with respect to the data object.

27. The method of claim 26, wherein the one or more virtual objects enable performance of the one or more requests with respect to an alternate format of the data object.

28. The method of claim 1, wherein configuring one or more aspects of the data object comprises performing the one or more requests with respect to a plurality of data objects that share one or more attributes with the data object.

29. The method of claim 1, wherein configuring one or more aspects of the data object comprises:

storing one or more first elements of the data object in a first storage resource; and

storing one or more second elements of the data object in a second storage resource.

30. The method of claim 29, wherein storing one or more first elements of the data object in a first storage resource comprises storing one or more first elements of the data object in a first storage resource based on at least one of:

a size of the one or more first elements of the data object, an access frequency of the one or more first elements of the data object, an age of the one or more first elements of the data object, a policy associated with the one or more first elements of the data object, a schedule associated with the one or more first elements of the data object, or a write frequency associated with the one or more first elements of the data object.

31. A system comprising:

a memory; and

a processing device, operatively coupled to the memory, to;

receive, from an application, one or more requests with respect to a data object;

process the one or more requests to determine one or more data utilization characteristics of the application with respect to the data object; and

configure one or more aspects of the data object in view of the one or more data utilization characteristics.

32. A non-transitory computer-readable medium having instructions encoded thereon that, when executed by a processing device, cause the processing device to:

receive, from an application, one or more requests with respect to a data object;

process, by the processing device, the one or more requests to determine one or more data utilization characteristics of the application with respect to the data object; and

configure one or more aspects of a storage of the data object in view of the one or more data utilization characteristics.