Data processing apparatus and method

• US 10,452,487 B2
• Filed: 02/23/2017
• Issued: 10/22/2019
• Est. Priority Date: 08/20/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Haustein, Nils, Kuhl, Fabian, Mueller, Christian, Mueller-Wicke, Dominic, Schreiber, Thomas
• Primary Examiner(s): Cao, Phuong Thao
• Application Number:
  US15/440,618
• Publication Number:
  US 20170161155A1
• Time in Patent Office: 971 Days
• Field of Search: 707646, 707616
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

Operating a data processing and storage apparatus to perform continuous backup monitoring for a collection of stored file system objects. In response to changes respective to a number of the file system objects, a set of Data Management Application Program Interface (DMAPI) events is created. For each of the events, accessory file system object information relative to a file system object subject to the change is determined. The events are grouped into an event group and a unique group identifier and an overall group size count are assigned to each of the events included in the event group. The events are sent together with the respective accessory file system object information, the respective group identifier and the respective group size to a number of backup clients registered as applications. The backup clients are to process the events together with the respective accessory file system object information, the respective group identifier and the respective group size into a number of backup requests.

Claims

1. A computer program product comprising a computer-readable non-transitory storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method, the method comprising:

creating, in response to changes respective to a number of file system objects, a set of events;

determining for each event of said set of events, in a file system event handling implementation, accessory file system object information relative to at least one file system object subject to a change, wherein said accessory file system object information includes a handle of said at least one file system object or a parent handle of a directory containing said at least one file system object, an event type, and a type of said at least one file system object;

grouping, by an event group assembler, the set of events into one or more event groups and for each event of a respective event group, assigning a unique group identifier of said respective event group and a number of group members in said respective event group to each event in an overall group size, wherein the overall group size is the overall number of events in said respective event group;

sending, by said file system event handling implementation, said set of events each associated with respective accessory file system object information, a respective unique group identifier and a respective overall group size to a number of backup clients registered as event listener applications to said file system event handling implementation;

processing, in one or more backup clients, said set of events each associated with respective accessory file system object information, a respective unique group identifier and a respective overall group size into a number of backup requests;

sending said number of backup requests according to a source backup operation type or a target backup operation type to a backup server for execution thereby causing the backup server to perform a backup operation according to a first backup request from the number of backup requests; and

awaiting successful completion of said backup operation.

2. The computer program product of claim 1, wherein said set of events are Data Management Application Program Interface (DMAPI) events, said file system event handling implementation is a DMAPI implementation in a file system kernel, said event group assembler is a DMAPI event group assembler, said handle and parent handle are DMAPI handles and said event listener applications are DMAPI applications.

3. The computer program product of claim 2, said processing performed by said backup clients comprising:

collecting said DMAPI events together with said respective accessory file system object information according to said respective group identifier until said respective overall group size is reached;

determining, from said DMAPI handles included in a group-wise collected accessory file system object information, at least one of a source path name and a target path name, said source path name or said target path name referencing to the at least one file system object subject to said change;

determining, for each group of DMAPI events, at least one of a source backup operation type and a target backup operation type to match with one in a set of available backup operation types including “

SEND”

, “

UPDATE” and

“

EXPIRE”

; and

creating the number of backup requests for said DMAPI event group, for said source path name or said target path name and for the source backup operation type or said target backup operation type.

4. The computer program product of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said source backup operation type to “

EXPIRE”

for causing a backup server to delete said at least one file system object referenced by the source path name from a backup data and setting the target backup operation type to “

SEND”

for causing the backup server to add said at least one file system object referenced by said target path name to the backup data when both of said source path name and said target path name have been determined for said DMAPI event group and said DMAPI event group includes;

one DMAPI event of type “

READ”

respective to a file system object of type “

FILE”

;

two DMAPI events of type “

ATTRIBUTE”

respective to file system objects of type “

DIRECTORY”

; and

one DMAPI event of type “

CLOSE”

respective to a file system object of type “

FILE”

.

5. The computer program product of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said target backup operation type to “

SEND”

for causing a backup server to add said at least one file system object referenced by said target path name to the backup data when only said target path name has been determined for the first backup request and said DMAPI event group includes;

one DMAPI event of type “

CREATE”

relative to a file system object of type “

FILE”

;

one DMAPI event of type “

ATTRIBUTE”

relative to a file system object of type “

DIR”

; and

one DMAPI event of type “

CLOSE”

relative to a file system object of type “

FILE”

.

6. The computer program product of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said target backup operation type to “

UPDATE”

for causing a backup server to update said at least one file system object referenced by said source path name and said target path name when both of said source path name and said target path name have been determined for the first backup request and said DMAPI event group includes;

one DMAPI event of type “

ATTRIBUTE”

relative to a file system object of type “

FILE”

; and

one DMAPI event of type “

CLOSE”

relative to a file system object of type “

FILE”

.

7. The computer program product of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said source backup operation type to “

EXPIRE”

for causing a backup server to expire a file system object of type “

FILE”

referenced by a source path name when only said source path name has been determined and said DMAPI event group includes one DMAPI event of type “

DESTROY”

respective to a file system object of type “

FILE”

.

8. The computer program product of claim 1, wherein said processing being performed by said backup clients further comprises:

queuing said backup requests into a backup request queue for deferred or scheduled execution;

applying, where a number of said queued backup requests has a file system object referenced by both a source path name and a target path name, a replacement policy for replacing earlier backup requests by subsequent backup request thereby un-queuing said replaced backup requests;

sending the remaining queued backup requests to a backup server for execution thereby causing the backup server to perform backup operations according to said remaining queued backup requests.

9. The computer program product of claim 8, wherein applying said replacement policy comprises grouping of the backup requests stored in said backup request queue into a number of backup request groups, each of said backup request groups containing backup requests relating to said file system object referenced by both said source path name and said target path name, thereby maintaining a queue ordering within each of said backup request groups.

10. The computer program product of claim 8, whereby applying said replacement policy comprises replacement of a preceding backup request by a subsequent backup request relative to the same file system object when:

the preceding backup request having backup request type “

UPDATE” and

the succeeding backup request having backup request type “

SEND”

;

the preceding backup request having backup request type “

SEND” and

the succeeding backup request having request backup request type “

EXPIRE”

;

the preceding backup request having backup request type “

SEND” and

the succeeding backup request having backup request type “

SEND”

;

the preceding backup request having backup request type “

UPDATE” and

the succeeding backup request having backup request type “

UPDATE”

.