Data processing apparatus and method

• US 9,665,439 B2
• Filed: 08/18/2015
• Issued: 05/30/2017
• Est. Priority Date: 08/20/2014
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Haustein, Nils, Kuhl, Fabian, Mueller, Christian, Mueller-Wicke, Dominic, Schreiber, Thomas
• Primary Examiner(s): Cao, Phuong Thao
• Application Number:
  US14/829,117
• Publication Number:
  US 20160055065A1
• Time in Patent Office: 651 Days
• Field of Search: 707646
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/182 Distributed file systems

Abstract

Operating a data processing and storage apparatus to perform continuous backup monitoring for a collection of stored file system objects. In response to changes respective to a number of the file system objects, a set of Data Management Application Program Interface (DMAPI) events is created. For each of the events, accessory file system object information relative to a file system object subject to the change is determined. The events are grouped into an event group and a unique group identifier and an overall group size count are assigned to each of the events included in the event group. The events are sent together with the respective accessory file system object information, the respective group identifier and the respective group size to a number of backup clients registered as applications. The backup clients are to process the events together with the respective accessory file system object information, the respective group identifier and the respective group size into a number of backup requests.

Claims

1. A method for operating a data processing and storage apparatus to perform continuous file system object monitoring and backup operations for a collection of file system objects stored in a file system, said method comprising:

creating, in response to changes respective to a number of said file system objects, a set of events;

determining for each event of said set of events, in a file system event handling implementation, accessory file system object information relative to at least one file system object subject to a change, wherein said accessory file system object information includes a handle of said at least one file system object or a parent handle of a directory containing said at least one file system object, an event type, and a type of said at least one file system object;

grouping, by an event group assembler, the set of events into one or more event groups and for each event in a respective event group, assigning a unique group identifier of said respective event group and a number of group members in said respective event group as an overall group size;

sending, by said file system event handling implementation, said set of events each associated with respective accessory file system object information, a respective unique group identifier and a respective overall group size to a number of backup clients registered as event listener applications to said file system event handling implementation; and

processing, in one or more backup clients, said set of events each associated with respective accessory file system object information, a respective unique group identifier and a respective overall group size into a number of backup requests;

sending said number of backup requests according to a source backup operation type or a target backup operation type to a backup server for execution thereby causing the backup server to perform a backup operation according to a first backup request from the number of backup requests; and

awaiting successful completion of said backup operation.

2. The method of claim 1, wherein said set of events are Data Management Application Program Interface (DMAPI) events, said file system event handling implementation is a DMAPI implementation in a file system kernel, said event group assembler is a DMAPI event group assembler, said handle and parent handle are DMAPI handles and said event listener applications are DMAPI applications.

3. The method of claim 2, said processing performed by said backup clients comprising:

collecting said DMAPI events together with said respective accessory file system object information according to said respective group identifier until said respective overall group size is reached;

determining, from said DMAPI handles included in a group-wise collected accessory file system object information, at least one of a source path name and a target path name, said source path name or said target path name referencing to the at least one file system object subject to said change;

determining, for each group of DMAPI events, at least one of a source backup operation type and a target backup operation type to match with one in a set of available backup operation types including “

SEND”

, “

UPDATE” and

“

EXPIRE”

; and

creating the number of backup requests for said DMAPI event group, for said source path name or said target path name and for the source backup operation type or said target backup operation type.

4. The method of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said source backup operation type to “

EXPIRE”

for causing a backup server to delete said at least one file system object referenced by the source path name from a backup data and setting the target backup operation type to “

SEND”

for causing the backup server to add said at least one file system object referenced by said target path name to the backup data when both of said source path name and said target path name have been determined for said DMAPI event group and said DMAPI event group includes;

one DMAPI event of type “

READ”

respective to a file system object of type “

FILE”

;

two DMAPI events of type “

ATTRIBUTE”

respective to file system objects of type “

DIRECTORY”

; and

one DMAPI event of type “

CLOSE”

respective to a file system object of type “

FILE”

.

5. The method of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said target backup operation type to “

SEND”

for causing a backup server to add said at least one file system object referenced by said target path name to the backup data when only said target path name has been determined for the first backup request and said DMAPI event group includes;

one DMAPI event of type “

CREATE”

relative to a file system object of type “

FILE”

;

one DMAPI event of type “

ATTRIBUTE”

relative to a file system object of type “

DIR”

; and

one DMAPI event of type “

CLOSE”

relative to a file system object of type “

FILE”

.

6. The method of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said target backup operation type to “

UPDATE”

for causing a backup server to update said at least one file system object referenced by said source path name and said target path name when both of said source path name and said target path name have been determined for the first backup request and said DMAPI event group includes;

one DMAPI event of type “

ATTRIBUTE”

relative to a file system object of type “

FILE”

; and

one DMAPI event of type “

CLOSE”

relative to a file system object of type “

FILE”

.

7. The method of claim 3, wherein determining said source backup operation type and said target backup operation type comprises setting said source backup operation type to “

EXPIRE”

for causing a backup server to expire a file system object of type “

FILE”

referenced by a source path name when only said source path name has been determined and said DMAPI event group includes one DMAPI event of type “

DESTROY”

respective to a file system object of type “

FILE”

.

8. The method of claim 1, wherein said processing being performed by said backup clients further comprises:

queuing said backup requests into a backup request queue for deferred or scheduled execution;

applying, where a number of said queued backup requests has a file system object referenced by both a source path name and a target path name, a replacement policy for replacing earlier backup requests by subsequent backup request thereby un-queuing said replaced backup requests;

sending the remaining queued backup requests to a backup server for execution thereby causing the backup server to perform backup operations according to said remaining queued backup requests.

9. The method of claim 8, wherein applying said replacement policy comprises grouping of the backup requests stored in said backup request queue into a number of backup request groups, each of said backup request groups containing backup requests relating to said file system object referenced by both said source path name and said target path name, thereby maintaining a queue ordering within each of said backup request groups.

10. The method of claim 8, whereby applying said replacement policy comprises replacement of a preceding backup request by a subsequent backup request relative to the same file system object when:

the preceding backup request having backup request type “

UPDATE” and

the succeeding backup request having backup request type “

SEND”

;

the preceding backup request having backup request type “

SEND” and

the succeeding backup request having request backup request type “

EXPIRE”

;

the preceding backup request having backup request type “

SEND” and

the succeeding backup request having backup request type “

SEND”

;

the preceding backup request having backup request type “

UPDATE” and

the succeeding backup request having backup request type “

UPDATE”

.

11. A data processing and storage apparatus having a file system storing a number of file system objects, a Data Management Application Program Interface (DMAPI) implementation, a DMAPI event group assembler and a number of backup clients, said number of backup clients being registered as DMAPI applications, said data processing and storage apparatus comprising a computer readable non-transitory storage medium further being configured for:

creating, in response to changes respective to a number of said file system objects in said file system, a set of DMAPI events;

determining for each DMAPI event of the set of DMAPI events, in said DMAPI implementation, accessory file system object information relative to at least one file system object subject to a change, wherein said accessory file system object information includes a DMAPI handle of said at least one file system object or a parent DMAPI handle of a directory containing said at least one file system object, an DMAPI event type, and a type of said at least one file system object;

grouping, in said DMAPI event group assembler, a subset of DMAPI events into a DMAPI event group, and assigning a unique group identifier and a number of group members as an overall group size to each of said DMAPI events included in said DMAPI event group;

sending, by said DMAPI implementation, said subset of DMAPI events each associated with respective accessory file system object information, a respective unique group identifier and a respective overall group size to the number of backup clients registered as DMAPI applications; and

processing, by said number of backup clients registered as DMAPI applications, said subset of DMAPI events each associated with respective accessory file system object information, a respective group identifier and a respective overall group size into a number of backup requests;

sending said number of backup requests according to a source backup operation type or a target backup operation type to a backup server for execution thereby causing the backup server to perform a backup operation according to said number of backup requests; and

awaiting successful completion of said backup operation.

12. The data processing and storage apparatus of claim 11, said backup clients further being configured for processing said DMAPI events into said number of backup requests by:

collecting said DMAPI events together with said respective accessory file system object information according to said respective group identifier up to said respective overall group size;

determining, from a DMAPI handle and a DMAPI parent handle included in a group wise collected accessory file system object information, at least one of a source path name and a target path name, said source path name or said target path name referencing said at least one file system objects subject to said change;

determining, for each group of DMAPI events, a number of backup operation types, each thereof matching with one in a set of available backup operation types including “

SEND”

, “

UPDATE” and

“

EXPIRE”

; and

creating said number of backup requests for said DMAPI event group, for said source path name, said target path name, and said set of available backup operation types.