Methods and systems for managing data

• US 9,201,491 B2
• Filed: 08/28/2013
• Issued: 12/01/2015
• Est. Priority Date: 06/25/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Arrouye, Yan, Giampaolo, Dominic, Carol, Andrew
• Primary Examiner(s): LE, UYEN T
• Application Number:
  US14/012,232
• Publication Number:
  US 20140068295A1
• Time in Patent Office: 825 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 1/329 by task scheduling
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/168 Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs query results presentation G06F16/156
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures

Abstract

Systems and methods for managing data, such as metadata or indexes for index databases. In one exemplary method, different processing priorities are assigned to different indexing tasks based upon the origin of the task. In another exemplary method, indexing tasks are processed in a first mode when a data processing system is in a first power state and indexing tasks are processed in a second mode when the data processing system is in a second power state.

Claims

1. A machine implemented method of processing data using one or more processors, the method comprising:

receiving requests for a plurality of indexing operations to index one or more files, wherein the requested indexing operations are required as a result of one of either a first occurrence or a second occurrence;

grouping the requested indexing operations into a first indexing queue and a second indexing queue based on whether the requested indexing operations are required as a result of the first occurrence or the second occurrence, wherein the requested indexing operations required as a result of the first occurrence are grouped into the first indexing queue and the requested indexing operations required as a result of the second occurrence are grouped into the second indexing queue;

determining whether a data processing system is in a high power state or a low power state; and

performing, when the data processing system is in the low power state, the requested indexing operations in the first indexing queue at a first priority and the requested indexing operations in the second indexing queue at a second priority different than the first priority.

2. A method as in claim 1 further comprising performing indexing operations from the second indexing queue for no more than a predetermined period of time after a last user action in a set of predefined user actions.

3. A method as in claim 2, wherein the set of predefined user actions does not comprise merely cursor movements.

4. A method as in claim 1, wherein the data processing system is in the low power state when it is powered by a battery.

5. A method as in claim 1, wherein the first priority is higher than the second priority.

6. A non-transitory machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving requests for a plurality of indexing operations to index one or more files, wherein the requested indexing operations are required as a result of one of either a first occurrence or a second occurrence;

grouping the requested indexing operations into a first indexing queue and a second indexing queue based on whether the requested indexing operations are required as a result of the first occurrence or the second occurrence, wherein the requested indexing operations required as a result of the first occurrence are grouped into the first indexing queue and the requested indexing operations required as a result of the second occurrence are grouped into the second indexing queue;

determining whether a data processing system is in a high power state or a low power state; and

performing, when the data processing system is in the low power state, the requested indexing operations in the first indexing queue at a first priority and the requested indexing operations in the second indexing queue at a second priority different than the first priority.

7. A medium as in claim 6 further comprising performing indexing operations from the second indexing queue for no more than a predetermined period of time after a last user action in a set of predefined user actions.

8. A medium as in claim 7, wherein the set of predefined user actions does not comprise merely cursor movements.

9. A medium as in claim 6, wherein the first priority is higher than the second priority.

10. A medium as in claim 6, wherein the data processing system is in the low power state when it is powered by a battery.

11. A data processing system comprising:

means for receiving requests for a plurality of indexing operations to index one or more files, wherein the requested indexing operations are required as a result of one of either a first occurrence or a second occurrence;

means for grouping the requested indexing operations into a first indexing queue and a second indexing queue based on whether the requested indexing operations are required as a result of the first occurrence or the second occurrence, wherein the requested indexing operations required as a result of the first occurrence are grouped into the first indexing queue and the requested indexing operations required as a result of the second occurrence are grouped into the second indexing queue;

means for determining whether a data processing system is in a high power state or a low power state;

means for performing, when the data processing system is in the low power state, the requested indexing operations in the first indexing queue at a first priority and the requested indexing operations in the second indexing queue at a second priority different than the first priority.

12. A system as in claim 11 further comprising performing indexing operations from the second indexing queue for no more than a predetermined period of time after a last user action in a set of predefined user actions.

13. A system as in claim 12, wherein the set of predefined user actions does not comprise merely cursor movements.

14. A system as in claim 11, wherein the data processing system is in the low power state when it is powered by a battery.

15. A system as in claim 11, wherein the first priority is higher than the second priority.

16. A machine implemented method for processing data using one or more processors, the method comprising:

receiving requests for a plurality of indexing operations to index one or more files, wherein the requested indexing operations are required as a result of one of either a first occurrence or a second occurrence;

determining whether a data processing system is in a high power state or a low power state; and

performing, in response to determining the data processing system is in the low power state, the requested indexing operations in a first indexing queue before the requested indexing operations in a second indexing queue, wherein the requested indexing operations are grouped in the first indexing queue based on being required as a result of the first occurrence and the requested indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.

17. A method as in claim 16, wherein when performing indexing operations required as a result of the second occurrence, indexing is performed for no more than a predetermined period of time after a last user action in a set of predefined user actions.

18. A method as in claim 17, wherein the set of predefined user actions does not comprise merely cursor movements.

19. A non-transitory machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method for processing data, the method comprising:

receiving requests for a plurality of indexing operations to index one or more files, wherein the requested indexing operations are required as a result of one of either a first occurrence or a second occurrence;

determining whether a data processing system is in a high power state or a low power state; and

performing, in response to determining the data processing system is in the low power state, the requested indexing operations in a first indexing queue before the requested indexing operations in a second indexing queue, wherein the requested indexing operations are grouped in the first indexing queue based on being required as a result of the first occurrence and the requested indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.

20. A medium as in claim 19, wherein when performing indexing operations required as a result of the second occurrence, indexing is performed for no more than a predetermined period of time after a last user action in a set of predefined user actions.

21. A medium as in claim 20, wherein the set of predefined user actions does not comprise merely cursor movements.

22. A data processing system comprising:

means for receiving requests for a plurality of indexing operations to index one or more files, wherein the requested indexing operations are required as a result of one of either a first occurrence or a second occurrence;

means for determining whether a data processing system is in a high power state or a low power state; and

means for performing, in response to determining the data processing system is in the low power state, the requested indexing operations in a first indexing queue before the requested indexing operations in a second indexing queue, wherein the requested indexing operations are grouped in the first indexing queue based on being required as a result of the first occurrence and the requested indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.

23. A system as in claim 22, wherein when performing indexing operations required as a result of the second occurrence, indexing is performed for no more than a predetermined period of time after a last user action in a set of predefined user actions.

24. A system as in claim 23, wherein the set of predefined user actions does not comprise merely cursor movements.

25. A machine implemented method for processing data using one or more processors, the method comprising:

determining whether a data processing system is in a high power consumption state or a low power consumption state;

determining whether, in response to determining the data processing system is in the low power consumption state, an indexing operation is of a first type or a second type, wherein the indexing operation is of the first type when the indexing operation is required as a result of a first occurrence, and wherein the indexing operation is of the second type when the indexing operation is required as a result of a second occurrence;

performing indexing at a first priority if the indexing operation is of the first type; and

performing indexing at a second priority if the indexing operation is of the second type, wherein the first priority is a higher priority than the second priority.

26. A method as in claim 25, wherein the first occurrence includes a contemporaneous change by a user to a file, and wherein the second occurrence includes an initial index of a volume or a reindex of a removable volume having files that have been modified since the removable volume was last mounted by the data processing system.

27. A method as in claim 26, wherein the data processing system is in the low power consumption state when it is powered by a battery.

28. A non-transitory machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method for processing data, the method comprising:

determining whether a data processing system is in a high power consumption state or a low power consumption state;

determining whether, in response to determining the data processing system is in the low power consumption state, an indexing operation is of a first type or a second type, wherein the indexing operation is of the first type when the indexing operation is required as a result of a first occurrence, and wherein the indexing operation is of the second type when the indexing operation is required as a result of a second occurrence;

performing indexing at a first priority if the indexing operation is of the first type; and

performing indexing at a second priority if the indexing operation is of the second type, wherein the first priority is a higher priority than the second priority.

29. A medium as in claim 28, wherein the first occurrence includes a result of a contemporaneous change by a user to a file, and wherein the second occurrence includes an initial index of a volume or a reindex of a removable volume having files that have been modified since the removable volume was last mounted by the data processing system.

30. A medium as in claim 29, wherein the data processing system is in the low power consumption state when it is powered by a battery.

31. A data processing system comprising:

means for determining whether a data processing system is in a high power consumption state or a low power consumption state;

means for determining whether, in response to determining the data processing system is in the low power consumption state, an indexing operation is of a first type or a second type, wherein the indexing operation is of the first type when the indexing operation is required as a result of a first occurrence, and wherein the indexing operation is of the second type when the indexing operation is required as a result of a second occurrence;

means for performing indexing at a first priority if the indexing operation is of the first type; and

means for performing indexing at a second priority if the indexing operation is of the second type, wherein the first priority is a higher priority than the second priority.

32. A system as in claim 31, wherein the first occurrence includes a contemporaneous change by a user to a file, and wherein the second occurrence includes an initial index of a volume or a reindex of a removable volume having files that have been modified since the removable volume was last mounted by the data processing system.

33. A system as in claim 32, wherein the data processing system is in the low power consumption state when it is powered by a battery.

34. A non-transitory machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method for processing data, the method comprising:

determining whether a data processing system is in a high power consumption state or a low power consumption state;

determining whether, in response to determining the data processing system is in the low power consumption state, an operation to add metadata of a file to a metadata database is of a first type or a second type, wherein the operation to add metadata is of the first type when the operation is required as a result of a first occurrence, and wherein the operation to add metadata is of the second type when the operation is required as a result of a second occurrence;

performing an adding of metadata at a first priority if the operation is of the first type; and

performing an adding of metadata at a second priority if the operation is of the second type, wherein the first priority is a higher priority than the second priority.

35. A medium as in claim 34, wherein the first occurrence includes a contemporaneous change by a user to a file, and wherein the second occurrence includes an initial importation or reimportation of a volume.

36. A medium as in claim 35, wherein the data processing system is in the low power consumption state when it is powered by a battery.

37. A machine implemented method of processing data using one or more processors, the method comprising:

receiving an indication that a data processing system is in either a high power state or a low power state; and

determining how to process indexing tasks in response to the indication, wherein the indexing tasks are grouped into a first indexing queue and a second indexing queue based on whether the indexing tasks are required as a result of a first occurrence or a second occurrence, wherein the indexing tasks required as a result of the first occurrence are grouped into the first indexing queue and the indexing tasks required as a result of the second occurrence are grouped into the second indexing queue, and wherein when the indication is that the data processing system is in the low power state, the indexing tasks in the first indexing queue are to be processed at a first priority and the indexing tasks in the second indexing queue are to be processed at a second priority different than the first priority.

38. A method as in claim 37, wherein the determining is performed automatically and causes indexing tasks to be processed from different indexing queues in response to the indication that the data processing system is in the low power state.

39. A method as in claim 37, wherein the indication comprises one or more indicators which specify at least one of:

(a) the data processing system is powered by only battery power;

or (b) a battery charge.

40. A method as in claim 37, wherein the determining comprises assigning different priorities to different indexing tasks stored in different indexing queues stored on a non-volatile storage.

41. A method as in claim 37, wherein determining how to process indexing tasks comprises at least one of determining to coalesce a plurality of notifications to index files or determining whether indexing is required for a mounted storage device.

42. A non-transitory machine readable medium providing executable instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving an indication that a data processing system is in either a high power state or a low power state; and

determining how to process indexing tasks in response to the indication, wherein the indexing tasks are grouped into a first indexing queue and a second indexing queue based on whether the indexing tasks are required as a result of a first occurrence or a second occurrence, wherein the indexing tasks required as a result of the first occurrence are grouped into the first indexing queue and the indexing tasks required as a result of the second occurrence are grouped into the second indexing queue, and wherein when the indication is that the data processing system is in the low power state, the indexing tasks in the first indexing queue are to be processed at a first priority and the indexing tasks in the second indexing queue are to be processed at a second priority different than the first priority.

43. A medium as in claim 42, wherein the determining is performed automatically and causes indexing tasks to be processed from different indexing queues in response to the indication that the data processing system is in the low power state.

44. A medium as in claim 42, wherein the indication comprises one or more indicators which specify at least one of:

(a) the data processing system is powered by only battery power;

or (b) a battery charge level.

45. A medium as in claim 42, wherein the determining comprises assigning different priorities to different indexing tasks stored in different indexing queues stored on a non-volatile storage.

46. A medium as in claim 42, wherein determining how to process indexing tasks comprises at least one of determining to coalesce a plurality of notifications to index files or determining whether indexing is required for a mounted storage device.

47. A data processing system comprising:

means for receiving an indication that a data processing system is in either a high power state or a low power state; and

means for determining how to process indexing tasks in response to the indication, wherein the indexing tasks are grouped into a first indexing queue and a second indexing queue based on whether the indexing tasks are required as a result of a first occurrence or a second occurrence, wherein the indexing tasks required as a result of the first occurrence are grouped into the first indexing queue and the indexing tasks required as a result of the second occurrence are grouped into the second indexing queue, and wherein when the indication is that the data processing system is in the low power state, the indexing tasks in the first indexing queue are to be processed at a first priority and the indexing tasks in the second indexing queue are to be processed at a second priority different than the first priority.

48. A data processing system as in claim 47, wherein the determining is performed automatically and causes indexing tasks to be processed from different indexing queues in response to the indication that the data processing system is in the low power state.

49. A data processing system as in claim 47, wherein the indication comprises one or more indicators which specify at least one of:

(a) the data processing system is powered by only battery power;

or (b) a battery charge level.

50. A data processing system as in claim 47, wherein the determining comprises assigning different priorities to different indexing tasks stored in different indexing queues stored on a non-volatile storage.

51. A data processing system as in claim 47, wherein determining how to process indexing tasks comprises at least one of determining to coalesce a plurality of notifications to index files or determining whether indexing is required for a mounted storage device.

52. A machine implemented method of processing data using one or more processors, the method comprising:

receiving requests for a plurality of indexing operations to index one or more files stored on a storage device;

determining whether a data processing system is in a high power state or a low power state;

determining, in response to determining the data processing system is in the low power state, storage locations of files to be indexed on the storage device, the files being listed in at least one of a first or a second indexing queue, wherein the files are listed in the first indexing queue when the requested indexing operation is required as a result of a first occurrence, and wherein the files are listed in the second indexing queue when the requested indexing operation is required as a result of a second occurrence; and

determining a sequence of indexing based on the storage locations.

53. A method as in claim 52, wherein the sequence attempts to reduce power consumption of the data processing system.

54. A method as in claim 52, wherein the sequence continues to index files on a spinning storage media of the storage device before starting to spin another storage media.

55. A method as in claim 52, wherein the sequence continues to index files in a partition of a storage volume of the storage device before starting to index files in another partition of the storage volume.

56. A method as in claim 52, wherein the sequence continues to index files of a first user before starting to index files of another user.

57. A non-transitory machine readable medium providing executable instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving requests for a plurality of indexing operations to index one or more files stored on a storage device;

determining whether a data processing system is in a high power state or a low power state;

determining, in response to determining the data processing system is in the low power state, storage locations of files to be indexed on the storage device, the files being listed in at least one of a first or a second indexing queue, wherein the files are listed in the first indexing queue when the requested indexing operation is required as a result of a first occurrence, and wherein the files are listed in the second indexing queue when the requested indexing operation is required as a result of a second occurrence; and

determining a sequence of indexing based on the storage locations.

58. A medium as in claim 57, wherein the sequence attempts to reduce power consumption of the data processing system.

59. A medium as in claim 57, wherein the sequence continues to index files on a spinning storage media of the storage device before starting to spin another storage media.

60. A medium as in claim 57, wherein the sequence continues to index files in a partition of a storage volume of the storage device before starting to index files in another partition of the storage volume.

61. A medium as in claim 57, wherein the sequence continues to index files of a first user before starting to index files of another user.

62. A data processing system comprising:

means for receiving requests for a plurality of indexing operations to index one or more files stored on a storage device;

means for determining whether a data processing system is in a high power state or a low power state;

means for determining, in response to determining the data processing system is in the low power state, storage locations of files to be indexed on the storage device, the files being listed in at least one of a first or a second indexing queue, wherein the files are listed in the first indexing queue when the requested indexing operation is required as a result of a first occurrence, and wherein the files are listed in the second indexing queue when the requested indexing operation is required as a result of a second occurrence; and

means for determining a sequence of indexing based on the storage locations.

63. A data processing system as in claim 62, wherein the sequence attempts to reduce power consumption of the data processing system.

64. A data processing system as in claim 62, wherein the sequence continues to index files on a spinning storage media of the storage device before starting to spin another storage media.

65. A data processing system as in claim 62, wherein the sequence continues to index files in a partition of a storage volume of the storage device before starting to index files in another partition of the storage volume.

66. A data processing system as in claim 62, wherein the sequence continues to index files of a first user before starting to index files of another user.

67. A machine implemented method of processing data using one or more processors, the method comprising:

storing data on a storage device of a data processing system; and

receiving, through a port coupled to the storage device, at least one command to cause indexing of data stored on the storage device based, at least in part, on a power state of the data processing system, wherein indexing the data stored on the storage device includes;

determining whether the data processing system is in a high power state or a low power state, and

performing, in response to determining the data processing system is in the low power state, indexing operations in a first indexing queue at a first priority and indexing operations in a second indexing queue at a second priority different than the first priority, wherein the indexing operations are grouped in the first indexing queue based on being required as a result of a first occurrence, and wherein the indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.

68. A method as in claim 67, wherein the storage device is a storage volume, and wherein the port is to couple to another data processing system which includes another storage device which is another storage volume which is indexed based, at least in part, on a power state of the another data processing system.

69. A method as in claim 68, wherein the data processing system is capable of being powered by only battery power, and wherein the another data processing system is powered by AC power.

70. A non-transitory machine readable medium providing executable instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

storing data on a storage device of a data processing system; and

receiving, through a port coupled to the storage device, at least one command to cause indexing of data stored on the storage device based, at least in part, on a power state of the data processing system, wherein indexing the data stored on the storage device includes;

determining whether the data processing system is in a high power state or a low power state, and

performing, in response to determining the data processing system is in the low power state, indexing operations in a first indexing queue at a first priority and indexing operations in a second indexing queue at a second priority different than the first priority, wherein the indexing operations are grouped in the first indexing queue based on being required as a result of a first occurrence, and wherein the indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.

71. A medium as in claim 70, wherein the storage device is a storage volume and, wherein the port is to couple to another data processing system which includes another storage device which is another storage volume which is indexed based, at least in part, on a power state of the another data processing system.

72. A medium as in claim 71, wherein the data processing system is capable of being powered by only battery power, and wherein the another data processing system is powered by AC power.

73. A data processing system comprising:

means for storing data on a storage device of a data processing system; and

means for receiving, through a port coupled to the storage device, at least one command to cause indexing of data stored on the storage device based, at least in part, on a power state of the data processing system, wherein indexing the data stored on the storage device includes;

determining whether the data processing system is in a high power state or a low power state, and

performing, in response to determining the data processing system is in the low power state, indexing operations in a first indexing queue at a first priority and indexing operations in a second indexing queue at a second priority different than the first priority, wherein the indexing operations are grouped in the first indexing queue based on being required as a result of a first occurrence, and wherein the indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.

74. A data processing system as in claim 73, wherein the storage device is a storage volume, and wherein the port is to couple to another data processing system which includes another storage device which is another storage volume which is indexed based, at least in part, on a power state of the another data processing system.

75. A data processing system as in claim 74, wherein the data processing system is capable of being powered by only battery power, and wherein the another data processing system is powered by AC power.

76. A machine implemented method of processing data using one or more processors, the method comprising:

storing data on a first storage volume of a first data processing system; and

receiving, through a port of the first data processing system coupled to a second data processing system which has a second storage volume, at least one command to cause indexing of data stored on the first storage volume based, at least in part, on a power state of at least one of the first data processing system or the second data processing system, wherein indexing the data stored on the first storage volume includes;

determining whether one or more of the first data processing system or the second data processing system is in a high power state or a low power state, and

performing, in response to determining that one or more of the first data processing system or the second data processing system is in the low power state, indexing operations in a first indexing queue at a first priority and indexing operations in a second indexing queue at a second priority different than the first priority, wherein the indexing operations are grouped in the first indexing queue based on being required as a result of a first occurrence, and wherein the indexing operations are grouped in the second indexing queue based on being required as a result of the second occurrence.