Methods and systems for managing data

• US 20060031263A1
• Filed: 04/22/2005
• Published: 02/09/2006
• Est. Priority Date: 06/25/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Carol, Andrew, Giampaolo, Dominic, Arrouye, Yan
• Granted Patent: US 7,693,856 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/164 File meta data generation
• CPC Class Codes: G06F 16/90335 Query processing
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation

Abstract

Systems and methods for managing data, such as metadata or indexes of content of files. In one exemplary method, notifications to update a metadata database or an index database are combined into a combined notification. According to other aspects, an order among logical locations on a storage device is determined in order to specify a sequence for scanning for files to be indexed. According to another aspect, a method includes determining whether to index a file based on a path name of the file relative to a plurality of predetermined path names.

Claims

1. A machine implemented method of processing data, the method comprising:

combining notifications into a combined notification for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the combined notification.

2. A method as in claim 1 wherein, in the metadata database, the type of information in metadata for files of a first type differs from the type of information in metadata for files of a second type.

3. A method as in claim 2 further comprising:

filtering the notifications before the combining of notifications, wherein notifications for files that are not to be indexed are prevented from causing the metadata database to be updated.

4. A method as in claim 3 wherein the filtering is based on a file pathname of the file and a plurality of predetermined pathnames.

5. A method as in claim 1 wherein each of the notifications indicate a creation or modification of a file on a storage device and is provided by an operating system component.

6. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

combining notifications into a combined notification for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the combined notification.

7. A medium as in claim 6 wherein, in the metadata database, the type of information in metadata for files of a first type differs from the type of information in metadata for files of a second type.

8. A medium as in claim 7, the method further comprising:

filtering the notifications before the combining of notifications, wherein notifications for files that are not to be indexed are prevented from causing the metadata database to be updated.

9. A medium as in claim 8 wherein the filtering is based on a file pathname of the file and a plurality of predetermined pathnames.

10. A medium as in claim 6 wherein each of the notifications indicate a creation or modification of a file on a storage device and is provided by an operating system component.

11. A data processing system comprising:

means for combining notifications into a combined notification for updating a metadata database;

means for updating the metadata database after receiving the combined notification.

12. A system as in claim 11 wherein, in the metadata database, the type of information in metadata for files of a first type differs from the type of information in metadata for files of a second type.

13. A system as in claim 12 further comprising:

means for filtering the notifications before the combining of notifications, wherein notifications for files that are not to be indexed are prevented from causing the metadata database to be updated.

14. A system as in claim 13 wherein the filtering is based on a file pathname of the file and a plurality of predetermined pathnames.

15. A system as in claim 11 wherein each of the notifications indicate a creation as modification of a file on a storage device and is provided by an operating system component.

16. A machine implemented method of processing data, the method comprising:

grouping a first set of notifications into a second set of notifications for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the second set of notifications.

17. A method as in claim 16 wherein the second set is smaller than the first set which is at least two notifications while the second set is two or less than two.

18. A method as in claim 16 wherein, in the metadata database, the type of information in metadata for files of a first type differs from the type of information in metadata for files of a second type.

19. A method as in claim 16 wherein the grouping is in response to determining that files identified by the first set of notifications are part of a package.

20. A method as in claim 16 wherein each of the notifications indicate a creation or modification of a file on a storage device and is provided by an operating system component.

21. A method as in claim 16 further comprising:

filtering the first set of notifications before the grouping of notifications, wherein notifications for files that are not to be indexed are prevented from causing the metadata database to be updated.

22. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

processing a first set of notifications into a second set of notifications for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the second set of notifications.

23. A medium as in claim 22 wherein the second set is smaller than the first set which is at least two notifications while the second set is two or less than two and wherein the processing comprises a grouping.

24. A medium as in claim 22 wherein, in the metadata database, the type of information in metadata for files of a first type differs from the type of information in metadata for files of a second type.

25. A medium as in claim 22 wherein the processing is in response to determining that files identified by the first set of notifications are part of a package.

26. A medium as in claim 22 wherein each of the notifications indicate a creation or modification of a file on a storage device and is provided by an operating system component.

27. A medium, as in claim 22, the method further comprising:

filtering the first set of notifications before the processing of notifications, wherein notifications for files that are not to be indexed are prevented from causing the metadata database to be updated.

28. A data processing system comprising:

means for processing a first set of notifications into a second set of notifications for updating a metadata database or an index database;

means for updating the metadata database or the index database after receiving the second set of notifications.

29. A system as in claim 28 wherein the second set is smaller than the first set which is at least two notifications while the second set is two or less than two.

30. A system as in claim 28 wherein, in the metadata database, the type of information in metadata for files of a first type differs from the type of information in metadata for files of a second type.

31. A system as in claim 28 wherein the grouping is in response to determining that files identified by the first set of notifications are part of a package.

32. A system as in claim 28 wherein each of the notifications indicate a creation or modification of a file on a storage device and is provided by an operating system component.

33. A system as in claim 28 further comprising:

means for filtering the first set of notifications before the grouping of notifications, wherein notifications for files that are not to be indexed are prevented from causing the metadata database to be updated.

34. A machine implemented method of processing data, the method comprising:

determining that a group of related objects has been stored onto a storage medium;

in response to the determining, creating a set of notifications for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the set of notifications.

35. A method as in claim 34 wherein the set of notifications is only one notification and the notification indicates a creation or modification of a file on a storage device and is provided by an operating system component.

36. A method as in claim 34 wherein, in the metadata database, a type of information in metadata for files of a first type differs from a type of information in metadata for files of a second type.

37. A method as in claim 34 wherein the group of related objects is a package of software components which are manipulated as a unit by a user.

38. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

determining that a group of related objects has been stored onto a storage medium;

in response to the determining, creating a set of notifications for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the set of notifications.

39. A medium as in claim 38 wherein the set of notifications is only one notification and the notification indicates a creation or modification of a file on a storage device and is provided by an operating system component.

40. A medium as in claim 38 wherein, in the metadata database, a type of information in metadata for files of a first type differs from a type of information in metadata for files of a second type.

41. A medium as in claim 38 wherein the group of related objects is a package of software components which are manipulated as a unit by a user.

42. A data processing system comprising:

means for determining that a group of related objects has been stored onto a storage medium;

means for in response to the determining, creating a set of notifications for updating a metadata database or an index database;

updating the metadata database or the index database after receiving the set of notifications.

43. A system as in claim 42 wherein the set of notifications is only one notification and the notification indicates a creation or modification of a file on a storage device and is provided by an operating system component.

44. A system as in claim 42 wherein, in the metadata database, a type of information in metadata for files of a first type differs from a type of information in metadata for files of a second type.

45. A system as in claim 42 wherein the group of related objects is a package of software components which are manipulated as a unit by a user.

46. A machine implemented method of processing data, the method comprising:

determining an order among logical locations on a storage device, the order specifying a sequence for scanning for files to be indexed on the storage device or for scanning for files having metadata to be added to a metadata database, the sequence based upon a likelihood of user documents being in the logical locations;

scanning through the logical locations to determine files to be indexed or to have metadata added to the metadata database.

47. A method as in claim 46 further comprising:

indexing full text content of the files to be indexed.

48. A method as in claim 47 wherein the indexing is performed in the order.

49. A method as in claim 46 wherein the order specifies the sequence which includes a user'"'"'s home folder and a desktop, and wherein the sequence is, at least in part, predetermined.

50. A method as in claim 46 wherein the logical locations are specified by pathnames in a file directory and wherein a system records pathnames accessed by a user in order to determine the likelihood.

51. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

determining an order among logical locations on a storage device, the order specifying a sequence for scanning for files to be indexed on the storage device or for scanning for files having metadata to be added to a metadata database, the sequence based upon a likelihood of user documents being in the logical locations;

scanning through the logical locations to determine files to be indexed or to have metadata added to the metadata database.

52. A medium as in claim 51, the method further comprising:

indexing full text content of the files to be indexed.

53. A medium as in claim 52 wherein the indexing is performed in the order.

54. A medium as in claim 51 wherein the order specifies the sequence which includes a user'"'"'s home folder and a desktop, and wherein the sequence is, at least in part, predetermined.

55. A medium as in claim 51 wherein the logical locations are specified by pathnames in a file directory and wherein a system records pathnames accessed by a user in order to determine the likelihood.

56. A data processing system comprising:

determining an order among logical locations on a storage device, the order specifying a sequence for scanning for files to be indexed on the storage device or for scanning for files having metadata to be added to a metadata database, the sequence based upon a likelihood of user documents being in the logical locations;

scanning through the logical locations to determine files to be indexed or to have metadata added to the metadata database.

57. A system as in claim 56 further comprising:

means for indexing full text content of the files to be indexed.

58. A system as in claim 57 wherein the indexing is performed in the order.

59. A system as in claim 56 wherein the order specifies the sequence which includes a user'"'"'s home folder and a desktop, and wherein the sequence is, at least in part, predetermined.

60. A system as in claim 56 wherein the logical locations are specified by pathnames in a file directory and wherein a system records pathnames accessed by a user in order to determine the likelihood.

61. A machine implemented method of processing data, the method comprising:

determining whether to index a file based on a file pathname of the file and a plurality of predetermined pathnames;

indexing the file in response to determining that the file is to be indexed.

62. A method as in claim 61 wherein files within predetermined directories are not to be indexed.

63. A method as in claim 62 wherein the predetermined directories are specified at least in part by the plurality of predetermined pathnames and comprise temporary directories and operating system directories.

64. A method as in claim 61 wherein the determining is based on at least a portion of the file pathname.

65. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

determining whether to index a file based on a file pathname of the file and a plurality of predetermined pathnames;

indexing the file in response to determining that the file is to be indexed.

66. A medium as in claim 65 wherein files within predetermined directories are not to be indexed.

67. A medium as in claim 66 wherein the predetermined directories are specified at least in part by the plurality of predetermined pathnames and comprise temporary directories and operating system directories.

68. A medium as in claim 65 wherein the determining is based on at least a portion of the file pathname.

74. A medium as in claim 65 wherein files within predetermined directories are not to have their metadata added to the metadata database.

75. A medium as in claim 66 wherein the predetermined directories are specified at least in part by the plurality of predetermined pathnames and comprise temporary directories and operating system directories.

76. A medium as in claim 65 wherein the determining is based on at least a portion of the file pathname.

69. A data processing system comprising:

means determining whether to index a file based on a file pathname of the file and a plurality of predetermined pathnames;

indexing the file in response to determining that the file is to be indexed.

70. A system as in claim 69 wherein files within predetermined directories are not to be indexed.

71. A system as in claim 70 wherein the predetermined directories are specified at least in part by the plurality of predetermined pathnames and comprise temporary directories and operating system directories.

72. A method as in claim 69 wherein the determining is based on at least a portion of the file pathname.

73. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

determining whether to add metadata from a file to a metadata database based on a file pathname of the file and a plurality of predetermined pathnames;

add the metadata of the file into the metadata database in response to the determining.

77. A machine implemented method for processing data, the method comprising:

coalescing notifications into a combined notification for updating a metadata database or an index database while dropping at least one notification;

retaining data from the at least one notification which was dropped.

78. A method as in claim 77 wherein the data is used to determine whether and/or when to perform the updating.