Methods and systems for managing permissions data and/or indexes

• US 20070033191A1
• Filed: 08/04/2006
• Published: 02/08/2007
• Est. Priority Date: 06/25/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Arrouye, Yan, Hornkvist, John
• Granted Patent: US 9,081,872 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/90335 Query processing

Abstract

Systems and methods for indexing and searching data, such as file contents and/or metadata. In one exemplary method, an index corresponding to files on a storage device is created. Index is partitioned into subindexes according to certain criteria, such as the location of files or exclusivity of access to files. Subindex contains the entire content of files or metadata describing files, in addition to identifiers leading back to files'"'"' physical storage. Index is maintained by moving files'"'"' index entries from one subindex to another as files change in relation to the partition criteria, such as changing location. Searching some subindexes, like one corresponding to files in a shared folder, is done with permission checking. Searches of certain other subindexes, like one corresponding to the home folder of the user searching, are done without permission checking the underlying files resulting in a performance improvement.

Claims

1. A machine implemented method of processing data comprising:

receiving a search query from a user;

performing a search of an index, based on the search query, wherein the index contains at least a subindex belonging to the user;

performing a permissions check upon files found outside the user'"'"'s subindex; and

displaying files found in the user'"'"'s subindex, without checking permissions, and those found outside the user'"'"'s subindex for which the user has permission to access.

2. A method as in claim 1 wherein the subindex is physically represented as a data structure.

3. A method as in claim 1 wherein the subindex is virtually represented within a data structure.

4. A method as in claim 1 wherein the subindex contains entries, wherein an entry contains at least file data and a file identifier.

5. A method as in claim 1 wherein the index contains entries, wherein an entry contains file data, a file identifier, and a user name, wherein a set of files within the index having the same user name is a virtual subindex belonging to a user identified by the user name.

6. A method as in claim 1 wherein the index contains the full text of files.

7. A method as in claim 1 wherein the search query contains a plurality of words.

8. A method as in claim 7 wherein the search further contains a plurality of numbers.

9. A method as in claim 8 wherein the plurality of words contains first words and second words, wherein a first word and a second word are associated with a first number from the plurality of numbers, wherein the first word and the second word are matched when the first word and second word are found within the first number of words of each other.

10. A method as in claim 1 wherein the index contains metadata.

11. A machine implemented method of processing data comprising:

receiving a search query from a user;

performing a search of an index, based on the search query, wherein the index contains at least a subindex belonging to the user;

examining data in a permissions cache for files found outside the user'"'"'s subindex; and

displaying files found in the user'"'"'s subindex, without checking permissions, and those found outside the user'"'"'s subindex for which the user has permission to access.

12. A method as in claim 11 wherein the permissions cache contains entries, wherein an entry contains a file identifier, a user name, and a flag, wherein the flag takes on a value of true when a user identified by the user name has access to a file identified by the file identifier.

13. A method as in claim 12 wherein an entry further contains an indication of validity, wherein the entry indicates whether it is a valid entry or an invalid entry.

14. A method as in claim 13 wherein the entry indicates that it is an invalid entry, a permissions check is performed and the entry'"'"'s flag is updated with a result of the permissions check and the entry now indicates that it is valid.

15. A method as in claim 13 wherein the entry indicates that it is a valid entry, wherein the value of the entry'"'"'s flag is used in lieu of a permissions check.

16. A method as in claim 11 wherein the subindex is physically represented as a data structure.

17. A method as in claim 11 wherein the subindex is virtually represented within a data structure.

18. A method as in claim 11 wherein the subindex contains entries, wherein an entry contains at least file data and a file identifier.

19. A method as in claim 11 wherein the index contains entries, wherein an entry contains file data, a file identifier, and a user name, wherein a set of files within the index having the same user name is a virtual subindex belonging to a user identified by the user name.

20. A method as in claim 11 wherein the index contains the full text of files.

21. A method as in claim 11 wherein the search query contains a plurality of words.

22. A method as in claim 21 wherein the search further contains a plurality of numbers.

23. A method as in claim 22 wherein the plurality of words contains first words and second words, wherein a first word and second word is associated with a first number from the plurality of numbers, wherein the first word and the second word are matched when the first word and second word are found within the first number of words of each other.

24. A method as in claim 11 wherein the index contains metadata.

25. A machine implemented method of processing data comprising:

receiving a search query from a user;

performing a search of a storage device, based on the search query, wherein the storage device contains at least a folder belonging to the user;

performing a permissions check upon files found outside the user'"'"'s folder;

displaying files found in the user'"'"'s folder, without checking permissions, and those found outside the user'"'"'s folder for which the user has permission to access.

26. A method as in claim 25 wherein the search query contains a plurality of words.

27. A method as in claim 26 wherein the search further contains a plurality of numbers.

28. A method as in claim 27 wherein the plurality of words contains first words and second words, wherein a first word and a second word are associated with a first number from the plurality of numbers, wherein the first word and the second word are matched when the first word and second word are found within the first number of words of each other.

29. A machine implemented method of processing data comprising:

receiving a user name for a user and a plurality of files within a plurality of folders, wherein the plurality of folders contains at least a folder belonging to the user and a shared folder;

creating a plurality of subindexes, wherein the plurality contains at least a user'"'"'s subindex and a shared subindex;

determining which files are located in the user'"'"'s folder and which files are in the shared folder; and

storing data from files located in the user'"'"'s folder in the user'"'"'s subindex and storing data from files located in the shared folder in the shared subindex.

30. A method as in claim 29 wherein there are a plurality of users and each user in the plurality owns at least a folder and there are a plurality of subindexes and each user in the plurality is associated with a subindex.

31. A method as in claim 29 wherein the plurality of subindexes are represented virtually within a single index.

32. A method as in claim 31 wherein the single index contains entries, wherein an entry contains a user name, a file identifier, and data.

33. A method as in claim 29 wherein the user'"'"'s folder is a hierarchical data structure containing files belonging to the user.

34. A method as in claim 29 wherein the user'"'"'s folder is a set of files for which the user has exclusive access and the shared folder is a set of files for which more than one user has access.

35. A method as in claim 29 wherein the data stored is the full text of files and file identifiers.

36. A method as in claim 29 wherein the data stored is metadata and file identifiers.

37. A method as in claim 29 wherein files in the shared folder require permission to access.

38. A method as in claim 37 wherein a permission check may be used to determine whether or not a user has access to a file.

39. A method as in claim 37 wherein an entry in a permissions cache may be used to determine if a user has access to a file.

40. A method as in claim 39 wherein an entry in a permissions cache may be invalid, requiring that the entry be updated with a result from a permission check, wherein an updated entry becomes valid.

41. A machine implemented method of processing data comprising:

receiving a file with a changed attribute, wherein the attribute has a former value that is not a current value;

identifying a former subindex corresponding to the former value, wherein the data from the file is currently stored in the former subindex;

removing the file'"'"'s data from the former subindex;

identifying a new subindex corresponding to the attribute'"'"'s current value; and

storing data from the file in the new subindex.

42. A method as in claim 41 wherein the former subindex and the new subindex are physically represented in a data structure.

43. A method as in claim 41 wherein the file was not previously stored in a subindex.

44. A method as in claim 43 wherein the file was created after the subindexes.

45. A method as in claim 41 wherein the former subindex and the new subindex are virtually represented within a data structure.

46. A method as in claim 41 wherein the attribute is a file'"'"'s location.

47. A method as in claim 41 wherein the attribute is a file'"'"'s accessibility.

48. A method as in claim 41 wherein the method is invoked by an operating system after a file'"'"'s attribute has changed.

49. A method as in claim 41 wherein an entry in a permissions cache corresponding to the file is made invalid.

50. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving a search query from a user;

performing a search of an index, based on the search query, wherein the index contains at least a subindex belonging to the user;

performing a permissions check upon files found outside the user'"'"'s subindex; and

displaying files found in the user'"'"'s subindex, without checking permissions, and those found outside the user'"'"'s subindex for which the user has permission to access.

51. A medium as in claim 50 wherein the subindex is physically represented as a data structure.

52. A medium as in claim 50 wherein the subindex is virtually represented within a data structure.

53. A medium as in claim 50 wherein the subindex contains entries, wherein an entry contains at least file data and a file identifier.

54. A medium as in claim 50 wherein the index contains entries, wherein an entry contains file data, a file identifier, and a user name, wherein a set of files within the index having the same user name is a virtual subindex belonging to a user identified by the user name.

55. A medium as in claim 50 wherein the index contains the full text of files.

56. A medium as in claim 50 wherein the search query contains a plurality of words.

57. A medium as in claim 56 wherein the search further contains a plurality of numbers.

58. A medium as in claim 57 wherein the plurality of words contains first words and second words, wherein a first word and a second word are associated with a first number from the plurality of numbers, wherein the first word and the second word are matched when the first word and second word are found within the first number of words of each other.

59. A medium as in claim 50 wherein the index contains metadata.

60. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving a search query from a user;

performing a search of an index, based on the search query, wherein the index contains at least a subindex belonging to the user;

examining data in a permissions cache for files found outside the user'"'"'s subindex; and

displaying files found in the user'"'"'s subindex, without checking permissions, and those found outside the user'"'"'s subindex for which the user has permission to access.

61. A medium as in claim 60 wherein the permissions cache contains entries, wherein an entry contains a file identifier, a user name, and a flag, wherein the flag takes on a value of true when a user identified by the user name has access to a file identified by the file identifier.

62. A medium as in claim 61 wherein an entry further contains an indication of validity, wherein the entry indicates whether it is a valid entry or an invalid entry.

63. A medium as in claim 62 wherein the entry indicates that it is an invalid entry, a permissions check is performed and the entry'"'"'s flag is updated with a result of the permissions check and the entry now indicates that it is valid.

64. A medium as in claim 62 wherein the entry indicates that it is a valid entry, wherein the value of the entry'"'"'s flag is used in lieu of a permissions check.

65. A medium as in claim 60 wherein the subindex is physically represented as a data structure.

66. A medium as in claim 60 wherein the subindex is virtually represented within a data structure.

67. A medium as in claim 60 wherein the subindex contains entries, wherein an entry contains at least file data and a file identifier.

68. A medium as in claim 60 wherein the index contains entries, wherein an entry contains file data, a file identifier, and a user name, wherein a set of files within the index having the same user name is a virtual subindex belonging to a user identified by the user name.

69. A medium as in claim 60 wherein the index contains the full text of files.

70. A medium as in claim 60 wherein the search query contains a plurality of words.

71. A medium as in claim 70 wherein the search further contains a plurality of numbers.

72. A medium as in claim 71 wherein the plurality of words contains first words and second words, wherein a first word and second word is associated with a first number from the plurality of numbers, wherein the first word and the second word are matched when the first word and second word are found within the first number of words of each other.

73. A medium as in claim 60 wherein the index contains metadata.

74. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving a search query from a user;

performing a search of a storage device, based on the search query, wherein the storage device contains at least a folder belonging to the user;

performing a permissions check upon files found outside the user'"'"'s folder;

displaying files found in the user'"'"'s folder, without checking permissions, and those found outside the user'"'"'s folder for which the user has permission to access.

75. A medium as in claim 74 wherein the search query contains a plurality of words.

76. A medium as in claim 75 wherein the search further contains a plurality of numbers.

77. A medium as in claim 76 wherein the plurality of words contains first words and second words, wherein a first word and a second word are associated with a first number from the plurality of numbers, wherein the first word and the second word are matched when the first word and second word are found within the first number of words of each other.

78. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving a user name for a user and a plurality of files within a plurality of folders, wherein the plurality of folders contains at least a folder belonging to the user and a shared folder;

creating a plurality of subindexes, wherein the plurality contains at least a user'"'"'s subindex and a shared subindex;

determining which files are located in the user'"'"'s folder and which files are in the shared folder; and

storing data from files located in the user'"'"'s folder in the user'"'"'s subindex and storing data from files located in the shared folder in the shared subindex.

79. A medium as in claim 78 wherein there are a plurality of users and each user in the plurality owns at least a folder and there are a plurality of subindexes and each user in the plurality is associated with a subindex.

80. A medium as in claim 78 wherein the plurality of subindexes are represented virtually within a single index.

81. A medium as in claim 80 wherein the single index contains entries, wherein an entry contains a user name, a file identifier, and data.

82. A medium as in claim 78 wherein the user'"'"'s folder is a hierarchical data structure containing files belonging to the user.

83. A medium as in claim 78 wherein the user'"'"'s folder is a set of files for which the user has exclusive access and the shared folder is a set of files for which more than one user has access.

84. A medium as in claim 78 wherein the data stored is the full text of files and file identifiers.

85. A medium as in claim 78 wherein the data stored is metadata and file identifiers.

86. A medium as in claim 78 wherein files in the shared folder require permission to access.

87. A medium as in claim 86 wherein a permission check may be used to determine whether or not a user has access to a file.

88. A medium as in claim 86 wherein an entry in a permissions cache may be used to determine if a user has access to a file.

89. A medium as in claim 88 wherein an entry in a permissions cache may be invalid, requiring that the entry be updated with a result from a permission check, wherein an updated entry becomes valid.

90. A machine readable medium providing instructions which when executed by a data processing system cause the data processing system to perform a method of processing data, the method comprising:

receiving a file and an old location, wherein the file'"'"'s location is not the old location;

identifying an old subindex corresponding to the old location, wherein data from the file is currently stored in the old subindex;

removing data from the file from the old subindex;

identifying a new subindex corresponding to the file'"'"'s location; and

storing data from the file in the new subindex.

91. A medium as in claim 90 wherein the former subindex and the new subindex are physically represented in a data structure.

92. A medium as in claim 90 wherein the file was not previously stored in a subindex.

93. A medium as in claim 92 wherein the file was created after the subindexes.

94. A medium as in claim 90 wherein the former subindex and the new subindex are virtually represented within a data structure.

95. A medium as in claim 90 wherein the attribute is a file'"'"'s location.

96. A medium as in claim 90 wherein the attribute is a file'"'"'s accessibility.

97. A medium as in claim 90 wherein the method is invoked by an operating system after a file'"'"'s attribute has changed.

98. A medium as in claim 90 wherein an entry in a permissions cache corresponding to the file is made invalid.

99. A data processing system comprising:

means for receiving a search query from a user;

means for performing a search of an index, based on the search query, wherein the index contains at least a subindex belonging to the user;

means for performing a permissions check upon files found outside the user'"'"'s subindex; and

means for displaying files found in the user'"'"'s subindex, without checking permissions, and those found outside the user'"'"'s subindex for which the user has permission to access.

100. A data processing system comprising:

means for receiving a search query from a user;

means for performing a search of an index, based on the search query, wherein the index contains at least a subindex belonging to the user;

means for examining data in a permissions cache for files found outside the user'"'"'s subindex; and

means for displaying files found in the user'"'"'s subindex, without checking permissions, and those found outside the user'"'"'s subindex for which the user has permission to access.

101. A data processing system comprising:

means for receiving a search query from a user;

means for performing a search of a storage device, based on the search query, wherein the storage device contains at least a folder belonging to the user;

means for performing a permissions check upon files found outside the user'"'"'s folder;

means for displaying files found in the user'"'"'s folder, without checking permissions, and those found outside the user'"'"'s folder for which the user has permission to access.

102. A data processing system comprising:

means for receiving a user name for a user and a plurality of files within a plurality of folders, wherein the plurality of folders contains at least a folder belonging to the user and a shared folder;

means for creating a plurality of subindexes, wherein the plurality contains at least a user'"'"'s subindex and a shared subindex;

means for determining which files are located in the user'"'"'s folder and which files are in the shared folder; and

means for storing data from files located in the user'"'"'s folder in the user'"'"'s subindex and storing data from files located in the shared folder in the shared subindex.

103. A data processing system comprising:

means for receiving a file and an old location, wherein the file'"'"'s location is not the old location;

means for identifying an old subindex corresponding to the old location, wherein data from the file is currently stored in the old subindex;

means for removing data from the file from the old subindex;

means for identifying a new subindex corresponding to the file'"'"'s location; and

means for storing data from the file in the new subindex.