Method and system for storing large data files

• US 20070192376A1
• Filed: 01/09/2007
• Published: 08/16/2007
• Est. Priority Date: 08/15/2001
• Status: Active Grant

• Current Assignee: Bentley Systems Incorporated
• Original Assignee: Bentley Systems Incorporated
• Inventors: Bentley, Keith
• Granted Patent: US 7,743,080 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: Y10S 707/99942 Manipulating data structure, e.g. compression, compaction, compilation
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

An enhanced file format to store large quantities of variable-sized data records on a storage medium and to permit efficient access and control over data stored in the enhanced file format. A file format is the structure of a file that defines the way it is stored and laid out on a disk. In a preferred embodiment of the present invention, a file format includes a model directory containing models. Models include element lists comprising element chunks. The element chunks include elements, where elements are variable-sized data records.

Claims

1-36. -36. (canceled)

37. A method in a computer system for modifying at least one compressed element chunk in a main storage area, comprising:

storing at least one root storage in the main storage area;

storing a model directory in said at least one root storage;

storing at least one model including a graphic element list and a control element list in each model directory;

storing at least one compressed element chunk in each graphic element list and control element list, wherein each said compressed element chunk comprises compressed elements;

storing said at least one root storage in a temporary memory;

decompressing said compressed element chunks and compressed elements in said graphic element list and said control element list;

modifying elements in the temporary memory;

flagging said decompressed element chunks having said modified elements in said temporary memory with a dirty flag;

compressing said flagged element chunks to provide modified compressed element chunks after a predetermined idle time has passed; and

replacing said compressed element chunks in the main storage area with said modified compressed element chunks.

38. The method as in claim 37, wherein the computer system comprises a first workstation having said temporary memory, wherein said first work station accesses and modifies elements;

and at least a second workstation accesses and views said modified elements upon request.

39. The method of claim 37, further comprising the step of associating a header with each root storage.

40. The method of claim 37, wherein the computer system is the Internet.

41. The method of claim 37, wherein the computer system is an Intranet.

42. The method of claim 37, wherein the computer system is a local area network.

43. The method of claim 37, wherein said main storage area is a file.

44. The method of claim 37, wherein at least one of said root storages is adapted to be operable with a computer aided design program.

45. The method of claim 37, wherein each said root storage is a file.

46. The method of claim 37, further comprising the step of associating at least one of a stream and a storage, neither of which are contained in the model directory, with at least one of the root storages.

47. The method of claim 37, further comprising the step of storing in said at least one root storage at least one of a first stream containing a header, a second stream containing session information, a third stream containing a manifest and a fourth stream containing file properties.

48. The method of claim 37, further comprising the step of storing in said at least one of root storage a control model containing a control model header, a global control element list and a global graphic element list, wherein said global control element list and said global graphic element list contain element chunks including global elements, wherein said global elements are accessed for use in any model directory.

49. The method of claim 37, further comprising the step of automatically sending a signal from the storage area to other workstations to notify users that an element chunk in a root storage had been modified.

50. A method in a computer system for modifying at least one encrypted element chunk stored in a main storage area, comprising:

storing at least one root storage in the main storage area;

storing a model directory in each root storage;

storing at least one model including a graphic element list and a control element list in each model directory;

storing at least one encrypted element chunk in each graphic element list and control element list, wherein each element chunk comprises compressed elements;

storing the at least one root storage in a temporary memory;

decrypting said element chunks and said elements in the graphic element list and control element list;

modifying elements in said temporary memory;

flagging said element chunks having said modified elements in said temporary memory with a dirty flag;

encrypting said element chunks having said modified elements in temporary memory to provide modified encrypted element chunks after a predetermined idle time has passed; and

replacing said encrypted element chunks in the main storage area with said modified encrypted element chunks.

51. The method of claim 50, wherein the computer system comprises a first workstation having said temporary memory, wherein said first work station accesses and modifies elements;

and at least a second workstation accesses and views the modified elements upon request.

52. The method of claim 50, further comprising the step of associating a header with each root storage.

53. The method of claim 50, wherein the computer system is the Internet.

54. The method of claim 50, wherein the computer system is an Intranet.

55. The method of claim 50, wherein the computer system is a local area network.

56. The method of claim 50, wherein the main storage area is a file.

57. The method of claim 50, wherein at least one of the root storages is adapted to be operable with a computer aided design program.

58. The method of claim 50, wherein each root storage is a file.

59. The method of claim 50, further comprising the step of associating at least one of a stream and a storage, neither of which are contained in the model directory, with at least one of the root storages.

60. The method of claim 50, further comprising the step of storing in the at least one root storage at least one of a first stream containing a header, a second stream containing session information, a third stream containing a manifest and a fourth stream containing file properties.

61. The method of claim 50, further comprising the step of storing in the at least one of root storage a control model containing a control model header, a global control element list and a global graphic element list, wherein the global control element list and the global graphic element list contain element chunks including global elements, wherein the global elements are accessed for use in any model directory.

62. The method of claim 50, further comprising the step of automatically sending a signal from the storage area to other workstations to notify users that an element chunk in a root storage had been modified.

63. A method in a computer system for modifying at least one compressed encrypted element chunk in a main storage area, comprising:

storing at least one root storage in the main storage area;

storing a model directory in each root storage;

storing at least one model including a graphic element list and a control element list in each model directory;

storing at least one compressed and encrypted element chunk in each graphic element list and control element list, wherein each element chunk comprises compressed elements;

storing the at least one root storage in a temporary memory;

decrypting the element chunks and elements in the graphic element list and control element list;

decompressing the element chunks and elements in the graphic element list and control element list;

modifying elements in the temporary memory;

flagging the element chunks having the modified elements in the temporary memory with a dirty flag;

compressing and encrypting the element chunks having the modified elements in temporary memory to provide modified compressed encrypted element chunks after a predetermined idle time has passed; and

replacing the compressed encrypted element chunks in the main storage area with the modified compressed encrypted element chunks.

64. The method as in claim 63, wherein the computer system comprises a first workstation having the temporary memory, wherein the first work station accesses and modifies elements;

and at least a second workstation accesses and views the modified elements upon request.

65. The method of claim 63, further comprising the step of associating a header with each root storage.

66. The method of claim 63, wherein the computer system is the Internet.

67. The method of claim 63, wherein the computer system is an Intranet.

68. The method of claim 63, wherein the computer system is a local area network.

69. The method of claim 63, wherein the main storage area is a file.

70. The method of claim 63, wherein at least one of the root storages is adapted to be operable with a computer aided design program.

71. The method of claim 63, wherein each root storage is a file.

72. The method of claim 63, further comprising the step of associating at least one of a stream and storage, neither of which are contained in the model directory, with at least one of the root storages.

73. The method of claim 63, further comprising the step of storing in the at least one root storage at least one of a first stream containing a header, a second stream containing session information, a third stream containing a manifest and a fourth stream containing file properties.

74. The method of claim 63, further comprising the step of storing in the at least one of root storage a control model containing a control model header, a global control element list and a global graphic element list, wherein the global control element list and the global graphic element list contain element chunks including global elements, wherein the global elements are accessed for use in any model directory.

75. The method of claim 63, further comprising the step of automatically sending a signal from the storage area to other workstations to notify users that an element chunk in a root storage had been modified.

76. A computer system for modifying at least one compressed chunk of elements stored in a main storage area, comprising:

a temporary memory;

a root storage stored in the main storage area and the temporary memory;

a model directory stored in the root storage;

at least one model stored in the model directory;

at least one graphic element list stored in each model;

at least one control element list stored in each model;

at least one compressed element chunk stored in each graphic element list and control element list, wherein each element chunk comprises compressed elements;

means for decompressing the element chunks and elements in the graphic element list and control element list in the temporary memory;

means for modifying elements in the temporary memory;

means for lagging the element chunks having the modified elements in the temporary memory;

means for compressing the element chunks having the modified elements in temporary memory to provide modified compressed element chunks after a predetermined idle time has passed; and

means for replacing the compressed element chunks in the main storage area with the modified compressed element chunks.

77. The computer system as in claim 76, further comprising a first workstation having the temporary memory, wherein the first work station modifies elements;

and at least a second workstation accesses and views the modified elements upon request.

78. The computer system as in claim 76, further comprising means for associating a header with each root storage.

79. The computer system as in claim 76, wherein the computer system is the Internet.

80. The computer system as in claim 76, wherein the computer system is an Intranet.

81. The computer system as in claim 76, wherein the computer system is a local area network.

82. The computer system as in claim 76, wherein the main storage area is a file.

83. The computer system as in claim 76, wherein at least one of the root storages is adapted to be operable with a computer aided design program.

84. The computer system as in claim 76, wherein each root storage is a file.

85. The computer system as in claim 76, further comprising means for associating at least one of a stream and storage, which are not contained in the model directory, with at least one of the root storages.

86. The computer system as in claim 76, further comprising means for storing in the at least one root storage at least one of a first stream containing a header, a second stream containing session information, a third stream containing a manifest and a fourth stream containing file properties.

87. The computer system as in claim 76, further comprising means for storing in the at least one of root storage a control model containing a control model header, a global control element list and a global graphic element list, wherein the global control element list and the global graphic element list contain element chunks including global elements, wherein the global elements are accessed for use in any model directory.

88. The computer system as in claim 76, further comprising means for automatically sending a signal from the storage area to other workstations to notify users that an element chunk in a root storage had been modified.

89. A computer system for modifying at least one encrypted element chunk stored in a main storage area, comprising:

a temporary memory;

a root storage stored in the main storage area and the temporary memory;

a model directory stored in the root storage;

at least one model stored in the model directory;

at least one graphic element list stored in each model;

at least one control element list stored in each model;

at least one encrypted element chunk stored in each graphic element list and control element list, wherein each element chunk comprises encrypted elements;

means for decrypting the element chunks and elements in the graphic element list and control element list in the temporary memory;

means for modifying elements in the temporary memory;

means for flagging the element chunks having the modified elements in the temporary memory with a dirty flag;

means for encrypting the element chunks having the modified elements in temporary memory to provide modified encrypted element chunks after a predetermined idle time has passed; and

means for replacing the encrypted element chunks in the main storage area with the modified encrypted element chunks.

90. The computer system as in claim 89, further comprising a first workstation having the temporary memory, wherein the first work station modifies elements;

and at least a second workstation accesses and views the modified elements upon request.

91. The computer system as in claim 89 further comprising means for associating a header with each root storage.

92. The computer system as in claim 89, wherein the computer system is the Internet.

93. The computer system as in claim 89, wherein the computer system is an Intranet.

94. The computer system as in claim 89, wherein the computer system is a local area network.

95. The computer system as in claim 89, wherein the main storage area is a file.

96. The computer system as in claim 89, wherein at least one of the root storages is adapted to be operable with a computer aided design program.

97. The computer system as in claim 89, wherein each root storage is a file.

98. The computer system as in claim 89, further comprising means for associating at least one of a stream and storage, which are not contained in the model directory, with at least one of the root storages.

99. The computer system as in claim 89, further comprising means for storing in the at least one root storage at least one of a first stream containing a header, a second stream containing session information, a third stream containing a manifest and a fourth stream containing file properties.

100. The computer system as in claim 89, further comprising means for storing in the at least one of root storage a control model containing a control model header, a global control element list and a global graphic element list, wherein the global control element list and the global graphic element list contain element chunks including global elements, wherein the global elements are accessed for use in any model directory.

101. The computer system as in claim 89, further comprising means for automatically sending a signal from the storage area to other workstations to notify users that an element chunk in a root storage had been modified.

102. A computer system for modifying at least one encrypted compressed element chunk stored in a main storage area, comprising:

a temporary memory;

a root storage stored in the main storage area and the temporary memory;

a model directory stored in the root storage;

at least one model stored in the model directory;

at least one graphic element list stored in each model directory;

at least one control element list stored in each model directory;

at least one encrypted compressed element chunk stored in each graphic element list and control element list, wherein each element chunk comprises encrypted compressed elements;

means for decrypting the element chunks and elements in the graphic element list and control element list in the temporary memory;

means for decompressing the element chunks and elements in the graphic element list and control element list in the temporary memory;

means for modifying elements in the temporary memory;

means for flagging the element chunks having the modified elements in the temporary memory with dirty flags;

means for compressing and encrypting the element chunks having the modified elements in temporary memory to provide modified encrypted compressed element chunks after a predetermined idle time has passed; and

means for replacing the encrypted compressed element chunks in the main storage area with the modified encrypted compressed element chunks.

103. The computer system of claim 102, further comprising first workstation having the temporary memory, wherein the first work station accesses and modifies elements;

and at least second workstation receiving, decrypting, decompressing and viewing the modified elements upon request.

104. The computer system of claim 102, further comprising means for associating a header with each root storage.

105. The computer system of claim 102, wherein the computer system is the Internet.

106. The computer system of claim 102, wherein the computer system is an Intranet.

107. The computer system of claim 102, wherein the computer system is a local area network.

108. The computer system of claim 102, wherein the main storage area is a file.

109. The computer system of claim 102, wherein at least one of the root storages is adapted to be operable with a computer aided design program.

110. The computer system of claim 102, wherein each root storage is a file.

111. The computer system of claim 102, further comprising means for associating at least one of a stream and storage, which are not contained in the model directory, with at least one of the root storages.

112. The computer system of claim 102, further comprising means for storing in the at least one root storage at least one of a first stream containing a header, a second stream containing session information, a third stream containing a manifest and a fourth stream containing file properties.

113. The computer system of claim 102, further comprising means for storing in the at least one of root storage a control model containing a control model header, a global control element list and a global graphic element list, wherein the global control element list and the global graphic element list contain element chunks including global elements, wherein the global elements are accessed for use in any model directory.

114. The method of claim 102, further comprising the steps of automatically sending a signal from the storage area to other workstations to notify users that an element chunk in a root storage had been modified.

115. A method of reading a file in a computer system, comprising:

creating the file by;

storing at least one root storage in a storage area;

storing a model directory in said at least one root storage;

storing at least one model in said model directory

storing a graphic element list and a control element list in said at least one model, said graphic element list having element chunks containing graphic elements and said control element list having element chunks containing control elements;

assigning a preselected number of elements to each element chunk;

allocating each element to an element chunk in one of said control element list and said graphic element list; and

reading the file.

116. A method in a computer system for reading element chunks of elements in a storage area, comprising:

storing at least one root storage in a storage area;

storing at least one model directory in each root storage;

storing a control model in each root storage;

storing at least one model in said model directory;

storing a graphic element list and a control element list in each model and each control model directory, said graphic element list having element chunks containing graphic elements and said control element list having element chunks containing control elements;

assigning a preselected number of elements to each element chunk;

allocating each element to an element chunk in one of said control element list and said graphic element list; and

reading one of said element chunks.

117. (canceled)