Giving access to networked storage dependent upon local demand

• US 20030126224A1
• Filed: 04/17/2002
• Published: 07/03/2003
• Est. Priority Date: 04/20/2001
• Status: Active Grant

• Current Assignee: Autodesk, Inc.
• Original Assignee: Autodesk, Inc.
• Inventors: Harnois, Stephane, Theriault, Eric Yves
• Granted Patent: US 6,792,473 B2
• Time in Patent Office: Days
• US Class Current: 709/214
• CPC Class Codes: H04N 21/2181 comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: H04N 21/2182 involving memory arrays, e.g. RAID disk arrays RAID arrays per se G06F3/0689; use of parity to protect data in RAID systems G06F11/1008
• CPC Class Codes: H04N 21/23116 involving data replication, e.g. over plural servers synchronization of replicated data G06F11/1658; error detection or correction by means of data replication G06F11/2053; replication in distributed file systems G06F16/10; replication in distributed file systems G06F16/27; replication or mirroring of data in data networks H04L67/1095
• CPC Class Codes: H04N 21/2318 using striping
• CPC Class Codes: H04N 21/2405 Monitoring of the internal components or processes of the server, e.g. server load allocation of resources in multiprogramming arrangements G06F9/50; performance measurement of computer activity G06F11/34
• CPC Class Codes: H04N 21/6338 directed to network
• CPC Class Codes: H04N 7/17309 Transmission or handling of upstream communications

Abstract

Data is transferred over a network having many image data processing systems (101, 102). A high bandwidth network (121) is connected to each of the data processing systems and to each of several storage systems (111, 112). Each of the storage systems is operated under the direct control of one of the processing systems. A request is issued from a first processing system to access a data storage system controlled by a second processing system over a low bandwidth network (151). A bandwidth assessment process assesses an extent to which the second processing system requires access to its local storage system. The first processing system is given access to the second storage system if an assessment is made to the effect that local access requirements are identified as being below a predetermined threshold.

Claims

1. Image data processing apparatus comprising:

a plurality of image data processing systems,

a plurality of data storage systems, wherein each of said data storage systems is operated under the direct control of one of said image processing systems,

a high bandwidth network connected to each of said data processing systems and to each of said data storage systems, and

a low bandwidth network connected to each of said data processing systems;

wherein

a first processing system includes requesting means configured to request access to a data storage system controlled by a second processing system over said low bandwidth network;

said second processing system includes bandwidth assessment means configured to assess an extent to which said second processing system requires access to said storage system,

comparison means configured to make an indication of storage regions that may be accessed if said extent is below a predetermined threshold, and

sending means configured to convey said indication over said low bandwidth network to said first processing system, wherein

said first processing system includes accessing means configured to access said storage system via said high bandwidth network.

2. Apparatus according to claim 1, wherein said data processing systems are based around a silicon graphics O₂, Octane or Onyx2 computer.

3. Apparatus according to claim 1, wherein said data storage systems include a plurality of disks configured to receive image stripes.

4. Apparatus according to claim 3, including redundant disks to provide data security.

5. Apparatus according to claim 4, wherein said disks are configured as a redundant array of inexpensive disks (RAID).

6. Apparatus according to claim 1, wherein said low bandwidth network is an Ethernet network.

7. Apparatus according to claim 1, wherein said high bandwidth network includes a high bandwidth switching means.

8. Apparatus according to claim 7, wherein said high bandwidth switching means is a fibre channel switch.

9. Apparatus according to claim 8, wherein said fibre channel switch is operated under the control of one of said image data processing systems.

10. Apparatus according to claim 1, wherein said processing systems execute programs to identify requests made by other processing systems.

11. Apparatus according to claim 1, wherein at least one image data processing system has direct control of a plurality of data storage systems.

12. Apparatus according to claim 9, including lower powered data processing systems that are configured to supply image data to image data processing systems connected to said high bandwidth switching means.

13. Apparatus according to claim 1, wherein said bandwidth assessment means include:

queuing means configured to queue requests from said second processing system for access to said data storage system controlled by said second processing system, and

queue measurement means configured to measure said queue.

14. Apparatus according to claim 1, wherein said bandwidth assessment means include:

accessing means configured to access said storage regions requested by said second processing system and retrieve the stored data;

buffering means configured to buffer said data retrieved from said storage regions; and

buffer measurement means configured to measure the amount of data stored in said buffering means.

15. Apparatus according to claim 1, wherein said bandwidth assessment means include:

queuing means configured to queue requests from said second processing system for access to said data storage system controlled by said second processing system,

queue measurement means configured to measure said queue;

accessing means configured to access said storage regions requested by said second processing system and retrieve the stored data;

buffering means configured to buffer said data retrieved from said storage regions; and

buffer measurement means configured to measure the amount of data stored in said buffering means.

16. Apparatus according to claim 13, wherein said queue measurement means is configured to sum the amount of data requested by each request in said queue.

17. Apparatus according to claim 14, wherein said buffer measurement means is configured to count the number of frames stored in said buffering means.

18. Apparatus according to claim 14, wherein said buffer measurement means is configured to sum the amount of data in the frames stored in the buffering means.

19. A method of transferring data in a networked image data processing environment, including a plurality of image data processing systems, a plurality of data storage systems;

a high bandwidth network connected to each of said data processing systems and to each of said storage systems; and

a low bandwidth network connected to said image processing systems, wherein said method comprises;

operating each of said data storage systems under the direct control of one of said image processing systems;

issuing a request from a first processing system to access a data storage system controlled by said second processing system over said low bandwidth network;

using bandwidth assessment means at said second processing system to assess an extent to which said second processing system requires access to said storage system;

using comparison means at said second processing system to make an indication of storage regions that may be accessed if said extent is below a predetermined threshold;

making an identification at said second processing system of said storage regions that may be accessed;

conveying said identification from said second processing system to said first processing system over said low bandwidth network; and

accessing said identified storage portion by said first processing system via said high bandwidth network.

20. The method according to claim 19, wherein the extent to which access to sort storage is assessed includes measuring the depth of a queue for request for access by a local processing system.