System for sending list of media data objects to server which may be read by client and receiving from the server indicator of allocated resource

• US 5,799,150 A
• Filed: 02/20/1997
• Issued: 08/25/1998
• Est. Priority Date: 03/21/1994
• Status: Expired due to Term

• Current Assignee: Avid Technology Incorporated
• Original Assignee: Avid Technology Incorporated
• Inventors: Hennessy, Richard, Hamilton, James, Peters, Eric, Chopde, Avinash, Choa, Pong, Koutavas, Jay
• Primary Examiner(s): Meky, Moustafa M.
• Application Number:
  US08/804,521
• Time in Patent Office: 551 Days
• Field of Search: 395/200.33, 395/200.36, 395/200.37, 395/200.38, 395/200.31, 395/200.47, 395/200.49, 395/200.53, 395/200.56, 395/200.54 , 395/200.59, 395/680
• US Class Current: 709/203
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/26 using explicit feedback to the source, e.g. choke packets
• CPC Class Codes: H04L 47/27 Evaluation or update of window size, e.g. using information derived from acknowledged [ACK] packets
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/9036 Common buffer combined with individual queues
• CPC Class Codes: H04L 49/9073 Early interruption upon arrival of a fraction of a packet
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/23106 involving caching operations prefetching while addressing of a memory level in which the access to the desired data or data block requires associative addressing means within memory systems or architectures G06F12/0862; caching at an intermediate stage in a data network H04L67/568
• CPC Class Codes: H04N 21/232 Content retrieval operation locally within server, e.g. reading video streams from disk arrays storage management G06F3/0604; details of querying and searching of video data from a database G06F16/739
• CPC Class Codes: H04N 21/238 Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/47202 : for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6581 : Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/6582 : Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8549 : Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 7/17336 : Handling of requests in head-ends

Abstract

The problems of latency, flow control and data loss, and data movement within a client system memory are solved in a distributed multimedia system so as to enable real-time transmission of broadcast quality media data over the network. Latency is reduced by an estimation by the server of client needs. Data loss is prevented and flow control is provided by permitting the server to send only as much information as the network interface can reliably receive. Data movement is minimized by copying data directly from the network interface to memory in a display processor or audio processor.

Claims

1. A distributed multimedia network system, comprising:

a server computer having a nonvolatile storage medium on which media data is stored in a plurality of media data files; and

a client computer, connected to the server computer by a computer network, and having means for sending the server computer a list of media data objects which may be requested by the client computer, wherein each media data object includes an indicator of one of the plurality of media data files and a range of data within the media data file, and means for sending a request for media data of one of the media data objects to the server computer;

wherein the server computer includes;

means for allocating a buffer in a memory in the server computer for the media data objects in the list, wherein the memory has a faster access time than that nonvolatile storage medium;

means for retrieving media data of the media data objects in the list from the plurality of media data files stored on the nonvolatile storage medium and for caching the retrieved media data in the allocated buffer; and

means, operative in response to the request from the client computer for media data of one of the media objects, for transmitting the media data of the media object to the client computer from the allocated buffer in the memory of the server computer.

2. The distributed multimedia network system of claim 1, further comprising, in the client computer, means for authorizing the server computer to send only an amount of data which the client computer is capable of processing for controlling flow of media data from the server computer to the client computer.

3. The distributed multimedia network system of claim 2, wherein the means for authorizing includes means for sending the server computer window packets indicative of an amount of data the client can reliably receive, and wherein the server computer includes means for sending only as much media data as indicated by any set of window packets received.

4. The distributed multimedia network system of claim 1, further comprising, in the client computer, means for receiving packet of media data from the server computer and means for processing the media data to automatically and directly transfer the media data to memory used by a display system for displaying the media data.

5. The distributed multimedia network system of claim 4, wherein the client computer includes a receive channel for each type of media data and a separate direct memory access controller for each receive channel for transferring media data from the network to the memory used by the display system for the type of media data.

6. The distributed multimedia network system of claim 1, wherein the client computer includes a multimedia authoring system, and wherein the means for sending the list of media objects to the server computer includes means for receiving the list as a selection of media files to be edited by the authoring system.

7. The distributed multimedia network system of claim 1, wherein the client computer includes a multimedia playback system, and wherein the means for sending the list of media objects to the server computer includes means for receiving the list as a composition of a plurality of media files to be played by the playback system.

8. The distributed multimedia network system of claim 6, wherein the media data is a sequence of digital still images defining broadcast quality video.

9. The distributed multimedia network system of claim 8, wherein the playback system broadcasts video data.

10. The distributed multimedia network system of claim 1, wherein the means for requesting data is operative in response to needs for media data by one or more media data playback systems of the client computer.

11. The distributed multimedia network system of claim 1, wherein the means for sending the server computer a list of media data objects which may be requested by the client computer comprises:

means for creating the list of media objects;

means for sending a request to the server computer to allocate a resource for storing the media objects;

means for receiving an identifier of the resource from the server computer;

means for sending a request to the server computer to associate media objects from the list with the resource, including an identifier of the resource, an indication of the location in the resource where the object is to be inserted, an identifier of the media object and an offset and a range in a media data file of the media object.

12. The distributed multimedia network system of claim 1, wherein the means for allocating a buffer in a memory in the server computer for the media data objects in the list comprises:

means for allocating a resource;

means for opening for each media object the media data file and allocating a flow by linking a cache buffer to the resource and the data file;

means for sending to the client computer an identifier of each flow allocated.

13. The distributed multimedia network system of claim 12, wherein the request from the client computer to read media data of a media data object includes an indication of the identifier of the flow associated with the media data object on the server.

14. The distributed multimedia network system of claim 1, wherein the means for reading the media data into the buffer includes means for maintaining a window about a currently active point in the buffer.

15. The distributed multimedia network system of claim 1, wherein the client computer creates a list of media objects for each type of media data, and wherein the server computer allocates a buffer for each list created by the client computer.

16. A server computer, for use in a distributed multimedia network system including a client computer connected to the server computer by a computer network, comprising:

a nonvolatile storage medium on which media data is stored in a plurality of media data files;

a memory having a faster access time than that nonvolatile storage medium;

means for receiving, from the client computer, a list of media data objects which may be requested by the client computer, wherein each media data object includes an indicator of one of the plurality of media data files and a range of data within the media data file;

means for allocating a buffer in the memory for the media data objects in the list;

means for retrieving media data of the media data objects in the list from the plurality of media data files stored on the nonvolatile storage medium and caching the retrieved media data in the allocated buffer;

means for receiving, from the client computer, a request for media data of one of the media data objects; and

means, operative in response to the request for media data of one of the media objects, for transmitting the media data of the media object to the client computer from the allocated buffer in the memory.

17. The server computer of claim 16, wherein the means for authorizing includes means for sending the server computer window packets indicative of an amount of data the client can reliably receive, and wherein the server computer includes means for sending only as much media data as indicated by any set of window packets received.

18. The server computer of claim 16, wherein the means for allocating a buffer in the memory for the media data objects in the list comprises:

means for allocating a resource;

means for opening for each media object the media data file and allocating a flow by linking the buffer to the resource and the data file;

means for sending to the client computer an identifier of each flow allocated.

19. The server computer of claim 18, wherein the request from the client computer to read media data of a media data object includes an indication of the identifier of the flow associated with the media data object on the server.

20. The server computer of claim 16, wherein the means for reading the media data into the buffer includes means for maintaining a window about a currently active point in the buffer.

21. A client computer for use in a distributed multimedia network system including a server computer having a nonvolatile storage medium on which media data is stored in a plurality of media data files, wherein the server computer is connected to the client computer by a computer network, comprising:

means for sending the server computer a list of media data objects which may be read by the client computer, wherein each media data object includes an indicator of one of the plurality of media data files and a range of data within the media data file;

means for receiving from the server computer an indicator of a resource allocated at the server computer for storing the media data of the media objects; and

means for sending a request for media data of one of the media data objects to the server computer, including the indicator of the allocated resource for storing the media data.

22. The client computer of claim 21, further comprising means for authorizing the server computer to send only an amount of data which the client computer is capable of processing for controlling flow of media data from the server computer to the client computer.

23. The client computer of claim 22, wherein the means for authorizing includes means for sending the server computer window packets indicative of an amount of data the client can reliably receive.

24. The client computer of claim 21, further comprising means for receiving packet of media data from the server computer and means for processing the media data to automatically and directly transfer the media data to memory used by a display system for displaying the media data.

25. The client computer of claim 24, further comprising a receive channel for each type of media data and a separate direct memory access controller for each receive channel for transferring media data from the network to the memory used by the display system for the type of media data.

26. The client computer of claim 21, further comprising a multimedia authoring system, and wherein the means for sending the list of media objects to the server computer includes means for receiving the list as a selection of media files to be edited by the authoring system.

27. The client computer of claim 21, further comprising a multimedia playback system, and wherein the means for sending the list of media objects to the server computer includes means for receiving the list as a composition of a plurality of media files to be played by the playback system.

28. The client computer of claim 27, wherein the media data is a sequence of digital still images defining broadcast quality video.

29. The client computer of claim 28, wherein the playback system broadcasts video data.

30. The client computer of claim 21, wherein the means for requesting data is operative in response to needs for media data by one or more media data playback systems of the client computer.

31. The client computer of claim 21, wherein the means for sending the server computer a list of media data objects which may be requested by the client computer comprises:

means for creating the list of media objects;

means for sending a request to the server computer to allocate a resource for storing the media objects;

means for receiving an identifier of the resource from the server computer;

means for sending a request to the server computer to associate media objects from the list with the resource, including an identifier of the resource, an indication of the location in the resource where the object is to be inserted, an identifier of the media object and an offset and a range in a media data file of the media object.

32. A process for communicating media data in a distributed multimedia network system, including a server computer having a nonvolatile storage medium on which media data is stored in a plurality of media data files and a client computer connected to the server computer by a computer network, the process comprising the steps of:

the client computer sending the server computer a list of media data objects which may be requested by the client computer, wherein each media data object includes an indicator of one of the plurality of media data files and a range of data within the media data file;

the server computer allocating a buffer in a memory in the server computer for the media data objects in the list, wherein the memory has a faster access time than that nonvolatile storage medium;

the server computer retrieving media data of the media data objects in the list from the plurality of media data files stored on the nonvolatile storage medium and caching the retrieved media data in the allocated buffer;

the client computer sending a request for media data of one of the media data objects to the server computer; and

the server computer operating in response to the request from the client computer for media data of one of the media objects to transmit the media data of the media object to the client computer from the allocated buffer in the memory of the server computer.

33. The process of claim 32, wherein the step of authorizing includes the step of sending the server computer window packets indicative of an amount of data the client can reliably receive.

34. The process of claim 32, further comprising the step of receiving in the client computer packets of media data from the server computer and the step of processing the media data at the client computer to automatically and directly transfer the media data to memory used by a display system for displaying the media data.

35. The process of claim 32, wherein the step of requesting data is performed in response to needs for media data by one or more media data playback systems of the client computer.

36. The process of claim 32, wherein the step of sending the server computer a list of media data objects which may be requested by the client computer comprises the steps of:

creating the list of media objects;

sending a request to the server computer to allocate a resource for storing the media objects;

receiving an identifier of the resource from the server computer;

sending a request to the server computer to associate media objects from the list with the resource, including an identifier of the resource, an indication of the location in the resource where the object is to be inserted, an identifier of the media object and an offset and a range in a media data file of the media object.

37. The process of claim 32, wherein the step of allocating a buffer in a memory in the server computer for the media data objects in the list comprises the steps of:

allocating a resource;

opening for each media object the media data file and allocating a flow by linking the buffer to the resource and the data file;

sending to the client computer an identifier of each flow allocated.

38. The process of claim 32, wherein the client computer creates a list of media objects for each type of media data, and wherein the server computer allocates a buffer for each list created by the client computer.

39. A process for communicating media data in a distributed multimedia network system, including a server computer having a nonvolatile storage medium on which media data is stored in a plurality of media data files and a client computer connected to the server computer by a computer network, the process comprising the steps, performed by the server computer, of:

receiving, from the client computer, a list of media data objects which may be requested by the client computer, wherein each media data object includes an indicator of one of the plurality of media data files and a range of data within the media data file;

allocating a buffer in a memory in the server computer for the media data objects in the list, wherein the memory has a faster access time than that nonvolatile storage medium;

retrieving media data of the media data objects in the list from the plurality of media data files stored on the nonvolatile storage medium and caching the retrieved media data in the allocated buffer;

receiving, from the client computer, a request for media data of one of the media data objects; and

in response to the request from the client computer for media data of one of the media objects, transmitting the media data of the media object to the client computer from the allocated buffer in the memory.

40. The process of claim 39, wherein the step of authorizing includes the step of receiving from the client computer window packets indicative of an amount of data the client can reliably receive, and wherein the server computer sends as much media data as indicated by any set of window packets received.

41. The process of claim 39, wherein the step of allocating a buffer in a memory in the server computer for the media data objects in the list comprises the steps of:

allocating a resource;

opening for each media object the media data file and allocating a flow by linking the buffer to the resource and the data file;

sending to the client computer an identifier of each flow allocated.

42. The distributed multimedia network system of claim 39, wherein the step of reading the media data into the buffer includes the step of maintaining a window about a currently active point in the buffer.

43. A process for reading data from a server computer in a distributed multimedia network system having a nonvolatile storage medium on which media data is stored in a plurality of media data files, wherein the server computer is connected to a client computer by a computer network, comprising the steps, performed by the client computer, of:

sending the server computer a list of media data objects which may be read by the client computer, wherein each media data object includes an indicator of one of the plurality of media data files and a range of data within the media data file;

receiving from the server computer an indicator of a resource allocated at the server computer for storing the media data of the media objects; and

sending a request for media data of one of the media data objects to the server computer, including the indicator of the allocated resource for storing the media data.

44. The process of claim 43, further comprising, the step of authorizing the server computer to send only an amount of data which the client computer is capable of processing for controlling flow of media data from the server computer to the client computer.

45. The process of claim 44, wherein the step of authorizing includes the step of sending the server computer window packets indicative of an amount of data the client can reliably receive.

46. The process of claim 43, further comprising, the step of receiving packets of media data from the server computer and processing the media data to automatically and directly transfer the media data to memory used by a display system for displaying the media data.

47. The process of claim 43, wherein the step of requesting data is performed in response to needs for media data by one or more media data playback systems of the client computer.

48. The process of claim 43, wherein the step of sending the server computer a list of media data objects which may be requested by the client computer comprises:

creating the list of media objects;

sending a request to the server computer to allocate a resource for storing the media objects;

receiving an identifier of the resource from the server computer;

sending a request to the server computer to associate media objects from the list with the resource, including an identifier of the resource, an indication of the location in the resource where the object is to be inserted, an identifier of the media object and an offset and a range in a media data file of the media object.