System and method for delivery of video data over a computer network

• US 5,956,716 A
• Filed: 06/07/1996
• Issued: 09/21/1999
• Est. Priority Date: 06/07/1995
• Status: Expired due to Term

• Current Assignee: InterVU, Inc. (Akamai Technologies, Inc.)
• Original Assignee: InterVU, Inc. (Akamai Technologies, Inc.)
• Inventors: Kenner, Brian, Gruber, Harry
• Primary Examiner(s): Choules, Jack M.
• Application Number:
  US08/660,540
• Time in Patent Office: 1,201 Days
• Field of Search: 707/104, 707/10, 707/100, 395/200.47
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/10015 Access to distributed or replicated servers, e.g. using brokers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/288 Distributed intermediate devices, i.e. intermediate devices for interaction with other intermediate devices on the same level
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04N 21/222 Secondary servers, e.g. proxy server, cable television Head-end provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/23106 involving caching operations prefetching while addressing of a memory level in which the access to the desired data or data block requires associative addressing means within memory systems or architectures G06F12/0862; caching at an intermediate stage in a data network H04L67/568
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2543 Billing , e.g. for subscription services payment schemes, architectures or protocols G06Q20/00; e-commerce G06Q30/00; arrangements for billing for the use of broadcast information or broadcast-related information H04H60/21
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/4622 : Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 7/17336 : Handling of requests in head-ends
• CPC Class Codes: Y10S 707/99945 : Object-oriented database structure processing

Abstract

A video clip storage and retrieval system whereby video clips, stored locally and/or at a more remote location, can be requested and retrieved by a user at the user'"'"'s multimedia terminal. When the user requests a desired video clip, the request is processed by a primary index manager ("PIM") via a Local Search and Retrieval Unit ("SRU"). Before the message is communicated to the PIM, the local SRU checks its own storage to see whether the requested video clips are available locally. If some of the video clips are local, the local SRU still forwards the request to the PIM so that the PIM may determine specific video clip usage. The PIM determines the extended SRU where the audio-visual data is stored and passes this information to a Data Sequencing Interface ("DSI"). The DSI collects the video clips and downloads the clips to the user'"'"'s terminal. The user may then view, copy, or print the video clip as desired. In a preferred embodiment, a distributed digital video clip delivery system, according to the invention, provides video clips stored at local and/or remote locations, which can be requested from the Internet and retrieved at the user'"'"'s multimedia terminal. When the user requests a desired video clip shown on a Web page, the request is diverted to a primary index manager ("PIM"). The PIM attempts to locate the closest server containing the requested clip, from which the download is completed. The system further includes means for uploading and distributing clips to geographically diverse servers, dynamic load balancing, subscription management mechanisms, and protection means to discourage unauthorized duplication of video clips.

Claims

1. A video clip storage and retrieval system comprising:

a multimedia terminal through which a user may request video clips from a database, the multimedia terminal also being able to receive and display requested video clips;

a local storage and retrieval module which communicates with the multimedia terminal and which is adapted to receive and process video clip requests from the multimedia terminal;

a primary index manager which communicates with the local storage and retrieval module and which is adapted to receive and process video clip requests from the local storage and retrieval module and to cause the distribution of video clips among a plurality of extended storage and retrieval modules according to video clip usage in the system;

a plurality of extended storage and retrieval modules which communicate with the primary index manager, and which store a plurality of databases including at least one database containing video clips;

a data sequencing interface controlled by the primary index manager and adapted to direct the extended storage and retrieval module to download the requested video clips; and

means for downloading the requested video clips to the multimedia terminal via the local storage and retrieval module.

2. The video clip storage and retrieval system as in claim 1 further comprising a plurality of multimedia terminals to accommodate a plurality of users.

3. The video clip storage and retrieval system as in claim 1 wherein a plurality of extended storage and retrieval modules arc connected to the primary index manager.

4. The video clip storage and retrieval system as in claim 1 wherein the primary manager is further connected to a plurality of remote index managers.

5. The video clip storage and retrieval system as in claim 4 wherein the primary index manager and each remote index manager maintains a list of every video clip stored at the extended storage and retrieval units.

6. The video clip storage and retrieval system as in claim 4 further comprising means for the local storage and retrieval module to attach a regional identifier to each requested video clip before the request is transmitted to the primary index manager.

7. The video clip storage and retrieval system as in claim 6 wherein the primary index manager uses the regional identifier to identify remote index managers containing the requested video clips.

8. The video clip storage and retrieval system as in claim 5 further comprising:

means for searching the local storage and retrieval module to determine whether the requested video clips are stored therein; and

means for modifying the user request to indicate whether the requested video clips are so stored.

9. The video clip storage and retrieval system as in claim 1 wherein the videos are stored in compressed form and the multimedia terminal includes decompression means to allow the user to view the video clip at the multimedia terminal.

10. The video clip storage and retrieval system as in claim 1 wherein the local search and retrieval module contains decompression means for downloading the requested video clips to the user terminals.

11. The video clip storage and retrieval system described in claim 3 wherein the data sequencing interface contains means for sequencing information received from the plurality of extended storage and retrieval module.

12. A video clip storage and retrieval system according to claim 1, wherein the user may request clips from a database at least one of real estate, pharmaceutical, retail sales, travel, and personnel information.

13. The video clip storage and retrieval system as in claim 6 wherein the user may request clips from a database containing real estate information and the regional identifier is one of a ZIP code, cartesian coordinate, and GPS coordinate.

14. A method for storing and retrieving an audio-visual clip from a database comprising the steps of:

searching through the database to select audio-visual clips for viewing and formulating a request for the selected audio-visual clips;

transmitting the request for audio-visual clips from a user'"'"'s multimedia terminal to a local search and retrieval module;

searching the local search and retrieval module to determine whether the requested audio-visual clips are stored therein;

modifying the request within the local search and retrieval module to indicate whether the requested audio-visual clips are stored therein, and by appending a regional identifier to each requested audio-visual clip;

transmitting the modified request to a primary index manager;

using the primary index manager to determine the exact storage location of each audio-visual clip within one or more extended search and retrieval modules;

creating and maintaining a data sequencing interface to direct the extended search and retrieval modules to download the requested audio-visual clips to the data sequencing interface;

downloading the audio-visual clips to the user'"'"'s multimedia terminal via the local search and retrieval module; and

decompressing the audio-visual clips from its compressed state for viewing at the user'"'"'s multimedia terminal.

15. A distributed video clip delivery system comprising:

at least one multimedia terminal through which a user may request video clips from a clip database, wherein the multimedia terminal is connected to a network and is able to receive and display requested video clips via the network;

a plurality of extended storage and retrieval units connected to the network, each storing a plurality of video clips;

at least one primary index manager which communicates with the multimedia terminal via the network and which is adapted to receive and process video clip requests from the multimedia terminal and to cause distribution of video clips among the plurality of extended storage and retrieval units according to video clip usage in the system; and

at least one data sequencing interface controlled by the primary index manager and adapted to direct the extended storage and retrieval units to download the requested video clips to the multimedia terminal.

16. The distributed video clip delivery system of claim 15, wherein said network is the Internet.

17. The distributed video clip delivery system of claim 15, wherein a plurality of the multimedia terminals is associated with each of the primary index managers.

18. The distributed video clip delivery system of claim 15, further comprising a plurality of remote storage and retrieval units, each storing a plurality of video clips, connected to the network.

19. The distributed video clip delivery system of claim 15, wherein said primary index manager maintains a user database containing information on all authorized users.

20. The distributed video clip delivery system of claim 15, wherein said multimedia terminal further comprises a storage buffer for temporary storage of downloaded clips.

21. The system of claim 20, wherein said storage buffer is hosted by a local storage and retrieval unit interposed between the terminal and the interface.

22. The system of claim 21, wherein the storage and retrieval unit maintains a local database of video clips.

23. The system of claim 22, wherein said multimedia terminal can access said local database alternatively to receiving video clips by said network.

24. The distributed video clip delivery system of claim 15, wherein;

certain video clips comprise a plurality of segments; and

the segments are indicated by segment data associated with a segmented clip.

25. The distributed video clip delivery system of claim 24, wherein the segment data comprises non-video information associated with at least one segment.

26. The distributed video clip delivery system of claim 24, wherein the segment data is stored by said primary index manager.

27. The distributed video clip delivery system of claim 26, wherein said segmented clip is stored as a plurality of files on said extended storage and retrieval units.

28. The system of claim 24, wherein the segmented clip is an MPEG file.

29. The method of claim 28, wherein said segment data is stored in a user segment belonging to said MPEG file.

30. A method for distributing a video clip over a network to a user having a multimedia terminal, comprising the steps of:

distributing, by an index manager, video clips among a plurality of clip databases according to video clip usage in the network;

identifying a video clip of interest;

searching a clip database in cooperation with an index manager to retrieve clip information corresponding to the clip of interest;

analyzing the clip information to determine where the clip is stored;

directing, by an index manager, a data sequencing interface to download the clip from a storage location; and

downloading the clip to the multimedia terminal.

31. The method of claim 30, further comprising the step of viewing the clip on a multimedia terminal.

32. The method of claim 31, further comprising the step of storing the clip on a local storage and retrieval unit.

33. The method of claim 31, further comprising the step of updating a user database to reflect additional charges incurred by the user for the download.

34. The method of claim 31, further comprising the steps of:

protecting the clip prior to downloading the clip; and

unprotecting the clip prior to viewing the clip.

35. The method of claim 30, further comprising the step of determining whether the clip is stored at a local storage and retrieval unit before directing a data sequencing interface to download the clip.

36. The method of claim 35, wherein said clip is not downloaded if it is already stored at the local storage and retrieval unit.

37. The method of claim 36, further comprising the step of determining whether the clip is stored on an extended storage and retrieval unit prior to directing a data sequencing interface to download the clip.

38. The method of claim 37, further comprising the step of querying neighboring index managers to determine where the clip is stored if the clip is not stored on an extended storage and retrieval unit.

39. The method of claim 38, further comprising the step of querying the source index manager to determine where the clip is stored if the clip is not stored on a storage and retrieval unit local to said neighboring index managers.

40. The method of claim 30, further comprising the step of making clips available on said network.

41. The method of claim 40, wherein said step of making clips available comprises the substeps of:

uploading a clip to a Web server;

registering the clip with an index manager corresponding to the Web server;

determining which selected index managers on the network will store the clip;

passing the clip to said selected index managers; and

loading the clip to selected extended storage and retrieval units and registering the clip with the index manager corresponding to each such extended storage and retrieval unit.

42. The method of claim 41, wherein said passing step comprises multicasting the clip to said selected index managers.

43. The method of claim 41, wherein each index manager determines whether to load the clip to its corresponding storage and retrieval units.

44. The method of claim 30, further comprising the step of distributing clips for efficient network utilization.

45. The method of claim 44, wherein said distributing step comprises the substeps of:

calculating a first predicted usage of clips for an upcoming period in a given subject area based on historical usage at the same time on previous days and on the same day in previous weeks;

calculating a second predicted usage of clips for an upcoming period based on historical usage at the same time on prior days;

calculating a third predicted usage of clips for an upcoming period based on historical usage in immediately preceding time periods;

combining said predicted usages to determine, for each clip, an overall predicted usage in the upcoming period;

estimating the bandwidth required to accommodate the predicted usage;

determining which popular clips contribute most to the predicted usage; and

moving said popular clips to distribute the load if the estimated bandwidth exceeds a threshold.

46. The method of claim 30, further comprising the step of communicating to the primary index manager any delays experienced in transmitting the clip.

47. The method of claim 46, wherein:

said primary index manager tracks the apparent load experienced by each of its extended storage and retrieval units; and

said primary index manager directs the redistribution of an extended storage and retrieval unit'"'"'s clips if the extended storage and retrieval unit'"'"'s apparent load is greater than a first threshold.

48. The method of claim 47, wherein said primary index manager directs that popular clips be loaded into a RAM buffer if an extended storage and retrieval unit'"'"'s apparent load based on the popular clips is greater than a second threshold.

49. The method of claim 48, wherein said primary index manager directs that clips be downloaded from remote storage and retrieval units associated with neighboring index managers if the data sequencing interface is unable to download from any extended storage and retrieval unit.

50. The method of claim 49, wherein the remote storage and retrieval units are identified by the data sequencing interface by querying the primary index manager.

51. The method of claim 30, further comprising the steps of:

determining whether the clip is segmented; and

if the clip is segmented, determining which segments are desired;

wherein the downloading step downloads only the desired segments.

52. The method of claim 30, further comprising the step of subscribing to desired content.

53. The method of claim 30, further comprising the steps of:

searching a user database on an index manager to retrieve user information corresponding to said user; and

matching the user information to the clip information to determine if the user is authorized to receive said clip prior to the directing step.

54. The method of claim 53, wherein the searching, analyzing, matching, and directing steps are performed by said index manager.

55. The method of claim 53, wherein the matching step includes comparing a rating attribute in said clip information to a rating limit in said user information.

56. A method for distributing a video clip over a network to a user having a multimedia terminal, comprising the steps of:

identifying a video clip of interest;

searching a clip database in cooperation with an index manager to retrieve clip information corresponding to the clip of interest;

analyzing the clip information to determine where the clip is stored;

directing a data sequencing interface to download the clip from a storage location;

downloading the clip to the multimedia terminal;

communicating to the index manager any delays experienced in transmitting the clip;

tracking an apparent load experienced by an extended storage and retrieval unit; and

directing redistribution of an extended storage and retrieval unit'"'"'s clips when the extended storage and retrieval unit'"'"'s apparent load is greater than a first threshold.

57. A method for distributing a video clip over a network to a user having a multimedia terminal, comprising the steps of:

identifying a video clip of interest;

searching a clip database in cooperation with an index manager to retrieve clip information corresponding to the clip of interest;

analyzing the clip information to determine where the clip is stored;

directing a data sequencing interface to download the clip from a storage location;

downloading the clip to the multimedia terminal; and

distributing clips for efficient network utilization, comprising the steps of;

calculating an first predicted usage of clips for a given time period based on historical usage at the same time on prior days;

generating an overall predicted usage according to the first predicted usage;

estimating a bandwidth required to accommodate the overall predicted usage;

determining which popular clips contribute most to the overall predicted usage; and

moving said popular clips to distribute clip retrieval load if the estimated bandwidth exceeds a threshold.

58. The method of claim 57 further including the steps of:

calculating a second predicted usage of clips for the given time period based on historical usage at the same time on previous days and on the same day in previous weeks; and

combining the first predicted usage with the second predicted usage to determine, for each clip, the overall predicted usage for the given time period.

59. The method of claim 58 further including the steps of:

calculating a third predicted usage of clips for the given time period based on historical usage in immediately preceding time periods; and

combining the first predicted usage with the second predicted usage and the third predicted usage to determine, for each clip, the overall predicted usage for the given time period.