Video archiving and processing method and apparatus

• US 20040216173A1
• Filed: 04/11/2003
• Published: 10/28/2004
• Est. Priority Date: 04/11/2003
• Status: Abandoned Application

• Current Assignee: Venaca.Com Co.
• Original Assignee: Venaca.Com Co.
• Inventors: Spector, Scott, Horoszowski, Peter, Samaan, Andrew, Grippo, George
• Application Number:
  US10/412,744
• Publication Number:
  US 20040216173A1
• Time in Patent Office: Days
• US Class Current: 725/145
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Abstract

In a video archiving and processing method, plural low-resolution video data streams in different formats are generated from an incoming stream of high-resolution video frame data. One of the low-resolution video data streams is a storyboard in the form of a low-resolution video data stream wherein successive frames each correspond to a respective different scene of the high-resolution video frame data. This storyboard is generated by a computer programmed to automatically identify scene changes in successive frames encoded in the video frame data.

Claims

1. A video archiving and processing method comprising:

providing a stream of high-resolution video frame data;

operating at least one digital computer to automatically identify scene changes in successive frames encoded in said video frame data;

automatically generating a storyboard in the form of a low-resolution video data stream wherein successive frames each correspond to a respective different scene of said high-resolution video frame data; and

storing said high-resolution video frame data and said low-resolution video data stream.

2. The method defined in claim 1, further comprising:

providing textual material corresponding to at least some frames of said high-resolution video frame data;

storing said textual material;

automatically generating a searchable index of said textual material, said index including identification codes associating said textual material with selected frames of said low-resolution video data stream; and

storing said searchable index including said identification codes.

3. The method defined in claim 2 wherein the providing of said textual material includes automatically extracting said textual material from text data included in said high-resolution video data.

4. The method defined in claim 3 wherein said text data includes closed caption data.

5. The method defined in claim 3 wherein said text data includes subtitles.

6. The method defined in claim 2 wherein the providing of said textual material includes inputting said textual material from a source other than said high-resolution video data.

7. The method defined in claim 6 wherein said textual material includes annotations related to subject matter of said high-resolution video data.

8. The method defined in claim 2, further comprising:

receiving, from a user computer, a request for a selected portion of the stored textual material;

in response to said request, transmitting said portion of the stored textual material to said user computer;

subsequently receiving from said user computer an edit request;

in response to said edit request, storing an edited version of said portion of the stored textual material.

9. The method defined in claim 2 wherein said identification codes are time codes.

10. The method defined in claim 1 wherein the operating of said computer to automatically identify scene changes includes analyzing changes in color.

11. The method defined in claim 1 wherein the operating of said computer to automatically identify scene changes includes a vector analysis of successive frames of said video frame data.

12. A video archiving and processing method comprising:

providing a stream of high-resolution video frame data;

storing a high-resolution version of said video frame data;

operating at least one digital computer to automatically generate, from said stream of video frame data, a plurality of low-resolution video data streams in respective formats different from each other; and

storing said low-resolution data streams.

13. The method defined in claim 12, further comprising:

providing textual material corresponding to at least some frames of said high-resolution video frame data;

storing said textual material;

automatically generating a searchable index of said textual material, said index including identification codes associating said textual material with selected frames of said low-resolution video data stream; and

storing said searchable index including said identification codes.

14. The method defined in claim 13 wherein the providing of said textual material includes automatically extracting said textual material from text data included in said high-resolution video data.

15. The method defined in claim 14 wherein said text data includes closed caption data.

16. The method defined in claim 14 wherein said text data includes subtitles.

17. The method defined in claim 13 wherein the providing of said textual material includes inputting said textual material from a source other than said high-resolution video data.

18. The method defined in claim 17 wherein said textual material includes annotations related to subject matter of said high-resolution video data.

19. The method defined in claim 13, further comprising:

receiving, from a user computer, a request for a selected portion of the stored textual material;

in response to said request, transmitting said portion of the stored textual material to said user computer;

subsequently receiving from said user computer an edit request;

in response to said edit request, storing an edited version of said portion of the stored textual material.

20. The method defined in claim 13 wherein said identification codes are time codes.

21. The method defined in claim 12 wherein the operating of said computer includes:

selecting sets of transcode rules from a store of possible rules to create transcode profiles for respective ones of said low-resolution video data streams, said transcode profiles corresponding to respective ones of said formats; and

generating said low-resolution video data streams in accordance with the respective transcode profiles.

22. The method defined in claim 21 wherein the operating of said computer further comprises:

receiving transcode-profile instructions from a user computer; and

creating at least one of said transcode-profiles pursuant to said instructions.

23. The method defined in claim 12, further comprising generating said high-resolution version of said video frame data.

24. The method defined in claim 23 wherein the operating of said computer includes generating said low-resolution data streams from said high-resolution version of said video frame data.

25. The method defined in claim 12 wherein at least one of said low-resolution video data streams is a storyboard in the form of a series of video frames representing respective different scenes of said video frame data.

26. The method defined in claim 25 wherein the operating of said computer includes automatically generating said storyboard at least indirectly from said video frame data.

27. The method defined in claim 26 wherein the generating of said storyboard includes a color analysis of video frames in said video frame data.

28. The method defined in claim 26 wherein the generating of said storyboard includes a vector analysis of video frames in said video frame data.

29. The method defined in claim 26 wherein the generating of said storyboard includes detecting time code in said video frame data.

30. The method defined in claim 25 wherein the operating of said computer includes:

detecting time code in said video frame data; and

generating said storyboard in part by selecting frames identified via said time code.

31. The method defined in claim 12 wherein said high-resolution version is in a format taken from the group consisting of MPEG-1 format and MPEG-2 format, the format of at least one of said low-resolution video data streams being taken from the group consisting of Windows Media and Real.

32. The method defined in claim 12, further comprising:

generating a video clip from said high-resolution version of said video frame data, said video clip having a defined in-point or starting frame and a defined out-point or end frame;

storing said video clip; and

transmitting said video clip to another computer in response to a request from a user computer.

33. The method defined in claim 12, further comprising:

accessing at least one of the stored low-resolution video data streams in lieu of the stored high-resolution version of said video frame data;

receiving editing instructions based on the accessed one of the stored low-resolution video data streams; and

in response to the received editing instructions, generating a video clip from the stored high-resolution version of said video frame data.

34. The method defined in claim 12, further comprising:

receiving, from a user computer, a request for a stored low-resolution data stream;

in response to said request, transmitting at least a portion of the requested low-resolution data stream to said user computer;

subsequently receiving from said user computer an edit decision list pertaining to said requested low-resolution data stream;

in response to said edit decision list, automatically generating a video clip from a high-resolution video frame data corresponding to said requested low-resolution data stream, the generated video clip being delimited in accordance with said edit decision list; and

transmitting said video clip to said user computer.

35. A video archiving and processing method comprising:

providing a stream of high-resolution video frame data;

operating at least one digital computer to automatically generate, from said stream of video frame data, at least one low resolution video data stream;

providing textual material corresponding to at least some frames of said high-resolution video frame data;

storing said textual material;

automatically generating a searchable index of said textual material, said index including identification codes associating said textual material with selected frames of said low resolution video data stream; and

storing said searchable index including said identification codes.

36. The method defined in claim 35 wherein the providing of said textual material includes automatically extracting said textual material from text data included in said high-resolution video data.

37. The method defined in claim 36 wherein said text data includes closed caption data.

38. The method defined in claim 36 wherein said text data includes subtitles.

39. The method defined in claim 35 wherein the providing of said textual material includes inputting said textual material from a source other than said high-resolution video data.

40. The method defined in claim 39 wherein said textual material includes annotations related to subject matter of said high-resolution video data.

41. The method defined in claim 35, further comprising:

receiving, from a user computer, a request for a selected portion of the stored textual material;

in response to said request, transmitting said portion of the stored textual material to said user computer;

subsequently receiving from said user computer an edit request;

in response to said edit request, storing an edited version of said portion of the stored textual material.

42. The method defined in claim 35 wherein said identification codes are time codes.

43. A video processing method comprising:

storing a high-resolution version and a low-resolution version of a video asset;

receiving a request from a user computer via a network;

in response to said request, transmitting at least a portion of said low-resolution version of said video asset across said network;

subsequently receiving edit instructions from said user computer pertaining to said video asset;

producing a video clip derived from said high-resolution version of said video asset in response to the received editing instructions; and

transmitting said video clip over said network.

44. The method defined in claim 43, further comprising automatically generating said low-resolution version from said high-resolution version.

45. The method defined in claim 44 wherein said low-resolution version is a storyboard version in the form of a sequence of video frames representing respective scenes of said video asset.

46. The method defined in claim 43, further comprising:

storing textual material relating to said video asset;

storing identification codes associating said textual material with portions of said video asset;

automatically generating a searchable index of said textual material;

storing said index; and

accessing said index in response to a request from said user computer.

47. The method defined in claim 43 wherein the transmitting of said video clip is to a target address and at a transmission time specified by instructions received from said user computer.

48. The method defined in claim 43, further comprising commencing a retrieval of said high-resolution version from storage prior to the receiving of said edit instructions.

49. The method defined in claim 43 wherein said high-resolution version of said video asset includes a plurality of different scenes, said video clip including fewer than all of said scenes.

55. The method defined in claim 43 wherein said high-resolution version of said video asset includes a plurality of different scenes, said video clip including fewer than all of said scenes.

50. A video processing method comprising:

storing (i) a high-resolution version of a video asset, (ii) a low-resolution version of said video asset, (iii) textual material pertaining to said video asset; and

(iv) a searchable index of said textual material;

receiving a request from a user computer via a network;

in response to said request, transmitting across said network at least one of (a) a portion of said low-resolution version of said video asset, (b) a portion of said textual material, and (c) a portion of said index;

subsequently receiving edit instructions from said user computer to generate a video clip from said high-resolution version of said video asset;

prior to the receiving of said edit instructions, commencing a retrieval of said high-resolution version from storage.

51. The method defined in claim 50, further comprising automatically generating said low-resolution version from said high-resolution version.

52. The method defined in claim 51 wherein said low-resolution version is a storyboard version in the form of a sequence of video frames representing respective scenes of said video asset.

53. The method defined in claim 50, further comprising automatically generating said index from said textual material.

54. The method defined in claim 50, further comprising:

generating said video clip from said high-resolution version of said video asset; and

transmitting said video clip to a target address and at a transmission time specified by instructions received from said user computer.

56. A video archiving and processing apparatus comprising:

a video input receiving a stream of high-resolution video frame data;

at least one digital computer operatively connected to said video input for analyzing said stream of high-resolution video frame data to automatically identify scene changes in successive frames encoded in said video frame data and for automatically generating a storyboard in the form of a low-resolution video data stream wherein successive frames each correspond to a respective different scene of said high-resolution video frame data; and

a memory operatively connected to said computer for storing said high-resolution video frame data and said low-resolution video data stream.

57. The apparatus defined in claim 56 wherein said computer is programmed to generate a searchable index of textual material corresponding to at least some frames of said high-resolution video frame data, said index including identification codes associating said textual material with selected frames of said low-resolution video data stream, said computer being connected to said memory for storing therein said searchable index including said identification codes.

58. The apparatus defined in claim 57 wherein said computer is further programmed to automatically extract said textual material from text data included in said high-resolution video data.

59. A video archiving and processing apparatus comprising:

a video input receiving a stream of high-resolution video frame data;

at least one digital computer operatively connected to said video input for generating, from said stream of video frame data, a plurality of low-resolution video data streams in respective formats different from each other; and

a memory operatively connected to said computer for storing said low-resolution data streams and a high-resolution version of said video frame data.

60. The apparatus defined in claim 59 wherein said computer is programmed to generate a searchable index of textual material corresponding to at least some frames of said high-resolution video frame data, said index including identification codes associating said textual material with selected frames of said low-resolution video data stream, said computer being connected to said memory for storing therein said searchable index including said identification codes.

61. The apparatus defined in claim 60 wherein said computer is further programmed to automatically extract said textual material from text data included in said high-resolution video data.

62. A video processing apparatus comprising:

a memory storing a high-resolution version and a low-resolution version of a video asset;

an interface for receiving a request from a user computer via a network, said interface being operatively connected to said memory for extracting at least a portion of said low-resolution version of said video asset from said memory and transmitting said portion of said low-resolution version of said video asset across said network; and

an editing tool operatively connected to said interface and said memory for generating, in response to editing instructions received from said user computer over said network, a video clip from said high-resolution version of said video asset.

63. A video processing apparatus comprising:

a memory storing (i) a high-resolution version of a video asset, (ii) a low-resolution version of said video asset, (iii) textual material pertaining to said video asset; and

(iv) a searchable index of said textual material;

an interface for receiving a request from a user computer via a network, said interface being connected to said memory for accessing said memory to transmit, in response to said request and across said network, at least one of (a) a portion of said low-resolution version of said video asset, (b) a portion of said textual material, and (c) a portion of said index;

a memory access unit operatively connected to said memory and said interface for commencing a retrieval of said high-resolution version from said memory upon the receiving of said request and prior to the receiving of edit instructions from said user computer to generate a video clip from said high-resolution version of said video asset.