Media access system

• US 7,668,869 B2
• Filed: 04/03/2007
• Issued: 02/23/2010
• Est. Priority Date: 04/03/2006
• Status: Expired due to Fees

• Current Assignee: Digitalsmiths Corporation (Adeia, Inc.)
• Original Assignee: Digitalsmiths Corporation (Adeia, Inc.)
• Inventors: Remsey, James A., Weinberger, Benjamin J.
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US11/695,766
• Publication Number:
  US 20070233738A1
• Time in Patent Office: 1,057 Days
• Field of Search: 707/101, 707/102, 707/104.1, 715/210, 715/719, 709/203, 709/207
• US Class Current: 707/741
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content

Abstract

Methods and systems for indexing video files, the method comprising selecting and loading a video into a video editing program, segmenting the video into short clips and creating an edit decision list (EDL) containing information corresponding to the short clips, importing the video and EDL, parsing the EDL, and automatically populating a database with names of the short clips and corresponding EDL information, and cataloging the video by establishing specific identifiers associated with the video, transcribing audio from each of the short clips and associating the transcribed audio with the respective short clip, associating visual identifiers with each short clip, extracting metadata from each short clip and associating the metadata with the respective short clip, storing the transcribed audio, visual identifiers, and metadata in the database, and indexing the database according to the specific identifiers.

Claims

1. A method for indexing video files, the method comprising the steps of:

selecting a video and loading the video into a video editing program;

segmenting the video into short clips using the video editing program, wherein each short clip includes time codes identifying where the respective short clip occurs within the video;

creating an edit decision list (EDL), the EDL containing information corresponding to the video and each of the short clips segmented from the video;

importing the video and EDL, parsing the EDL, and automatically populating a database with names of the short clips and with the time codes of the short clips obtained from the EDL information; and

cataloging the video for later searching, identification, and retrieval of one or more of the short clips contained in the video, the step of cataloging further comprising;

establishing a plurality of specific identifiers associated with the video wherein the specific identifiers include names of actors appearing in the video, names of characters played by the actors, physical locations shown in the video, common actions performed by the characters in the video, and common physical objects appearing in the video;

analyzing each short clip and identifying which of the previously established specific identifiers of the plurality of specific identifiers associated with the video are included within each respective short clip;

transcribing audio from the video and associating the relevant portions of the transcribed audio with the corresponding short clip and with the corresponding character who spoke the audio in the short clip;

extracting metadata from each short clip and associating the metadata with the respective short clip; and

storing the transcribed audio, the identified specific identifiers, and metadata associated with each of the short clips in the database in a computer searchable format for later searching and retrieval of selected short clips.

2. The method of claim 1, further comprising retrieving one or more selected short clips from the database by selecting and searching upon one or more of the specific identifiers.

3. The method of claim 1, further comprising importing the video and EDL using a web interface.

4. The method of claim 1, further comprising importing the video and EDL using a standalone program.

5. The method of claim 1, wherein the video includes one or more episodes of a multi-season television series and wherein the information contained in the EDL includes season number and episode number of the short clips in the video.

6. The method of claim 1, further comprising converting the video into a digital format.

7. The method of claim 1, wherein the step of cataloging further comprises adding a new specific identifier to the plurality of specific identifiers associated with the video.

8. The method of claim 7, wherein the step of adding the new specific identifier occurs after the step of analyzing at least one short clip of the video.

9. The method of claim 1, wherein establishing the plurality of specific identifiers occurs prior to and independent of the step of cataloging the video.

10. The method of claim 1, wherein the step of transcribing audio further comprises checking the transcript for errors, and ensuring information is formatted correctly.

11. A method for indexing video files, the method comprising the steps of:

selecting and loading a video into a video editing program;

segmenting the video into short clips using the video editing program, wherein each short clip includes time codes identifying where the respective short clip occurs within the video;

creating an edit decision list (EDL), the EDL containing information corresponding to the video and each of the short clips of the video;

importing the video and EDL, parsing the EDL, and automatically populating a database with names of the short clips and with the time codes of the short clips obtained from the EDL information; and

cataloging the video for later searching, identification, and retrieval of one or more of the short clips contained in the video, the step of cataloging further comprising;

establishing a plurality of specific identifiers associated with the video wherein the specific identifiers include names of actors appearing in the video, names of characters played by the actors, physical locations shown in the video, common actions performed by the characters in the video, and common physical objects appearing in the video;

analyzing selected frames of each short clip and identifying which of the previously established specific identifiers of the plurality of specific identifiers are included within the selected frames;

associating the identified specific identifiers of the selected frames with the corresponding short clips; and

storing the associated identified specific identifiers with the corresponding short clips in the database in a computer searchable format for later searching and retrieval of selected short clips.

12. The method of claim 11, further comprising transcribing audio from each of the short clips, associating the transcribed audio with the respective short clip, storing the transcribed audio in the database, and storing the association between the transcribed audio and the respective short clip in the database.

13. The method of claim 12, wherein the step of transcribing audio further comprises checking the transcript for errors, and ensuring information is formatted correctly.

14. The method of claim 11, further comprising extracting metadata from each short clip, associating the metadata with the respective short clip, storing the metadata in the database, and storing the association between the metadata and the respective short clip in the database.

15. The method of claim 11, wherein the step of cataloging further comprises adding a new specific identifier to the plurality of specific identifiers associated with the video.

16. The method of claim 11, further comprising retrieving one or more selected short clips from the database by selecting and searching upon one or more of the specific identifiers.

17. The method of claim 11, further comprising importing the video and EDL using a web interface.

18. The method of claim 11, further comprising importing the video and EDL using a standalone program.

19. The method of claim 11, wherein the video includes one or more episodes of a multi-season television series and wherein the information contained in the EDL includes season number and episode number of the short clips in the video.

20. The method of claim 11, further comprising converting the video into a digital format.

21. The method of claim 11, wherein the step of cataloging further comprises adding a new specific identifier to the plurality of specific identifiers associated with the video.

22. The method of claim 21, wherein the step of adding the new specific identifier occurs after the step of analyzing selected frames of at least one short clip of the video.

23. The method of claim 11, wherein the step of cataloging the video further comprises separating the video into a plurality of individual frames and images.

24. The method of claim 11, wherein the step of analyzing selected frames of each short clip and identifying which of the previously established specific identifiers of the plurality of specific identifiers are included within the selected frames further comprises extracting objects and images from the selected frames using a visual recognition program.

25. The method of claim 24, wherein the selected frames comprise frames occurring after a scene or camera angle change within the respective short clip.

26. The method of claim 24, wherein the extracted objects and images from the selected frames are converted to textual representations of the objects and images.