Techniques for relating arbitrary metadata to media files

• US 8,065,604 B2
• Filed: 12/30/2004
• Issued: 11/22/2011
• Est. Priority Date: 12/30/2004
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Blankinship, Erik Jackson
• Primary Examiner(s): RIES, LAURIE ANNE
• Application Number:
  US11/027,117
• Publication Number:
  US 20060149781A1
• Time in Patent Office: 2,518 Days
• Field of Search: 715/201, 715/200, 715/229, 715/230
• US Class Current: 715/229
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded

Abstract

A metadata text file is used to make media files searchable and rearrangeable. The metadata file includes a sequence of relaters that relate items of metadata to segments of media files. The metadata file can be searched for an item of metadata and the item'"'"'s relater used to locate the corresponding media file segment, or be used to “play” the metadata files by displaying segments in an order depending on the order of the relaters. New combinations of media file segments may be made by adding, deleting, or reordering the relaters in the metadata text file. The metadata file is used to relate metadata to media files in systems for making fan vids, for comparing the text of a book with a movie, or that use temperature readings from pots being used to cook a recipe to locate sections of a cooking video.

Claims

1. A text object used by an application that manipulates segments of one or more other objects, the text object and the other objects being stored in memory accessible to a processor, the text object being used when the processor is executing the application to manipulate the segments, and the text object comprising:

a sequence of relaters, a relater including

a first portion that is a segment locator that locates a segment of the segments; and

a second portion that is an application metadata value, the application metadata value being neither an identifier for the relater in the text object nor belonging to a class of metadata values whose values are metadata values in the segment, the application metadata value being related by the application to the segment located by the first portion and

the processor manipulating a segment of the segments when executing the application by responding, to the relater'"'"'s application metadata value by locating the segment using the relater'"'"'s segment locator and manipulating, the located segment as required by the application.

2. The text object set forth in claim 1 wherein:

the relaters are XML constructs in the text object

3. The text object set forth in any one of claims 1 or 2 wherein:

the processor selects the relater to be responded to by searching the text object for the relater'"'"'s application metadata value.

4. The text object set forth in any one of claims 1 or 2 wherein:

the processor further has access to a display device; and

the processor manipulates the segment located using the segment locator by displaying the located segment.

5. The text object set forth in any one of claims 1 or 2 wherein:

the processor further has access to a display device; and

the processor manipulates the segment by altering the order of the sequence of relaters in the text object,

the processor displaying the segments in an order corresponding to the altered order of the sequence of relaters.

6. The text object set forth in any one of claims 1 or 2 wherein:

the other objects are accessible to the processor via a network.

7. The text object set forth in claim 6 wherein:

the other objects are stored in servers in the network.

8. The text object set forth in any one of claims 1 or 2 wherein:

the other objects are media objects; and

the segment locator in the relater uses an in point and an out point in one of the media objects to specify the segment.

9. The text object set forth in any one of claims 1 or 2 wherein:

the other objects have a text related thereto;

the text object includes the text;

the application metadata value is a portion of the text; and

the segment corresponds to the portion of the text.

10. The text object set forth in claim 9 wherein:

the other objects are media objects.

11. The text object set forth in any one of claims 1 or 2 wherein:

a set of values is related to the segments;

the application metadata value in the relater is a value in the set thereof; and

the segment specifier specifies the segment that is related to the value.

12. The text object set forth in claim 11 wherein:

the segments relate to stages in a process that is monitored by instruments; and

the application metadata values are values that may be recorded by the instruments.

13. A memory device that is readable by a processor, the memory device being characterized in that:

the memory device contains the text object set forth in any one of claims 1 or 2.

14. The text object set forth in any one of claims 1 or 2 wherein:

the processor further manipulates the segments according to an order of the relaters in the sequence.

15. The text object set forth in claim 14 wherein:

the order of the relaters in the sequence is determined at least in part by the application metadata of the relaters.

16. A method of making a text object used by an application that manipulates segments of one or more other objects, the text object being stored in a memory accessible to a processor for an application to be executed by the processor, the text object including one or more relaters, a relater relating an application metadata value to a segment of an object and having a first portion which is the application metadata value and a second portion that is a segment locator that locates the segment,

the method comprising the steps performed by the processor, the processor being programmed to perform the steps, of:

obtaining an application metadata value, the application metadata value being neither an identifier for the relater in the text object nor belonging to a class of metadata values whose values are metadata values in the segment;

obtaining a location in the object of the segment that the application relates to the application metadata value;

making a relater in which the relater'"'"'s first portion represents the location and the relater'"'"'s second portion represents the application metadata value; and

placing the relater in the text object.

17. The method of claim 16, wherein:

the relater is one of a sequence thereof in the text object.

18. A method of viewing a first version and a second version of a work, a segment of the first version being related to a segment of the second version by a relater, the relater being included in a text object stored in a memory accessible to a processor,

the method comprising the steps performed by the processor, the processor being programmed to perform the steps, of:

obtaining the text object;

finding the relater in the text object; and

displaying the segment of the first version and the segment of the second version that are related by the relater in a display that is accessible to the processor.

19. Apparatus that permits an application to manipulate segments of one or more objects stored in memory, the apparatus including a processor that executes the application and has access to the memory and

the apparatus comprising:

a text object for the application stored in the memory, the text object including a sequence of relaters, a relater including a first portion that is a segment locator and a second portion that is an application metadata value, the application metadata value being neither an identifier for the relater in the text object nor belonging to a class of metadata values whose values are metadata values in the segment, the application metadata value being related by the application to a content of the segment located by the first portion; and

in the course of executing the application, the processor locates a relater according, to the relater'"'"'s application metadata value and manipulates the located segment as required by the application.

20. The apparatus set forth in claim 19 wherein:

the relaters are XML constructs in the text object.

21. The apparatus set forth in any one of claims 19 or 20 wherein:

the application receives a search value and applies the search value to the application metadata values to locate the relater.

22. The apparatus set forth in any one of claims 19 or 20 wherein:

the apparatus further includes a display device to which the processor has access; and

the application execution responds to an application metadata value selection input by displaying a selected metadata value together with its associated segment in the display device.

23. The apparatus set forth in claim 22 wherein:

the selected application metadata value is from a first version of a work; and

the associated segment is from a second version of the work.

24. The apparatus set forth in claim 22 wherein:

a user makes the application metadata value selection input by selecting a relater from a representation of the sequence of relaters in the display.

25. The apparatus set forth in claim 24 wherein:

the representation of the sequence of relaters is a line wherein a position in the line corresponds to a relater in the sequence.

26. The apparatus set forth in any one of claims 19 or 20 wherein:

the relater relates the application metadata value to more than one segment; and

the application execution displays the segments associated with the relater together in the display device.

27. A memory device that is readable by a processor, the memory device being characterized in that:

the memory device contains code which, when executed by the processor, implements the apparatus set forth in any one of claims 19 or 20.

28. The text object set forth in claim 19 wherein:

the relaters are XML constructs in the text object.

29. A memory device that is readable by a processor, the memory device being characterized in that:

the memory device contains the text object set forth in any one of claims 19 or 28.

30. Apparatus that permits an application to display segments of at least two other objects, the other objects being stored in memory accessible to a processor, and

the apparatus comprising:

a text object for the application stored in the memory, the text object including a sequence of relaters, a relater including

a first portion that is a first segment locator that locates a segment of the segments in one of the at least two other objects; and

a second portion that is another segment locator that locates a segment in another of the at least two other objects;

the processor manipulating a segment of the segments when executing the application by locating the segment in the one of the at least two other objects using the first segment locator and/or the segment in the other of that least two other objects using the second segment locator and manipulating the located segment as required by the application, whereby the relater relates the segment and the other segment to each other.

31. The apparatus set forth in claim 30 wherein:

the apparatus further includes to display device to which the processor has access; and

the application execution simultaneously displays the segment in the one object and the segment in the other object in the display device.

32. The apparatus set forth in claim 31 wherein:

the one object is a first version of a work; and

the other object is from a second version of the work.

33. A memory device that is readable by a processor, the memory device being characterized in that:

the memory device contains the text object set forth in claim 30.

34. Apparatus that permits an application to relate a text work to a video work derived therefrom and to manipulate the text work and/or the video work, there being a digital representation of the video work in a digital memory and the digital representation being divided into segments, the apparatus including a processor that executes the application and has access to the digital memory and to a display device and the apparatus being characterized by:

a digital text object stored in the memory, the text object including the text of the text work and segment locators located in the text, a segment locator specifying a segment of the digital representation of the video work that is related to the portion of the digital text object in which the segment locator is located, and

in the course of executing the application, the processor encounters the segment locator in the text and displays the text that contains the segment locator simultaneously with the segment specified by the segment locator.

35. A memory device that is readable by a processor, the memory device being characterized in that:

the memory device contains the text object set forth in claim 34.