Annotation system for creating and retrieving media and methods relating to same

• US 7,992,215 B2
• Filed: 04/08/2009
• Issued: 08/02/2011
• Est. Priority Date: 12/11/2002
• Status: Active Grant

• Current Assignee: Trio Systems, LLC
• Original Assignee: Trio Systems, LLC
• Inventors: Bartholomew, Alan
• Primary Examiner(s): Chai, Longbit
• Application Number:
  US12/420,619
• Publication Number:
  US 20090198685A1
• Time in Patent Office: 846 Days
• Field of Search: 726/30
• US Class Current: 726/30
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content

Abstract

The invention described herein is generally directed to a method and apparatus for creating and retrieving audio data. In one implementation the invention comprises an annotation system configured to record, store, and retrieve media. The annotation system contains a set of client-processing devices configured to capture media for subsequent playback. Each client-processing device typically contains a record button to initiate the capture and is configured upon performing the capture operation to trigger an association of a unique ID with the media. The client-processing devices are further configured to upload the media and a unique ID to a server for purposes of storage. The server obtains the media and unique ID for subsequent retrieval and provides the media and the unique ID to at least one client-processing device from the set of client processing devices.

Claims

1. An annotation system configured to record, store, and retrieve media data comprising:

a first device capable of capturing or serving media, the first device comprising first hardware and first software for controlling the first hardware to perform the following steps;

capturing or selecting media data in response to a user command;

associating a media identifier (ID) with the media data, wherein the media ID is a globally unique value within the annotation system;

providing the media ID for purposes of retrieval;

associating at least a media classification attribute value with the media data wherein the media classification attribute value comprises information corresponding to a hierarchical, multi-tier classification, the multi-tier classification being descriptive of the media data and comprising classification data comprising a category attribute value, a context attribute value, and a keyword attribute value;

encoding the classification data into a knowledge attribute data that is a pseudo-unique number;

storing a knowledge object, the knowledge object comprising a representation of the media data and the knowledge attribute data;

accepting the media ID from a media retrieval device;

transferring information represented in the knowledge object to the media retrieval device in response to receiving the media ID from the media retrieval device;

accepting a media classification query from the media retrieval device, the media classification query comprising at least a query value wherein the query value comprises information corresponding to a hierarchical, multi-tier classification that is descriptive of the requested media data and that comprises classification data encoding a category search parameter, a context search parameter, and a keyword search parameter; and

forwarding information represented in the knowledge object to the media retrieval device in response to the knowledge attribute data matching the accepted media classification query value.

2. The annotation system of claim 1 further comprising a second device comprising second hardware and second software to cause the second hardware to perform the following steps:

sending the media ID to the first device;

receiving the media data from the first device;

creating the media classification query value;

providing the media classification query value to the first device; and

receiving the media data matching the media classification query value from the first device.

3. The annotation system of claim 2 wherein the second device provides the media data received from the first device to a user of the second device.

4. The annotation system of claim 2 wherein the second device creates the media classification query value in response to commands from a user of the second device.

5. The system of claim 1 wherein the media classification attribute value comprises:

a category attribute value, a context attribute value, and the keyword attribute value of the media data, wherein the category attribute value, the context attribute value, and the keyword attribute value describe the media data, wherein the category attribute value comprises a general classification category, the context attribute value comprises a classification type, and the keyword attribute value comprises a classification detail.

6. The annotation system of claim 1 wherein the first software further comprises steps for representing the classification attribute value as a numeric value by generating a hash value from the keyword attribute value and the one or more narrowing classification terms.

7. An annotation system configured to record, store, and provide retrieval of media data comprising:

a media capture device and a media server device, the media capture device and the media server device comprising respective hardware and software for causing the annotation system to perform the following steps;

capturing media data in response to a user command;

associating a media identifier (ID) with the media data, wherein the media ID is a globally unique value within the annotation system;

providing the media ID for purposes of retrieval;

associating at least a media classification attribute value with the media data wherein the media classification attribute value comprises;

a hierarchical, multi-tier classification descriptive of the media data, the multi-tier classification comprising knowledge attribute data comprising a category attribute value, a context attribute value, and a keyword attribute value;

encoding the classification data into a knowledge attribute data that is a pseudo-unique number;

storing a knowledge object in the media server device wherein the knowledge object comprises a representation of the media data and the knowledge attribute data;

accepting the media ID from a media retrieval device;

transferring information represented in the knowledge object to the media retrieval device in response to receiving the media ID;

accepting a media classification query value from the media retrieval device, the media classification query value comprising one or more query values wherein a query value comprises information corresponding to a hierarchical, multi-tier classification that is descriptive of the requested media data and that encodes a category search parameter, a context search parameter, and a keyword search parameter; and

forwarding information represented in the knowledge object to the media retrieval device in response to the knowledge attribute data matching the accepted media classification query value.

8. The system of claim 7 further comprising the media retrieval device, the media retrieval device comprising hardware and software to cause the media retrieval device hardware to perform the following steps:

sending the media ID to the media server device;

receiving the media data from the media server device;

creating the media classification query value;

providing the media classification query value to the media server device; and

receiving the media data matching the media classification query value from the first device.

9. The system of claim 8 wherein the media retrieval device provides the media data received from the media server device to the user of the media retrieval device.

10. The system of claim 8 wherein the media retrieval device creates the media classification query value in response to commands by the user of the media retrieval device.

11. The system of claim 8 wherein the software of the media retrieval device further comprises steps to cause the media retrieval device to receive media forwarded from the media server device and to perform the functions of the media server device.

12. The system of claim 8 wherein the media capture device and the media server device are the same device.

13. The system of claim 7 wherein the media classification attribute value comprises:

a category attribute value, a context attribute value, and the keyword attribute value of the media data, wherein the category attribute value, the context attribute value, and the keyword attribute value describe the media data, wherein the category attribute value comprises a general classification category, the context attribute value comprises a classification type, and the keyword attribute value comprises a classification detail.

14. The annotation system of claim 7 wherein the software of at least one of the media capture device and the media server device causes the annotation system to perform the following steps:

representing the classification attribute value as a numeric value by generating a hash value from the keyword attribute value and the one or more narrowing classification terms; and

representing the classification query as at least a numeric value by generating a hash value from a keyword search parameter and one or more narrowing search parameters.

15. The annotation system of claim 7 wherein the media classification attribute value is represented as a reference to an attribute specification document.

16. The annotation system of claim 7 wherein the software of at least one of the media capture device and the media server device causes the annotation system to perform the following steps:

identifying the knowledge object by a recommender as being of interest to a content consumer; and

,

recommending the knowledge object to the content consumer.

17. The annotation system of claim 7 wherein the software of at least one of the media retrieval device and the media server device causes the annotation system to perform the following steps:

forming a subscription specification wherein the subscription specification comprises a hierarchical, multi-tier classification attribute comprising a keyword attribute value combined with one or more narrowing classification terms;

accepting the subscription specification for storage on the media server; and

forwarding information represented in the knowledge object to the media retrieval device in response to the knowledge object classification attribute value matching the accepted subscription specification.