SYSTEM AND METHOD FOR RICH MEDIA ANNOTATION

• US 20100023553A1
• Filed: 07/22/2008
• Published: 01/28/2010
• Est. Priority Date: 07/22/2008
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Labs Incorporated (AT&T, Inc.)
• Inventors: GAUSMAN, Paul, Gibbon, David C.
• Granted Patent: US 10,127,231 B2
• Time in Patent Office: Days
• US Class Current: N/A
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

Disclosed herein are systems, methods, and computer readable-media for rich media annotation, the method comprising receiving a first recorded media content, receiving at least one audio annotation about the first recorded media, extracting metadata from the at least one of audio annotation, and associating all or part of the metadata with the first recorded media content. Additional data elements may also be associated with the first recorded media content. Where the audio annotation is a telephone conversation, the recorded media content may be captured via the telephone. The recorded media content, audio annotations, and/or metadata may be stored in a central repository which may be modifiable. Speech characteristics such as prosody may be analyzed to extract additional metadata. In one aspect, a specially trained grammar identifies and recognizes metadata.

Claims

1. A method of rich media annotation, the method comprising:

receiving a first recorded media content;

receiving at least one audio annotation about the first recorded media;

extracting metadata from the at least one of audio annotation; and

associating all or part of the metadata with the first recorded media content.

2. The method of claim 1, wherein additional data elements are also associated with the first recorded media content.

3. The method of claim 1, wherein the audio annotation is a telephone conversation and the recorded media content is captured via the telephone.

4. The method of claim 1, wherein the recorded media content, audio annotations, and/or metadata are stored in a central repository.

5. The method of claim 4, wherein audio annotations and/or metadata stored in the central repository are modifiable.

6. The method of claim 5, wherein the central repository solicits additional metadata from a user about the first recorded media.

7. The method of claim 1, wherein metadata is extracted by analyzing speech prosody.

8. The method of claim 7, wherein speech converted to text is parsed to identify locations, individuals, and/or activities.

9. The method of claim 7, wherein prosody includes characteristics such as tone, amplitude, pitch, and/or rate of speech.

10. The method of claim 1, wherein metadata is extracted using a grammar trained to identify metadata.

11. A system for rich media annotation, the system comprising:

a module configured to receive a first recorded media content;

a module configured to receive at least one audio annotation about the first recorded media;

a module configured to extract metadata from the at least one of audio annotation; and

a module configured to associate all or part of the metadata with the first recorded media content.

12. The system of claim 11, wherein additional data elements are also associated with the first recorded media content.

13. The system of claim 11, wherein the audio annotation is a telephone conversation and the recorded media content is captured via the telephone.

14. The system of claim 11, wherein the recorded media content, audio annotations, and/or metadata are stored in a central repository.

15. The system of claim 14, wherein audio annotations and/or metadata stored in the central repository are modifiable.

16. The system of claim 15, wherein the central repository solicits additional metadata from a user about the first recorded media.

17. The system of claim 11, wherein metadata is extracted by analyzing speech prosody.

18. The system of claim 17, wherein speech converted to text is parsed to identify locations, individuals, and/or activities.

19. The system of claim 17, wherein prosody includes characteristics such as tone, amplitude, pitch, and/or rate of speech.

20. The system of claim 11, wherein metadata is extracted using a grammar trained to identify metadata.

21. A computer-readable medium storing a computer program having instructions for rich media annotation, the instructions comprising:

receiving a first recorded media content;

receiving at least one audio annotation about the first recorded media;

extracting metadata from the at least one of audio annotation; and

associating all or part of the metadata with the first recorded media content.

22. The computer-readable medium of claim 21, wherein additional data elements are also associated with the first recorded media content.

23. The computer-readable medium of claim 21, wherein the audio annotation is a telephone conversation and the recorded media content is captured via the telephone.

24. The computer-readable medium of claim 21, wherein the recorded media content, audio annotations, and/or metadata are stored in a central repository.

25. The computer-readable medium of claim 24, wherein audio annotations and/or metadata stored in the central repository are modifiable.

26. The computer-readable medium of claim 25, wherein the central repository solicits additional metadata from a user about the first recorded media.

27. The computer-readable medium of claim 21, wherein metadata is extracted by analyzing speech prosody.

28. The computer-readable medium of claim 27, wherein speech converted to text is parsed to identify locations, individuals, and/or activities.

29. The computer-readable medium of claim 27, wherein prosody includes characteristics such as tone, amplitude, pitch, and/or rate of speech.

30. The computer-readable medium of claim 21, wherein metadata is extracted using a grammar trained to identify metadata.