Multimedia system generating audio trigger markers synchronized with video source data and related methods

• US 8,887,190 B2
• Filed: 05/28/2009
• Issued: 11/11/2014
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Original Assignee: Harris Corporation (L3Harris Technologies, Inc.)
• Inventors: McDonald, Robert, Dunkel, Christopher T., Heminghous, John, Peterson, Aric, Bakir, Tariq
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): BROWN, RUEBEN M
• Application Number:
  US12/473,321
• Publication Number:
  US 20100306796A1
• Time in Patent Office: 1,993 Days
• Field of Search: 725/18, 725/19, 704/235, 704/268, 704/236, 704/251
• US Class Current: 725/18
• CPC Class Codes: G06F 16/70 of video data

Abstract

A multimedia system may include at least one audio comment input device configured to permit at least one commentator to generate audio comment data based upon viewing video data from a video source. Furthermore, a media processor may cooperate with the at least one audio comment input device and be configured to process video source data and audio comment data and generate therefrom audio trigger markers synchronized with the video source data for predetermined audio triggers in the audio comment data, and combine the video source data, the audio comment data, and the audio trigger markers into a media data stream.

Claims

1. A multimedia system comprising:

a plurality of audio comment input devices; and

a media processor cooperating with said plurality of audio comment input devices and configured to

generate audio comment data based upon audio input from commentators using respective audio comment input devices, the commentators viewing common video data from a video source,

locate multiple occurrences of predetermined audio keywords in the audio comment data within a set time and from different audio comment input devices and, responsive thereto,

generate respective audio trigger markers synchronized with the video source data for the located predetermined audio keywords, and

combine the audio trigger markers with the video source data and the audio comment data into a media data stream.

2. The multimedia system of claim 1 wherein said media processor is further configured to store portions of the media data stream associated with occurrences of the audio trigger markers.

3. The multimedia system of claim 1 wherein said media processor combines the video data feed, the audio data feed, and the audio trigger markers by multiplexing to generate the media data stream.

4. The multimedia system of claim 1 wherein said media processor is further configured to generate notifications based upon occurrences of the predetermined audio keywords in the audio comment data.

5. The multimedia system of claim 1 further comprising a plurality of text comment input devices configured to permit a plurality of commentators to generate shared text comment data based upon viewing the video data;

and wherein said media processor is further configured to process the video source data and shared text comment data and generate therefrom a database comprising shared text comment data indexed in time with the video source data so that the database is searchable by text keywords to locate corresponding portions of the video source data.

6. The multimedia system of claim 1 wherein said media processor comprises a media server.

7. The multimedia system of claim 6 wherein said media server comprises a processor and a memory cooperating therewith.

8. A multimedia data processing method comprising:

generating audio comment data based upon audio input from commentators using respective audio comment input devices, the commentators viewing common video data from a video source;

locating multiple occurrences of predetermined audio keywords in the audio comment data within a set time and from different audio comment input devices and, responsive thereto;

generating respective audio trigger markers synchronized with the video source data for the located predetermined audio keywords; and

combining the audio trigger markers with the video source data and the audio comment data into a media data stream using the media processor.

9. The method of claim 8 further comprising storing portions of the media data stream associated with occurrences of the audio trigger markers using the media server.

10. The method of claim 8 wherein combining comprises multiplexing the video data feed, the audio data feed, and the audio trigger markers to generate the media data stream.

11. A non-transitory computer-readable storage device having computer-executable instructions for causing a media processor to cooperate with a plurality of audio comment input devices to perform steps comprising:

generating audio comment data based upon audio input from commentators using respective audio comment input devices, the commentators viewing common video data from a video source;

locating multiple occurrences of predetermined audio keywords in the audio comment data within a set time and from different audio comment input devices and, responsive thereto,

generating respective audio trigger markers synchronized with the video source data for the located predetermined audio keywords; and

combining the audio trigger markers with the video source data and the audio comment data into a media data stream.

12. The non-transitory computer-readable storage device of claim 11 further comprising computer-executable instructions for causing the media processor to perform a step of storing portions of the media data stream associated with occurrences of the audio trigger markers using the media server.

13. The non-transitory computer-readable storage device of claim 11 wherein combining comprises multiplexing the video data feed, the audio data feed, and the audio trigger markers to generate the media data stream.