DIGITAL ASSET MANAGEMENT, AUTHORING, AND PRESENTATION TECHNIQUES

• US 20120236201A1
• Filed: 01/25/2012
• Published: 09/20/2012
• Est. Priority Date: 01/27/2011
• Status: Abandoned Application

• Current Assignee: In The Telling. Inc.
• Original Assignee: In The Telling. Inc.
• Inventors: Larsen, Jeffrey Ward, Smith, Andrew, Maurer, Gavin, Johnson, Kevin, Arniotes, Damon, Wolf, Dean E.
• Application Number:
  US13/358,493
• Publication Number:
  US 20120236201A1
• Time in Patent Office: Days
• US Class Current: 348/468
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Various techniques are disclosed for authoring and/or presenting packages of multimedia content. In at least one embodiment, the digital multimedia package may include video content, audio content, and text transcription content representing a transcription of the audio content. The video content, audio content, and text transcription content are each maintained in continuous synchronization with each other during video playback, and also as a user selectively navigates to different scenes of the video content. The text transcription content is presented via an interactive Resources Display GUI. Interacting with the Resources Display GUI, a user may cause the displayed text to dynamically scroll to a different portion of the text transcription corresponding to a different scene of the video. In response, the concurrent presentation of video content may automatically and dynamically change to display video content corresponding to the scene associated with the text transcription currently displayed in the Resources Display GUI.

Claims

1. A multimedia display system comprising:

at least one processor;

at least one interface operable to provide a communication link to at least one network device; and

memory;

the system being operable to;

identify a digital multimedia package, wherein the digital multimedia package includes;

a video content portion, an audio content portion, and a text content portion, wherein the text content portion includes a text transcription content portion representing a transcription of the audio content portion;

cause, at a client system, synchronous presentation of the video content portion, audio content portion, and text transcription content portion;

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other during playback of the video content portion;

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other as a user selectively navigates to different scenes of the video content portion;

wherein the video content portion is presented via an interactive Video Player graphical user interface (GUI) at a display of the client system;

wherein the audio content portion is presented via an audio output device at the client system; and

wherein the text transcription content portion is presented via a an interactive Resources Display GUI at the display of the client system.

2. The system of claim 1 being further operable to:

cause a first portion of video content corresponding to a first scene to be displayed in the Video Player GUI;

cause a first portion of text transcription content corresponding to the first scene to be displayed in the Resources Display GUI;

wherein the display of the first portion of video content in the Video Player GUI is concurrent with the display of the first portion of text transcription content in the Resources Display GUI;

receive user input via the Resources Display GUI;

cause, in response to the received user input, the presentation of text displayed in the Resources Display GUI to dynamically scroll to a second portion of the text transcription content corresponding to a second scene; and

cause, in response to the received user input, the presentation of video content displayed in the Video Player GUI to dynamically display a second portion of video content corresponding to the second scene.

3. The system of claim 1 being further operable to:

cause a first portion of video content corresponding to a first scene to be displayed in the Video Player GUI, wherein the first portion of the video content is mapped to a first timecode value set;

cause a first portion of text transcription content corresponding to the first scene to be displayed in the Resources Display GUI, wherein the first portion of the text transcription content is mapped to the first timecode value set;

wherein the display of the first portion of video content in the Video Player GUI is concurrent with the display of the first portion of text transcription content in the Resources Display GUI;

receive user input via the Resources Display GUI;

cause, in response to the received user input, the presentation of text displayed in the Resources Display GUI to dynamically scroll to a second portion of the text transcription content corresponding to a second scene, wherein the second portion of the text transcription content is mapped to a second timecode value set;

cause, in response to the received user input, the presentation of video content displayed in the Video Player GUI to dynamically display a second portion of video content corresponding to the second scene, wherein the second portion of video content is mapped to the second timecode value set; and

wherein the display of the second portion of video content in the Video Player GUI is concurrent with the display of the second portion of text transcription content in the Resources Display GUI.

4. The system of claim 1:

wherein the digital multimedia package further includes timecode synchronization information for use maintaining synchronized presentation of the video content portion, audio content portion, and text transcription content portion.

5. The system of claim 1:

wherein the digital multimedia package further includes;

timecode synchronization information and at least one additional resource selected from a group consisting of;

metadata, notes, games, drawings, images, diagrams, photos, assessments, documents, slides, documents, photos, games, communication threads, events, URLs, and spreadsheets;

wherein the video content portion comprises a plurality of distinct video segments, each video segment being mapped to a respective timecode of the timecode synchronization information;

wherein the audio content portion comprises a plurality of distinct audio segments, each audio segment being mapped to a respective timecode of the timecode synchronization information;

wherein the text transcription content portion comprises a plurality of distinct text transcription segments, each text transcription segment being mapped to a respective timecode of the timecode synchronization information;

wherein each of the at least one additional resource is being mapped to a respective timecode of the timecode synchronization information;

the system being further operable to;

maintain, using at least a portion of the mapped timecode information, presentation synchronization among different portions of content being concurrently displayed at the client system display.

6. A system for automated conversion of a source video into a digital multimedia package, wherein the source video includes video content and audio content, the system comprising:

at least one processor;

at least one interface operable to provide a communication link to at least one network device; and

memory;

the system being operable to;

analyze the source video for identifying specific properties and characteristics;

automatically generate a text transcription of the source video'"'"'s audio content using speech processing analysis;

automatically generate synchronization data for use in synchronizing distinct chunks of the text transcription with respective distinct chunks of the video content; and

automatically generate the digital multimedia package, wherein the digital multimedia package includes;

a video content portion derived from the source video, an audio content portion derived from the source video, and a text transcription content portion representing a transcription of the audio content portion.

7. The system of claim 6 being further operable to:

cause, at a client system, synchronous presentation of the video content portion, audio content portion, and text transcription content portion;

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other during playback of the video content portion; and

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other as a user selectively navigates to different scenes of the video content portion;

wherein the video content portion is presented via an interactive Video Player graphical user interface (GUI) at a display of the client system;

wherein the audio content portion is presented via an audio output device at the client system; and

wherein the text transcription content portion is presented via a an interactive Resources Display GUI at the display of the client system.

8. The system of claim 6 being further operable to:

analyze the source video in order to automatically identify one or more different segments of the source video which match specific characteristics selected from a group consisting of;

voice characteristics relating to voices of different persons speaking in the audio portion of the source video;

image characteristics relating to facial recognition features, color features, object recognition, and/or scene transitions; and

audio characteristics relating to sounds matching a particular frequency, pitch, duration, and/or pattern.

9. The system of claim 6 being further operable to automatically:

analyze the audio portion of the source video to automatically identify different vocal characteristics relating to voices of one or more different persons speaking in the audio portion of the source video; and

identify and associate selected portions of the text transcription with a particular voice identified in the audio portion of the source video.

10. The system of claim 6 being further operable to perform at least one operation selected from a group consisting of:

identify one or more scenes in the digital multimedia package where a selected person'"'"'s face has been identified in the video content portion of the digital multimedia package;

identify one or more scenes in the digital multimedia package where a selected person'"'"'s voice has been identified in the audio content portion of the digital multimedia package;

identify one or more scenes in the digital multimedia package where audio characteristics matching a specific pattern or criteria have been identified in the audio content portion of the digital multimedia package;

identify one or more scenes in the digital multimedia package which have been identified as being filmed at a specified geographic location;

identify one or more scenes in the digital multimedia package where image characteristics matching a specific pattern or criteria have been identified in the video content portion of the digital multimedia package.

11. A method for presenting multimedia content comprising:

identifying a digital multimedia package, wherein the digital multimedia package includes;

a video content portion, an audio content portion, and a text content portion, wherein the text content portion includes a text transcription content portion representing a transcription of the audio content portion;

causing, at a client system, synchronous presentation of the video content portion, audio content portion, and text transcription content portion;

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other during playback of the video content portion;

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other as a user selectively navigates to different scenes of the video content portion;

wherein the video content portion is presented via an interactive Video Player graphical user interface (GUI) at a display of the client system;

wherein the audio content portion is presented via an audio output device at the client system; and

wherein the text transcription content portion is presented via a an interactive Resources Display GUI at the display of the client system.

12. The method of claim 11 further comprising:

causing a first portion of video content corresponding to a first scene to be displayed in the Video Player GUI;

causing a first portion of text transcription content corresponding to the first scene to be displayed in the Resources Display GUI;

wherein the display of the first portion of video content in the Video Player GUI is concurrent with the display of the first portion of text transcription content in the Resources Display GUI;

receiving user input via the Resources Display GUI;

causing, in response to the received user input, the presentation of text displayed in the Resources Display GUI to dynamically scroll to a second portion of the text transcription content corresponding to a second scene; and

causing, in response to the received user input, the presentation of video content displayed in the Video Player GUI to dynamically display a second portion of video content corresponding to the second scene.

13. The method of claim 11 further comprising:

causing a first portion of video content corresponding to a first scene to be displayed in the Video Player GUI, wherein the first portion of the video content is mapped to a first timecode value set;

causing a first portion of text transcription content corresponding to the first scene to be displayed in the Resources Display GUI, wherein the first portion of the text transcription content is mapped to the first timecode value set;

wherein the display of the first portion of video content in the Video Player GUI is concurrent with the display of the first portion of text transcription content in the Resources Display GUI;

receiving user input via the Resources Display GUI;

causing, in response to the received user input, the presentation of text displayed in the Resources Display GUI to dynamically scroll to a second portion of the text transcription content corresponding to a second scene, wherein the second portion of the text transcription content is mapped to a second timecode value set;

causing, in response to the received user input, the presentation of video content displayed in the Video Player GUI to dynamically display a second portion of video content corresponding to the second scene, wherein the second portion of video content is mapped to the second timecode value set; and

wherein the display of the second portion of video content in the Video Player GUI is concurrent with the display of the second portion of text transcription content in the Resources Display GUI.

14. The method of claim 11:

wherein the digital multimedia package further includes timecode synchronization information for use maintaining synchronized presentation of the video content portion, audio content portion, and text transcription content portion.

15. The method of claim 11:

wherein the digital multimedia package further includes;

timecode synchronization information and at least one additional resource selected from a group consisting of;

metadata, notes, games, drawings, images, diagrams, photos, assessments, documents, slides, documents, photos, games, communication threads, events, URLs, and spreadsheets;

wherein the video content portion comprises a plurality of distinct video segments, each video segment being mapped to a respective timecode of the timecode synchronization information;

wherein the audio content portion comprises a plurality of distinct audio segments, each audio segment being mapped to a respective timecode of the timecode synchronization information;

wherein the text transcription content portion comprises a plurality of distinct text transcription segments, each text transcription segment being mapped to a respective timecode of the timecode synchronization information;

wherein each of the at least one additional resource is being mapped to a respective timecode of the timecode synchronization information;

the method further comprising;

maintain, using at least a portion of the mapped timecode information, presentation synchronization among different portions of content being concurrently displayed at the client system display.

16. A method for automated conversion of a source video into a digital multimedia package, wherein the source video includes video content and audio content, the method comprising:

analyzing the source video for identifying specific properties and characteristics;

automatically generating a text transcription of the source video'"'"'s audio content using speech processing analysis;

automatically generating synchronization data for use in synchronizing distinct chunks of the text transcription with respective distinct chunks of the video content; and

automatically generating the digital multimedia package, wherein the digital multimedia package includes;

a video content portion derived from the source video, an audio content portion derived from the source video, and a text transcription content portion representing a transcription of the audio content portion.

17. The method of claim 16 further comprising:

causing, at a client system, synchronous presentation of the video content portion, audio content portion, and text transcription content portion;

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other during playback of the video content portion; and

wherein the synchronous presentation of the video content portion, audio content portion, and text transcription content portion are each maintained in continuous synchronization with each other as a user selectively navigates to different scenes of the video content portion;

wherein the video content portion is presented via an interactive Video Player graphical user interface (GUI) at a display of the client system;

wherein the audio content portion is presented via an audio output device at the client system; and

wherein the text transcription content portion is presented via a an interactive Resources Display GUI at the display of the client system.

18. The method of claim 16 further comprising:

analyzing the source video in order to automatically identify one or more different segments of the source video which match specific characteristics selected from a group consisting of;

voice characteristics relating to voices of different persons speaking in the audio portion of the source video;

image characteristics relating to facial recognition features, color features, object recognition, and/or scene transitions; and

audio characteristics relating to sounds matching a particular frequency, pitch, duration, and/or pattern.

19. The method of claim 16 further comprising automatically:

analyzing the audio portion of the source video to automatically identify different vocal characteristics relating to voices of one or more different persons speaking in the audio portion of the source video; and

identifying and associate selected portions of the text transcription with a particular voice identified in the audio portion of the source video.

20. The method of claim 16 further comprising perform at least one operation selected from a group consisting of:

identifying one or more scenes in the digital multimedia package where a selected person'"'"'s face has been identified in the video content portion of the digital multimedia package;

identifying one or more scenes in the digital multimedia package where a selected person'"'"'s voice has been identified in the audio content portion of the digital multimedia package;

identifying one or more scenes in the digital multimedia package where audio characteristics matching a specific pattern or criteria have been identified in the audio content portion of the digital multimedia package;

identifying one or more scenes in the digital multimedia package which have been identified as being filmed at a specified geographic location;

identifying one or more scenes in the digital multimedia package where image characteristics matching a specific pattern or criteria have been identified in the video content portion of the digital multimedia package.