Real-time slide presentation multimedia data object and system and method of recording and browsing a multimedia data object

• US 20040205478A1
• Filed: 09/13/2001
• Published: 10/14/2004
• Est. Priority Date: 09/13/2001
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Lin, I-Jong, Samadani, Ramin
• Granted Patent: US 7,356,763 B2
• Time in Patent Office: Days
• US Class Current: 715/500.1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A system for recording a real-time slide presentation to generate a low bit-rate multimedia data object including a plurality of synchronized overlayed replayable bitstreams including at least a bitstream corresponding to an image of each of a plurality of slides of the slide presentation, a bitstream corresponding to symbolic representations of presenter'"'"'s interactions with points of interest within each slide, and a bitstream corresponding to a presenter'"'"'s audio associated with each slide is described. The plurality of bitstreams can be linked so as to make the multimedia data object browsable on a presenter interaction event-by-event basis. Interaction events can be linked to the audio bitstream and/or to a video clip bitstream. Video clips can be recorded during the real-time presentation such that when replaying the multimedia data object, a video clip is synchronized and replayed dependent on presenter interaction events.

Claims

1. A multimedia data object comprising:

a plurality of overlayed replayable bitstreams representing a real-time slide presentation captured by an image capture device and audio signal capture device including at least;

a first bitstream corresponding to an image of each of a plurality of slides of the slide presentation;

a second bitstream corresponding to symbolic representations of a presenter'"'"'s interaction with each slide captured during the presentation; and

a third bitstream corresponding to an audio signal of the presentation captured during the presentation;

wherein the bitstreams are synchronized and replayable on a slide-by-slide basis.

2. The multimedia data object as described in claim 1 further comprising links between a symbolic representations of the presenter'"'"'s interactions within the second bitstream to a corresponding location within another of the plurality of bitstreams such that selection of a symbolic representation within the replayed slide causes the replaying of the other of the plurality of bitstreams at the corresponding linked location.

3. The multimedia data object as described in claim 2 wherein the other bitstream is the third bitstream.

4. The multimedia data object as described in claim 2 further comprising a fourth bitstream corresponding to a plurality of video clips.

5. The multimedia data object as described in claim 4 wherein the plurality of video clips are captured during the real-time slide presentation dependent on detected presenter interactions and wherein the other of the plurality of bitstreams is the fourth bitstream such that selection of a symbolic representation within the replayed slide causes the replaying of an associated video clip within the fourth bitstream.

6. The multimedia data object as described in claim 2 wherein the link comprises a look-up table for storing pointers into the other bitstream.

7. A system of creating a browsable multimedia data object comprising:

means for recording a real-time slide presentation using an image capture device and audio signal capture device and generate a plurality of overlayed replayable bitstreams corresponding to the multimedia data object including at least a first bitstream corresponding to an image of each of a plurality of slides of the slide presentation, a second bitstream corresponding to a symbolic representation of a presenter'"'"'s interactions with the slides, and a third bitstream corresponding to an audio signal of the real-time slide presentation;

means for tracking location within one of the plurality of bitstreams while recording the multimedia data object;

means for detecting a presenter interaction with a region of interest within a slide while capturing the multimedia data object, the detected presenter interaction having a corresponding symbolic interaction event within the symbolic interaction bitstream; and

means for linking the symbolic interaction event with a corresponding tracked location occurring within the one bitstream at the time of the symbolic interaction event.

8. The system as described in claim 7 wherein the other bitstream is the third bitstream.

9. The system as described in claim 7 wherein the plurality of bitstreams includes further a fourth bitstream corresponding to a plurality of video clips of the real-time slide presentation and the other bitstream is the fourth bitstream.

10. The system as described in claim 9 wherein the plurality of video clips are captured during the real-time slide presentation dependent on detected presenter interactions and wherein the other of the plurality of bitstreams is the fourth bitstream such that selection of a symbolic representation within the replayed slide causes the replaying of an associated video clip within the fourth bitstream.

15. The method as described in claim 8 further comprising browsing the multimedia data object while replaying by selecting the symbolic interaction within a replayed image of a slide wherein the audio stream begins replaying at the tracked location within the audio stream.

11. A system comprising:

a computing system for generating an image signal corresponding to a plurality of slides;

a display system for displaying the image signal corresponding to the slides within a display area;

a capture device for capturing at least an image of a real-time slide presentation including an image of the plurality of slides and an image of a presenter interacting with each of the slides and for capturing presenter audio, to generate captured signals;

means for creating a plurality of overlayed synchronously replayable bitstreams corresponding to the multimedia data object from the computer generated image signal, the captured signals, the plurality of bitstreams including at least a bitstream corresponding to the image of each of a plurality of slides of the slide presentation, a bitstream corresponding to a presenter'"'"'s interactions with each of the slides, and a bitstream corresponding to a presenter'"'"'s audio contribution;

a counter for tracking location within at least one of the captured signals while being captured;

a detector for detecting the occurrence of a presenter interaction during the real-time presentation, each interaction having a corresponding symbolic interaction event within the symbolic interaction bitstream;

a lookup table for storing a first indicator representative of the symbolic interaction event corresponding to the detected presenter interaction within the interaction bitstream and a second indicator representative of a location within one of the plurality of bitstreams corresponding to a tracked location within one of the capture signals occurring at the time of the detected presenter interaction, the first and second indicators being linked such that, when the multimedia data object is replayed, selection of the symbolic interaction event within the image of one of the slides causes the audio bitstream to be played at the tracked location.

12. The system as described in claim 11 wherein the counter is a timer.

13. The system as described in claim 11 wherein the counter is tracks the amount of audio data stored.

14. A method of creating a browsable multimedia data object having a plurality of overlayed replayable bitstreams including at least a bitstream corresponding to an image of each of a plurality of slides of the slide presentation, a bitstream corresponding to a presenter'"'"'s symbolic interaction with points of interest within each slide, and a bitstream corresponding to a presenter'"'"'s audio associated with each slide, the method comprising:

tracking location within the audio bitstream;

detecting a presenter interaction with a point of interest within a slide while capturing the multimedia data object said presenter interaction being represented as a symbolic interaction within the symbolic interaction bitstream; and

linking the symbolic interaction with a corresponding tracked location within the audio stream occurring at the time of the presenter interaction.