Real-time slide presentation multimedia data object and system and method of recording and browsing a multimedia data object

• US 7,356,763 B2
• Filed: 09/13/2001
• Issued: 04/08/2008
• Est. Priority Date: 09/13/2001
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Lin, I-Jong, Samadani, Ramin
• Primary Examiner(s): Hutton; Doug
• Assistant Examiner(s): TRAN, QUOC A
• Application Number:
  US09/952,642
• Publication Number:
  US 20040205478A1
• Time in Patent Office: 2,399 Days
• Field of Search: 715/500.1, 715/730, 434/276, 709/204, 463/1, 386/120, 348/333.05, 348/14.07, 375/240.26, 345/473, 345/776, 345/839, 345/753, 345/15, 345/330, 345/730
• US Class Current: 715/205
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

A system for recording a real-time slide presentation to generate a low bit-rate multimedia data object including a plurality of synchronized overlayed replayable bitstreams including at least a bitstream corresponding to an image of each of a plurality of slides of the slide presentation, a bitstream corresponding to symbolic representations of presenter'"'"'s interactions with points of interest within each slide, and a bitstream corresponding to a presenter'"'"'s audio associated with each slide is described. The plurality of bitstreams can be linked so as to make the multimedia data object browsable on a presenter interaction event-by-event basis. Interaction events can be linked to the audio bitstream and/or to a video clip bitstream. Video clips can be recorded during the real-time presentation such that when replaying the multimedia data object, a video clip is synchronized and replayed dependent on presenter interaction events.

Claims

1. A data file tangibly embodied in a computer readable storage medium comprising:

a plurality of overlayed replayable sets of data representing a real-time slide presentation captured by an image capture device and audio signal capture device including at least;

a first set of data corresponding to an image of each of a plurality of slides of the slide presentation;

a second set of data corresponding to symbolic representations of a presenter'"'"'s interaction with each slide captured during the presentation;

a third set of data corresponding to an audio signal of the presentation captured during the presentation;

wherein the sets of data are synchronized and replayable on a slide-by-slide basis;

links between the symbolic representations of the presenter'"'"'s interactions within the second set of data to a corresponding location within another of the plurality of sets of data such that selection of a symbolic representation within the replayed slide causes the replaying of the other of the plurality of sets of data at the corresponding linked location.

2. The data file as described in claim 1 wherein the other set of data is the third set of data.

3. The data file as described in claim 1 further comprising a fourth set of data corresponding to a plurality of video clips.

4. The data file as described in claim 3 wherein the plurality of video clips are captured during the real-time slide presentation dependent on detected presenter interactions and wherein the other of the plurality of sets of data is the fourth set of data such that selection of a symbolic representation within the replayed slide causes the replaying of an associated video clip within the fourth set of data.

5. The data file as described in claim 1 wherein the link comprises a look-up table for storing pointers into the other set of data.

6. The data file as described in claim 1 further comprising:

a data file unit configured to automatically locate a point of interest based upon the presenter'"'"'s interaction with each slide and to automatically insert a digital symbol representing the presenter'"'"'s interaction into the second set of data.

7. A system of creating a browsable multimedia data object comprising:

means for recording a real-time slide presentation using an image capture device and audio signal capture device and generate a plurality of overlayed replayable bitstreams corresponding to the multimedia data object including at least a first bitstream corresponding to an image of each of a plurality of slides of the slide presentation, a second bitstream corresponding to a symbolic representation of a presenter'"'"'s interactions with the slides, and a third bitstream corresponding to an audio signal of the real-time slide presentation;

means for tracking location within one of the plurality of bitstreams while recording the multimedia data object;

means for detecting a presenter interaction with a region of interest within a slide while capturing the multimedia data object, the detected presenter interaction having a corresponding symbolic interaction event within the symbolic interaction bitstream; and

means for linking the symbolic interaction event with a corresponding tracked location occurring within the one bitstream at the time of the symbolic interaction event,

wherein selection of a symbolic representation within the replayed slide causes the replaying of another bitstream.

8. The system as described in claim 7 wherein the other bitstream is the third bitstream.

9. The system as described in claim 7 wherein the plurality of bitstreams includes further a fourth bitstream corresponding to a plurality of video clips of the real-time slide presentation and the other bitstream is the fourth bitstream.

10. The system as described in claim 9 wherein the plurality of video clips are captured during the real-time slide presentation dependent on detected presenter interactions and wherein the other of the plurality of bitstreams is the fourth bitstream such that selection of a symbolic representation within the replayed slide causes the replaying of an associated video clip within the fourth bitstream.

11. The system as described in claim 7 further comprising:

means for identifying the region of interest; and

means for generating symbolic representations of the region of interest identified by the means for identifying.

12. A system comprising:

a computing system for generating an image signal corresponding to a plurality of slides;

a display system for displaying the image signal corresponding to the slides within a display area;

a capture device for capturing at least an image of a real-time slide presentation including an image of the plurality of slides and an image of a presenter interacting with each of the slides and for capturing presenter audio, to generate captured signals;

means for creating a plurality of overlayed synchronously replayable bitstreams corresponding to the multimedia data object from the computer generated image signal, the captured signals, the plurality of bitstreams including at least a bitstream corresponding to the image of each of a plurality of slides of the slide presentation, a bitstream corresponding to a presenter'"'"'s interactions with each of the slides, and a bitstream corresponding to a presenter'"'"'s audio contribution;

a counter for tracking location within at least one of the captured signals while being captured;

a detector for detecting the occurrence of a presenter interaction during the real-time presentation, each interaction having a corresponding symbolic interaction event within the symbolic interaction bitstream;

a lookup table for storing a first indicator representative of the symbolic interaction event corresponding to the detected presenter interaction within the interaction bitstream and a second indicator representative of a location within one of the plurality of bitstreams corresponding to a tracked location within one of the capture signals occurring at the time of the detected presenter interaction, the first and second indicators being linked such that, when the multimedia data object is replayed, selection of the symbolic interaction event within the image of one of the slides causes the audio bitstream to be played at the tracked location.

13. The system as described in claim 12 wherein the counter is a timer.

14. The system as described in claim 12 wherein the counter is tracks the amount of audio data stored.

15. A method of creating a browsable data file having a plurality of overlayed replayable sets of data including at least a set of data corresponding to an image of each of a plurality of slides of the slide presentation, a set of data corresponding to a presenter'"'"'s symbolic interaction with points of interest within each slide, and a set of data corresponding to a presenter'"'"'s audio associated with each slide, the method comprising:

tracking location within the audio set of data;

detecting a presenter interaction with a point of interest within a slide while capturing the data file, said presenter interaction being represented as a symbolic interaction within the symbolic interaction set of data;

linking the symbolic interaction with a corresponding tracked location within the audio stream occurring at the time of the presenter interaction; and

browsing the data file while replaying by selecting the symbolic interaction within a replayed image of a slide wherein the set of data corresponding to the presenter'"'"'s audio begins replaying at the tracked location within the set of data corresponding to the presenter'"'"'s audio.