Real time media journaler with a timing event coordinator

• US 6,665,835 B1
• Filed: 12/23/1997
• Issued: 12/16/2003
• Est. Priority Date: 12/23/1997
• Status: Expired due to Fees

• Current Assignee: Verizon Laboratories Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Laboratories Incorporated (Verizon Communications Inc.)
• Inventors: Paschetto, James, Martin, Christopher M., Gutfreund, Steven, Nicol, John R., Rush, Kimberly
• Primary Examiner(s): Hong, Stephen S.
• Assistant Examiner(s): HUYNH, CONG LAC T
• Application Number:
  US08/996,690
• Time in Patent Office: 2,184 Days
• Field of Search: 345/302, 345/328, 345/327, 345/723, 709/203, 707/501
• US Class Current: 715/202
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/329 on a disc [VTOC]

Abstract

A media journaling method and apparatus provides an ability for capturing an event, such as a seminar style presentation with visual aids, in real-time and coordinating other related events as they occur, and then processing the combination to create a synchronized multimedia record of events. The presentation is captured in real-time, and the audio/video converted to digital format, and using post-processing techniques, within a very short period thereafter, the related presentation material such as slides and user notes are combined and synchronized therewith. The new presentation is then made available on a network such as the Internet through a media journal player. The player is, for example, web browser based and allows the user to view the whole presentation, or allows for seeking to different places in the presentation while maintaining the synchronization. A user is able to add new events that are synchronized to the presentation using a timing event coordinator that tracks relative discrete time changes of the new events.

Claims

1. A timing event coordinator for maintaining a record of relative times of time-related components exhibiting temporal state changes, said timing event coordinator comprising:

means for marking a base event with reference marks;

means for time stamping said time-related components to synchronize said time-related components to said base event, each time-related component of said time-related components having time stamps that are independent of each other;

means for creating a unified view of time indicating a type for each of said time-related components and their corresponding time stamps and an index for said each time-related component;

means for creating a presentation by providing events from said unified view of time to an application to allow said time-related components to act according to status of said base event;

means for receiving, subsequent to said creating, at least one new time-related component from an end user during a viewing of said presentation by the end user, said at least one new time-related component including notes relating to said presentation; and

means for integrating said at least one new time-related component into said presentation to create a new presentation.

2. The timing event coordinator according to claim 1 further comprising means defining a special status flag to each time-related component type.

3. The timing event coordinator according to claim 2 wherein said unified view of time is available shortly after the base event occurs.

4. The timing event coordinator according to claim 3 wherein said unified view of time is modified by adding new time-related components that are time stamped by said means for time stamping.

5. The timing event coordinator according to claim 3 wherein said base event is an audio/video stream.

6. The timing event coordinator according to claim 5 wherein said time-related components comprise view graphs and user notes.

7. The timing event coordinator according to claim 6 wherein a new set of notes having a new type and independent time stamps is created after said base event.

8. The timing event coordinator according to claim 7, wherein said timing event coordinator further comprises:

means for receiving a command to set a relative time to a user specified time;

means for determining whether a special flag exists in any of the time-related component types;

means for processing any requirements dictated by a special flag;

means for determining whether any time-related components have a time stamp matching the relative time;

means for displaying the appropriate time-related components according to the special flag and time stamps associated therewith.

9. A media journaler for creating a multimedia presentation of a recordable event having time-related components associated therewith and having a timing event coordinator for maintaining a record of relative times of said time-related components, said media journaler comprising:

an audio/video capture device for providing an audio/video file of a recorded event; and

a journaling tool for creating at least one streamable audio/video file representing said recordable event and corresponding time stamp information, said journaling tool including said timing event coordinator, said timing event coordinator further comprising;

a base event marker for marking a base event with reference marks,

time stamping device for time stamping said time-related components to synchronize said time-related components to said base event, each time-related component of said time-related components having time stamps that are independent of each other,

unified view of time indicating a type for each of said time-related components and their corresponding time stamps and an index for said each time-related component, and

processing element configured to create a first multimedia presentation by providing said unified view of time to an application to allow said time-related components to act according to a status of said base event, receive at least one new time-related component from an end user during a viewing of said first multimedia presentation by the end user, said at least one new time-related component including notes relating to said first multimedia presentation, and integrate said at least one new time-related component into said first multimedia presentation to create a second multimedia presentation.

10. The media journaler according to claim 9 wherein said audio/video capture device is a video camera.

11. The media journaler according to claim 10 wherein said video camera is a digital video camera.

12. The media journaler according to claim 9 wherein said journaling tool receives an analog or digital audio/video stream from said audio/video capture device.

13. The media journaler according to claim 12 wherein said journaling tool is a standalone or network-based application.

14. The media journaler according to claim 12 wherein said journaling tool comprises:

a video window;

a view graph window; and

a notes window.

15. The medial journaler according to claim 12 further comprising:

a journal player configured to present said first multimedia presentation to a user, receive said at least one new time-related component during said presenting, and send said at least one new time-related component to said processing element.

16. The media journaler according to claim 15 wherein said time-related components are stored in one or more network servers for retrieval by said journal player when playing said multimedia presentation.

17. In a timing event coordinator, a method of creating a multimedia presentation of a recordable event having time-related components, said multimedia presentation created within minutes of said recordable event, said method comprising:

creating a movie of said recordable event;

capturing time stamp information for synchronizing said time-related events to said recordable event;

generating timestamped versions of said movie with reference marks encoded therewith;

time stamping time-related components to synchronize said time-related components to said movie, each time-related component of sad time-related components having time stamps that are independent of each other;

creating a unified view of time indicating a type for each of said time-related components and their corresponding time stamps and an index for said each time-related component;

providing said unified view of time to an application to allow said time-related components to act according to status of said movie;

generating at least one stream including said movie with captured time stamps encoded therewith;

electing images of time-related events and coupling said images to said movie according to said time stamp information to create a presentation;

receiving, subsequent to said electing, new time-related components from an end user during a viewing of said presentation by the end user, said new time-related components including notes relating to said presentation; and

integrating said new time-related components into said presentation to create a new presentation.

18. The method according to claim 17 wherein said movie and images are located on web servers.

19. The method according of claim 18 wherein said journal player is a web based application that retrieves said media presentation from said web servers.