Computer controlled display system activities using correlated graphical and timeline interfaces for controlling replay of temporal data representing collaborative activities
First Claim
1. A computer controlled display system for controlling the replay of a session captured on a plurality of media capture devices, wherein at least one of said plurality of media capture devices is a shared representation media, said shared representation media for creating and displaying graphical objects, said computer controlled display system coupled to one or more players for replaying said session, said computer controlled display system comprising:
- a display;
a cursor control device for enabling a user to interact with said computer controlled display system;
session input means for receiving temporal data of said captured session, said temporal data comprising timestreams and events;
processing circuitry coupled to said session input means, said processing circuitry for generating display information for windows displayed on said display, said processing circuitry comprising;
shared representation media emulation circuitry for generating display information from a timestream representing interactions with said shared representation media for display in a first window on said display, said first window serving as a player for visually displaying the temporal sequence of markings on said shared representation media and as a user interface for controlling the playback of said session;
timeline generation circuitry for generating display information for displaying visual indicators on a timeline in a second window on said display, said visual indicators corresponding to an event recorded by said plurality of media capture devices and each of said visual indicators representing a temporal index into said session; and
user interface control circuitry for detecting a user interaction in either said first window or said second window and generating control signals to each of said shared representation media emulation circuitry and said timeline generation circuitry for updating said first window and said second window responsive to said user interaction.
8 Assignments
0 Petitions
Accused Products
Abstract
A system for controlling the playback of a recorded session. Timestream and event information for the session is captured by one or more recording devices. Playback of a session is performed under the control of a session access device. A session access device utilizes event information to create a user interface for controlling session replay. In the present invention, two windows are used in a coherent and synergistic fashion. A first window functions as a player for playing back a timestream for the electronic whiteboard is also used for controlling playback of the session. A second window functions as a playback controller utilizing a timeline metaphor. Various interactions in one window will cause a resulting change in the other window. For example, selecting a marking in the first window may cause all related events to be displayed on the timeline of the second window. This coherency enables a user to more clearly pinpoint points in the session that would contain information of interest.
418 Citations
10 Claims
-
1. A computer controlled display system for controlling the replay of a session captured on a plurality of media capture devices, wherein at least one of said plurality of media capture devices is a shared representation media, said shared representation media for creating and displaying graphical objects, said computer controlled display system coupled to one or more players for replaying said session, said computer controlled display system comprising:
-
a display; a cursor control device for enabling a user to interact with said computer controlled display system; session input means for receiving temporal data of said captured session, said temporal data comprising timestreams and events; processing circuitry coupled to said session input means, said processing circuitry for generating display information for windows displayed on said display, said processing circuitry comprising; shared representation media emulation circuitry for generating display information from a timestream representing interactions with said shared representation media for display in a first window on said display, said first window serving as a player for visually displaying the temporal sequence of markings on said shared representation media and as a user interface for controlling the playback of said session; timeline generation circuitry for generating display information for displaying visual indicators on a timeline in a second window on said display, said visual indicators corresponding to an event recorded by said plurality of media capture devices and each of said visual indicators representing a temporal index into said session; and user interface control circuitry for detecting a user interaction in either said first window or said second window and generating control signals to each of said shared representation media emulation circuitry and said timeline generation circuitry for updating said first window and said second window responsive to said user interaction. - View Dependent Claims (2, 3, 4, 5)
-
-
6. In a computer controlled display system for the replay of a session captured on a plurality of media capture devices, wherein at least one of said plurality of media capture devices is a shared representation media, said shared representation media for creating and displaying graphical objects, a method for controlling a playback point of said session comprising the steps of:
-
a) replaying a shared representation media timestream in an shared representation media window, said shared representation media window having a first visual state at a first time, said first visual state indicating the graphical objects displayed on said shared representation media at said first time; b) displaying a timeline interface playback control window, said timeline interface control window displaying a plurality of visual indicators positioned in temporal sequence each visual indicator corresponding to an event recorded by one of said plurality of media capture devices which occurred at a point in time of said session; c) detecting that a user has selected one or more of the graphical objects in said shared representation media window; d) identifying one or more events associated with said one or more graphical objects, each of said one or more events having an associated time in said session; e) displaying visual indicators corresponding to said one or more events on a selection track in said timeline interface playback control window f) detecting that a user has selected a visual indicator on said selection track; g) determining a second time in said session associated with said selected visual indicator; and h) updating said shared representation media window to a second visual state, said second visual state indicating the graphical objects on said shared representation media at said second time. - View Dependent Claims (7)
-
-
8. In a computer controlled display system for the replay of a session captured on a plurality of media capture devices, wherein at least one of said plurality of media capture devices is a shared representation media, said shared representation media for creating and displaying graphical objects, a method for controlling a playback point of said session comprising the steps of:
-
a) replaying a shared representation media timestream in a shared representation media window, said shared representation media window having a first visual state at a first time, said first visual state indicating the graphical objects displayed on said shared representation media at said first time; b) displaying a timeline interface playback control window, said timeline interface control window displaying a plurality of visual indicators positioned in temporal sequence, each of said plurality of visual indicators representing an event recorded one of said plurality of media capture devices, and each of said plurality of visual indicators used to index into said session by time; c) detecting that a user has selected an area in said shared representation media window; d) identifying one or more graphical objects in said selected area; e) identifying one or more events associated with said one or more graphical objects in said selected area, each of said one or more events having an associated time in said session; and f) displaying visual indicators corresponding to said one or more events on a selection track in said timeline interface playback control window; g) detecting that a user has selected a visual indicator on said selection track; h) determining a second time in said session associated with said selected visual indicator; and i) updating said shared representation media window to a second visual state, said second visual state indicating the graphical objects displayed on said shared representation media at said second time. - View Dependent Claims (9)
-
-
10. In a computer controlled display system for the replay of a session captured on a plurality of media capture devices, wherein at least one of said plurality of media capture devices is a shared representation media, said shared representation media for creating and displaying graphical objects, a method for controlling a playback point of said session comprising the steps of:
-
a) replaying an shared representation media timestream in an shared representation media window, said shared representation media window having a first visual state at a first time, said first visual state indicating the graphical objects displayed on said shared representation media at said first time; b) displaying a timeline interface playback control window, said timeline interface control window displaying a plurality of visual indicators positioned in temporal sequence, each of said plurality of visual indicators representing an event recorded by one of said plurality of media capture devices, and each of said plurality of visual indicators used to index into said session by time; c) detecting that a user has selected a visual indicator in said timeline interface playback control window; d) determining a second time in said session associated with said selected visual indicator; e) updating said shared representation media window to a second visual state, said second visual state indicating the graphical objects displayed on said shared representation media at said second time; and f) highlighting a graphical object on said shared representation media window associated with said selected visual indicator.
-
Specification