Annotation management system

• US 20040236830A1
• Filed: 05/15/2003
• Published: 11/25/2004
• Est. Priority Date: 05/15/2003
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Nelson, Steve, Harris, Jason
• Application Number:
  US10/440,526
• Publication Number:
  US 20040236830A1
• Time in Patent Office: Days
• US Class Current: 709/204
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/1104 Session initiation protocol [SIP]
• CPC Class Codes: H04L 65/1106 Call signalling protocols; H.323 and related
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15

Abstract

An annotation management system for providing real-time annotations for media content during a videoconference session is provided. The annotation management system includes a media management server configured to manage media data and annotation data for distribution to participants of the videoconference session. A storage server in communication with the media management server is configured to store the media data and the annotation data. An event database in communication with the media management server is configured to capture events associated with the annotation data. A media analysis server is in communication with the media management server, the event database, and the storage server. The media analysis server is configured to associate the stored annotation data with the captured events to enable reconstruction of the videoconference session based on the captured events. A videoconference system, a computer readable medium, a graphical user interface, and a method are also included.

Claims

1. A videoconference system, comprising:

a plurality of clients;

a server component configured to distribute media to the plurality of clients;

a conference channel communication connection over which video and audio data streams are carried between the plurality of clients and the server component;

an annotation management system configured to manage and store annotation data and annotation control data, the annotation management system in communication with the server component; and

a back-channel communication connection over which the annotation data and the annotation control data are communicated between the plurality of clients, the server component and the annotation management system.

2. The videoconference system of claim 1, wherein the back-channel communication connection enables each of the clients to communicate with other clients without disturbing the conference session.

3. The videoconference system of claim 1, wherein each of the plurality of clients execute different videoconference applications.

4. The videoconference system of claim 3, wherein the different videoconference applications are selected from the group consisting of an administrator client application, a conference room client application, a desktop client application, a small device client application, and a small device annotation client application.

5. The videoconference system of claim 1, wherein the annotation data is a note added to one of a document shared by the plurality of clients and a virtual whiteboard shared by the plurality of clients.

6. The videoconference system of claim 1, wherein the annotation management system includes a media management server configured to manage both annotation data and annotation control data communicated between the plurality of clients.

7. The videoconference system of claim 1, wherein upon completion of the videoconference session, the annotation management system is further configured to generate a meeting summarization based upon the annotation data.

8. A videoconferencing system enabling participants to exchange annotation information, comprising:

a server component;

a client configured to execute application software enabling interaction between the client and the server component, the interaction including sharing real-time annotation data between clients; and

an annotation management system in communication with the server component, the annotation management system configured to manage and store the real-time annotation data.

9. The videoconference system of claim 8, wherein the server component is configured to distribute media data to the client over a conference connection path.

10. The videoconference system of claim 9, further comprising:

a back-channel defined between the client and the server component, the back-channel providing a path for the annotation data and the annotation control data to be communicated between the client and the server component.

11. The videoconference system of claim 8, wherein the application software is selected from the group of application software consisting of an administrator client application, a conference room client application, a desktop client application, a small device client application, and a small device annotation client application.

12. The videoconference system of claim 8, wherein the annotation management system includes a media analysis server, the media analysis server configured to associate stored annotation data with stored videoconference session data, the stored annotation data including properties of annotations occurring during the videoconference session.

13. The videoconference system of claim 8, wherein upon completion of a videoconference session between the server component and the client, the annotation management system is further configured to generate a meeting summarization based upon the annotation data.

14. The videoconference system of claim 8, wherein the annotation management server is further configured to manage and store data associated with a virtual pointer.

15. The videoconference system of claim 14, wherein the annotation management server includes,

an event database configured to store both data associated with the virtual pointer and the annotation data;

a storage server configured to store videoconference session data; and

a media analysis server in communication with the event database and the storage server, the media analysis server configured to associate the virtual pointer data and the annotation data with the videoconference session data in order to enable retrieval of the stored videoconference session data based upon one of the virtual pointer data and the annotation data.

16. An annotation management system for providing real-time annotations for media content during a videoconference session, comprising:

a media management server configured to manage both media data and annotation data for distribution to participants of the videoconference session;

a storage server in communication with the media management server, the storage server configured to store the media data and the annotation data;

an event database in communication with the media management server, the event database configured to capture events associated with the annotation data; and

a media analysis server in communication with the media management server, the event database, and the storage server, the media analysis server configured to associate the stored annotation data with the captured events to enable reconstruction of the videoconference session based on the captured events.

17. The annotation management system of claim 16, wherein the media management server includes,

a web service module;

a meeting schedule service module;

an annotation service module; and

a virtual pointer service module.

18. The annotation management system of claim 17, wherein the web service module is configured to enable downloading of software code from a distributed network.

19. The annotation management system of claim 17, wherein the annotation service module is configured to enable one of adding annotation data during the videoconference session and viewing annotation data from a previously recorded videoconference session.

20. A graphical user interface (GUI) enabled to provide real-time annotation of display data rendered on a display screen, the display data associated with a videoconference session, comprising:

a media display region corresponding to a media signal, the media display region capable of being annotated by a videoconference participant, wherein the annotation of the media display region generates an event for storage on an annotation management server, the annotation of the media display region further generating a signal presented to remaining videoconference participants in real-time; and

a control display region enabling a participant to define control properties associated with the media display region.

21. The GUI of claim 20, wherein the media display region includes regions selected from the group consisting of a video display region, a virtual whiteboard region, a control region, and a slide display region.

22. The GUI of claim 20, wherein detection of a selection within the control display region enables adjustment of the control properties.

23. The GUI of claim 20, wherein the control properties include one of audio volume and media display region configuration.

24. A method for providing real-time annotation data to clients of a videoconference session, comprising

annotating a display region of a user interface associated with a client of the videoconference session;

detecting the annotating of the display region;

in response to detecting the annotating of the display region, the method includes, communicating data corresponding to the detecting of the annotating of the display region to other clients of the videoconference session for real-time presentation;

storing the data corresponding to the detecting of the annotating of the display region; and

associating the data corresponding to the detecting of the annotating of the display region with data defining the videoconference session.

25. The method of claim 24, further comprising:

generating a meeting summarization of the data defining the videoconference session based upon the data corresponding to the detecting of the annotating of the display region.

26. The method of claim 24, wherein the method operation of communicating data corresponding to the detecting of the annotating of the display region to other clients of the videoconference session for real-time presentation includes,

transmitting the data corresponding to the detecting of the annotating of the display region from the client to an annotation management system.

27. The method of claim 24, wherein the method operation of storing the data corresponding to the detecting of the annotating of the display region includes,

storing the data defining the videoconference session.

28. The method of claim 24, wherein the method operation of associating the data corresponding to the detecting of the annotating of the display region with data defining the videoconference session includes,

storing the data defining the videoconference session;

and

inserting markers into the data defining the videoconference session, the markers indicating one of a starting point of the annotating of the display region and a type of media being annotated.

29. The method of claim 24, wherein the method operation of annotating a display region of a user interface associated with a client of the videoconference session includes,

identifying a region.

30. The method of claim 24, wherein the method operation of identifying a region, includes

distinguishing the region from other regions;

and

selecting a control feature, wherein the control feature is selected from the group consisting of display configuration and layout settings, volume settings and muting, selecting and de-selecting media, annotation controls, and virtual pointer controls

31. A computer readable medium having program instructions for providing real-time annotation data to clients of a videoconference session, comprising

program instructions for annotating a display region of a user interface associated with a client of the videoconference session;

program instructions for detecting the annotation of the display region;

program instructions for communicating data corresponding to the detection of the annotation of the display region to other clients of the videoconference session for real-time presentation;

program instructions for storing the data corresponding to the detection of the annotation of the display region; and

program instructions for associating the data corresponding to the detection of the annotation of the display region with data defining the videoconference session.

32. The computer readable medium of claim 31, further comprising:

program instructions for generating a meeting summarization of the data defining the videoconference session based upon the data corresponding to the detecting of the annotating of the display region.

33. The computer readable medium of claim 31, wherein the program instructions for communicating data corresponding to the detecting of the annotating of the display region to other clients of the videoconference session for real-time presentation includes,

program instructions for transmitting the data corresponding to the detecting of the annotating of the display region from the client to an annotation management system.

34. The computer readable medium of claim 31, wherein the program instructions for storing the data corresponding to the detecting of the annotating of the display region includes,

program instructions for storing the data defining the videoconference session.

35. The computer readable medium of claim 31, wherein the program instructions for associating the data corresponding to the detecting of the annotating of the display region with data defining the videoconference session includes,

program instructions for storing the data defining the videoconference session;

and

program instructions for inserting markers into the data defining the videoconference session, the markers indicating one of a starting point of the annotating of the display region and a type of media being annotated.