METHOD FOR ARCHIVING A COLLABORATION SESSION WITH A MULTIMEDIA DATA STREAM AND VIEW PARAMETERS

• US 20170046113A1
• Filed: 08/12/2016
• Published: 02/16/2017
• Est. Priority Date: 08/13/2015
• Status: Active Grant

• Current Assignee: Bluebeam, Inc. (Nemetschek SE)
• Original Assignee: Bluebeam Software Incorporated (Nemetschek SE)
• Inventors: Jacob, Don, Noyes, Peter, Lee, Richard
• Granted Patent: US 11,132,165 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: G09G 2370/027 Arrangements and methods specific for the display of internet documents
• CPC Class Codes: G09G 2370/20 Details of the management of multiple sources of image data
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06

Abstract

A method for archiving a collaboration session regarding visual content is disclosed. A collaboration session is established from a collaboration server with participant nodes. The visual content is transmitted to the participant nodes. A first multimedia data stream, an annotation data object associated with an annotation to the visual content in timed correlation to a first time reference within the first multimedia data stream, and view parameters are received. A first session record entry associated with the multimedia data stream, the annotation data object, and the view parameters is stored into a session record. The session record includes a plurality of session record entries including the first session record entry. The session record is retrievable by other participant nodes for playing back of the collaboration session in sequence with the session record entries. The first session record entry is transmitted to other participant nodes.

Claims

1. A method for archiving a collaboration session regarding visual content, the method comprising;

establishing a collaboration session from a collaboration server with a plurality of participant nodes;

transmitting the visual content to the participant nodes from the collaboration server;

receiving at the collaboration server a first multimedia data stream associated with a first one of the plurality of participant nodes;

receiving at the collaboration server from the first one of the plurality of participant nodes an annotation data object associated with an annotation to the visual content in timed correlation to a first time reference within the first multimedia data stream;

receiving at the collaboration server from the first one of the plurality of participant nodes view parameters of the first one of the plurality of participant nodes in timed correlation to the first time reference;

generating a first session record entry associated with the received first multimedia data stream, the annotation data object, and the view parameters;

storing the generated first session record entry into a session record specific to the collaboration session and residing on the collaboration server, the session record including a plurality of session record entries including the generated first session record entry, the session record being retrievable by any one of the participant nodes for playing back of the collaboration session in sequence with the session record entries; and

transmitting the first session record entry from the collaboration server to one or more of the other ones of the plurality of participant nodes.

2. The method of claim 1 wherein the multimedia data stream is an audio data stream.

3. The method of claim 1 wherein the visual content is a portable document format (PDF) document.

4. The method of claim 1 wherein the annotation data object is generated in response to user input associated with placement of the annotation in relation to the visual content locally on the first one of the plurality of participant nodes.

5. The method of claim 4 wherein a one of the view parameters is selected from a group consisting of:

dots-per-inch settings of a display device for the first one of the plurality of participant nodes, window width and height of the visual content as displayed on the first one of the plurality of participant nodes, zoom factor of the visual content as displayed on the first one of the plurality of participant nodes, rotation of the visual content as displayed on the first one of the plurality of participant nodes, offset of the visual content as displayed on the first one of the plurality of participant nodes, document page number of the visual content as displayed on the first one of the plurality of participant nodes, display type of the visual content as displayed on the first one of the plurality of participant nodes, and a 3D transformation matrix.

6. The method of claim 1 further includes:

receiving at the collaboration server from the first one of the plurality of participant nodes a broadcast chat message data object associated with a broadcast chat message in timed correlation to a second time reference within the multimedia data stream.

7. The method of claim 6 further includes:

receiving at the collaboration server from the first one of the plurality of participant nodes second view parameters of the first one of the plurality of participant nodes in timed correlation to the second time reference.

8. The method of claim 6 wherein the broadcast chat message data object is generated in response to user input associated with entry of chat text separate from the visual content locally on the first one of the plurality of participant nodes.

9. The method of claim 1 further includes:

receiving a second multimedia data stream at the collaboration server associated with a second one of the plurality of participant nodes.

10. The method of claim 9 further includes:

generating a second session record entry associated with the received second multimedia data stream; and

storing the generated second session record entry into the session record specific to the collaboration session and residing on the collaboration server, the session record including a plurality of session record entries including the generated first session record entry and the generated second session record entry, the session record being retrievable by any one of the participant nodes for playing back of the collaboration session in sequence with the session record entries.

11. The method of claim 1 wherein the multimedia data stream includes an audio data stream and the method includes:

detecting audible characteristics in the audio data stream in comparison to a threshold value associated with vocal sounds.

12. The method of claim 1 further includes establishing a time reference in relation to the detected audible characteristics.

13. A method for archiving a collaboration session from a local node regarding visual content viewable by a plurality of users on remote nodes, the method comprising:

transmitting the visual content to a remote collaboration server from the local node, the visual content being associated with the collaboration session;

receiving a local data object associated with the visual content on the local node, the visual content being displayed on the local node in accordance with a set of local view parameters particular to the receipt of the local data object;

transmitting to the collaboration server a first multimedia data stream associated with the local node;

transmitting to the collaboration server from the local node an annotation data object associated with an annotation to the visual content in timed correlation to a first time reference within the first multimedia data stream;

transmitting to the collaboration server from the local node view parameters of the local node in timed correlation to the first time reference;

generating a session data object from the local data object on the local node, the session data object including the first multimedia data stream, the annotation data object and the view parameters; and

transmitting the session data object and a broadcast request to the remote collaboration server from the local node, the broadcast request being specifically associated with the transmitted session data object and the transmitted session data object being stored in a session record as a first session record entry generated therefrom, the session record including a plurality of session record entries including the generated first session record entry and being retrievable by the local node for playing back the collaboration session in sequence with the session record entries.

14. The method of claim 13 wherein the annotation data object is generated in response to user input associated with placement of the annotation on the visual content locally on the local node.

15. The method of claim 13 wherein a one of the view parameters is selected from a group consisting of:

dots-per-inch settings of a display device for the local node, window width and height of the visual content as displayed on the local node, zoom factor of the visual content as displayed on the local node, rotation of the visual content as displayed on the local node, offset of the visual content as displayed on the local node, document page number of the visual content as displayed on the local node, display type of the visual content as displayed on the first one of the plurality of participant nodes, and a 3D transformation matrix.

16. A method for accessing an archived collaboration session from a local node regarding visual content viewable by a plurality of users on remote nodes, the method comprising:

receiving the visual content on the local node from a remote collaboration server, the visual content being associated with the archived collaboration session;

receiving a first session data object on the local node from the remote collaboration server, the first session data object being associated with a first one of the remote nodes and being derived from a corresponding session record entry of a session record specific to the archived collaboration session and residing on the collaboration server;

generating on the local node an inventory of the received first session data object and other prior received session data objects from other remote nodes in the archived collaboration session, the first session data object including a first multimedia data stream, an annotation data object associated with an annotation to the visual content in timed correlation to a first time reference within the first multimedia data stream, and view parameters of the first one of the remote nodes in timed correlation to the first time reference;

receiving a selection of the first session data object from the inventory on the local node; and

displaying the visual content on the local node in timed correlation in relation to the first time reference.

17. The method of claim 16 wherein the displaying of the visual content on the local node is in substantial conformity with the view parameters.

18. The method of claim 16 wherein the displaying of the visual content is temporally prior to the first time reference.

19. The method of claim 16 wherein a one of the view parameters is selected from a group consisting of:

dots-per-inch settings of a display device for the first one of the plurality of participant nodes, window width and height of the visual content as displayed on the first one of the plurality of participant nodes, zoom factor of the visual content as displayed on the first one of the plurality of participant nodes, rotation of the visual content as displayed on the first one of the plurality of participant nodes, offset of the visual content as displayed on the first one of the plurality of participant nodes, document page number of the visual content as displayed on the first one of the plurality of participant nodes, display type of the visual content as displayed on the first one of the plurality of participant nodes, and a 3D transformation matrix.