Methods and systems for facilitating virtual collaboration

• US 10,511,551 B2
• Filed: 09/06/2015
• Issued: 12/17/2019
• Est. Priority Date: 09/06/2014
• Status: Active Grant

• Current Assignee: Gang Han, Zhou Lu
• Original Assignee: Gang Han
• Inventors: Han, Gang, Lu, Zhou
• Primary Examiner(s): Vu, Viet D
• Application Number:
  US14/846,793
• Publication Number:
  US 20170005957A1
• Time in Patent Office: 1,563 Days
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information

Abstract

Various embodiments of the present technology provide an online and/or offline meeting system that utilizes a “scene” as a collaboration context and/or for collecting and grouping related text and multimedia based messages exchanged in discussions, and causes the related texts and/or messages to be presented to participants of an online and/or offline meeting in a cinematic way. When an online meeting is over and the meeting session is ended, participants can still make offline communications using the scene as the collaboration context. Further, the present technology improves user experience in viewing or annotating non-text based content in a chat session.

Claims

1. A computer-implemented method for providing a virtual collaboration, comprising:

under the control of a computer device configured with executable instructions, receiving a non-text content;

generating at least one collaborative session of the virtual collaboration based at least in part upon the non-text content, the at least one collaborative session enabling any of one or more participants of the virtual collaboration to click at or point to a location on the at least one collaborative session, and conduct a plurality of operations including adding an annotation tag, the annotation tag associated with a 2-dimensional coordinate of the location on the at least one collaborative session, wherein each annotation tag of the at least one collaborative session is associated with a corresponding timestamp, each drawing of the at least one collaborative session is associated with a corresponding timestamp, and each text message of the at least one collaborative session is associated with a corresponding timestamp;

grouping text and multimedia-based messages during the virtual collaboration, into a plurality of sub-groups, the text and multimedia-based messages associated with the non-text content;

causing the texts and multimedia-based messages in the plurality of sub-groups to be presented on at least one computing device of the one or more participants of the virtual collaboration, wherein the virtual collaboration presented on a display of the at least one computing device comprises a base layer and a sandbox layer spanning the entirety of the virtual collaboration, wherein the base layer includes the non-text content, wherein the sandbox layer includes content of the non-text content and enables at least two participants of the at least one collaborative sessions to modify the non-text content; and

playing back the at least one collaborative session of the virtual collaboration based at least upon timestamps associated with at least one collaborative session annotation tags, drawings and text messages of the at least one collaborative session.

2. The computer-implemented method of claim 1, wherein each of the at least one collaborative session has a session identification (ID).

3. The computer-implemented method of claim 1, wherein the non-text content has a scene ID, each annotation tag of the at least one collaborative session has an annotation ID, each drawing of the at least one collaborative session has a drawing ID, and each text message of the at least one collaborative session has a text ID.

4. The computer-implemented method of claim 3, wherein each annotation tag of the at least one collaborative session is associated with a normalized 2-dimensional coordinate in relation to the non-text content.

5. The computer-implemented method of claim 4, further comprising determining the normalized 2-dimensional coordinate of a corresponding annotation tag of the at least one collaborative session by detecting a touch, mouse click, or gesture of a user of the computing device.

6. The computer-implemented method of claim 5, wherein each text of the at least one collaborative session comprises at least one of the sessions ID, the scene ID, or the normalized 2-dimensional coordinate of a corresponding annotation tag in relation to the non-text content.

7. The computer-implemented method of claim 1, wherein the playing back the at least one collaborative session of the virtual collaboration comprises providing a slide bar for a user of the computing device to view a corresponding annotation tag, corresponding drawing or corresponding text message associated with a specific timestamp.

8. The computer-implemented method of claim 1, wherein the virtual collaboration presented on a display of the computing device further comprises an annotation layer.

9. The computer-implemented method of claim 8, wherein the annotation layer includes metadata of geometries and text messages of the at least one collaborative session.

10. The computer-implemented method of claim 9, further comprising providing an option for a user of the computing device to resize or pan the base layer, render an annotation that includes a 2-dimensional or 3-dimensional geometry object or a text on top of the base layer, erase or modify an annotation from a participant of the at least one collaborative session, or play back the at least one collaborative session.

11. The computer-implemented method of claim 10, further comprising causing the virtual collaboration to be presented on the computing device by combining modified annotation layer with the sandbox layer.

12. The computer-implemented method of claim 1, further comprising:

determining that the at least one collaborative session has ended, and enabling an offline scene-based collaboration.

13. A system, comprising:

a processor; and

a computer-readable medium storing instructions that, when executed by the processor, cause the system to perform operations comprising;

receiving a non-text content;

generating at least one collaborative session of the virtual collaboration based at least in part upon the non-text content, each of the at least one collaborative session has a session identification (ID), the at least one collaborative session enabling any of one or more participants of the virtual collaboration to click at or point to a location on the at least one collaborative session, and conduct a plurality of operations including adding an annotation tag, the annotation tag associated with a 2-dimensional coordinate of the location on the at least one collaborative session;

grouping text and multimedia-based messages during the virtual collaboration, into a plurality of sub-groups, the text and multimedia-based messages associated with the non-text content; and

causing the texts and multimedia-based messages in the plurality of sub-groups to be presented on at least one computing device of one or more participants of the virtual collaboration, wherein the virtual collaboration presented on a display of the at least one computing device comprises a base layer and a sandbox layer spanning the entirety of the virtual collaboration, wherein the base layer includes the non-text content, wherein the sandbox layer includes content of the non-text content and enables at least two participants of the at least one collaborative sessions to modify the non-text content,

wherein the non-text content has a scene ID and a corresponding timestamp, each annotation tag of the at least one collaborative session has an annotation ID and a corresponding timestamp, each drawing of the at least one collaborative session has a drawing ID and a corresponding timestamp, and each text message of the at least one collaborative session has a text ID and a corresponding timestamp,

wherein the at least one collaborative session of the virtual collaboration is configured to be played back based at least upon timestamps associated with at least one collaborative session annotation tags, drawings and text messages of the at least one collaborative session.

14. The system of claim 13, wherein each annotation tag of the at least one collaborative session is associated with a normalized 2-dimensional coordinate in relation to the non-text content.

15. The system of claim 13, wherein the at least one collaborative session of the virtual collaboration is configured to be played back by providing a slide bar for a user of the computing device to view a corresponding annotation tag, corresponding drawing or corresponding text message associated with a specific timestamp.

16. The system of claim 13, wherein the virtual collaboration presented on a display of the computing device further comprises the annotation layer includes metadata of geometries and text messages of the at least one collaborative session.

17. A system, comprising:

a processor; and

a computer-readable medium storing instructions that, when executed by the processor, cause the system to perform operations comprising;

receiving a non-text content;

generating at least one collaborative session of the virtual collaboration based at least in part upon the non-text content, each of the at least one collaborative session has a session identification (ID), the at least one collaborative session enabling any of one or more participants of the virtual collaboration to click at or point to a location on the at least one collaborative session, and conduct a plurality of operations including adding an annotation tag, the annotation tag associated with a 2-dimensional coordinate of the location related to a unique scene on the at least one collaborative session, wherein each annotation tag of the at least one collaborative session is associated with a corresponding timestamp, each drawing of the at least one collaborative session is associated with a corresponding timestamp, and each text message of the at least one collaborative session is associated with a corresponding timestamp;

grouping text and multimedia-based messages during the virtual collaboration, into a plurality of sub-groups, the text and multimedia-based messages associated with the non-text content;

causing the texts and multimedia-based messages in the plurality of sub-groups to be presented on at least one computing device of one or more participants of the virtual collaboration, the virtual collaboration presented on a display of the at least one computing device comprises a base layer and a sandbox layer spanning the entirety of the virtual collaboration, wherein the base layer includes the non-text content, wherein the sandbox layer includes content of the non-text content, and enables at least two participants of the at least one collaborative sessions to modify the non-text content; and

playing back the at least one collaborative session of the virtual collaboration based at least upon timestamps associated with at least one collaborative session annotation tags, drawings and text messages of the at least one collaborative session.

18. The system of claim 17, wherein each of the at least one collaborative session has a session identification (ID) and wherein the non-text content has a scene ID, each annotation tag of the at least one collaborative session has an annotation ID, each drawing of the at least one collaborative session has a drawing ID, and each text message of the at least one collaborative session has a text ID.

19. The system of claim 17, wherein each annotation tag of the at least one collaborative session is associated with a normalized 2-dimensional coordinate in relation to the non-text content.

20. The computer-implemented method of claim 19, wherein the operations further comprises:

determining the normalized 2-dimensional coordinate of a corresponding annotation tag of the at least one collaborative session by detecting a touch, mouse click, or gesture of a user of the computing device.