System and method for collaborative information display and markup

• US 8,762,856 B2
• Filed: 07/11/2008
• Issued: 06/24/2014
• Est. Priority Date: 01/13/2006
• Status: Active Grant

• Current Assignee: 7842317 Canada Incorporated, Xenogenic Development Limited Liability Company (Intellectual Ventures LLC)
• Original Assignee: Reliable Tack Acquisitions LLC (Intellectual Ventures LLC)
• Inventors: Nykamp, Paul
• Primary Examiner(s): Abdul-Ali, Omar
• Assistant Examiner(s): BHARGAVA, ANIL K
• Application Number:
  US12/171,820
• Publication Number:
  US 20080313546A1
• Time in Patent Office: 2,174 Days
• Field of Search: 715/751, 715/759, 715/733, 715/738
• US Class Current: 715/738
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/194 Calculation of difference between files
• CPC Class Codes: G06Q 10/00 Administration; Management

Abstract

The present invention provides a system that allows documents of various types to be shared between users at geographically dispersed client computers. The users may contemporaneously manipulate the documents and each user'"'"'s manipulations are displayed to the other users in real time using a lightweight synchronization process.

Claims

1. A method for collaborative display and markup of a document comprising:

in response to a request from a controlling client computer, loading the document at a server;

transmitting the document to a plurality of client computers, including the controlling client computer, such that the document is displayed on the plurality of client computers in an initial display state;

receiving, from the controlling client computer, a new display state message indicating a new display state of the document at the controlling client computer and a new view message, wherein the new display state message comprises a document identifier, a displacement from a display state, a zoom level, and a markup layer, wherein the markup layer comprises a markup superimposed over the document, wherein the new view message includes a name of a view associated with the new display state, and wherein the name of the view is for display in a list of views; and

transmitting a version of the new display state message to each of the client computers, except the controlling client computer, such that the document is updated on each of the client computers in accordance with the new display state of the document at the controlling client computer.

2. The method of claim 1, wherein the new view message includes view data comprising a markup state for the document, and further comprising:

recording the view data; and

transmitting the view data to the client computers, except for the controlling client computer.

3. The method of claim 2, wherein the name of the view corresponds to a first view, and further comprising:

receiving, from the controlling client computer, a set view message identifying a second view;

retrieving view data corresponding to the second view; and

transmitting the view data corresponding to the second view to each of the client computers.

4. The method of claim 1, wherein the document comprises a video comprising a plurality of frames and wherein the display state is defined by at least one of the following states:

stop at a specified frame, play forward at specified speed from a specified frame, play forward from a specified frame, play reverse at a specified speed from a specified frame, play reverse from a specified frame, jump to a specified frame, and pause at a specified frame.

5. The method of claim 1, wherein the document comprises a video and further comprising:

receiving, from the controlling client computer, a new markup state message indicating one or more markups superimposed on a display of a frame of the video at the controlling client computer, wherein the new markup state message includes the frame; and

transmitting a version of the new markup state message to the plurality of client computers such that the one or more markups can be superimposed on the document at each of the plurality of client computers, except the controlling client computer.

6. The method of claim 1, wherein the document comprises a text document, a two-dimensional image, a three-dimensional image, a spreadsheet, a video stream, a video clip, an audio stream, a panorama, a floor plan, or an audio clip.

7. The method of claim 1, wherein each client computer stores a plurality of document objects and a display module, wherein each document object is capable of maintaining the display state of the document, wherein the display module is capable of displaying the document according to instructions received from the document object, wherein each document is associated with a document type, and wherein each of the plurality of document objects is specific to a particular document type.

8. The method of claim 7, wherein each document object includes manipulation tools that correspond to the document type.

9. The method of claim 1, further comprising recording the new display state of the new display state message at the server.

10. The method of claim 1, further comprising transmitting a version of the new display state message to the controlling client computer.

11. The method of claim 1, wherein the displacement comprises a two-dimensional displacement defined by an X direction displacement and a Y direction displacement.

12. The method of claim 1, wherein the displacement comprises a three-dimensional displacement defined by an X direction displacement, a Y direction displacement, and a Z direction displacement.

13. The method of claim 1, wherein the document comprises a video having a plurality of frames, and wherein the displacement comprises a specified frame of the video.

14. The method of claim 1, wherein the markup comprises an addition, deletion, or change to the document in the form of a freehand drawing, a circle, an ellipse, or text, and further wherein the version of the new display state message is transmitted whenever the addition, the deletion, or the change occurs.

15. The method of claim 1, further comprising storing the name of the view and the new display state when the markup is added, deleted, or changed.

16. The method of claim 1, wherein transmitting the version of the new display state message occurs when a predetermined number of markups have been added, deleted, or changed.

17. A method of collaboratively displaying a document comprising:

transmitting a document to a plurality of client computers such that the document can be displayed at the plurality of client computers in an initial display state;

transmitting, to the plurality of client computers, a new display state message indicating a new display state of the document and a new view message, wherein the new display state message comprises a document identifier, a displacement from a previous display state, a zoom level such that the document can be displayed at the plurality of client computers in accordance with the new display state, and a markup layer, wherein the markup layer comprises a markup superimposed over the document, wherein the new view message includes a name of a view associated with the new display state, and wherein the name of the view is for display in a list of views.

18. The method of claim 17, further comprising:

receiving a request from a controlling computer to take control of the document;

allowing the controlling computer to manipulate the document; and

receiving the new display state message from the controlling computer, wherein the new display state of the document results from manipulation of the document by the controlling computer.

19. A method for collaborative display of a document:

displaying the document on a first client computer, wherein the document corresponds to a type of document, wherein the first client computer comprises a document object compatible with the type of document, wherein the compatible document object maintains a display state of the document, and wherein the compatible document object includes a plurality of manipulation tools for manipulating a display of the document;

receiving a message describing a manipulation of the display of the document on a second client computer, wherein the message comprises a new display state defined by a document identifier, a reference point from a previous display state, a zoom level, a name of a view associated with the new display state, and a markup layer, wherein the markup layer comprises a markup superimposed over the document and wherein the name of the view is for display in a list of views; and

synchronizing the display of the document on the first client computer with that of the second client computer using the compatible document object and the new display state.

20. An apparatus comprising:

a memory; and

a communication device operatively coupled to the memory, wherein the communication device is configured to;

transmit a document to a plurality of client computers, including a controlling client computer, such that the document is displayed on the plurality of client computers in an initial display state;

receive, from the controlling client computer, a new display state message indicating a new display state of the document at the controlling client computer and a new view message, wherein the new display state message comprises a document identifier, a displacement from the initial display state, a zoom level, and a markup layer, wherein the markup layer comprises a markup superimposed over the document, wherein the new view message includes a name of a view associated with the new display state, and wherein the name of the view is for display in a list of views; and

transmit a version of the new display state message to each of the client computers, except the controlling client computer, such that the document is updated on each of the client computers in accordance with the new display state of the document at the controlling client computer.

21. The apparatus of claim 20, wherein the displacement comprises at least a two-dimensional displacement defined by an X direction displacement and a Y direction displacement.