Annotation of computer video displays

• US 5,920,694 A
• Filed: 04/07/1997
• Issued: 07/06/1999
• Est. Priority Date: 03/19/1993
• Status: Expired due to Term

• Current Assignee: NCR Corporation (NCR Voyix Corporation)
• Original Assignee: NCR Corporation (NCR Voyix Corporation)
• Inventors: Connet, David R., Carleton, Allison A., Schwartz, Krista S.
• Primary Examiner(s): Rinehart, Mark H.
• Application Number:
  US08/833,549
• Time in Patent Office: 820 Days
• Field of Search: 395/200.34, 395/200.35, 707/512, 345/509, 345/510, 345/330, 345/331
• US Class Current: 709/205
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A system in which multiple computers engage in a collaborative video conference. One computer generates a common image which is distributed to the other computers. The invention allows the users of the other computers to annotate (that is, mark up, by drawings and text) the image at their respective computers. The invention replicates the annotations at the other computers.

One type of annotation allowed is "highlighting," wherein a user drags a cursor across a display, and the invention leaves a colored trail behind the cursor, which is transparent, and does not obscure the underlying images.

Claims

1. In a system wherein a host computer and multiple remote computers display at least one common image, the common image being generated by a program at the host computer, comprising:

a) annotation means, distinct from the program at the host computer generating the common image, for allowing users of the host computer and the multiple remote computers to make at least one annotation on the common image; and

b) means for storing the annotation generated by that computer at that computer, while using the program at the host computer to store the common image at a different location at the host computer.

2. A system according to claim 1, in which the annotation means allows each user to make annotations by drawing transparent highlights onto the common image.

3. A system according to claim 1, in which the annotations means allows each user to make annotations by

i) typing text onto the common image;

ii) drawing lines onto the common image; and

iii) drawing transparent highlights onto the common image.

8. A system according to claim 1, in which the annotations means allows each user to make annotations by typing text onto the common image.

9. A system according to claim 1, in which the annotation means allows each user to make annotations by

i) typing text onto the common image;

and

ii) drawing lines onto the common image.

10. A system according to claim 1, in which the annotation means allows each user to make annotations by

i) typing text onto the common image;

and

ii) drawing transparent highlights onto the common image.

11. A system according to claim 1, in which the annotation means allows each user to make annotations by

i) typing text onto the common image;

ii) drawing lines onto the common image; and

iii) drawing transparent highlights onto the common image.

4. A system wherein a host computer and multiple remote computers display at least one common image, the common image being generated by a program at the host computer, comprising:

a) means for displaying a video image in addition to the common image;

b) annotation means, distinct from the program at the host computer generating the common image, for allowing users of the host computer and the remote computers to make at least one annotation on the common image or the video image;

c) means for storing the annotation generated by that computer at that computer, while using the program at the host computer to store the common image at the host computer at a different location than image data and video data.

5. A system wherein a host computer and at least one remote computer display a common document, the common document being generated by the host computer, comprising:

a) means for allowing users of the host computer and the remote computers to make at least one annotation on the document;

b) means for storing the annotated document;

c) means for retrieving the annotated document from storage and displaying it;

d) means for allowing a user to

i) edit the annotated document and

ii) remove all annotations using a single sequence of commands.

12. A system according to claim 5, including annotation means allowing each user to make annotations by typing text onto the common document.

13. A system according to claim 5, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

and

ii) drawing lines onto the common document.

14. A system according to claim 5, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

and

ii) drawing transparent highlights onto the common document.

15. A system according to claim 5, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

ii) drawing lines onto the common document; and

iii) drawing transparent highlights onto the common document.

6. A computer system comprising.

(a) means for permitting two or more users of respective computers to produce a common document, the common document additionally including annotations to the common document, the annotations including typed annotations to the common document generated by machine, and

(b) means for permitting one of the users to obtain the common document, with annotations absent, the means for obtaining the common document being such as not to require user removal of annotations individually.

7. A system according to claim 6, in which the annotations include typed characters generated by machine.

16. A system according to claim 6, including annotation means allowing each user to make annotations by typing text onto the common document.

17. A system according to claim 6, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

and

ii) drawing lines onto the common document.

18. A system according to claim 6, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

and

ii) drawing transparent highlights onto the common document.

19. A system according to claim 6, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

ii) drawing lines onto the common document; and

iii) drawing transparent highlights onto the common document.

20. A computer system including multiple computers, each of which is running a message-driven operating system comprising

a) a shared program on a single host computer generating a common image;

b) annotation means for allowing users of the computers to make at least one annotation on the common image; and

c) means for storing annotation data generated by that computer at that computer, while using the shared program to store the common image at a different location;

d) in which one or more of the means of b) or c) is a computer program which is distinct from the shared program.

24. A system according to claim 20, in which the annotation means allows each user to make annotations by

i) typing text onto the common image;

ii) drawing lines onto the common image; and

iii) drawing transparent highlights onto the common image.

21. A computer system including multiple computers, each of which is running a message-driven operating system comprising

a) a shared program on a single host computer generating a common image;

b) means for displaying a video image in addition to the common image;

c) annotation means for allowing users of the computers to make at least one annotation on the common image or on the video image;

d) means for storing the annotation generated by that computer at that computer, while using the shared program to store the common image at a different location than the video image;

e) in which one or more of the means of b), c), or d) is a computer program which is distinct from the shared program.

25. A system according to claim 21, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

ii) drawing lines onto the common document; and

iii) drawing transparent highlights onto the common document.

22. A computer system including multiple computers, each of which is running a message-driven operating system comprising:

a) a shared program on a single host computer used to generate a document;

b) means for allowing users of the computers to make at least one annotation on the document;

c) means for storing the annotated document;

d) means for retrieving the annotated document from storage and displaying it;

e) means for allowing a user to

i) edit thc annotated document and

ii) remove all annotations using a single sequence of commands;

f) in which one or more of the means of b), c), d), or e) is a computer program which is distinct from the shared program.

26. A system according to claim 22, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

ii) drawing lines onto the common document; and

iii) drawing transparent highlights onto the common document.

23. A computer system including multiple computers, each of which is running a message-driven operating system comprising:

a) a shared program on a single host computer used to generated a common document;

b) means for permitting two or more users of respective computers to use the shared program to produce the common document, the common document additionally including annotations to the common document, the annotations including typed annotations to the common document generated by machine,

c) means for permitting one of the users to obtain the common document, with annotations absent, the means for obtaining the common document being such as not to require user removal of annotations individually, and

d) in which one or more of the means of b) or c) is a computer program which is distinct from the shared program.

27. A system according to claim 23, including annotation means allowing each user to make annotations by

i) typing text onto the common document;

ii) drawing lines onto the common document; and

iii) drawing transparent highlights onto the common document.