Showing interactions as they occur on a whiteboard

• US 10,705,783 B2
• Filed: 10/19/2016
• Issued: 07/07/2020
• Est. Priority Date: 06/24/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Coplen, C. Joe, Landis, David, Talbot, Keri, Caldwell, Gary, Fish, Nathan, Faulkner, Sarah
• Primary Examiner(s): Patel, Nitin
• Assistant Examiner(s): Stone, Robert M
• Application Number:
  US15/297,288
• Publication Number:
  US 20170039022A1
• Time in Patent Office: 1,357 Days
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15

Abstract

Real-time interactions made by a client on a whiteboard are shown on remote client(s) currently viewing the whiteboard. The real-time interactions that are shown on the remote clients can include a variety of different interactions. For example, the location(s) of where a remote client is touching the whiteboard or interacting with the whiteboard using a stylus may be viewed. A current inking stroke of a remote user may also be viewed as it is occurring. Interactions on the whiteboard may be shown differently depending on the remote user performing the interaction. The whiteboard may also show a location on the whiteboard where each of the remote users are currently viewing. A user may also track the actions of another user. When a change is committed to the whiteboard, the remote clients update the display to reflect the committed state.

Claims

1. A method for showing interactions on a whiteboard, comprising:

providing a whiteboard that is shared across a plurality of remote clients including at least a first remote client and a second remote client;

detecting an interaction with the whiteboard at the first remote client, the interaction being displayed on the whiteboard at the first remote client using a first visual display method;

determining a state of the interaction;

while the interaction is in a non-committed state, displaying an approximation of the interaction on the whiteboard at the second remote client using a second visual display method that is distinct from the first visual display method used to display the interaction on the whiteboard at the first remote client; and

while the interaction is in a committed state, displaying the interaction on the whiteboard at the second remote client using the first visual display method such that the interaction is visually displayed the same on the whiteboard at both the first remote client and the second remote client.

2. The method of claim 1, wherein displaying the approximation of the interaction on the whiteboard at the second remote client comprises displaying a location of a touch interaction with the whiteboard detected at the first remote client.

3. The method of claim 1, wherein displaying the approximation of the interaction on the whiteboard at the second remote client comprises displaying an inking interaction while the inking is occurring on the whiteboard at the first remote client.

4. The method of claim 3, further comprising displaying a current location of an input device used to make the inking interaction while the inking is occurring.

5. The method of claim 1, further comprising displaying a view indicator on the whiteboard that identifies a portion of the whiteboard currently being viewed.

6. The method of claim 1, further comprising identifying a remote user on the whiteboard when one of the plurality of remote clients enters the whiteboard.

7. The method of claim 1, further comprising receiving real-time interaction information while the interaction is occurring and determining the interaction is in the committed state in response to receiving a change notification.

8. The method of claim 1, wherein displaying the approximation of the interaction on the whiteboard at the second remote client comprises displaying a currently occurring inking stroke in a different color from a color used to display a committed inking stroke.

9. The method of claim 1, wherein the interaction, comprises:

a location where a touch is detected on the whiteboard by one of the plurality of remote clients;

a location where a stylus is pointing on the whiteboard by one of the plurality of remote clients;

a change to a whiteboard viewport; and

an identifier of an object on the whiteboard being touched.

10. A computer-readable medium storing computer-executable instructions for showing interactions on a whiteboard, comprising:

providing a whiteboard that is shared across a plurality of remote clients including at least a first remote client and a second remote client;

detecting an interaction with the whiteboard at the first remote client, the interaction being displayed on the whiteboard at the first remote client using a first visual display method;

determining a state of the interaction;

while the interaction is in a non-committed state, displaying an approximation of the interaction on the whiteboard at the second remote client using a second visual display method that is distinct from the first visual display method used to display the interaction on the whiteboard at the first remote client; and

while the interaction is in a committed state, displaying the interaction on the whiteboard at the second remote client using the first visual display method such that the interaction is visually displayed the same on the whiteboard at both the first remote client and the second remote client.

11. The computer-readable medium of claim 10, wherein displaying the approximation of the interaction on the whiteboard at the second remote client comprises displaying a location of a touch interaction with the whiteboard detected at the first remote client.

12. The computer-readable medium of claim 10, further comprising displaying a user indicator on the whiteboard that identifies a portion of the whiteboard currently being viewed by one of the first remote client and the second remote client.

13. The computer-readable medium of claim 10, further comprising identifying a remote user on the whiteboard when one of the first remote client and the second remote client enters the whiteboard and displaying an indication when the remote user leaves the display whiteboard.

14. The computer-readable medium of claim 10, further comprising receiving real-time interaction information from the first remote client and determining the interaction is in the committed state in response to receiving a change notification.

15. The computer-readable medium of claim 10, wherein displaying the approximation of the interaction on the whiteboard at the second remote client comprises displaying a currently occurring inking stroke in a different color from a color used to depict a committed inking stroke.

16. The computer-readable medium of claim 10, wherein the interaction, comprises:

a location where a touch is detected on the whiteboard by one of the first remote client and the second remote client;

a location where a stylus is pointing on the whiteboard by one of the first remote client and the second remote client;

a change to a whiteboard viewport; and

an identifier of an object on the whiteboard being touched.

17. A system for showing interactions on a whiteboard, comprising:

a processor and memory;

an operating environment executing using the processor;

a whiteboard that is shared between remote clients including at least a first remote client and a second remote client; and

a manager that is configured to perform actions comprising;

displaying the whiteboard on the remote clients;

receiving in real-time an interaction with the whiteboard at the first remote client, the interaction being displayed on the whiteboard at the first remote client using a first visual display method, and the interaction including receiving an inking interaction while the inking is occurring at the first remote client;

determining a state of the inking interaction is in a non committed state;

while the inking interaction is in a non-committed state, displaying an approximation of the inking interaction on the whiteboard at the second remote client using a second visual display method that is distinct from the first visual display method used to display the inking interaction on the whiteboard at the first remote client; and

while the inking interaction is in a committed state, displaying the inking interaction on the whiteboard at the second remote client using the first visual display method such that the inking interaction is visually displayed the same on the whiteboard at both the first remote client and the second remote client.

18. The system of claim 17, wherein displaying the approximation of the inking interaction on the whiteboard at the second remote client comprises displaying a location of a touch interaction with the whiteboard detected at the first remote client.

19. The system of claim 17, wherein displaying the approximation of the inking interaction on the whiteboard at the second remote client comprises displaying a currently occurring inking stroke in a different color from a color used to display a committed inking stroke.

20. The system of claim 17, wherein the interaction, comprises:

a location where a touch is detected on the whiteboard;

a location where a stylus is pointing on the whiteboard; and

a change to a viewport.