User interface for collaborative efforts

• US 10,754,490 B2
• Filed: 06/06/2017
• Issued: 08/25/2020
• Est. Priority Date: 10/14/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Tan, Desney S., Hinckley, Kenneth P., Bathiche, Steven N., Pessner, Ronald O., Lee, Bongshin, Gupta, Anoop, Netz, Amir, Brewer, Brett D.
• Primary Examiner(s): Xiao, Di
• Application Number:
  US15/615,169
• Publication Number:
  US 20170269793A1
• Time in Patent Office: 1,176 Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/316 by observing the pattern of computer usage, e.g. typical user behaviour
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/34 involving the use of external additional devices, e.g. dongles or smart cards
• CPC Class Codes: G06F 21/84 output devices, e.g. displays or monitors
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 2221/032 Protect output to user by software means
• CPC Class Codes: G06F 2221/2149 Restricted operating environment
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 65/40 Support for services or applications

Abstract

The description relates to a shared digital workspace. One example includes a display device and sensors. The sensors are configured to detect users proximate the display device and to detect that an individual user is performing an individual user command relative to the display device. The system also includes a graphical user interface configured to be presented on the display device that allows multiple detected users to simultaneously interact with the graphical user interface via user commands.

Claims

1. A system, comprising:

a display device;

a processor; and

a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to;

in a first instance;

present a shared canvas on the display device;

modify the shared canvas responsive to user inputs directed to the shared canvas received from different users;

responsive to user commands received from the different users, retrieve different personal data items of the different users;

concurrently display the different personal data items on the shared canvas; and

save a copy of the shared canvas to personal data associated with an individual user; and

in a subsequent instance, retrieve the shared canvas from the personal data associated with the individual user and present the shared canvas on the display device with the different personal data items of the different users that were retrieved and concurrently displayed in the first instance.

2. The system of claim 1, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance;

receive different free-form ink inputs for different free-form ink drawings entered by the different users; and

modify the shared canvas to include the different free-form ink drawings on the shared canvas responsive to the different free-form ink inputs; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the display device with the different free-form ink drawings received from the different users in the first instance.

3. The system of claim 2, the display device comprising a touch sensor configured to detect the different free-form ink inputs.

4. The system of claim 1, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance;

receive different free-form ink inputs from the different users;

perform ink-to-text processing on the different free-form ink inputs; and

modify the shared canvas to include different text representations, produced by the ink-to-text processing, of the different free-form ink inputs; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the display device with the different text representations of the different free-form ink inputs received from the different users in the first instance.

5. The system of claim 4, wherein the instructions, when executed by the processor, cause the processor to:

provide the shared canvas to a remote user of a remote device.

6. The system of claim 5, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance;

receive further inputs from the remote device, the further inputs identifying one or more words;

further modify the shared canvas to provide a further modified shared canvas that reflects the one or more words identified by the further inputs received from the remote device; and

display the further modified shared canvas on the display device; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the display device with the one or more words identified by the further inputs received from the remote user in the first instance.

7. The system of claim 6, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, obtain the different personal data items of the different users from a cloud service.

8. The system of claim 6, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, obtain the different personal data items from different mobile devices of the different users.

9. A method comprising:

in a first instance;

presenting a shared display area on a display device;

modifying the shared display area with different free-form ink drawings responsive to different free-form inputs directed to the shared display area, the different free-form inputs being received from different users;

responsive to user commands received from the different users, retrieving different data items of the different users;

concurrently displaying the different data items on the shared display area with the different free-form ink drawings; and

saving a representation of the shared display area; and

in a subsequent instance, retrieving the representation of the shared display area and presenting the representation of the shared display area on the display device with the different free-form ink drawings and the different data items of the different users that were retrieved and concurrently displayed in the first instance.

10. The method of claim 9, further comprising:

in the first instance, receiving the different free-form inputs from a stylus that contacts the display device.

11. The method of claim 9, further comprising:

in the first instance, receiving the different free-form inputs from fingers of the different users when the fingers contact the display device.

12. The method of claim 9, further comprising:

in the first instance;

converting other free-form ink received from the different users to obtain text; and

displaying the text on the shared display area; and

in the subsequent instance, retrieving the representation of the shared display area and presenting the representation of the shared display area on the display device with the text obtained by converting the other free-form ink received from the different users.

13. The method of claim 9, further comprising:

sending the representation of the shared display area to a remote user of a remote device.

14. The method of claim 9, further comprising:

providing the representation of the shared display area to a cloud service that sends the representation to a remote device of a remote user.

15. The method of claim 9, further comprising:

in the first instance;

receiving further inputs from a remote device, the further inputs specifying text input to the remote device by a remote user; and

modifying the shared display area to include the text input to the remote device by the remote user; and

in the subsequent instance, retrieving the representation of the shared display area and presenting the representation of the shared display area on the display device with the text specified by the further inputs received from the remote device in the first instance.

16. A system, comprising:

a touch screen;

a processor; and

a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to;

in a first instance;

present a shared canvas on the touch screen;

modify the shared canvas responsive to touch inputs received from different users, the touch inputs being directed to the shared canvas;

responsive to the touch inputs received from the different users, retrieve different data items specified by the different users from a cloud service;

concurrently display the different data items retrieved from the cloud service on the shared canvas; and

save a copy of the shared canvas; and

in a subsequent instance, retrieve the shared canvas and present the shared canvas on the touch screen with the different data items of the different users that were retrieved and concurrently displayed in the first instance.

17. The system of claim 16, wherein the instructions, when executed by the processor, cause the processor to:

scroll the shared canvas in a horizontal or vertical direction.

18. The system of claim 16, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, authenticate the different users before retrieving the different data items from the cloud service.

19. The system of claim 16, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, receive free-form ink from an individual user and modify the shared canvas to include the free-form ink responsive to the touch inputs; and

in the subsequent instance, retrieve the shared canvas and present the shared canvas on the touch screen with the different data items of the different users that were retrieved and concurrently displayed in the first instance and the free-form ink received from the individual user in the first instance.

20. The system of claim 16, wherein the instructions, when executed by the processor, cause the processor to:

in the first instance, send the shared canvas to a remote device of a remote user.