Cross application digital ink repository

• US 10,228,775 B2
• Filed: 01/22/2016
• Issued: 03/12/2019
• Est. Priority Date: 01/22/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Zhou, Francis
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US15/004,574
• Publication Number:
  US 20170212612A1
• Time in Patent Office: 1,145 Days
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

A computing device includes a digital ink system that provides digital ink support to applications on the computing device. Digital ink inputs are received by the digital ink system, which provides ink stroke data for the digital ink inputs to the application for storage in a manner and format the application desires. The digital ink system also generates a digital ink container associated with the digital ink input, and communicates the digital ink container to a digital ink repository. The digital ink repository stores digital ink containers for multiple applications, and can be searched from a computing device to identify digital ink input to an application regardless of which application the digital ink was input to.

Claims

1. A method comprising:

receiving, by a digital ink system, a digital ink input to an application;

providing, by the digital ink system to the application, ink stroke data for the digital ink input for storage by the application;

adding, to a digital ink container, an indication of the ink stroke data for the digital ink input stored by the application;

adding, to the digital ink container, data representing a context of the digital ink input, the data representing the context of the digital ink input including an identifier of the application;

communicating the digital ink container to a cross application digital ink repository responsive to determining a digital ink session has ended based on one of the application being closed, a particular user selection being made, a particular amount of time having elapsed, or a threshold amount of time having elapsed since a last ink stroke, the cross application digital ink repository storing the digital ink container as well as multiple additional digital ink containers each including ink stroke data indications for additional digital ink inputs to each of one or more additional applications;

receiving digital ink search criteria as a user input for a search of the cross application digital ink repository; and

identifying one or more digital ink containers in the cross application digital ink repository that satisfy the digital ink search criteria by comparing, for each of multiple digital ink containers in the cross application digital ink repository, the digital ink search criteria to the data in the digital ink container representing the context of the digital ink.

2. The method of claim 1, the method being implemented in the digital ink system of a computing device running the application and at least one of the additional applications.

3. The method of claim 1, the data representing the context of the digital ink input further including:

a uniform resource identifier that distinguishes the application from other applications;

a date and/or time at which the digital ink was input to the application; and

a geographic location of a device implementing the application at the time the digital ink was input to the application.

4. The method of claim 3, the data representing the context of the digital ink input further including an identifier of users that are present when the digital ink was input to the application.

5. The method of claim 1, the indication of the ink stroke data comprising coordinates of an input device where the digital ink input occurred.

6. The method of claim 1, the indication of the ink stroke data comprising a screenshot of at least part of a display device when the digital ink was input.

7. The method of claim 1, the indication of the ink stroke data comprising an animated view of the digital ink input.

8. The method of claim 1, further comprising:

displaying indications of the digital ink associated with the identified digital ink containers.

9. The method of claim 8, the method being implemented on a computing device, the method further comprising:

receiving a user selection of one of the identified digital ink containers;

running, on the computing device, the application to which the digital ink associated with the user-selected digital ink container was input; and

displaying an indication of a file stored by a digital ink store of the application associated with the selected one of the identified digital ink containers.

10. The method of claim 9, further comprising:

identifying, based on a uniform resource identifier included in the user-selected digital ink container, the application;

downloading, responsive to determining that the application is not installed on the computing device, the application from an online store; and

installing the downloaded application on the computing device prior to running the application on the computing device.

11. A system comprising:

one or more storage devices configured to store instructions for an application and a digital ink store associated with the application;

one or more processors configured to run the application;

a digital ink system configured to receive a digital ink input to the application, to provide to the application ink stroke data for the digital ink input for storage in the digital ink store, to add to a digital ink container an indication of the ink stroke data for the digital ink input, and to add to the digital ink container context data representing a context of the digital ink input, the context data including an identifier of the application;

a communication module configured to communicate the digital ink container to a cross application digital ink repository responsive to determining a digital ink session has ended based on one of the application being closed, a particular user selection being made, a particular amount of time having elapsed, or a threshold amount of time having elapsed since a last ink stroke, the cross application digital ink repository storing the digital ink container as well as multiple additional digital ink containers each including ink stroke data indications for additional digital ink inputs to each of one or more additional applications; and

a search program configured to receive digital ink search criteria as a user input for a search of the cross application digital ink repository, and identify digital ink containers in the cross application digital ink repository that satisfy the digital ink search criteria by comparing, for each of multiple digital ink containers in the cross application digital ink repository, the digital ink search criteria to the data in the digital ink container representing the context of the digital ink.

12. The system of claim 11, the one or more processors being further configured to run a search program configured to:

display indications of the digital ink associated with the identified digital ink containers;

receive a user selection of one of the identified digital ink containers; and

run, on the system, the application to which the digital ink associated with the user-selected digital ink container was input.

13. The system of claim 11, the indication of the ink stroke data comprising an animated view of the digital ink input.

14. A computing device comprising:

one or more processors; and

a computer-readable storage medium having stored thereon multiple instructions that, responsive to execution by the one or more processors, cause the one or more processors to perform acts comprising;

receiving a digital ink input to an application executed by the one or more processors;

providing to the application ink stroke data for the digital ink input;

adding, to a digital ink container, an indication of the ink stroke data for the digital ink input provided to the application;

adding, to the digital ink container, context data representing a context of the digital ink input, the context data including a uniform resource identifier of the application that distinguishes the application from other applications;

communicating the digital ink container to a cross application digital ink repository responsive to determining a digital ink session has ended based on one of the application being closed, a particular user selection being made, a particular amount of time having elapsed, or a threshold amount of time having elapsed since a last ink stroke, the cross application digital ink repository storing the digital ink container as well as multiple additional digital ink containers each including ink stroke data indications for additional digital ink inputs to each of the other applications;

receiving digital ink search criteria as a user input for a search of the cross application digital ink repository; and

identifying one or more digital ink containers in the cross application digital ink repository that satisfy the digital ink search criteria by comparing, for each of multiple digital ink containers in the cross application digital ink repository, the digital ink search criteria to the data in the digital ink container representing the context of the digital ink.

15. The computing device of claim 14, the acts further comprising:

displaying indications of the digital ink associated with the identified digital ink containers;

receiving a user selection of one of the identified digital ink containers;

running, on the computing device, the application to which the digital ink associated with the user-selected digital ink container was input.

16. The computing device of claim 14, the context data further including:

a date and/or time at which the digital ink was input to the application; and

a geographic location of the computing device at the time the digital ink was input to the application.

17. The computing device of claim 14, the context data further including an identifier of users that are present when the digital ink was input to the application.

18. The computing device of claim 14, the indication of the ink stroke data comprising a screenshot of at least part of a display device when the digital ink was input.

19. The computing device of claim 14, the digital ink input having been provided by movement of a pen, and the cross application digital ink repository comprising a storage device implemented in the pen.