Interacting with an Assistant Component Based on Captured Stroke Information
First Claim
1. A computer-readable storage medium for storing computer-readable instructions, the computer-readable instructions, when executed by one or more processing devices, performing a method that comprises:
- receiving captured stroke information from an input capture device, the input capture device producing the captured stroke information in response to capturing freehand ink strokes made by a user on an input surface associated with the input capture device;
transforming the captured stroke information into recognized stroke information;
automatically performing analysis on the recognized stroke information to generate output analysis information;
identifying, without being prompted to do so by the user, a response to the captured stroke information based on the output analysis information, and/or an action to be performed based on the output analysis information;
displaying the captured stroke information on a canvas display device; and
presenting the response to the user and/or performing the action.
1 Assignment
0 Petitions
Accused Products
Abstract
A computer-implemented technique is described herein that receives captured stroke information when a user enters handwritten notes using an input capture device. The technique then automatically performs analysis on the captured stroke information to produce output analysis information. Based on the output analysis information, the technique uses an assistant component to identify a response to the captured stroke information and/or to identify an action to be performed. The technique then presents the response, together with the original captured stroke information. In addition, or alternatively, the technique performs the action. In one case, the response is a text-based response; that text-based response may be presented in a freeform handwriting style to give the user the impression that a virtual assistant is responding to the user'"'"'s own note. In another case, the response engages the user in an interactive exercise of any type.
35 Citations
20 Claims
-
1. A computer-readable storage medium for storing computer-readable instructions, the computer-readable instructions, when executed by one or more processing devices, performing a method that comprises:
-
receiving captured stroke information from an input capture device, the input capture device producing the captured stroke information in response to capturing freehand ink strokes made by a user on an input surface associated with the input capture device; transforming the captured stroke information into recognized stroke information; automatically performing analysis on the recognized stroke information to generate output analysis information; identifying, without being prompted to do so by the user, a response to the captured stroke information based on the output analysis information, and/or an action to be performed based on the output analysis information; displaying the captured stroke information on a canvas display device; and presenting the response to the user and/or performing the action. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system, implemented by one or more computing devices, for engaging a user in a dialog based on captured stroke information, comprising:
-
an ink analysis component configured to; receive captured stroke information from an input capture device, the input capture device producing the captured stroke information in response to capturing freehand ink strokes made by a user on an input surface associated with the input capture device; transform the captured stroke information into recognized stroke information; and automatically perform analysis on the recognized stroke information to generate output analysis information; an assistant component configured to; identify, without being prompted to do so by the user, an appropriate dialog with which to engage the user, based on the output analysis information, the dialog encompassing one or more responses; and formulate a response to the captured stroke information based on the dialog and the output analysis information; and a canvas presentation component configured to display the captured stroke information on a canvas display device, and to also present the response. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A method, implemented by one or more computing devices, for engaging a user based on captured stroke information, comprising:
-
receiving captured stroke information from an input capture device, the input capture device producing the captured stroke information in response to capturing freehand ink strokes made by a user on an input surface associated with the input capture device; transforming the captured stroke information into recognized stroke information; automatically performing analysis on the recognized stroke information to generate output analysis information; identifying, without being prompted to do so by the user, a response to the captured stroke information based the output analysis information, and/or an action to be performed based on the output analysis information; displaying the captured stroke information on a canvas display device; and presenting the response to the user and/or performing the action.
-
Specification