Correlation of written notes to digital content
First Claim
1. A computer-implemented method comprising:
- receiving, by a processor, a first data stream representing gesture data captured by a gesture capture system of a smart pen device interacting with a writing surface;
receiving, by the processor, a second data stream representing a sequence of states associated with one or more applications executing on a computing device, each state identifying content being displayed by a computing device while the gesture capture system captures the gesture data;
indexing, by the processor, the first and second data streams to a synchronized time index; and
storing the indexed first and second data streams to a memory.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method receives a plurality of data streams from a smart pen device and a computing device, and indexes the data streams to a synchronized time index. A processor receives a first data stream representing gesture data captured by a smart pen device, and a second data stream representing a sequence of states associated with applications executing on a computing device, such that each state identifies content displayed by a computing device while the gesture data is captured. For example, a state could be a particular page of a digital document displayed by the computing device. After receiving the first and second data streams, the processor indexes the data streams to a synchronized time index, and stores the indexed data streams in a memory.
16 Citations
21 Claims
-
1. A computer-implemented method comprising:
-
receiving, by a processor, a first data stream representing gesture data captured by a gesture capture system of a smart pen device interacting with a writing surface; receiving, by the processor, a second data stream representing a sequence of states associated with one or more applications executing on a computing device, each state identifying content being displayed by a computing device while the gesture capture system captures the gesture data; indexing, by the processor, the first and second data streams to a synchronized time index; and storing the indexed first and second data streams to a memory. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A smart pen computing system comprising:
a non-transitory computer-readable storage medium storing computer program code and integrated within the smart pen device, the computer program code configured to be executed by the processor, the computer program code including instructions for; receiving, by a processor, a first data stream representing gesture data captured by a gesture capture system of a smart pen device interacting with a writing surface; receiving, by the processor, a second data stream representing a sequence of states associated with one or more applications executing on a computing device, each state identifying content being displayed by a computing device while the gesture capture system captures the gesture data; indexing, by the processor, the first and second data streams to a synchronized time index; and storing the indexed first and second data streams to a memory. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21)
Specification