Stroke localization and binding to electronic document
First Claim
Patent Images
1. A process for associating an ink stroke with an electronic document comprising the steps of:
- generating a first two-dimensional array of bits;
generating a second two-dimensional array of bits;
combining the first two-dimensional array and the second two-dimensional array to generate a combined array, wherein the first two-dimensional array and the second two-dimensional array at least partially overlap in the combined array and wherein a start position of the second two-dimensional array in the combined array is shifted, by an amount that is based on a document identifier associated with an electronic document, relative to a start position of the first two-dimensional array in the combined array;
printing the combined array on a paper documentreceiving a first captured image of the paper document from a camera associated with a pen;
receiving a second captured image of the paper document from the camera associated with the pen;
obtaining encoded information from the first captured image and the second captured image;
decoding said information from the first captured image and the second captured image, wherein the decoded information includes location information and a document identifier, wherein location information is decoded at least in part by decoding a portion of the first two-dimensional array contained within an image and wherein a document identifier is decoded at least in part by determining the shift of a portion of the second two-dimensional array contained within an image relative to a portion of the first two-dimensional array contained within the image;
forming a representation of an ink stroke based on the decoded location information from the first captured image and the second captured image;
identifying an electronic version of the paper document based on the decoded document identifier from said decoding step;
storing the formed representation of the ink stroke in association with the identified electronic version of the paper document; and
displaying the electronic version of the paper document, including displaying the ink stroke based on the formed representation stored in association with the electronic version of the identified document.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus for capturing information encoded within a surface, such as location information or document metadata, and associating the information with a document is described. The captured information may be obtained by a camera associated with a pointing or writing device having a camera, such as an image-capturing pen.
-
Citations
16 Claims
-
1. A process for associating an ink stroke with an electronic document comprising the steps of:
-
generating a first two-dimensional array of bits; generating a second two-dimensional array of bits; combining the first two-dimensional array and the second two-dimensional array to generate a combined array, wherein the first two-dimensional array and the second two-dimensional array at least partially overlap in the combined array and wherein a start position of the second two-dimensional array in the combined array is shifted, by an amount that is based on a document identifier associated with an electronic document, relative to a start position of the first two-dimensional array in the combined array; printing the combined array on a paper document receiving a first captured image of the paper document from a camera associated with a pen; receiving a second captured image of the paper document from the camera associated with the pen; obtaining encoded information from the first captured image and the second captured image; decoding said information from the first captured image and the second captured image, wherein the decoded information includes location information and a document identifier, wherein location information is decoded at least in part by decoding a portion of the first two-dimensional array contained within an image and wherein a document identifier is decoded at least in part by determining the shift of a portion of the second two-dimensional array contained within an image relative to a portion of the first two-dimensional array contained within the image; forming a representation of an ink stroke based on the decoded location information from the first captured image and the second captured image; identifying an electronic version of the paper document based on the decoded document identifier from said decoding step; storing the formed representation of the ink stroke in association with the identified electronic version of the paper document; and displaying the electronic version of the paper document, including displaying the ink stroke based on the formed representation stored in association with the electronic version of the identified document. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A system for associating pen movement with a document comprising:
-
an input that receives images of the document from a camera associated with a pen, wherein each image contains a combined array comprised of a first two-dimensional array of bits and a second two-dimensional array of bits, wherein a start position of the second two-dimensional array in the combined array is shifted, by an amount that is based on a document identifier associated with the document, relative to a start position of the first two-dimensional array in the combined array; at least one processor that receives the images, the processor obtaining encoded information from the images, decoding the information to determine location information and a document identifier, and forming an ink stroke based on the identified location information, wherein location information is determined at least in part by decoding a portion of the first two-dimensional array contained within an image and wherein the document identifier is decoded at least in part by determining the shift of a portion of the second two-dimensional array contained within a first image relative to a portion of the first two-dimensional array contained within the first image; and a component that stores the ink stroke in association with the document so that the associated ink stroke can be output along with the document. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A pen that captures images, said images being processed to associate a stroke with an electronic document, the pen comprising:
-
a component for capturing images of a surface containing an EIC symbol array and an output of the electronic document, the EIC symbol array including encoded position information and an encoded document identifier, wherein the EIC symbol array is comprised of a first two-dimensional array of bits and a second two-dimensional array of bits, wherein a start position of the second two-dimensional array is shifted, by an amount that is based on a document identifier associated with an electronic document, relative to a start position of the first two-dimensional array; a component for decoding an EIC symbol within captured images to determine the position of the pen at the time an image was captured, wherein the position is determined at least in part by decoding the first two-dimensional array contained within an EIC symbol; a component for generating an ink stroke based at least in part on the determined positions of captured images; a component for decoding an EIC symbol within captured images to determine a document identifier, wherein the document identifier is decoded at least in part by determining the shift of the second two-dimensional array contained within an EIC symbol relative to the first two-dimensional array contained within the EIC symbol; a component for identifying the electronic document based at least in part on the decoded document identifier; and a component for binding the generated ink stroke to the electronic document so that the ink stroke can be identified when the electronic document is retrieved. - View Dependent Claims (16)
-
Specification