Indexed document modification sharing with mixed media reality
First Claim
1. A computer-implemented method of modifying documents for shared use, comprising:
- creating, by a processor, an index in a database by transforming features detected in a document into textual terms that represent both the features and two-dimensional relationships of the features in the document, the features including trigrams of word lengths horizontally and vertically;
receiving, by the processor, a first digital image from a first user, the first digital image including text;
extracting, by the processor from the first digital image, horizontal and vertical features including a geometric arrangement of word lengths in the text of the first digital image;
retrieving, by the processor, the document from the database based on matching the two-dimensional relationships of the features in the document included in the index, including the trigrams of word lengths horizontally and vertically, with the geometric arrangement of word lengths included in the horizontal and vertical features extracted from the first digital image;
receiving, by the processor, user information of users that have interacted with the document;
recognizing, by the processor, that the document is associated with the first user based on searching a database including the user information;
receiving, by the processor, from the first user a modification to the document associated with the first digital image;
applying, by the processor, the modification to the document;
creating, by the processor, a modified document associated with the first user using the modification;
updating, by the processor, the index to include the modification to the document;
receiving, by the processor, a second digital image;
determining, by the processor, that the second digital image includes at least a portion of the document and is similar to the first digital image based on the two-dimensional relationships of the features in the document and the modification of the document included in the index;
determining, by the processor, that the second digital image is associated with a second user based on searching the database including the user information; and
in response to the first user and the second user capturing similar digital images, authorizing, by the processor, the second user to access a web-based interface to communicate with the first user about the modified document posted on the web-based interface by the first user.
1 Assignment
0 Petitions
Accused Products
Abstract
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). The present invention provides systems, methods, and computer program products for modifying documents for shared use, and for collaborative discussion of shared documents. Captured digital images of documents or portions associated with a user are received, along with modifications to the images. Documents are recognized from the captured digital images, and the modifications to the images are applied to the documents. Alternatively, captured digital images of documents are received, and the documents are recognized along with a hotspot in the document. The user is authenticated to a website associated with the hotspot, and is provided access to an associated multimedia repository.
562 Citations
27 Claims
-
1. A computer-implemented method of modifying documents for shared use, comprising:
-
creating, by a processor, an index in a database by transforming features detected in a document into textual terms that represent both the features and two-dimensional relationships of the features in the document, the features including trigrams of word lengths horizontally and vertically; receiving, by the processor, a first digital image from a first user, the first digital image including text; extracting, by the processor from the first digital image, horizontal and vertical features including a geometric arrangement of word lengths in the text of the first digital image; retrieving, by the processor, the document from the database based on matching the two-dimensional relationships of the features in the document included in the index, including the trigrams of word lengths horizontally and vertically, with the geometric arrangement of word lengths included in the horizontal and vertical features extracted from the first digital image; receiving, by the processor, user information of users that have interacted with the document; recognizing, by the processor, that the document is associated with the first user based on searching a database including the user information; receiving, by the processor, from the first user a modification to the document associated with the first digital image; applying, by the processor, the modification to the document; creating, by the processor, a modified document associated with the first user using the modification; updating, by the processor, the index to include the modification to the document; receiving, by the processor, a second digital image; determining, by the processor, that the second digital image includes at least a portion of the document and is similar to the first digital image based on the two-dimensional relationships of the features in the document and the modification of the document included in the index; determining, by the processor, that the second digital image is associated with a second user based on searching the database including the user information; and in response to the first user and the second user capturing similar digital images, authorizing, by the processor, the second user to access a web-based interface to communicate with the first user about the modified document posted on the web-based interface by the first user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A computer program product for modifying documents for shared use, the computer program product comprising:
-
a non-transitory computer-readable storage medium; and computer program code, coded on the non-transitory computer-readable storage medium, which when executed by a computer causes the computer to; create an index in a database by transforming features detected in a document into textual terms that represent both the features and two-dimensional relationships of the features in the document, the features including trigrams of word lengths horizontally and vertically; receive a first digital image from a first user, the first digital image including text; extract, from the first digital image, horizontal and vertical features including a geometric arrangement of word lengths in the text of the first digital image; retrieve the document from the database based on matching the two-dimensional relationships of the features in the document included in the index including the trigrams of word lengths horizontally and vertically, with the geometric arrangement of word lengths included in the horizontal and vertical features extracted from the first digital image; receive user information of users that have interacted with the document; recognize that the document is associated with the first user based on searching a database including the user information; receive from the first user a modification to the document associated with the first digital image; apply the modification to the document; create a modified document associated with the first user using the modification; update the index to include the modification to the document; receive a second digital image; determine that the second digital image includes at least a portion of the document and is similar to the first digital image based on the two-dimensional relationships of the features in the document and the modification of the document included in the index; determine that the second digital image is associated with a second user based on searching the database including the user information; and in response to the first user and the second user capturing similar digital images, authorize the second user to access a web-based interface to communicate with the first user about the modified document posted on the web-based interface by the first user. - View Dependent Claims (22, 23, 24, 25, 26)
-
-
27. A system for modifying documents for shared use, the system comprising:
-
one or more processors; and a memory storing instructions, which when executed by the one or more processors causes the system to create an index in a database by transforming features detected in a document into textual terms that represent both the features and two-dimensional relationships of the features in the document, the features including trigrams of word lengths horizontally and vertically; receive a first digital image from a first user, the first digital image including text; extract, from the first digital image, horizontal and vertical features including geometric arrangement of word lengths in the text of the first digital image; retrieve the document from the database based on matching the two-dimensional relationships of the features in the document included in the index, including the trigrams of word lengths horizontally and vertically, with the geometric arrangement of word lengths included in the horizontal and vertical features extracted from the first digital image; receive user information of users that have interacted with the document; recognize that the document is associated with the first user based on searching a database including the user information; receive a second digital image; determine that the second digital image includes at least a portion of the document and is similar to the first digital image based on the two-dimensional relationships of the features in the document and a modification of the document included in the index; and determine that the second digital image is associated with a second user based on searching the database including the user information; receive from the first user the modification associated with the first digital image associated with the first user; apply the modification to the document; create a modified document associated with the first user using the modification; update the index to include the modification to the document; and in response to the first user and the second user capturing similar digital images, authorize the second user to access a web-based interface to communicate with the first user about the modified document posted on the web-based interface by the first user.
-
Specification