Triggering applications based on a captured text in a mixed media environment
First Claim
1. A system for performing an action in a mixed media environment having a first type of medium and a second type of medium, the system comprising:
- a capture device for capturing a first electronic representation of a document in the first type of medium, wherein the first type of medium is a physical printed medium;
a media storage for a storing a plurality of mixed media documents, each mixed media document comprising;
an action;
a second electronic representation corresponding to the document in the physical printed medium; and
an index linking the action to the second electronic representation;
a recognition unit for identifying a mixed media document from the plurality of mixed media documents that has the second electronic representation that matches the first electronic representation; and
an action processing unit coupled to the recognition unit to receive an action of the identified mixed media document, and adapted to perform the action of the identified mixed media document.
1 Assignment
0 Petitions
Accused Products
Abstract
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system includes an action processor and method, and MMR documents with an associated action. The MMR document structure is particularly advantageous because the ability to specify different actions for different MMR documents, combined with the ability to create any number of MMR documents for a particular location on any media, allows the MMR architecture to serve as a universal trigger or initiator for additional processing. In other words, addition processing or actions can be triggered or initiated based on MMR recognition. The action processor receives the output of the MMR recognition process which yields an MMR document including at least one action. The action processor executes that action which includes various commands to the MMR system or other systems coupled to the MMR system. The MMR system architecture is advantageous because an action can be executed by pointing the capture device at a block of text, and the action is performed. Example actions include retrieving the text in electronic form to the capture device, retrieving the specification for the action, inserting data to a MMR document, transferring data between documents, purchasing items, authoring actions or reviewing historical information about actions. The MMR system includes a variety of user applications (one or more actions) initiated by the MMR recognition of a text patch such as information retrieval for a travel guide book, stock listings or advertisements; information capture such as recording content from a conference, recording and storing multimedia associated with the document, capturing information for a calendar and on the fly authoring; purchasing media files for storage on any part of an MMR document.
-
Citations
19 Claims
-
1. A system for performing an action in a mixed media environment having a first type of medium and a second type of medium, the system comprising:
-
a capture device for capturing a first electronic representation of a document in the first type of medium, wherein the first type of medium is a physical printed medium; a media storage for a storing a plurality of mixed media documents, each mixed media document comprising; an action; a second electronic representation corresponding to the document in the physical printed medium; and an index linking the action to the second electronic representation; a recognition unit for identifying a mixed media document from the plurality of mixed media documents that has the second electronic representation that matches the first electronic representation; and an action processing unit coupled to the recognition unit to receive an action of the identified mixed media document, and adapted to perform the action of the identified mixed media document. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
Specification