TRIGGERING APPLICATIONS FOR DISTRIBUTED ACTION EXECUTION AND USE OF MIXED MEDIA RECOGNITION AS A CONTROL INPUT
First Claim
1. A system for performing an action in a mixed media environment having a first type of medium and a second type of medium, the system comprising:
- a capture device for capturing a first representation of a document in the first type of medium;
a media storage for a storing a plurality of mixed media documents, each mixed media document having an index, an action and a second representation of a corresponding document in the first type of medium;
a recognition unit for identifying a mixed media document from the plurality of mixed media documents that has a second representation that matches the first representation; and
a server coupled for communication with the capture device, the media storage and the recognition unit, the server including an action processor for receiving an action of the identified mixed media document, and performing the action of the identified mixed media document.
2 Assignments
0 Petitions
Accused Products
Abstract
A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium. In one embodiment of the present invention, the MMR system includes an action processor and method, and MMR documents with an associated action. The MMR document structure specifies different actions for different MMR documents combined with the ability to create any number of MMR documents for a particular location on any media, which allows the MMR architecture to serve as a universal trigger or initiator for additional processing. The action processor receives the output of the MMR recognition process which yields an MMR document including at least one action. The action processor executes that action which includes various commands to the MMR system or other systems coupled to the MMR system. The MMR system executes the action using other system and the MMR software is distributed among the MMR system and these other systems. The MMR system architecture is advantageous because an action can be executed by pointing the capture device at a rendered document, and the action is performed. Example actions include retrieving the electronic form of the rendered document, retrieving the specification for the action, inserting data to a MMR document, transferring data between documents, purchasing items, authoring actions or reviewing historical information about actions. In another embodiment, the MMR system, in particular MMR recognition and the input/output capabilities of the capture device, are used as a control mechanism for a third party system.
-
Citations
33 Claims
-
1. A system for performing an action in a mixed media environment having a first type of medium and a second type of medium, the system comprising:
-
a capture device for capturing a first representation of a document in the first type of medium;
a media storage for a storing a plurality of mixed media documents, each mixed media document having an index, an action and a second representation of a corresponding document in the first type of medium;
a recognition unit for identifying a mixed media document from the plurality of mixed media documents that has a second representation that matches the first representation; and
a server coupled for communication with the capture device, the media storage and the recognition unit, the server including an action processor for receiving an action of the identified mixed media document, and performing the action of the identified mixed media document. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A first system for controlling a second system, the first system providing a mixed media environment having a first type of medium and a second type of medium, the first system comprising:
-
a capture device for capturing a first representation of a document in the first type of medium;
a media storage for a storing a plurality of mixed media documents, each mixed media document having an index, an action and a second representation of a corresponding document in the first type of medium;
a recognition unit for identifying a mixed media document from the plurality of mixed media documents that has a second representation that matches the first representation; and
a server coupled for communication with the capture device, the media storage, the recognition unit and the second system, the server adapted to control the second system in response to an action in a mixed media document. - View Dependent Claims (14, 15, 16, 17, 18, 19)
-
-
20. A method for performing an action in a mixed media environment having a first type of medium and a second type of medium, the method comprising:
-
acquiring an input representation;
comparing the input representation to a plurality of stored representations, each of the plurality of stored representations being associated with a mixed media document having a first action and a second action;
identifying a matching stored representation that matches the input representation and the mixed media document associated with the matching stored representation; and
performing the first action of the mixed media document associated with the matching stored representation; and
performing the second action of the mixed media document associated with the matching stored representation. - View Dependent Claims (21, 22, 23, 24, 25, 26)
-
-
27. A method for controlling a system using an action in a mixed media environment having a first type of medium and a second type of medium in response to recognition of a representation, the method comprising:
-
acquiring an input representation;
comparing the input representation to a plurality of stored representations, each of the plurality of stored representations being associated with a mixed media document including an action;
identifying a matching stored representation that matches the input representation and the mixed media document associated with the matching stored representation; and
controlling the system by performing the action of the mixed media document associated with the matching stored representation. - View Dependent Claims (28, 29, 30, 31, 32, 33)
-
Specification