Adding information or functionality to a rendered document via association with an electronic counterpart
First Claim
Patent Images
1. A method in a mobile device for responding to a capture of text from a display of information that includes text, the method comprising:
- capturing, using an imaging component of the mobile device, an image of a display of information, wherein the image includes text;
recognizing, using a text recognition component of the mobile device, at least a portion of the text within the captured image;
identifying, via the mobile device, one or more actions associated with the captured text;
presenting, via a display of the mobile device, a menu of user-selectable options associated with the identified one or more actions; and
performing, at the mobile device, the identified one or more actions via a display and speakers of the mobile device, wherein when the action to be performed includes visual elements, performing the action using the display of the mobile device, and when the action to be performed includes audio elements, using the speakers of the mobile device.
4 Assignments
0 Petitions
Accused Products
Abstract
An action plan data structure for one or more selected rendered documents is described. The data structure contains information specifying an action to perform automatically in response to a text capture from any of the selected rendered documents.
1036 Citations
11 Claims
-
1. A method in a mobile device for responding to a capture of text from a display of information that includes text, the method comprising:
-
capturing, using an imaging component of the mobile device, an image of a display of information, wherein the image includes text; recognizing, using a text recognition component of the mobile device, at least a portion of the text within the captured image; identifying, via the mobile device, one or more actions associated with the captured text; presenting, via a display of the mobile device, a menu of user-selectable options associated with the identified one or more actions; and performing, at the mobile device, the identified one or more actions via a display and speakers of the mobile device, wherein when the action to be performed includes visual elements, performing the action using the display of the mobile device, and when the action to be performed includes audio elements, using the speakers of the mobile device. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer-readable medium whose contents cause a mobile device to perform a method of performing an action in response to an image of a display of information, the method comprising:
-
capturing, using an imaging component of the mobile device, an image of a display of information, wherein the image includes text; recognizing, using a text recognition component of the mobile device, at least a portion of the text within the captured image; identifying, via the mobile device, one or more actions associated with the captured text; presenting, via a display of the mobile device, a menu of user-selectable options associated with the identified one or more actions; and performing, at the mobile device, the identified one or more actions via a display and speakers of the mobile device, wherein when the action to be performed includes visual elements, performing the action using the display of the mobile device, and when the action to be performed includes audio elements, using the speakers of the mobile device.
-
-
7. A system of one or more components stored in memory of a mobile device and configured to cause a processor of the mobile device to perform an action in response to an image of a display of information, the system comprising:
-
an imaging component, wherein the imaging component is configured to capture an image of a display of information that includes text; a text recognition component, wherein the text recognition component is configured to recognize at least a portion of the text within the captured image; an action identification component, wherein the action identification component is configured to identify one or more performable actions associated with the captured image; a menu component, wherein the menu component is configured to present, via a display of the mobile device, a menu of user-selectable options associated with the identified one or more actions; and an action performance component, wherein the action performance component is configured to perform actions that are associated with options selected by a user using a display and speaker of the mobile device. - View Dependent Claims (8, 9, 10, 11)
-
Specification