User augmented reality for camera-enabled mobile devices
First Claim
Patent Images
1. A method of providing information regarding one or more scenes captured with a camera of a mobile device, comprising:
- in response to determining that a camera of the mobile device is pointed at a scene including one or more objects, (i) displaying a visual representation of the scene in a display of the mobile device, and (ii) presenting in combination with the visual representation a plurality of options for selecting one of a plurality of user augmented reality modes that include an encyclopedia mode, a decision support mode, and an action mode;
in response to selection of the decision support mode, obtaining decision information related to a set of actions that can be taken with respect to an identity of the one or more objects and presenting the decision information in the display; and
in response to selection of the action mode after selection of the decision support mode, obtaining a set of references to the set of actions related to the presented decision information and that can be performed with respect to the identity of the one or more objects, and presenting the set of references in the display so that the references are selectable by a user to initiate the referenced actions, wherein the referenced actions include sending information regarding the one or more objects to another user using a contact list on the mobile device, or making a reservation at a place associated with the one or more objects including creating an event in a calendar on the mobile device.
8 Assignments
0 Petitions
Accused Products
Abstract
Apparatus and methods are described for providing a user augmented reality (UAR) service for a camera-enabled mobile device, so that a user of such mobile device can use the mobile device to obtain meta data regarding one or more images/video that are captured with such device. The meta data is interactive and allows the user to obtain additional information or specific types of information, such as information that will aid the user in making a decision regarding the identified objects or selectable action options that can be used to initiate actions with respect to the identified objects.
-
Citations
21 Claims
-
1. A method of providing information regarding one or more scenes captured with a camera of a mobile device, comprising:
-
in response to determining that a camera of the mobile device is pointed at a scene including one or more objects, (i) displaying a visual representation of the scene in a display of the mobile device, and (ii) presenting in combination with the visual representation a plurality of options for selecting one of a plurality of user augmented reality modes that include an encyclopedia mode, a decision support mode, and an action mode; in response to selection of the decision support mode, obtaining decision information related to a set of actions that can be taken with respect to an identity of the one or more objects and presenting the decision information in the display; and in response to selection of the action mode after selection of the decision support mode, obtaining a set of references to the set of actions related to the presented decision information and that can be performed with respect to the identity of the one or more objects, and presenting the set of references in the display so that the references are selectable by a user to initiate the referenced actions, wherein the referenced actions include sending information regarding the one or more objects to another user using a contact list on the mobile device, or making a reservation at a place associated with the one or more objects including creating an event in a calendar on the mobile device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A mobile device for providing information regarding one or more scenes, comprising:
-
a camera for capturing one or more scenes; a display; at least one a processor; and at least one memory, the at least one processor and/or memory being configured for; in response to determining that the camera is pointed at a scene including one or more objects, (i) displaying a visual representation of the scene in the display, and (ii) presenting in combination with the visual representation a plurality of options for selecting one of a plurality of user augmented reality modes that include an encyclopedia mode, a decision support mode, and an action mode; in response to selection of the decision support mode, obtaining decision information related to a set of actions that can be taken with respect to an identity of the one or more objects and presenting the decision information in the display; and in response to selection of the action mode after selection of the decision support mode, obtaining a set of references to the set of actions related to the presented decision information and that can be performed with respect to the identity of the one or more objects, and presenting the set of references in the display so that the references are selectable by a user to initiate the referenced actions, wherein the referenced actions include sending information regarding the one or more objects to another user using a contact list on the mobile device, or making a reservation at a place associated with the one or more objects including creating an event in a calendar on the mobile device. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. At least one computer readable storage medium that is non-transitory and having computer program instructions stored thereon that are arranged such that when executed by one or more computing devices they cause the one or more computing devices to perform the following operations:
-
in response to determining that a camera of the mobile device is pointed at a scene including one or more objects, (i) displaying a visual representation of the scene in a display of the mobile device, and (ii) presenting in combination with the visual representation a plurality of options for selecting one of a plurality of user augmented reality modes that include an encyclopedia mode, a decision support mode, and an action mode; in response to selection of the decision support mode, obtaining decision information related to a set of actions that can be taken with respect to an identity of the one or more objects and presenting the decision information in the display; and in response to selection of the action mode after selection of the decision support mode, obtaining a set of references to the set of actions related to the presented decision information and that can be performed with respect to the identity of the one or more objects, and presenting the set of references in the display so that the references are selectable by a user to initiate the referenced actions, wherein the referenced actions include sending information regarding the one or more objects to another user using a contact list on the mobile device, or making a reservation at a place associated with the one or more objects including creating an event in a calendar on the mobile device. - View Dependent Claims (17, 18, 19, 20, 21)
-
Specification