Gesture-controlled augmented reality experience using a mobile communications device
First Claim
1. A method for producing a gesture-controlled augmented reality experience using a first mobile communications device, the method comprising:
- receiving a motion sensor input on a motion sensor input modality of the first mobile communications device from a user;
calculating a trajectory of a camera of the first mobile communications device in response to the received motion sensor input;
receiving one or more images of a person other than the user captured by the camera of the first mobile communications device;
translating a gesture of the person other than the user into a set of quantified values based on the received one or more images and the calculated trajectory of the camera, the set of quantified values being calculated by a removal of the calculated trajectory from the received one or more images of the person other than the user; and
displaying an augmented reality object on the first mobile communications device in response to a substantial match between the set of quantified values and a set of predefined values, the augmented reality object displayed in a movable-window view of a three-dimensional virtual environment by which a portion of the three-dimensional environment is displayed on the first mobile communications device and the user may adjust which portion of the three-dimensional virtual environment is displayed by panning the first mobile communications device through space.
3 Assignments
0 Petitions
Accused Products
Abstract
A method for producing a gesture-controlled augmented reality experience using a first mobile communications device includes receiving a motion sensor input on a motion sensor input modality of the first mobile communications device, calculating a trajectory of a camera of the first mobile communications device in response to the received motion sensor input, receiving a visual input captured by the camera of the first mobile communications device, translating a gesture of a user into a set of quantified values based on the received visual input and the calculated trajectory of the camera, and controlling an augmented reality object within a three-dimensional virtual environment in response to a substantial match between the set of quantified values and a set of predefined values.
72 Citations
19 Claims
-
1. A method for producing a gesture-controlled augmented reality experience using a first mobile communications device, the method comprising:
-
receiving a motion sensor input on a motion sensor input modality of the first mobile communications device from a user; calculating a trajectory of a camera of the first mobile communications device in response to the received motion sensor input; receiving one or more images of a person other than the user captured by the camera of the first mobile communications device; translating a gesture of the person other than the user into a set of quantified values based on the received one or more images and the calculated trajectory of the camera, the set of quantified values being calculated by a removal of the calculated trajectory from the received one or more images of the person other than the user; and displaying an augmented reality object on the first mobile communications device in response to a substantial match between the set of quantified values and a set of predefined values, the augmented reality object displayed in a movable-window view of a three-dimensional virtual environment by which a portion of the three-dimensional environment is displayed on the first mobile communications device and the user may adjust which portion of the three-dimensional virtual environment is displayed by panning the first mobile communications device through space. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system comprising a non-transitory program storage medium readable by a first mobile communications device, the medium tangibly embodying one or more programs of instructions executable by the device to perform operations for producing a gesture-controlled augmented reality experience, the operations comprising:
-
receiving a motion sensor input on a motion sensor input modality of the first mobile communications device from a user; calculating a trajectory of a camera of the first mobile communications device in response to the received motion sensor input; receiving one or more images of a person other than the user captured by the camera of the first mobile communications device; translating a gesture of the person other than the user into a set of quantified values based on the received one or more images and the calculated trajectory of the camera, the set of quantified values being calculated by a removal of the calculated trajectory from the received one or more images of the person other than the user; and displaying an augmented reality object on the first mobile communications device in response to a substantial match between the set of quantified values and a set of predefined values, the augmented reality object displayed in a movable-window view of a three-dimensional virtual environment by which a portion of the three-dimensional environment is displayed on the first mobile communications device and the user may adjust which portion of the three-dimensional virtual environment is displayed by panning the first mobile communications device through space. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A mobile communications device operable to produce a gesture-controlled augmented reality experience, the mobile communications device comprising:
-
a motion sensor for receiving a motion sensor input from a user; a camera for capturing one or more images of a person other than the user; and a processor for calculating a trajectory of the camera in response to the received motion sensor input, translating a gesture of the person other than the user into a set of quantified values based on the received one or more images and the calculated trajectory of the camera, the set of quantified values being calculated by a removal of the calculated trajectory from the received one or more images of the person other than the user, and displaying an augmented reality object on the mobile communications device in response to a substantial match between the set of quantified values and a set of predefined values, the augmented reality object displayed in a movable-window view of a three-dimensional virtual environment by which a portion of the three-dimensional environment is displayed on the mobile communications device and the user may adjust which portion of the three-dimensional virtual environment is displayed by panning the mobile communications device through space. - View Dependent Claims (19)
-
Specification