Adaptable framework for cloud assisted augmented reality
First Claim
1. A method comprising:
- acquiring sensor data using a mobile platform, wherein the sensor data comprises at least one captured image of an object;
tracking the object with visual based tracking using the at least one captured image of the object;
determining whether there is a trigger event comprising a change in the sensor data relative to previously acquired sensor data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image;
transmitting the sensor data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object; and
receiving information related to the sensor data from the server.
1 Assignment
0 Petitions
Accused Products
Abstract
A mobile platform efficiently processes sensor data, including image data, using distributed processing in which latency sensitive operations are performed on the mobile platform, while latency insensitive, but computationally intensive operations are performed on a remote server. The mobile platform acquires sensor data, such as image data, and determines whether there is a trigger event to transmit the sensor data to the server. The trigger event may be a change in the sensor data relative to previously acquired sensor data, e.g., a scene change in an image. When a change is present, the sensor data may be transmitted to the server for processing. The server processes the sensor data and returns information related to the sensor data, such as identification of an object in an image or a reference image or model. The mobile platform may then perform reference based tracking using the identified object or reference image or model.
42 Citations
44 Claims
-
1. A method comprising:
-
acquiring sensor data using a mobile platform, wherein the sensor data comprises at least one captured image of an object; tracking the object with visual based tracking using the at least one captured image of the object; determining whether there is a trigger event comprising a change in the sensor data relative to previously acquired sensor data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; transmitting the sensor data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object; and receiving information related to the sensor data from the server. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A mobile platform comprising:
-
a sensor adapted to acquire sensor data, wherein the sensor is a camera and the sensor data comprises at least one captured image of an object; a wireless transceiver; a processor coupled to the sensor and the wireless transceiver, the processor adapted to acquire the sensor data via the sensor, to track the object with visual based tracking using the at least one captured image of the object, to determine whether there is a trigger event comprising a change in the sensor data relative to previously acquired sensor data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image, to transmit via the wireless transceiver the sensor data to an external processor when the trigger event is present while continuing to track the object with visual based tracking using the at least one captured image of the object, and to receive information related to the sensor data from the external processor via the wireless transceiver. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40)
-
-
41. A non-transitory computer-readable medium including program code stored thereon, comprising:
-
program code to acquire sensor data, wherein the sensor data comprises at least one captured image of an object; program code to track the object with visual based tracking using the at least one captured image of the object; program code to determine whether there is a trigger event comprising a change in the sensor data relative to previously acquired sensor data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; program code to transmit the sensor data to an external processor when the trigger event is present while continuing to track the object with visual based tracking using the at least one captured image of the object, and program code to receive information related to the sensor data from the external processor. - View Dependent Claims (42)
-
-
43. A mobile platform comprising:
-
means for acquiring sensor data, wherein the means for acquiring sensor data is a camera and the sensor data comprises at least one captured image of an object; means for tracking the object with visual based tracking using the at least one captured image of the object; means for determining whether there is a trigger event comprising a change in the sensor data relative to previously acquired sensor data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; means for transmitting the sensor data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object; and means for receiving information related to the sensor data from the server. - View Dependent Claims (44)
-
Specification