Adaptable framework for cloud assisted augmented reality
First Claim
1. A method comprising:
- acquiring image data using a mobile platform, wherein the image data is from at least one captured image of an object;
tracking the object with visual based tracking using the at least one captured image of the object;
determining whether there is a trigger event comprising a change in the image data relative to previously acquired image data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image;
transmitting the image data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object;
receiving information related to the image data from the server, wherein the information related to the image data comprises at least one of the following;
a two dimensional (2D) model of the different object, a three dimensional (3D) model of the different object, a three-dimensional coordinate estimation of points on the different object, augmentation information, saliency information about the different object, and information related to object matching; and
tracking the different object using the information related to the image data received from the server.
1 Assignment
0 Petitions
Accused Products
Abstract
A mobile platform efficiently processes image data, using distributed processing in which latency sensitive operations are performed on the mobile platform, while latency insensitive, but computationally intensive operations are performed on a remote server. The mobile platform acquires image data, and determines whether there is a trigger event to transmit the image data to the server. The trigger event may be a change in the image data relative to previously acquired image data, e.g., a scene change in an image. When a change is present, the image data may be transmitted to the server for processing. The server processes the image data and returns information related to the image data, such as identification of an object in an image or a reference image or model. The mobile platform may then perform reference based tracking using the identified object or reference image or model.
51 Citations
42 Claims
-
1. A method comprising:
-
acquiring image data using a mobile platform, wherein the image data is from at least one captured image of an object; tracking the object with visual based tracking using the at least one captured image of the object; determining whether there is a trigger event comprising a change in the image data relative to previously acquired image data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; transmitting the image data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object; receiving information related to the image data from the server, wherein the information related to the image data comprises at least one of the following;
a two dimensional (2D) model of the different object, a three dimensional (3D) model of the different object, a three-dimensional coordinate estimation of points on the different object, augmentation information, saliency information about the different object, and information related to object matching; andtracking the different object using the information related to the image data received from the server. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A mobile platform comprising:
-
a sensor that acquires image data, wherein the sensor is a camera and the image data is from at least one captured image of an object; a wireless transceiver; and a processor coupled to the sensor and the wireless transceiver, the processor acquires the image data via the sensor, tracks the object with visual based tracking using the at least one captured image of the object, determines whether there is a trigger event comprising a change in the image data relative to previously acquired image data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image, transmits via the wireless transceiver the image data to an external processor when the trigger event is present while continuing to track the object with visual based tracking using the at least one captured image of the object, and receives information related to the image data from the external processor via the wireless transceiver, wherein the information related to the image data comprises at least one of the following;
a two dimensional (2D) model of the different object, a three dimensional (3D) model of the different object, a three-dimensional coordinate estimation of points on the different object, augmentation information, saliency information about the different object, and information related to object matching, and tracks the different object using the information related to the image data received from the external processor. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38)
-
-
39. A mobile platform comprising:
-
means for acquiring image data, wherein the means for acquiring image data is a camera and the image data is from at least one captured image of an object; means for tracking the object with visual based tracking using the at least one captured image of the object; means for determining whether there is a trigger event comprising a change in the image data relative to previously acquired image data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; means for transmitting the image data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object; means for receiving information related to the image data from the server, wherein the information related to the image data comprises at least one of the following;
a two dimensional (2D) model of the different object, a three dimensional (3D) model of the different object, a three-dimensional coordinate estimation of points on the different object, augmentation information, saliency information about the different object, and information related to object matching; andmeans for tracking the different object using the information related to the image data received from the server. - View Dependent Claims (40)
-
-
41. A non-transitory computer-readable medium including program code stored thereon, comprising:
-
program code to acquire image data, wherein the image data is from at least one captured image of an object; program code to track the object with visual based tracking using the at least one captured image of the object; program code to determine whether there is a trigger event comprising a change in the image data relative to previously acquired image data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; program code to transmit the image data to an external processor when the trigger event is present while continuing to track the object with visual based tracking using the at least one captured image of the object, program code to receive information related to the image data from the external processor, wherein the information related to the image data comprises at least one of the following;
a two dimensional (2D) model of the different object, a three dimensional (3D) model of the different object, a three-dimensional coordinate estimation of points on the different object, augmentation information, saliency information about the different object, and information related to object matching; andprogram code to track the different object using the information related to the image data received from the server. - View Dependent Claims (42)
-
Specification