Server-assisted object recognition and tracking for mobile devices
First Claim
Patent Images
1. A method, comprising:
- capturing digital image data using a camera of a mobile device;
performing preliminary object detection on at least a portion of the image data to recognize an object and generate preliminary object detection data for the recognized object;
tracking the recognized object using the preliminary object detection data, while transmitting the at least a portion of the image data to a remote server for confirmation of the recognized object and refinement of the preliminary object detection data;
receiving from the remote server object data for the recognized object in the transmitted image data, the object data including data for an object reference frame for rendering on a display of the mobile device; and
refining tracking of the recognized object based on the received object data and the preliminary object detection data, wherein the tracking commences on the mobile device using the preliminary object detection data and continues after receiving the object data from the remote server using both the preliminary object detection data and the received object data.
2 Assignments
0 Petitions
Accused Products
Abstract
Exemplary embodiments for performing server-assisted object recognition and tracking are disclosed herein. For example, in certain embodiments of the disclosed technology, one or more objects are efficiently recognized and tracked on a mobile device by using a remote server that can provide high capacity computing and storage resources. With the benefit of high-speed image processing on a remote server and high-bandwidth communication networks connecting the mobile device and the remote server, it is possible to identify an object and to track changes in the object'"'"'s characteristics or location, so that a user experiences seamless, real-time tracking.
37 Citations
20 Claims
-
1. A method, comprising:
-
capturing digital image data using a camera of a mobile device; performing preliminary object detection on at least a portion of the image data to recognize an object and generate preliminary object detection data for the recognized object; tracking the recognized object using the preliminary object detection data, while transmitting the at least a portion of the image data to a remote server for confirmation of the recognized object and refinement of the preliminary object detection data; receiving from the remote server object data for the recognized object in the transmitted image data, the object data including data for an object reference frame for rendering on a display of the mobile device; and refining tracking of the recognized object based on the received object data and the preliminary object detection data, wherein the tracking commences on the mobile device using the preliminary object detection data and continues after receiving the object data from the remote server using both the preliminary object detection data and the received object data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. One or more computer-readable storage media storing computer-executable instructions which when executed by a computing device cause the computing device to perform a method for processing image data, the stored instructions comprising:
-
instructions to capture digital image data using a camera of a mobile device; instructions to perform preliminary object detection on at least a portion of the image data to recognize an object and generate preliminary object detection data for the recognized object; instructions to track the recognized object using the preliminary object detection data, while transmitting the at least a portion of the image data to a remote server for confirmation of the recognized object and refinement of the preliminary object detection data; instructions to receive from the remote server object data for the recognized object in the transmitted image data, the object data including data for an object reference frame for rendering on a display of the mobile device; and instructions to refine tracking of the recognized object based on the received object data and the preliminary object detection data, wherein the tracking commences on the mobile device using the preliminary object detection data and continues after receiving the object data from the remote server using both the preliminary object detection data and the received object data.
-
-
13. A system, comprising:
-
a memory or storage device storing a program; and at least one processor that executes the program, wherein said execution of the program causes the at least one processor to; capture digital image data using a camera of a mobile device; perform preliminary object detection on at least a portion of the image data to recognize an object and generate preliminary object detection data for the recognized object; track the recognized object using the preliminary object detection data, while transmitting the at least a portion of the image data to a remote server for confirmation of the recognized object and refinement of the preliminary object detection data; receive from the remote server object data for the recognized object in the transmitted image data, the object data including data for an object reference frame for rendering on a display of the mobile device; and refine tracking of the recognized object based on the received object data and the preliminary object detection data, wherein the tracking commences on the mobile device using the preliminary object detection data and continues after receiving the object data from the remote server using both the preliminary object detection data and the received object data. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification