Client-server based dynamic search
First Claim
1. A method of performing a search, comprising:
- receiving a plurality of images of an environment in view of a mobile device;
generating a simultaneous localization and mapping of the environment using the plurality of images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment;
sending a set of the plurality of map points as a search query to a server at a first time instance;
receiving a query response from the server at a second time instance; and
identifying an object in the environment based at least in part on the query response, wherein the mobile device has a first pose relative to the object at the first time instance and the mobile device has a second pose relative to the object at the second time instance.
1 Assignment
0 Petitions
Accused Products
Abstract
Method, mobile device, computer program product and apparatus for performing a search are disclosed. The method of performing a search comprises receiving one or more images of an environment in view of a mobile device, generating a simultaneous localization and mapping of the environment using the one or more images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment, sending a set of the plurality of map points as a search query to a server, receiving a query response from the server, and identifying an object in the environment based at least in part on the query response.
13 Citations
34 Claims
-
1. A method of performing a search, comprising:
-
receiving a plurality of images of an environment in view of a mobile device; generating a simultaneous localization and mapping of the environment using the plurality of images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment; sending a set of the plurality of map points as a search query to a server at a first time instance; receiving a query response from the server at a second time instance; and identifying an object in the environment based at least in part on the query response, wherein the mobile device has a first pose relative to the object at the first time instance and the mobile device has a second pose relative to the object at the second time instance. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A mobile device, comprising:
-
a camera configured to receive a plurality of images of an environment in view of the mobile device; a control unit configured to generate a simultaneous localization and mapping of the environment using the plurality of images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment; a network interface configured to send a set of the plurality of map points as a search query to a server at a first time instance;
the network interface is further configured to receive a query response from the server at a second time instance; andthe control unit is further configured to identify an object in the environment based at least in part on the query response, wherein the mobile device has a first pose relative to the object at the first time instance and the mobile device has a second pose relative to the object at the second time instance. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A computer program product comprising a non-transitory medium storing instructions for execution by one or more computer systems, the instructions comprising:
-
instructions for receiving a plurality of images of an environment in view of a mobile device; instructions for generating a simultaneous localization and mapping of the environment using the plurality of images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment; instructions for sending a set of the plurality of map points as a search query to a server at a first time instance; instructions for receiving a query response from the server at a second time instance; and instructions for identifying an object in the environment based at least in part on the query response, wherein the mobile device has a first pose relative to the object at the first time instance and the mobile device has a second pose relative to the object at the second time instance. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. An apparatus, comprising:
-
means for receiving a plurality of images of an environment in view of a mobile device; means for generating a simultaneous localization and mapping of the environment using the plurality of images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment; means for sending a set of the plurality of map points as a search query to a server at a first time instance; means for receiving a query response from the server at a second time instance; and means for identifying an object in the environment based at least in part on the query response, wherein the mobile device has a first pose relative to the object at the first time instance and the mobile device has a second pose relative to the object at the second time instance.
-
Specification