Remote sensor access and queuing

• US 9,978,174 B2
• Filed: 12/29/2016
• Issued: 05/22/2018
• Est. Priority Date: 08/25/2014
• Status: Active Grant

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: DAQRI, LLC
• Inventors: Mullins, Brian, Kammerait, Matthew, Broaddus, Christopher
• Primary Examiner(s): McCormack, Thomas
• Application Number:
  US15/393,257
• Publication Number:
  US 20170109923A1
• Time in Patent Office: 509 Days
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: H04Q 2209/47 using RFID associated with sensors
• CPC Class Codes: H04Q 2209/75 by polling or interrogating the sub-stations
• CPC Class Codes: H04Q 2209/84 Measuring functions
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Abstract

An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.

Claims

1. A device comprising:

one or more hardware processors;

a memory storing instructions that, when executed by the one or more hardware processors, configure the device to perform operations comprising;

receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;

identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;

generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;

receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and

building a three-dimensional model of the physical object based on the sensor data.

2. The device of claim 1, wherein the first wearable device comprises a camera, a depth sensor, an inertial sensor, and a transparent display that displays augmented reality content based on the sensor data.

3. The device of claim 2, wherein the operations further comprise:

remotely activating the camera, the depth sensor, and the inertial sensor of the first wearable device.

4. The device of claim 1, wherein the sensor data further comprises a video feed from the first wearable device, depth sensor data from the first wearable device, an orientation of the first wearable device, and a location of the first wearable device.

5. The device of claim 1, wherein the query further identifies a location of the physical object.

6. The device of claim 1, wherein the operations further comprise:

generating analytics data processed by a server to provide an information including one of a location of the physical object being detected, a location of the three-dimensional model of the physical object being detected, a location of the physical object being triggered, a location of the three-dimensional model of the physical object being triggered, a duration of the physical object being detected, a duration of the three-dimensional model of the physical object being detected and a combination thereof.

7. The device of claim 1, wherein the operations further comprise:

determining whether the first wearable device is within the detection range of the physical object based on a distance between the first wearable device and the physical object.

8. The device of claim 7, wherein the detection range corresponds to a threshold range within where the three-dimensional model of the physical object is built based on the sensor data.

9. The device of claim 1, wherein the sensor data from the first wearable device is generated at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

10. The device of claim 9, wherein the rate increases in response to the distance between the first wearable device and the physical object decreasing.

11. A method comprising:

receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;

identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;

generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;

receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and

building a three-dimensional model of the physical object based on the sensor data.

12. The method of claim 11, wherein the first wearable device comprises a camera, a depth sensor, an inertial sensor, and a transparent display that displays augmented reality content based on the sensor data.

13. The method of claim 12, further comprising:

remotely activating the camera, the depth sensor, and the inertial sensor of the first wearable device.

14. The method of claim 11, wherein the sensor data further comprises a video feed from the first wearable device, depth sensor data from the first wearable device, an orientation of the first wearable device, and a location of the first wearable device.

15. The method of claim 11, wherein the query further identifies a location of the physical object.

16. The method of claim 11, further comprising:

generating analytics data processed by a server to provide an information including one of a location of the physical object being detected, a location of the three-dimensional model of the physical object being detected, a location of the physical object being triggered, a location of the three-dimensional model of the physical object being triggered, a duration of the physical object being detected, a duration of the three-dimensional model of the physical object being detected and a combination thereof.

17. The method of claim 11, further comprising:

determining whether the first wearable device is within the detection range of the physical object based on a distance between the first wearable device and the physical object.

18. The method of claim 17, wherein the detection range corresponds to a threshold range within where the three-dimensional model of the physical object is built based on the sensor data.

19. The method of claim 11, wherein the sensor data from the first wearable device is generated at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;

identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;

generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;

receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and

building a three-dimensional model of the physical object based on the sensor data.