Augmented reality asset locator

• US 10,438,409 B2
• Filed: 12/14/2015
• Issued: 10/08/2019
• Est. Priority Date: 12/15/2014
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Todeschini, Erik, Venkatesha, Sharath, Anderson, Donald
• Primary Examiner(s): Good Johnson, Motilewa
• Application Number:
  US14/967,418
• Publication Number:
  US 20160171777A1
• Time in Patent Office: 1,394 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

A method includes receiving a signal from a device to be located, the signal identifying the device, determining location information from the received signal, creating a graphic representative of the location of the device, and providing an augmented reality view of an area where the device is located with the graphic to provide user visible location information corresponding to the device.

Claims

1. A method of assisting a user in locating a target device, the method comprising:

accessing, from a surveillance system by an augmented reality (AR) system, image information of an area where the target device is located,

wherein prior to accessing the image information, a first signal comprising device identifying information and location identifying information, is received from the target device by the surveillance system, and

wherein in response to receiving the first signal, the image information of the area where the target device is located is captured by the surveillance system, wherein the area where the target device is location is determined based on the location identifying information included in the first signal;

determining, by the AR system, location information based on the image information;

creating, by the AR system, a location graphic based on the determination of the location information and the image information; and

providing, by the AR system, an augmented reality (AR) view of the area where the target device is located based at least in part on the image information, the AR view comprising the location graphic and configured to provide the location information corresponding to the target device.

2. The method of claim 1 comprising:

receiving, by the AR system, a second signal from the surveillance system corresponding to the target device.

3. The method of claim 1 wherein the location information comprises information associated with a distance of the target device from the AR system, wherein the distance is determined based on the image information and the location identifying information.

4. The method of claim 3 wherein the location graphic comprises a circle having a radius corresponding to the distance, and wherein a center of the circle corresponds to a position of the AR system.

5. The method of claim 1 wherein the location information comprises a position of the target device determined based on a signal strength of the first signal received by the surveillance system.

6. The method of claim 5 wherein the location graphic comprises a location indicator overlaid to identify the position of the target device in the AR view.

7. The method of claim 6 wherein the location indicator comprises an arrow pointing to the target device in the AR view.

8. The method of claim 5 wherein the first signal comprises a low energy RF signal, and the position is determined based on the signal strength of the first signal.

9. The method of claim 5 wherein the first signal comprises a global positioning signal.

10. The method of claim 1, wherein the device identifying information includes a MAC address or serial number of the target device.

11. The method of claim 1 wherein the image information comprises image of the area where the target device is located.

12. The method of claim 11 wherein the image comprises an image of the target device.

13. The method of claim 1, wherein the image information comprises information about a second area and an object not present in the second area, wherein the object not present in the area corresponds to the target device.

14. A non-transitory machine-readable storage device having instructions for execution by a processor to perform a method comprising:

accessing, from a surveillance system, by an augmented reality (AR) system, an image information of an area where a target device is located,

wherein prior to accessing the image information, a first signal comprising device identifying information and location identifying information, is received from the target device by the surveillance system, and

wherein in response to receiving the first signal, the image information of the area where the target device is located is captured by the surveillance system, wherein the area where the target device is location is determined based on the location identifying information included in the first signal;

determining, by the AR system, location information based on the image information;

creating, by the AR system, a location graphic based on the determination of the location information and the image information; and

providing, by the AR system, an augmented reality (AR) view of the area where the target device is located based at least in part on the image information, the AR view comprising the location graphic and configured to provide the location information corresponding to the target device.

15. The non-transitory machine-readable storage device of claim 14 wherein the location information comprises information related to a distance of the target device from the AR system, wherein the distance is determined based on the image information and the location identifying information.

16. The non-transitory machine readable storage device of claim 15 wherein the location graphic comprises a circle having a radius corresponding to the distance, and wherein a center of the circle corresponds to a position of the AR system.

17. The non-transitory machine-readable storage device of claim 14 wherein the location information comprises a position of the target device determined based on a signal strength of the first signal received by the surveillance system.

18. The non-transitory machine-readable storage device of claim 17 wherein the location graphic comprises a location indicator overlaid to identify the position of the target device in the view.

19. The non-transitory machine-readable storage device of claim 18 wherein the location indicator comprises an arrow pointing to the target device in the AR view.

20. The non-transitory machine-readable storage device of claim 17 wherein the first signal comprises a low energy RF signal, and the position is an indoor positioning signal or a global positioning signal.

21. The non-transitory machine-readable storage device of claim 14 wherein the image information comprises an image for the area in which the target device is located.

22. The non-transitory machine-readable storage device of claim 21 wherein the image comprises an image of the target device.

23. The non-transitory machine-readable storage device of claim 14 wherein the image information comprises information about a second area and an object absent in the second area, wherein the object absent in the second area corresponds to the target device.

24. A device comprising:

a processor;

a display coupled to the processor; and

a memory device coupled to the processor and having a program stored thereon for execution by the processor to;

access, from a surveillance system, an image information of an area where a target device is located, wherein the image information is captured by the surveillance system based on receiving, at the surveillance system a first signal comprising device identifying information and location identifying information from the target device, and wherein the image information is accessed based on the capturing of the image information by the surveillance system;

determine location information based on the image information;

create a location graphic based on the location information and the image information; and

provide an augmented reality (AR) view of the area where the target device is located based at least in part on the image information, the AR view comprising the location graphic and configured to provide the location information corresponding to the target device.

25. The device of claim 24 wherein the location information comprises information relating to a distance of the target device from the device, wherein the distance is determined based on the image information and the location identifying information, and wherein the location graphic comprises a circle having a radius corresponding to the distance, and wherein a center of the circle corresponds to a position of the device.

26. The device of claim 24 wherein the location information comprises a position of the target device determined based on a signal strength of the first signal received by the surveillance system, and wherein the location graphic comprises a location indicator overlaid to identify the position of the target device in the AR view.

27. The device of claim 26 wherein the location indicator comprises an arrow pointing to the target device in the AR view, wherein the first signal comprises a low energy RF signal, and the position is an indoor positioning signal or a global positioning signal.

28. The device of claim 24 wherein the image information comprises an image of the area in which the target device is located.

29. The device of claim 28 wherein the image comprises an image of the target device.

30. The device of claim 24 wherein the image information comprises information about a second area and an object not present in the second area, wherein the object corresponds to the target device.