Responsive Augmented Content

• US 20170270362A1
• Filed: 03/18/2016
• Published: 09/21/2017
• Est. Priority Date: 03/18/2016
• Status: Abandoned Application

• Current Assignee: RPX Corporation
• Original Assignee: DAQRI, LLC
• Inventors: Barnehama, Arye, Freeman, Jonathan, Berman, Laura
• Application Number:
  US15/073,958
• Publication Number:
  US 20170270362A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04W 4/023 using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds

Abstract

A wearable computing device includes at least one processor, a display element configured to display augmented reality (AR) content to a wearer of the wearable computing device and presenting a field of view to the wearer, a location sensor providing location information associated with the wearable computing device, and an augmented reality (AR) engine. The AR engine is configured to identify a location of the wearable computing device and a location of a first device within the environment, receive an operating status of the first device, determine a first AR element associated with the first device based on the operating status of the first device and the location of the first device relative to the location of the wearable computing device, and display the first AR element using the display element, the first AR element is displayed at a display location approximately aligned with or proximate to the location of the first device within the field of view.

Claims

1. A wearable computing device comprising:

at least one processor;

a display element configured to display augmented reality (AR) content to a wearer of the wearable computing device, the display element presenting a field of view to the wearer based on an orientation of the wearable computing device;

a location sensor providing location information associated with the wearable computing device; and

an augmented reality (AR) engine, executed by the at least one processor, configured to perform operations comprising;

identifying a location of the wearable computing device within an environment;

identifying a location of a first device within the environment;

receiving an operating status of the first device;

determining a first AR element associated with the first device based on the operating status of the first device and the location of the first device relative to the location of the wearable computing device; and

displaying the first AR element using the display element, the first AR element is displayed at a display location approximately aligned with or proximate to the location of the first device within the field of view.

2. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

identifying a first threshold value;

computing a first distance between the location of the wearable computing device and the location of the first device; and

determining that the first distance is less than the first threshold value,

wherein determining the first AR element associated with the first device based on the location of the first device relative to the location of the wearable computing device is based on the determining that the first distance is less than the first threshold value.

3. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

identifying a second AR element associated with the first device; and

prior to displaying the first AR element, displaying the second AR element using the display element, the second AR element is displayed at a display location approximately aligned with, or proximate to, the location of the first device in the field of view.

4. The wearable computing device of claim 3, wherein the AR engine is further configured to perform operations comprising:

determining a status of the first device; and

determining a status symbol associated with the status,

wherein one of the first AR element and the second AR element includes the status symbol.

5. The wearable computing device of claim 1, wherein the first AR element is one of (1) a status symbol associated with a status of the first device and (2) operational data associated with the first device.

6. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

determining that the display location is at least partially outside of the field of view; and

altering the display location such that the first AR element is entirely within the field of view.

7. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

identifying a focus area within the field of view;

determining that the focus area is within a pre-determined distance of, or at least partially overlaps, at least one of the location of the first device in the field of view and the first AR element; and

displaying a second AR element associated with the first device using the display element.

8. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

receiving an event message indicating an event associated with the first device;

determining that the first device is not within the field of view; and

displaying a second AR element using the display element, the second AR element indicating a direction toward the first device,

wherein displaying the first AR element occurs when the first device is brought within the field of view.

9. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

receiving an event message indicating an event associated with the first device;

based on receiving the event message, determining a route from the location of the wearable computing device to the location of the first device; and

displaying one or more directional AR elements on the display device as the wearer moves along the route.

10. The wearable computing device of claim 1, wherein the AR engine is further configured to perform operations comprising:

receiving task data associated with at least one task to be performed by the wearer on the first device;

determining that the wearable computing device is within a pre-determined distance from the first device; and

based on the determining that the wearable computing device is within a pre-determined distance from the first device, displaying one or more AR elements associated with the at least one task using the display element.

11. A computer-implemented method comprising:

identifying a location of a wearable computing device within an environment, the wearable computing device including a display element configured to display augmented reality (AR) content to a wearer, the display element presenting a field of view to the wearer based on an orientation of the wearable computing device;

identifying a location of a first device within the environment;

receiving an operating status of the first device;

determining a first AR element associated with the first device based on the operating status of the first device and the location of the first device relative to the location of the wearable computing device; and

displaying the first AR element using the display element, the first AR element is displayed at a display location approximately aligned with or proximate to the location of the first device within the field of view.

12. The method of claim 11, further comprising:

identifying a first threshold value;

computing a first distance between the location of the wearable computing device and the location of the first device; and

determining that the first distance is less than the first threshold value,

wherein determining the first AR element associated with the first device based on the location of the first device relative to the location of the wearable computing device is based on the determining that the first distance is less than the first threshold value.

13. The method of claim 11, further comprising:

identifying a second AR element associated with the first device; and

prior to displaying the first AR element, displaying the second AR element using the display element, the second AR element is displayed at a display location approximately aligned with or proximate to the location of the first device in the field of view.

14. The method of claim 13, further comprising:

determining a status of the first device; and

determining a status symbol associated with the status,

wherein one of the first AR element and the second AR element includes the status symbol.

15. The method of claim 11, wherein the first AR element is one of (1) a status symbol associated with a status of the first device and (2) operational data associated with the first device.

16. The method of claim 11, further comprising:

determining that the display location is at least partially outside of the field of view; and

altering the display location such that the first AR element is entirely within the field of view.

17. The method of claim 11, further comprising:

identifying a focus area within the field of view;

determining that the focus area is within a pre-determined distance of, or at least partially overlaps, at least one of the location of the first device in the field of view and the first AR element; and

displaying a second AR element associated with the first device using the display element.

18. The method of claim 11, further comprising:

receiving an event message indicating an event associated with the first device;

determining that the first device is not within the field of view; and

displaying a second AR element using the display element, the second AR element indicating a direction toward the first device,

wherein displaying the first AR element occurs when the first device is brought within the field of view.

19. The method of claim 11, further comprising:

receiving an event message indicating an event associated with the first device;

based on receiving the event message, determining a route from the location of the wearable computing device to the location of the first device; and

displaying one or more directional AR elements on the display device as the wearer moves along the route.

20. A non-transitory machine-readable medium storing processor-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:

identifying a location of a wearable computing device within an environment, the wearable computing device including a display element configured to display augmented reality (AR) content to a wearer, the display element presenting a field of view to the wearer based on an orientation of the wearable computing device;

identifying a location of a first device within the environment;

receiving an operating status of the first device;

determining a first AR element associated with the first device based on the operating status of the first device and the location of the first device relative to the location of the wearable computing device; and

displaying the first AR element using the display element, the first AR element is displayed at a display location approximately aligned with or proximate to the location of the first device within the field of view.