Distributed augmented reality system

• US 10,261,542 B1
• Filed: 07/12/2018
• Issued: 04/16/2019
• Est. Priority Date: 08/14/2017
• Status: Active Grant

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: Facebook Technologies, LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Trail, Nicholas Daniel
• Primary Examiner(s): Wilson, Adrian S
• Application Number:
  US16/034,148
• Time in Patent Office: 278 Days
• Field of Search: 36167903
• CPC Class Codes: A61B 5/6822 Neck
• CPC Class Codes: A61B 5/6831 Straps, bands or harnesses
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0156 with optionally usable elements
• CPC Class Codes: G02B 2027/0161 characterised by the relative positioning of the constitutive elements
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G02C 3/006 Arrangements for fitting and securing to the head or neck not in the position of use
• CPC Class Codes: G02C 3/04 Arrangements for supporting by hand, e.g. lorgnette, Arrangements for supporting by articles by walking-sticks A45B3/00
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H02J 50/10 using inductive coupling
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 1/406 microphones

Abstract

A distributed augmented reality system for producing rendered environment includes a neckband formed from a first arm, second arm, and computation compartment. A power source is embedded in the first and/or second arm, while a processor is embedded in the computation compartment of the neckband. The neckband may be capable of producing an AR, VR or MR environment, or any combination thereof. The neckband device may be used with a coupled eyewear device system encompassing a Near-Eye Display (NED) and/or secondary user device, which may also produce an AR, VR or MR environment, or any combination thereof. The neckband device may provide power and computation to the eyewear device, allowing for a reduced form factor AR/VR/MR eyewear device.

Claims

1. A neckband device comprising:

a first arm and a second arm coupled together to form a shape such that the neckband device conforms to a neck of a user; and

a plurality of compartments within the neckband device, the plurality of compartments including a battery compartment for a battery that is configured to power an eyewear device and a computation compartment configured to hold a processor that is configured to compute at least one value from a sensor of the eyewear device, and the first arm includes at least one of the plurality of compartments,

wherein the neckband device is communicatively coupled with the eyewear device.

2. The neckband device of claim 1, wherein the first arm and the second arm are coupled to, and removable from, the computation compartment.

3. The neckband device of claim 1, wherein at least one of the first arm, the second arm and the computation compartment contains a multifunction compartment, of the plurality of compartments, and the multifunction compartment interfaces with a functional unit, the functional unit comprising at least one of:

a memory unit;

a processing unit;

a microphone array;

a projector; and

a camera.

4. The neckband device of claim 3, wherein the functional unit is part of the second arm and the functional unit comprises the camera.

5. The neckband device of claim 3, wherein the functional unit is part of the second arm, the functional unit comprising the projector, and the projector is configured to project visual content onto a surface.

6. The neckband device of claim 1, further comprising a microphone array, the microphone array configured to record the user'"'"'s voice and provide audio data to a processor.

7. The neckband device of claim 1, further comprising:

a wireless gateway, the wireless gateway configured to communicatively couple the neckband device with the eyewear device.

8. The neckband device of claim 1, further comprising:

a wireless gateway, the wireless gateway configured to communicatively couple the neckband device with at least a mobile device.

9. The neckband device of claim 1, further comprising a connector having:

a first connector arm latched near a first end tip of the eyewear device;

a second connector arm latched near a second end tip of the eyewear device; and

a third connector arm latched to the neckband device, and the third connector arm is coupled to the first connector arm and the second connector arm.

10. The neckband device of claim 9, the connector further comprising:

an adjustable tension slider configured to secure the eyewear device to the user'"'"'s head by compressing the first connector arm to the second connector arm, and wherein the connector provides power and information from the neckband device to the eyewear device.

11. The neckband device of claim 1, further comprising:

a vitals sensor configured to determine a vital sign of the user.

12. The neckband device of claim 1, further comprising:

an IMU sensor configured to determine a position of the neckband device relative to an environment of the user.

13. The neckband device of claim 1, wherein a first end of the first arm and a first end of the second arm are coupled together using a clasping segment, and a second end of the first arm and a second end of the second arm are coupled together with the computation compartment.

14. A system comprising:

an eyewear device that includes a sensor;

a neckband device comprising;

a first arm and a second arm coupled together to form a shape such that the neckband device conforms to a neck of a user, and

a plurality of compartments within the neckband device, the plurality of compartments including a battery compartment for a battery that is configured to power the eyewear device and a computation compartment configured to hold a processor that is configured to compute at least one value from the sensor, and the first arm includes at least one of the plurality of compartments,

wherein the neckband device is communicatively coupled with the eyewear device.

15. The system of claim 14, wherein at least one of the first arm, the second arm and the computation compartment contains a multifunction compartment, of the plurality of compartments, and the multifunction compartment interfaces with a functional unit, the functional unit comprising at least one of:

a memory unit;

a processing unit;

a microphone array;

a projector; and

a camera.

16. The system of claim 15, wherein the functional unit is part of the second arm and the functional unit comprises the projector, and the projector is configured to project visual content onto a surface.

17. The system of claim 14, further comprising:

a wireless gateway, the wireless gateway configured to communicatively couple the neckband device with at least a secondary user device,

wherein the secondary user device is selected from a group consisting of a smartphone, a laptop, a tablet, a personal digital assistant, a watch, and a bracelet.

18. The system of claim 17, wherein the secondary device functions as an additional processor for the neckband device.

19. The system of claim 17, wherein the secondary device includes a camera assembly that determines a three dimensional (3D) description of an environment of the user, and the secondary device provides the 3D description to at least one of the neckband and eyewear device.

20. The system of claim 17, wherein the secondary device includes a camera assembly that determines a three dimensional description of a face of the user, and the secondary device provides the 3D description to at least one of the neckband and eyewear device.