Powered augmented reality projection accessory display device

• US 9,383,831 B1
• Filed: 09/26/2014
• Issued: 07/05/2016
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Worley, William Spencer III
• Primary Examiner(s): Chowdhury, Sultan
• Application Number:
  US14/498,590
• Time in Patent Office: 648 Days
• Field of Search: 353/28, 353/30, 353 69- 70, 353/79, 353/119, 353/122, 345/156, 345/157, 345/633, 345/676, 348135-140, 348743-747
• US Class Current: 1/1
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An augmented reality system may generate an augmented reality environment by projecting images onto various surfaces within a scene. A projection accessory display device (PADD) provides known characteristics for projection, and may be configured to simplify generation and maintenance of the projected image upon the PADD. The PADD may also provide one or more input devices which accept input from a user within the augmented reality environment. The PADD may comprise non-electronic passive components, electronic active components, or a combination thereof.

Claims

1. A method of generating an augmented reality environment, the method comprising:

identifying a projection surface to receive a projection of the augmented reality environment;

associating the projection surface with an augmented reality functional node that is configured to project the augmented reality environment onto the projection surface;

projecting an image, by a projector associated with the augmented reality functional node, onto the projection surface;

transmitting a signal to an active device coupled to the projection surface;

receiving a device signal from the active device coupled to the projection surface; and

modifying the augmented reality environment based at last in part on the received device signal.

2. The method of claim 1, further comprising:

receiving, by the active device, the signal; and

presenting, on the projection surface, feedback suitable to instruct a user to orient the projection surface to maintain an orientation within a pre-determined preferential angular range in relation to the projector.

3. The method of claim 1, further comprising transferring power from a wireless power transmitter of the augmented reality functional node to a wireless power receiver of the active device, the wireless power transmitter to transmit electromagnetic fields for recovery by the wireless power receiver, the wireless power receiver to convert the electromagnetic fields into electrical power for use by the active component.

4. The method of claim 1, wherein the recognizing the projection surface comprises interpreting, by the augmented reality functional node, an optical tag coupled to the projection surface, the optical tag including scannable features providing at least one of an identification of the projection surface or information about an orientation of the projection surface.

5. The method of claim 1, further comprising:

detecting movement of an object relative to the projection surface and relative to the augmented reality functional node; and

modifying the augmented reality environment based at least in part on the detected movement of the object.

6. A system comprising:

one or more processors; and

memory including computer-readable instructions that, when executed, cause the one or more processors to;

detect a projection surface within an augmented reality environment;

associating the projection surface with an augmented reality functional node, the augmented reality functional node configured to project content onto the projection surface within the augmented reality environment;

transmitting orientation data to an active device coupled to the projection surface, the orientation data including at least one of (i) information to enable the active device to modify an orientation of the projection surface or (ii) a request for the active device to provide orientation information of the projection surface;

receive data from the active device in response to user interaction with the projection surface; and

cause a projector within the augmented reality functional node to project an image onto the projection surface.

7. The system of claim 6, wherein the orientation data provides feedback suitable to instruct a user to orient the projection surface to maintain an orientation within a pre-determined preferential angular range in relation to the projector.

8. The system of claim 6, wherein the computer-readable instructions further cause the one or more processors to cause a wireless power transmitter of the augmented reality functional node to transmit electromagnetic fields for recovery by a wireless power receiver of the active device, the wireless power receiver to convert the electromagnetic fields into electrical power for use by the active component.

9. The system of claim 6, wherein the detecting the projection surface comprises interpreting, by the augmented reality functional node, an optical tag coupled to the projection surface.

10. The system of claim 6, wherein the computer-readable instructions further cause the one or more processors to receive a response from the active device that includes orientation information about the projection surface.

11. The system of claim 10, wherein the computer-readable instructions further cause the one or more processors to adjust the projection of the image based at least in part on the received orientation information.

12. A method comprising:

recognizing a projection surface within an augmented reality environment;

associating the projection surface with an augmented reality functional node, the augmented reality functional node configured to project content onto the projection surface within the augmented reality environment;

transmitting orientation data to an active device coupled to the projection surface, the orientation data including at least one of (i) information to enable the active device to modify an orientation of the projection surface or (ii) a request for the active device to provide orientation information of the projection surface; and

causing a projector within the augmented reality functional node to project an image onto the projection surface within the augmented reality environment.

13. The method as recited in claim 12, further comprising receiving an input from the active device based at least in part on user interaction with the projection surface.

14. The method as recited in claim 13, wherein the received input is a biometric input for use in the augmented reality environment.

15. The method as recited in claim 12, wherein the input is a touch input.

16. The method as recited in claim 12, wherein the orientation data provides feedback suitable to instruct a user to orient the projection surface to maintain an orientation within a pre-determined preferential angular range in relation to the projector.

17. The method as recited in claim 12, further comprising receiving a response from the active device that includes orientation information about the projection surface.