Unpowered augmented reality projection accessory display device

• US 9,236,000 B1
• Filed: 10/28/2014
• Issued: 01/12/2016
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Worley, William Spencer III
• Primary Examiner(s): Chowdhury, Sultan
• Application Number:
  US14/526,370
• Time in Patent Office: 441 Days
• Field of Search: 353/28, 353/30, 353 69- 70, 353/79, 353/119, 353/121, 353/122, 348135-140, 348743-747, 345/156, 345/157, 345/633, 345/676
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/013 comprising a combiner of particular shape, e.g. curvature
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An augmented reality system may generate an augmented reality environment by projecting images onto various surfaces within a scene. A projection accessory display device (PADD) provides known characteristics for projection, and may be configured to simplify generation and maintenance of the projected image upon the PADD. The PADD may also provide one or more input devices which accept input from a user within the augmented reality environment. The PADD may comprise non-electronic passive components, electronic active components, or a combination thereof.

Claims

1. A method comprising:

recognizing a projection surface within an augmented reality environment;

associating the projection surface with an augmented reality functional node;

presenting an image, projected by a projector within the augmented reality functional node, on the projection surface; and

generating visual feedback suitable to instruct a user to maintain an orientation of the projection surface within a pre-determined preferential angular range in relation to the projector.

2. The method as recited in claim 1, wherein the visual feedback includes differential reflectivity from a plurality of regions on the projection surface, the projection surface configured with differing reflectance response curves such that the differential reflectivity varies with an angle of incident light used to create one or more visible indicia on the projection surface.

3. The method as recited in claim 1, wherein generating the visual feedback comprises projecting one or more visible indicia on the projection surface.

4. The method as recited in claim 1, further comprising interpreting, by the augmented reality functional node, an optical tag coupled to the projection surface.

5. The method as recited in claim 1, further comprising generating data suitable for input in the augmented reality environment by detecting movement of the projection surface relative to the augmented reality functional node.

6. The method as recited in claim 1, further comprising generating data suitable for input in the augmented reality environment by detecting movement of an object relative to the projection surface and relative to the augmented reality functional node.

7. A method comprising:

determining a location of a projection surface and an orientation of the projection surface within an augmented reality environment, the projection surface including a primary viewing region having a first reflectance response curve and a secondary viewing region having a second reflectance response curve; and

projecting, from a remotely located augmented reality functional node, an image onto the projection surface based at least in part on the location and the orientation of the projection surface.

8. The method as recited in claim 7, wherein the first reflectance response curve is configured to reflect light incident at a pre-determined preferential angle relative to the projection surface to a greater degree than light incident at a non-preferential angle.

9. The method as recited in claim 7, wherein the second viewing region is disposed along at least a portion of a perimeter of the projection surface.

10. The method as recited in claim 7, wherein the determining further comprises scanning a passive component of the projection surface, the passive component including an optical tracking target that is configured to provide orientation cues to the augmented reality functional node.

11. The method as recited in claim 7, wherein the determining comprises scanning a passive component of the projection surface, the passive component including an optical tag that stores an identifier of the projection surface.

12. The method as recited in claim 7, further comprising generating visual feedback suitable to instruct a user to orient the projection surface to maintain an orientation of the projection surface within a pre-determined preferential angular range in relation to the projector.

13. The method as recited in claim 7, further comprising, prior to the projecting of the image onto the projection surface, associating the projection surface with the augmented reality functional node.

14. A method comprising:

recognizing a projection surface within an augmented reality environment based at least partly on the projection surface having a plurality of viewing regions having different pre-defined reflectance response characteristics; and

presenting an image projected by a projector within an augmented reality functional node on the projection surface.

15. The method as recited in claim 14, further comprising generating visual feedback suitable to instruct a user to orient the projection surface to maintain an orientation of the projection surface within a pre-determined preferential angular range in relation to the projector.

16. The method as recited in claim 14, further comprising:

determining that the projection surface is within a pre-determined orientation relative to the presented image; and

presenting a visual feedback pattern resulting from interaction with the presented image and the different pre-defined reflectance response characteristics.

17. The method as recited in claim 14, further comprising:

determining that a relative angle between the projection surface and the projector exceeds a pre-determined preferential angular range; and

presenting a visual feedback pattern resulting from interaction of the presented image and the different pre-defined reflectance response characteristics.

18. The method as recited in claim 14, wherein a reflectance response characteristic of at least one viewing region of the plurality of viewing regions is configured to preferentially reflect light incident within a pre-determined preferential angular range relative to the projection surface.

19. The method as recited in claim 14, wherein a reflectance response characteristic of at least one viewing region of the plurality of viewing regions is configured to preferentially scatter or absorb incident light outside of a pre-determined preferential angular range relative to the projection surface.

20. The method as recited in claim 14, further comprising scanning the augmented reality environment to determine at least one of a location of the projection surface or an orientation of the projection surface.