Unpowered augmented reality projection accessory display device

• US 10,031,335 B1
• Filed: 11/30/2015
• Issued: 07/24/2018
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Worley, III, William Spencer
• Primary Examiner(s): Chowdhury, Sultan
• Application Number:
  US14/954,773
• Time in Patent Office: 967 Days
• CPC Class Codes: G02B 2027/013 comprising a combiner of particular shape, e.g. curvature
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An augmented reality system may generate an augmented reality environment by projecting images onto various surfaces within a scene. A projection accessory display device (PADD) provides known characteristics for projection, and may be configured to simplify generation and maintenance of the projected image upon the PADD. The PADD may also provide one or more input devices which accept input from a user within the augmented reality environment. The PADD may comprise non-electronic passive components, electronic active components, or a combination thereof.

Claims

1. A projection surface configured to present images projected by a projector within an augmented reality environment, comprising:

one or more regions that are configured to generate visual feedback suitable to instruct a user to maintain an orientation of the projection surface within a pre-determined preferential angular range in relation to the projector.

2. The projection surface recited in claim 1, wherein the visual feedback includes differential reflectivity from at least one region of the one or more regions, the projection surface configured with differing reflectance response curves such that the differential reflectivity varies with an angle of incident light used to create one or more visible indicia on the projection surface.

3. The projection surface recited in claim 1, wherein the differential reflection comprises greater reflection of light incident within a pre-determined preferential angular range than of light incident beyond the pre-determined preferential angular range.

4. The projection surface recited in claim 1, wherein a region of the one or more regions is configured to present an icon at a time at which the projection surface is within a pre-determined preferential angular range of the projector.

5. The projection surface recited in claim 1, wherein the projection surface further includes a watermark that is configured to be imaged, by a camera within the augmented reality environment, with at least one of infrared wavelengths or ultraviolet wavelengths.

6. The projection surface as recited in claim 1, wherein the one or more regions are further configured to differentially reflect light emitted from the projector based at least in part upon an angle of incident light from the projector compared to the orientation of the projection surface.

7. A projection surface comprising:

a first viewing region having a first reflectance response curve;

a second viewing region having a second reflectance response curve; and

a passive component that includes at least one of;

an optical tracking target that is configured to provide orientation cues to an augmented reality functional node associated with a projector;

or

an optical tag that stores an identifier of the projection surface,

wherein the projection surface is configured to present an image projected by the projector on at least one of the first viewing region or the second viewing region.

8. The projection surface as recited in claim 7, wherein at least one of the first reflectance response curve or the second reflectance response curve is configured to reflect light incident at a pre-determined preferential angle relative to the projection surface to a greater degree than light incident at a non-preferential angle.

9. The projection surface as recited in claim 7, wherein the projection surface is configured to generate visual feedback suitable to instruct a user to orient the projection surface to maintain an orientation of the projection surface within a pre-determined preferential angular range in relation to the projector.

10. The projection surface as recited in claim 9, wherein the visual feedback includes differential reflectivity from at least the first viewing region or the second viewing region, at least one of the first reflectance response curve or the second reflectance response curve causing the differential reflectivity to vary with an angle of incident light used to create one or more visible indicia on the projection surface.

11. The projection surface as recited in claim 7, wherein the projection surface is configured to present the image based at least partly on at least one of a location or an orientation of the projection surface.

12. The projection surface as recited in claim 7, wherein a reflectance response characteristic of at least one of the first viewing region or the second viewing region is configured to preferentially scatter or absorb incident light outside of a pre-determined preferential angular range relative to the projection surface.

13. A projection surface comprising:

a plurality of viewing regions having different pre-defined reflectance response characteristics,

wherein the projection surface is configured to present an image projected by a projector on at least one viewing region of the plurality of viewing regions, and

wherein the projection surface is configured to present a visual feedback pattern based at least partly on user interaction with the image.

14. The projection surface as recited in claim 13, wherein the projection surface is configured to generate visual feedback suitable to instruct a user to orient the projection surface to maintain an orientation of the projection surface within a pre-determined preferential angular range in relation to the projector.

15. The projection surface as recited in claim 13, wherein the projection surface is configured to present the image based at least partly on the different pre-defined reflectance response characteristics.

16. The projection surface as recited in claim 13, wherein the projection surface is configured to present the image based at least partly on at least one of a location or an orientation of the projection surface.

17. The projection surface as recited in claim 13, wherein a reflectance response characteristic of at least one viewing region of the plurality of viewing regions is configured to preferentially reflect light incident within a pre-determined preferential angular range relative to the projection surface.

18. The projection surface as recited in claim 13, wherein a reflectance response characteristic of at least one viewing region of the plurality of viewing regions is configured to preferentially scatter or absorb incident light outside of a pre-determined preferential angular range relative to the projection surface.

19. The projection surface as recited in claim 13, further comprising a passive component that includes an optical tracking target that is configured to provide orientation cues to an augmented reality functional node associated with the projector.

20. The projection surface as recited in claim 13, further comprising a passive component that includes an optical tag that stores an identifier of the projection surface.