Unpowered augmented reality projection accessory display device

• US 8,905,551 B1
• Filed: 12/23/2010
• Issued: 12/09/2014
• Est. Priority Date: 12/23/2010
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Rawles, LLC (Amazon.com, Inc.)
• Inventors: Worley, William Spencer III
• Primary Examiner(s): CHOWDHURY, SULTAN U.
• Application Number:
  US12/977,992
• Time in Patent Office: 1,447 Days
• Field of Search: 353/10, 353/15, 353/28, 353 30- 31, 353 69- 70, 353/79, 353/98, 353/122, 348/333.01, 348/173, 348/564, 348/190, 348/744, 348/747, 348/E05.099, 348/E05.022, 715/863, 715/767, 715/773, 715/810, 715/839, 382/154, 382/181, 382/284, 382/292, 349/5, 349 7- 9, 349/11
• US Class Current: 353/79
• CPC Class Codes: G02B 2027/013 comprising a combiner of particular shape, e.g. curvature
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An augmented reality system may generate an augmented reality environment by projecting images onto various surfaces within a scene. A projection accessory display device (PADD) provides known characteristics for projection, and may be configured to simplify generation and maintenance of the projected image upon the PADD. The PADD may also provide one or more input devices which accept input from a user within the augmented reality environment. The PADD may comprise non-electronic passive components, electronic active components, or a combination thereof.

Claims

1. A device for use in an augmented reality environment, the device comprising:

a chassis;

a projection surface coupled to the chassis and configured to accept a projected image from a remotely located augmented reality functional node that at least in part introduces an augmented reality into a scene, the projection surface comprising a primary viewing region having a first reflectance response curve and a secondary viewing region having a second reflectance response curve; and

a passive component configured to be scanned by the augmented reality functional node.

2. The device of claim 1, wherein the first reflectance response curve is configured to reflect light incident at a pre-determined preferential angle relative to the projection surface more than light incident at a non-preferential angle.

3. The device of claim 1, wherein the second viewing region is disposed along at least a portion of a perimeter of the projection surface.

4. The device of claim 1, wherein the projection surface further comprises a watermark.

5. The device of claim 4, wherein the watermark encodes a pseudorandom noise pattern and is configured to be imaged with a non-visible wavelength of light.

6. The device of claim 1, wherein the passive component comprises a non-electronic button configured to generate an acoustic signal upon activation.

7. The device of claim 6, wherein the acoustic signal is ultrasonic.

8. The device of claim 1, wherein the passive component comprises an optical tracking target configured to provide orientation cues to the augmented reality functional node.

9. The device of claim 1, wherein the passive component comprises an optical tag storing an identifier of the device.

10. The device of claim 1, wherein the passive component comprises a resonant acoustic tag configured to accept acoustic energy and emit an acoustic signal.

11. The device of claim 1, wherein the device is embodied as a table top or countertop.

12. A device comprising:

a projection surface in an augmented reality environment, the projection surface configured to present a projected image from a remote projector, the projection surface comprising a plurality of viewing regions having differing pre-defined reflectance response characteristics; and

a chassis configured to support the projection surface.

13. The device of claim 12, wherein the plurality of viewing regions are configured such that when the projection surface is within a pre-determined orientation relative to the projected image projected by the remote projector, a visual feedback pattern resulting from the interaction of the projected image and the differing pre-defined reflectance response characteristics is presented.

14. The device of claim 12, wherein the plurality of viewing regions are configured such that when a relative angle between the projection surface and the remote projector exceeds a pre-determined preferential angular range, a visual feedback pattern resulting from the interaction of the projected image and the differing pre-defined reflectance response characteristics is presented.

15. The device of claim 12, wherein the pre-determined preferential angular range is within about 30 degrees of a perpendicular of the projection surface.

16. The device of claim 12, wherein the reflectance response characteristics of at least one of the plurality of viewing regions is configured to preferentially reflect light incident within a pre-determined preferential angular range relative to the projection surface.

17. The device of claim 12, wherein the reflectance response characteristics of at least one of the plurality of viewing regions is configured to preferentially scatter or absorb incident light outside of a pre-determined preferential angular range relative to the projection surface.

18. The device of claim 12, further comprising a non-electronic button configured to, upon activation, generate an ultrasonic acoustic signal suitable for communication with an augmented reality functional node.

19. The device of claim 18, further comprising a plurality of non-electronic buttons, each configured to generate a distinctive ultrasonic acoustic signal upon activation.

20. A device comprising:

a projection surface configured to present a projected image from a projector that is remote from the projection surface, the projection surface comprising a plurality of viewing regions having differing pre-defined reflectance response characteristics; and

a chassis configured to support the projection surface.

21. The device of claim 20, wherein the plurality of viewing regions are configured such that when the projection surface is within a pre-determined orientation relative to the projected image projected by the remote projector, a visual feedback pattern resulting from the interaction of the projected image and the differing pre-defined reflectance response characteristics is presented.

22. The device of claim 20, wherein the plurality of viewing regions are configured such that when a relative angle between the projection surface and the projector exceeds a pre-determined preferential angular range, a visual feedback pattern resulting from the interaction of the projected image and the differing pre-defined reflectance response characteristics is presented.

23. The device of claim 20, wherein the pre-determined preferential angular range is within about 30 degrees of a perpendicular of the projection surface.

24. The device of claim 20, wherein the reflectance response characteristics of at least one of the plurality of viewing regions is configured to preferentially reflect light incident within a pre-determined preferential angular range relative to the projection surface.

25. The device of claim 20, wherein the reflectance response characteristics of at least one of the plurality of viewing regions is configured to preferentially scatter or absorb incident light outside of a pre-determined preferential angular range relative to the projection surface.

26. The device of claim 20, further comprising a non-electronic button configured to generate an ultrasonic acoustic signal.

27. The device of claim 26, further comprising a plurality of non-electronic buttons, each configured to generate a distinctive ultrasonic acoustic signal.

28. A device comprising:

a chassis;

a projection surface coupled to the chassis and configured to receive an image projected by a projector that is remote from the device, the projection surface comprising a primary viewing region having a first reflectance response curve and a secondary viewing region having a second reflectance response curve; and

a passive component configured to be scanned by a camera that is remote from the device.

29. The device of claim 28, wherein the first reflectance response curve is configured to reflect light incident at a pre-determined preferential angle relative to the projection surface more than light incident at a non-preferential angle.