Shifted reality display device and environmental scanning system

• US 10,338,385 B2
• Filed: 09/12/2017
• Issued: 07/02/2019
• Est. Priority Date: 12/14/2011
• Status: Active Grant

• Current Assignee: Christopher V. Beckman
• Original Assignee: Christopher V. Beckman
• Inventors: Beckman, Christopher V.
• Primary Examiner(s): LaBalle, Clayton E.
• Assistant Examiner(s): Fenwick, Warren K
• Application Number:
  US15/702,732
• Publication Number:
  US 20180017791A1
• Time in Patent Office: 658 Days
• Field of Search: 359601, 296 9619, 296 972
• CPC Class Codes: B60J 3/04 adjustable in transparency
• CPC Class Codes: G02B 2027/0109 comprising details concerning the making of holograms
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0136 with a single image source for both eyes
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0103 comprising holographic elements
• CPC Class Codes: G03B 11/045 Lens hoods or shields
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

New visual systems are provided, implementing a new form of mediated reality, known as shifted-reality. In some embodiments, a matrix of specialized pixels creates redirected light with a plurality of angle-alterable, shiftable sources, which create virtual objects of greater realism than conventional 3-D imaging methods, and reduce the appearance of other objects or conditions. In some embodiments, existing images and objects viewed through a screen are shifted in perspective, and enhanced with effects and information related to objects and an environment. An object structure and materials library may be maintained, as well as an object inventory, based on observation with sensors. One sensor may be non-visual, but with a perspective related to a visual sensor. An array of subdividing material and structural categories may also be maintained.

Claims

1. A system for enhancing observable images and environments comprising:

hardware capable of defining observation point(s) or region(s); and

hardware capable of blocking any of several areas of a screen to shade or intercept at least some light that would otherwise reach said observation point(s) or region(s),

hardware capable of creating light to produce virtual objects and effects,

hardware capable of re-routing environmental light passing through it, to produce a range of actual and virtual objects with a shifting perspective.

2. The system of claim 1, wherein the system determines the observation point(s) or region(s) with eye-tracking hardware.

3. The system of claim 2, wherein the eye-tracking hardware comprises at least one camera.

4. The system of claim 3, wherein the eye-tracking hardware comprises a plurality of cameras.

5. The system of claim 2, wherein the eye-tracking hardware comprises at least one sensor.

6. The system of claim 3, wherein the system comprises a housing, and a display on one side of the housing, and at least one environmental camera is mounted on a side of the housing opposite from the display.

7. The system of claim 6, wherein the at least one environmental camera comprises a plurality of environmental cameras.

8. The system of claim 7, wherein the plurality of environmental cameras are configured to view the environment from different perspectives, and

wherein the system is configured to creating a 3-D map of objects present in the environment.

9. The system of claim 3, wherein the system comprises a housing, and a display on one side of the housing, and at least one environmental sensor is mounted on a side of the housing opposite from the display.

10. The system of claim 9, wherein at least one environmental camera is also mounted on a side of the housing opposite from the display.

11. The system of claim 10, wherein said at least one environmental camera comprises a plurality of environmental cameras.

12. The system of claim 6, wherein the side of the housing opposite from the display comprises a plurality of angled surfaces, each configured to absorb light from a plurality of angles, and configured to enhance a user'"'"'s grip.

13. The system of claim 12, wherein at least one of said plurality of angled surfaces comprises a sensor, configured to sense the environment.

14. The system of claim 12, wherein at least one of said plurality of angled surfaces comprises hardware for transmitting environmental light entering from the side of the housing opposite from the display, based on commands from a control system.

15. The system of claim 14, wherein at least one of said plurality of angled surfaces comprises hardware configured to alter the angle and focus of said light entering from the side of the housing opposite from the display before transmitting it, based on commands from a control system.

16. A method for identifying and enhancing real world objects with a personal environment viewing and scanning device, comprising the following steps:

identifying at least one observation focal point of a user of the device;

scanning an image and identifying an environmental object and category encompassing said environmental object, using at least one camera and at least one other sensor paired with said at least one camera;

creating and presenting a virtual object at the observation focal point, representing said environmental object, with shifted reality hardware;

applying object physics stored in a library to said virtual object.

17. The method for identifying and enhancing real world objects with a personal environment viewing and scanning device of claim 16, comprising the following additional step:

testing and observing appearance, structure and behavior of said environmental object.

18. The method for identifying and enhancing real world objects with a personal environment viewing and scanning device of claim 17, comprising the following additional step:

creating new category(ies) of real world objects, based on said observed appearance, structure and behavior.