Smart head-mounted projection system

• US 9,810,913 B2
• Filed: 03/27/2015
• Issued: 11/07/2017
• Est. Priority Date: 03/28/2014
• Status: Active Grant

• Current Assignee: Gerard Dirk Smits
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Smits, Gerard Dirk
• Primary Examiner(s): Abraham, Samantha K
• Application Number:
  US14/671,904
• Publication Number:
  US 20150278992A1
• Time in Patent Office: 956 Days
• CPC Class Codes: G02B 30/35 using reflective optical elements in the optical path between the images and the observer
• CPC Class Codes: G02B 5/124 plural reflecting elements forming part of a unitary plate or sheet

Abstract

Embodiments are directed towards a system for enabling a user to view an image on a surface. The system may include projector(s), sensor, projection surface or screen, and processor. The projectors may project light for an image onto the surface. The sensor may detect light reflected off the surface. The surface may include multiple types of surface elements, such as multiple first elements positioned as border of a display area on the surface to provide feedback regarding the surface and multiple second elements positioned within the border of the display area to reflect the image to the user. The processor may determine characteristics of the border of the display area based on light reflected to the sensor from first elements. And it may modify parameters of the image based on the characteristics of the border of the display area.

Claims

1. A system for enabling a user to view an image on a surface, comprising:

one or more projectors that project light for the image onto the surface;

a sensor that detects light reflected off the surface;

a plurality of first elements located on the surface, which border a display area on the surface, wherein each of the first elements reflect light projected from the one or more projectors to the sensor and at least a portion of this reflected light being non-visible to the user;

a plurality of second elements that are positioned within the border of the display area, wherein the plurality of second elements reflect light for the image from the one or more projectors to the user for viewing the image;

a plurality of third elements that are arranged as one or more fiduciary structures on the surface within the border area to reflect light projected from the one or more projectors to the sensor, wherein this reflected light provides spatial feedback for one or more locations within the display area; and

a processor that performs actions, including;

determining one or more characteristics of the border of the display area based on light reflected to the sensor from the plurality of first elements; and

modifying one or more parameters of the image that is projected onto the surface of the display area based on the one or more characteristics of the border of the display area, wherein the modified one or more parameters are employed to position the image inside the border of the display area.

2. The system of claim 1, wherein the plurality of first elements include full retro reflector (FRR) elements, wherein each FRR element reflects light from the one or more projectors directly to the sensor.

3. The system of claim 1, wherein the processor performs further actions, comprising:

determining a distance from the one or more projectors to the surface based on a triangulation of light from at least one of the projectors that is reflected off a retro reflector on the surface onto at least a first sensor.

4. The system of claim 1, wherein modifying at least one parameter of the image, further comprises:

tracking the border of the display area by continuously determining the one or more characteristics of the border; and

dynamically modifying one or more of a size, a shape, or an orientation of the image to stay within the tracked border.

5. The system of claim 1, wherein the surface includes the plurality of third elements that reflect light from the one or more projectors onto the sensor that represent an embedded code of surface information.

6. The system of claim 1, wherein the plurality of third elements are positioned to reflect light from the one or more projectors onto the sensor and the surface to provide feedback on locations relative to the display area of objects positioned between the one or more projectors and the surface, wherein the user is enabled to interact with the image.

7. The system of claim 1, further comprising:

another separate surface that includes the plurality of second elements, wherein the other surface provides another separate display area that is closer to the user than the display area located on the surface that includes the plurality of first elements.

8. A method for enabling a user to view an image on a surface,

employing one or more projectors to project light for the image onto the surface;

employing a sensor to detect light reflected off the surface;

employing a plurality of first elements located on the surface, wherein the plurality of first elements border a display area on the surface, and wherein each of the first elements reflect light projected from the one or more projectors to the sensor and at least a portion of this reflected light being non-visible to the user;

employing a plurality of second elements located on the surface, wherein the plurality of second elements are positioned within the border of the display area, wherein the plurality of second elements reflect light for the image from the one or more projectors to the user for viewing the image;

employing a plurality of third elements that are arranged as one or more fiduciary structures on the surface within the border area to reflect light projected from the one or more projectors to the sensor, wherein this reflected light provides spatial feedback for one or more locations within the display area;

determining one or more characteristics of the border of the display area based on light reflected to the sensor from the plurality of first elements; and

modifying one or more parameters of the image that is projected onto the surface of the display area based on the one or more characteristics of the border of the display area, wherein the modified one or more parameters are employed to position the image inside the border of the display area.

9. The method of claim 8, wherein the plurality of first elements include full retro reflector (FRR) elements, wherein each FRR element reflects light from the one or more projectors directly to the sensor.

10. The method of claim 8, further comprising:

a plurality of third elements that are positioned within the border of the display area, wherein the plurality of second elements reflect light for the image from the one or more projectors to the user for viewing the image.

11. The method of claim 8, further comprising, determining a distance from the one or more projectors to the surface based on a triangulation of light from at least one of the projectors that is reflected off a retro reflector on the surface onto at least a first sensor.

12. The method of claim 8, wherein modifying at least one parameter of the image, further comprises:

tracking the border of the display area by continuously determining the one or more characteristics of the border; and

dynamically modifying one or more of a size, a shape, or an orientation of the image to stay within the tracked border.

13. The method of claim 8, wherein the surface includes the plurality of third elements that reflect light from the one or more projectors onto the sensor that represent an embedded code of surface information.

14. The method of claim 8, wherein the plurality of third elements are positioned to reflect light from the one or more projectors onto the sensor and the surface to provide feedback on locations relative to the display area of objects positioned between the one or more projectors and the surface, wherein the user is enabled to interact with the image.

15. A computer for viewing an image on a surface, comprising:

a non-transitory computer readable memory that stores instructions; and

a processor that executes the instructions, wherein the processor performs actions, including;

projecting light for the image onto a plurality of first elements that are positioned within a border of a display area on the surface;

detecting light, provided by one or more projectors, that is reflected off the surface;

determining one or more characteristics of the border of the display area based on light detected from a plurality of second elements that that are positioned within the border of the display area, wherein the plurality of second elements reflect light for the image to the user for viewing the image;

receiving reflected light from a plurality of third elements that are arranged as one or more fiduciary structures on the surface within the border area to reflect light projected from the one or more projectors, wherein this reflected light provides spatial feedback for one or more locations within the display area; and

modifying one or more parameters of the image that is projected onto the surface of the display area based on the one or more characteristics of the border of the display area, wherein the modified one or more parameters are employed to position the image inside the border of the display area.

16. The computer of claim 15, wherein detecting light reflected off the surface, further comprises:

detecting light reflected from a plurality of full retro reflector (FRR) elements to determine the boarder of the display area.

17. The computer of claim 15, wherein the processor performs further actions, comprising:

determining a distance from the one or more projectors to the surface based on a triangulation of light from at least a first projector that is reflected off a retro reflector on the surface onto at least a first sensor.

18. The computer of claim 15, wherein modifying at least one parameter of the image, further comprises:

tracking the border of the display area by continuously determining the one or more characteristics of the border; and

dynamically modifying one or more of a size, a shape, or an orientation of the image to stay within the tracked border.

19. The computer of claim 15, wherein the processor performs further actions, comprising:

determining surface information from an embedded code within a plurality of third elements located on the surface.