Method and apparatus for inhibiting a subject's eyes from being exposed to projected light

• US 7,686,460 B2
• Filed: 07/03/2007
• Issued: 03/30/2010
• Est. Priority Date: 05/24/2006
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Holmgren, David E., Benner, Erik
• Primary Examiner(s): Epps; Georgia Y
• Assistant Examiner(s): LE, BAO-LUAN Q
• Application Number:
  US11/773,319
• Publication Number:
  US 20080106706A1
• Time in Patent Office: 1,001 Days
• Field of Search: 353/69, 353/70, 353/97, 353/121, 353/122, 345/647, 345/619, 345/633, 345/634, 345/635
• US Class Current: 353/121
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 21/14 Details
• CPC Class Codes: G03B 21/2053 Intensity control of illuminating light controlled by video signal processing H04N5/74 or H04N9/31
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/3179 Video signal processing therefor
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A method of inhibiting a subject'"'"'s eyes from being exposed to projected light when the subject is positioned in front of a background on which an image is displayed comprises capturing an image of the background including the displayed image, processing the captured image to detect the existence of the subject and to locate generally the subject and masking image data used by the projector to project the image corresponding to a region that encompasses at least the subject'"'"'s eyes, the image data masking compensating for differing camera and projector viewpoints.

Claims

1. In a projection system comprising a projector to project an image for display on a background and at least two cameras to capture images of said background from different vantages, each of said at least two cameras having a viewpoint differing from the viewpoint of said projector, a method of inhibiting a subject'"'"'s eyes from being exposed to projected light when the subject is positioned in front of the background, said method comprising:

capturing sets of images of the background including the displayed image;

processing the captured images to detect the existence of a subject therein and to locate generally the depth of the subject from said background; and

masking image data used by the projector to project the image corresponding to a region that encompasses at least the subject'"'"'s eyes, said image data masking compensating for said differing camera and projector viewpoints.

2. The method of claim 1 wherein during said masking, pixels in said region are set to a black or near black level.

3. The method of claim 1 wherein said region is geometrically shaped and generally encompasses the subject'"'"'s head.

4. The method of claim 3 wherein said projection system comprises at least two spaced cameras, during said capturing, multiple images being captured and during said processing, a disparity image based on the captured images being generated.

5. The method of claim 4 wherein during said capturing, sets of images are successively captured and mapped to one another, each set of mapped images being processed to yield the disparity image.

6. The method of claim 5 wherein during said processing, said disparity image is processed to detect generally the center of the subject'"'"'s head, the geometrically shaped region being generally centered about the center of the subject'"'"'s head.

7. The method of claim 6 wherein during processing, said disparity image is examined to determine if a subject exists therein, if so, said disparity image is thresholded prior to processing to detect generally the center of the subject'"'"'s head.

8. The method of claim 7 further comprising tracking the subject'"'"'s head over successive sets of images and calculating an average center position, said average center position being used to position said geometrically shaped region.

9. The method of claim 8 further comprising calculating an average head velocity and using said average level velocity and average head position to position said geometrically shaped region.

10. The method of claim 1 wherein during said processing, the subject as seen by said at least one camera, is converted generally to a size as would be seen by said camera if positioned at said projector.

11. The method of claim 10 wherein the subject as seen by said at least one camera is scaled to compensate for different camera and projector resolutions.

12. The method of claim 1 wherein said background is an interactive touch panel.

13. In a projection system comprising a projector to project an image for display on a background and at least two laterally spaced cameras to capture an image of said background, a method of inhibiting a subject'"'"'s eyes from being exposed to projected light when the subject is positioned in front of the background, said method comprising:

successively capturing sets of images of the background including the displayed image from different vantages;

processing each set of captured images to detect the existence of the subject and to locate generally the depth of the subject'"'"'s head from the background; and

modifying image data used by the projector to project the image taking into account differing viewpoints of said cameras and projector, so that the displayed image comprises an area of darkness that at least encompasses the subject'"'"'s eyes and that does not extend appreciably beyond the subject'"'"'s head.

14. The method of claim 13 wherein the images of each set are mapped to one another, the mapped images being processed to yield a disparity image.

15. The method of claim 14 wherein during processing, said disparity image is examined to determine if a subject exists therein, if so, said disparity image is thresholded prior to processing to detect generally the center of the subject'"'"'s head.

16. The method of claim 15 further comprising tracking the subject'"'"'s head over successive sets of images and calculating an average center position, said average center position being used to position said geometrically shaped region.

17. A projection system comprising:

a projector receiving image data and projecting an image onto a background;

at least two cameras capturing images of the background including the projected image from different vantages, each of said at least two cameras being spaced from said projector and having a viewpoint differing from that of said projector; and

processing structure processing the captured images to locate a subject in the captured images and to map the depths of the subject to the viewpoint of said projector, said processing structure masking image data used by the projector to project the image corresponding to a region that encompasses at least the subject'"'"'s eyes.

18. A projection system according to claim 17 further comprising a video source providing the image data to said projector.

19. A projection system according to claim 18 wherein said video source is a computer.

20. A projection system according to claim 19 wherein said computer is coupled to said at least one camera and masks the image data.

21. A projection system according to claim 20 wherein said computer processes the captured images to detect when the subject occludes projected light and to locate generally the subject'"'"'s head.

22. A projection system according to claim 21 wherein during masking, said processing structure sets pixels in the region to a black or near black level.

23. A projection system according to claim 22 wherein said region is geometrically shaped and generally encompasses the subject'"'"'s head.

24. In a projection system comprising a projector to project an image for display on a background and at least two spaced cameras to capture images of said background from different vantages, a method of determining the distance a subject in the captured image is from the background, said method comprising:

comparing the images captured by the cameras to determine image disparity;

using the image disparity and the geometry of the projection system to calculate the background to subject distance; and

masking at least a portion of the subject.

25. The method of claim 24 wherein during said comparing, subsets of the captured images are compared.

26. The method of claim 25 wherein during said comparing a subset of one image is selected and scanned across the other image to locate a matching subset in said other image.

27. The method of claim 26 wherein the subset of said one image is horizontally scanned across the other image.

28. In a projection system comprising a projector to project an image for display on a background, an image processor and at least two cameras to capture images of said background from different vantages, a method of setting up said projection system comprising:

determining the orthogonal distance between the background and the projector and determining the width of said background;

assuming a maximum distance that a subject will stand in front of said background;

using the orthogonal distance, the width and the maximum distance to calculate a maximum camera to projector spacing;

positioning said at least two cameras relative to and within said maximum camera to projector spacing of said projector; and

during image projection, masking at least a portion of the subject.