MULTIPLE PERSPECTIVE INTERACTIVE IMAGE PROJECTION

• US 20150049078A1
• Filed: 08/15/2013
• Published: 02/19/2015
• Est. Priority Date: 08/15/2013
• Status: Abandoned Application

• Current Assignee: MEP Tech, Inc.
• Original Assignee: MEP Tech, Inc.
• Inventors: Mealing, Donald Roy, Davis, Mark L., Hoole, Roger H., Stoker, Matthew L., Swank, W. Lorenzo, Bradshaw, Michael J.
• Application Number:
  US13/968,232
• Publication Number:
  US 20150049078A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G01B 11/25 by projecting a pattern, e.g. one or more lines, moiré fringes on the object G01B11/255 takes precedence ; image analysis for depth or shape recovery G06T7/50
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 13/25 using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
• CPC Class Codes: H04N 13/254 in combination with electromagnetic radiation sources for illuminating objects
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388

Abstract

The projection of interactive images such that different images are pre-edited so that when projected, the image is better suited for viewing from a particular perspective. Thus, a variety of images might be projected such that some are suitable for one perspective, some are suitable for another perspective, and so forth. For instance, one image might be edited so that when projected, the projected first image is presented for better viewing from a first perspective. Another image might be edited so that when projected, the projected second image is presented for better viewing from a second perspective.

Claims

1. A computer program product comprising one or more computer-readable storage media having thereon computer-executable instructions that are structured such that, when executed by one or more processors of a computing system, cause the computing system to perform a method comprising:

an act of editing a first image so that when projected, the projected first image is presented for better viewing from a first perspective;

an act of editing a second image so that when projected, the projected second image is presented for better viewing from a second perspective;

an act of detecting a first image input event using first captured data representing user interaction with the projected first image; and

an act of detecting a second image input event using second captured data representing user interaction with the projected second image.

2. The computer program product in accordance with claim 1,

the act of editing the first image occurring in a manner in which keystoning is reduced when viewed from a first angle;

and

the act of editing the second image occurring in a manner in which keystoning is reduced when viewed from a second angle different than the first angle.

3. The computer program product in accordance with claim 1,

the act of editing the first image occurring in a manner in which keystoning is reduced when viewed from a first angle and when the projected first image is projected onto a surface that is not perpendicular to the direction of projection;

and

the act of editing the second image occurring in a manner in which keystoning is reduced when viewed from a second angle different than the first angle and when the projected first image is projected onto the surface that is not perpendicular to the direction of projection.

4. The computer program product in accordance with claim 1, wherein the first and second image are the same image prior to the acts of editing.

5. The computer program product in accordance with claim 4,

the act of editing the first image comprising removing image data from a first portion of the first image;

and

the act of editing the second image comprising removing image data from a second portion of the second image.

6. The computer program product in accordance with claim 1, the first image and the second image are each dynamic images having a plurality of frames, wherein the frames of the first image are interleaved with the frames of the second image, such that the first perspective is through a first shuttering system that permits the frames of the first image to be viewed but not the frames of the second image, and such that the second perspective is through a second shuttering system that permits the frames of the second image to be viewed but not the frames of the first image.

7. The computer program product in accordance with claim 6, wherein the first image is a three-dimensional image such that a portion of the frames of the first image are to be viewed by a left eye of a user through the first shuttering system, and such that a portion of the frames of the first image are to be viewed by a right eye of the user through the first shuttering system.

8. The computer program product in accordance with claim 7, wherein the second image is also a three-dimensional image such that a portion of the frames of the second image are to be viewed by a left eye of a second user through the second shuttering system, and such that a portion of the frames of the second image are to be viewed by a right eye of the second user through the second shuttering system.

9. The computer program product in accordance with claim 1, the method further comprising:

an act of detecting an object in a field of projection of the projected first image;

in response to the act of detecting the object in the field of projection, the act of editing the first image includes an act of editing the first image such that a portion of the first image corresponding to a location of the detected object is modified.

10. The computer program product in accordance with claim 9, wherein the portion of the first image is modified such that the detected object has a certain color.

11. The computer program product in accordance with claim 9, wherein the portion of the first image is modified such that the detected object has at a least one control displayed thereon, the user interaction with the projected first image comprising the user interacting with the control projected on the detected object.

12. The computer program product in accordance with claim 11, wherein the detected object is a hand, wherein the portion of the first image is modified such that the hand has a plurality of controls displayed thereon, each control corresponding to a predetermined portion of the hand.

13. The computer program product in accordance with claim 9, wherein the portion of the first image is modified such that the detected object has displayed thereon image data that is obscured by the detected object.

14. The computer program product in accordance with claim 9, wherein the editing of the first image is performed so as to incorporate one or more user preferences of a user that is to view the projected image from the first perspective.

15. A method comprising:

an act of a computing system editing a first image so that when projected, the projected first image is presented for better viewing from a first perspective as compared to a second perspective;

an act of a projection system projecting the first image onto a surface;

an act of a camera system capturing first captured data representing user interaction with the projected first image;

an act of the computing system detecting a first image input event using the first captured data representing user interaction;

an act of the computing system editing a second image so that when projected, the projected second image is presented for better viewing from the second perspective as compared to the first perspective; and

an act of the projection system projecting the second image onto the surface.

16. The method in accordance with claim 15, further comprising:

an act of the camera system capturing second captured data representing user interaction with the projected second image; and

an act of the computing system detecting a second image input event using the second captured data representing user interaction.

17. The method in accordance with claim 15, the act of the projection system projecting the first image onto the surface comprising:

an act of using a first projector to project the first image onto the surface from a first angle and having a first field of projection; and

an act of using a second projector to project the first image onto the surface from a second angle and having a second field of projection, such that the first and second fields of projection converge on the surface; and

an act of detecting an object in either or both of the first and second fields of projection of the projected first image;

in response to the act of detecting the object, the act of editing the first image includes an act of editing the first image for at least one of the fields of projection so as not to provide non-convergent versions of the first image onto the detected object.

18. A system comprising:

a projection system;

a camera system; and

a control system, wherein the control system is configured to perform the following method;

an act of editing a first image so that when projected by the projection system on a surface, the projected first image is presented for better viewing from a first perspective;

an act of editing a second image so that when projected by the projection system on the surface, the projected second image is presented for better viewing from a second perspective;

an act of detecting a first image input event using first captured data representing user interaction with the projected first image, the first captured data captured by the camera system; and

an act of detecting a second image input event using second captured data representing user interaction with the projected second image, the second captured data captured by the camera system.

19. The system in accordance with claim 18, wherein the projection system, the camera system, and the control system are integrated and are designed to sit on a same flat surface onto which the projection system projects.

20. The system in accordance with claim 19, wherein the projection system is configured to be attached to a ceiling.