Interactive projection system and method

• US 20060072076A1
• Filed: 10/04/2005
• Published: 04/06/2006
• Est. Priority Date: 10/04/2004
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Frankenberger, James Stephen, Smoot, Lanny, McArdle, William Joseph, Tanaka, Arthur Jun, Knowles, Kenneth L., Kurth, Deborah Susan, Kravitz, Don, Ayala, Alfredo Medina
• Granted Patent: US 7,273,280 B2
• Time in Patent Office: Days
• US Class Current: 353/34
• CPC Class Codes: G03B 15/10 using back-projection, i.e. blending artificial background with real foreground
• CPC Class Codes: G03B 21/26 Projecting separately subsidiary matter simultaneously with main image
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor

Abstract

A method and system of selectively projecting images is disclosed. An illuminated area is created on a projection surface by directing a light source to the projection surface. The illuminated area is detected with a camera. Electrical signals are transmitted from the camera to the projector, the electrical signals being indicative of the position of the illuminated area in relation to the projection surface. Based on the received electrical signals, an image and a second image are projected on the projection surface. The image is projected on the illuminated area of the projection surface. The second image is projected on an area of the projection surface that is not illuminated by the light source. Applications of this method and system include the projection of background and foreground images creating the illusion of an x-ray beam, the projection of a normal image and an overblown image creating the illusion of a magnifying light beam.

Claims

1. A system of selectively projecting images, comprising:

a light source configured to create an illuminated area on a projection surface;

a camera configured to detect the illuminated area on the projection surface;

a processing unit configured to receive signals from the camera indicative of the position of the illuminated area in relation to the projection surface, the processing unit utilizing the signals received from the camera to create a first image and a second image to be projected on the projection surface; and

a projector configured to project the first image on the illuminated area of the projection surface, and a second image on an area of the projection surface that is not illuminated by the light source.

2. The system of claim 1, wherein the processing unit utilizes input data from a first video generator to create the first image, and wherein a keyer utilizes input data from a second video generator to create the second image.

3. The system of claim 1, wherein the first image and the second image are three-dimensional images.

4. The system of claim 1, wherein the projection surface is translucent.

5. The system of claim 1, wherein the projection surface is non-translucent.

6. The system of claim 1, wherein the illuminated area of the projection surface is also projected with the second image.

7. The system of claim 1, wherein the first image is a moving video image.

8. The system of claim 7, wherein the first image is synchronized with an audio output.

9. The system of claim 7, wherein the moving video image is triggered to commence upon the light source impinging on a target area of the projection surface.

10. The system of claim 1, wherein the second image is a moving video image.

11. The system of claim 10, wherein the second image is synchronized with an audio output.

12. The system of claim 10, wherein the audio output is triggered to commence upon the light source impinging on the projection surface.

13. The system of claim 1, wherein the first image and the second image are projected from the same side of the projection surface in relation to the light source.

14. The system of claim 1, wherein the first image and the second image are projected from the opposite side of the projection surface in relation to the light source.

15. The system of claim 1, wherein the light source is a flashlight.

16. The system of claim 1, wherein the light source is mounted to a pair of wearable eyeglasses.

17. The system of claim 1, wherein the light source is mounted on a wearable helmet.

18. The system of claim 1, wherein the light source is mounted on a ring.

19. The system of claim 1, wherein the light source comprises a plurality of light beams.

20. The system of claim 1, wherein the light source is an infrared light and the camera is sensitive to infrared light.

21. The system of claim 1, wherein the light source is of a specific wavelength and the camera is sensitive to the specific wavelength.

22. The system of claim 21, wherein the light source can be identified based on the wavelength of the light source.

23. The system of claim 1, wherein the first image is an image representing the present appearance of an object and the second image is an image representing the appearance of an object at a different time than the present.

24. The system of claim 1, further comprising a second projection surface upon which the first image is projected.

25. The system of claim 1, further comprising a computing device that constructs a final image to be projected on the projection surface, the final image including the first image and the second image.

26. The system of claim 1, wherein the first and the second images are projected on one side of the projection surface.

27. The system of claim 1, wherein the projection surface encompasses the surface of a three-dimensional object, the first and the second images being projected on multiple sides of the projection surface.

28. The system of claim 1, further comprising a second light source that creates a second illuminated area on the projection surface, wherein the projector projects a third image on the second illuminated area of the projection surface.

29. The system of claim 1, further comprising a second projector that receives electrical signals from the camera indicative of the position of the illuminated area in relation to the projection surface, wherein the projector projects the first image on the illuminated area of the projection surface, wherein the second projector projects the second image on an area of the projection surface that is not illuminated by the light source.

30. A method of selectively projecting images, the method comprising:

creating an illuminated area on a projection surface by directing a light source towards the projection surface;

detecting the position of the illuminated area relative to the projection surface with a camera;

transmitting signals from the camera to a processing unit, the signals being indicative of the position of the illuminated area relative to the projection surface;

utilizing at the processing unit the signals received from the camera to create an image to be projected on the projection surface; and

projecting an image on the projection surface, the image being projected on the illuminated area of the projection surface by a projector.

31. The method of claim 30, further comprising projecting a complementary image on an area of the projection surface that is not illuminated by the light source.

32. The method of claim 30, wherein the processing unit utilizes input data from a first video generator to create the image, and wherein the processing unit utilizes input data from a second video generator to create the complementary image.

33. The method of claim 30, wherein projecting an image and a complementary image on the projection surface includes utilizing a computing device to construct a final image to be projected on the projection surface, the final image including the image and the complementary image.

34. The method of claim 30, further comprising projecting a third image on a second illuminated area of the projection surface, the second illuminated area created by a second light source.

35. The method of claim 30, wherein transmitting signals from the camera further includes transmitting the signals to a second projector, wherein the signals are indicative of the position of the illuminated area in relation to the projection surface, wherein the projector projects the image on the illuminated area of the projection surface, and wherein the second projector projects the complementary image on an area of the projection surface that is not illuminated by the light source.

36. A system of selectively projecting images, comprising:

a light source configured to create an illuminated area on a projection surface;

a camera configured to detect the illuminated area on the projection surface;

a processing unit configured to receive signals from the camera indicative of the position of the illuminated area relative to the projection surface, the processing unit utilizing the signals received from the camera to establish a position on the projection surface at which an image is to be projected; and

a projector configured to project the image at the position on the projection surface established by the processing unit.

37. The system of claim 36, wherein the projector projects a complementary image on an area of the projection surface that is not illuminated by the light source.

38. The system of claim 37, wherein the processing unit utilizes input data from a first video generator to create the image, and wherein the keyer utilizes input data from a second video generator to create the complementary image.

39. The system of claim 37, wherein the image and the complementary image are three-dimensional images.

40. The system of claim 36, wherein the projection surface is translucent.

41. The system of claim 36, wherein the projection surface is non-translucent.

42. A system for selectively projecting images onto a projection surface, comprising:

a pointing device having a magnetic source, the magnetic source configured to generate directional magnetic energy in the vicinity of a projection surface;

a magnetic receiver in the vicinity of the projection surface, the magnetic receiver configured to detect the position and direction of the magnetic source;

a processing unit configured to receive signals from the magnetic receiver and indicate the position and pointing direction of the magnetic source in relation to the projection surface, wherein the processing unit utilizes the signals received from the magnetic receiver to determine a location coordinate on the projection surface to which the user is pointing, wherein the processing unit creates a first image to be projected at the location coordinate on the projection surface, wherein the processing unit creates a second image to be projected on the projection surface that is not the location coordinate on the projection surface; and

a projector configured to project the first image and the second image.

43. The system of claim 42, wherein the processing unit utilizes input data from a first video generator to create the first image, and wherein the keyer utilizes input data from a second video generator to create the second image.

44. The system of claim 42, wherein the first image is a three-dimensional image.

45. The system of claim 42, wherein the first image and the second image are three-dimensional images.

46. The system of claim 42, wherein the projection surface is translucent.

47. The system of claim 42, wherein the projection surface is non-translucent.

48. A network of interactive projection systems to allow users at separate locations, to share in an interactive experience, comprising:

a plurality of interactive projection systems, each system comprising a projection screen, a camera, and a controller, wherein the camera captures light from at least one light source, the light from the at least one light source being focused on the projection screen, and wherein the camera transmits to the controller signals representing the at least one light source being focused at the projection screen;

a computing device that communicably receives data from each of the controllers of each of the plurality of interactive projection systems, the data received by the computing device being indicative of the at least one light source present at each of the projection systems; and

a database of light source identifiers that can be accessed by the computing device to associate the at least one light source present at each of the projection systems with each projection screen.

49. The network of claim 48, wherein the computing device is configured to keep a score for each light source, the score indicative of a number of target areas focused on by the light source.

50. The network of claim 48, wherein the computing device can access the database of light source identifiers to determine which light source is associated with a projection screen.

51. The network of claim 48, wherein each of the plurality of interactive projection systems is located in a separate room.

52. The network of claim 48, wherein each of the plurality of interactive projection systems is located in a separate geographical area.

53. A method of selecting from a first plurality of illuminators a second plurality of illuminators that focus light on a projection screen, comprising:

providing a back channel to each of the first plurality of illuminators, the back channel to each of the plurality of illuminators being connected to a central computer;

detecting a plurality of illumination areas at a projection surface;

momentarily turning off each of the first plurality of illuminators, the first plurality of illuminators being turned off through the back channel by the central computer, wherein every time each of the first plurality of illuminators is turned off, a camera detects whether any one of the plurality of illumination areas at the projection surface decreases in light energy; and

including a selected illuminator in the second plurality of illuminators if one of the plurality of illumination areas decreases in light energy, the selected illuminator corresponding to the illumination area decreasing in light energy.

54. A method of identifying an illuminator focusing light on a target area of a projection surface, comprising:

providing a plurality of illuminators, each of the illuminators illuminating an area of the projection surface;

generating a dynamic database that includes a position of the each of the illuminated areas on the projection surface and an illuminator identifier corresponding to each of the plurality of illuminators;

comparing each of the positions of the illuminated areas to a position of the target area;

if the position of a illuminated area matches the position of the target area, locating in the dynamic database the illuminator identifier corresponding to the illuminated area; and

utilizing the illuminator identifier to identify the illuminator focusing light on the target area.

55. The method of claim 54, further comprising generating a static database of a plurality of target area positions and illuminator identifiers corresponding to illuminators focused on the target area.

56. The method of claim 54, wherein a plurality of users utilize the plurality of illuminators to engage in a game that rewards a user that focuses light on the target area.

57. The method of claim 54, wherein the user is awarded a point every time the user focuses light on the target area.

58. A method of identifying an illuminator focusing light on a target area of a projection surface, comprising:

providing a plurality of illuminators, each of the illuminators illuminating an area of the projection surface;

providing a back channel to each of the plurality of illuminators, the back channel to each of the plurality of illuminators being connected to a central computer;

detecting with a camera whether the target area on the projection surface has being illuminated;

measuring an initial amount of light energy at the target area;

sequentially turning off each of the plurality of illuminators, the plurality of illuminators being turned off through the back channel by the central computer, wherein after turning off each of the plurality of illuminators, the resulting light energy of the target area is measured;

determining whether the resulting light energy of the target area is different in comparison with the initial amount of light energy at the target area; and

if the target area is different in comparison with the initial amount of light energy at the target area, identifying the illuminator that was last turned off as the illuminator focusing light on a target area of the projection screen.

59. The method of claim 58, further comprising generating a static database of a plurality of target area positions and illuminator identifiers corresponding to illuminators focused on the target area.

60. The method of claim 58, wherein a plurality of users utilize the plurality of illuminators to engage in a game that rewards a user that focuses light on the target area.

61. The method of claim 58, wherein the user is awarded a point every time the user focuses light on the target area.

62. A method of distinguishing the origin of the illumination of a target illuminated area on a projection screen, comprising:

detecting the target illuminated area on the projection screen, the target illuminated area being detected by a camera;

turning the first light source off and on, wherein if the target illuminated area dims in illumination, the first light source is determined to be illuminating the target illuminated area; and

turning the second light source off and on, wherein if the target illuminated area dims in illumination, the second light source is determined to be illuminating the target illuminated area.

63. The method of claim 62, further comprising generating a database of a plurality of target area positions and light source identifiers corresponding to light sources focused on the target area.

64. The method of claim 62, wherein a plurality of users utilize the plurality of light sources to engage in a game that rewards a user that focuses light on the target illuminated area.

65. The method of claim 62, wherein the user is awarded a point every time the user focuses light on the target illuminated area.

66. A method of determining a user that focuses light on a target area of a projection screen, comprising:

providing a plurality of light sources, wherein each of the plurality of light sources emits light at a different wavelength;

providing each user of a plurality of users with one of the plurality of light sources;

generating a database that includes a record for each of the plurality of light sources, each record including a light source wavelength and a light source identifier;

detecting if a target area on the projection screen has being illuminated, the illumination of target area being detected by a camera;

determining an illumination wavelength of the light illuminating the target area;

locating a selected light source identifier in the database such that the light source wavelength matches the illumination wavelength; and

identifying the user utilizing the light source corresponding to the selected light source identifier as the first user that focuses light on a target area of the projection screen.

67. The method of claim 66, wherein a plurality of cameras can be used to capture the illumination of the target area, wherein each of the plurality of cameras can capture the wavelength of one of the plurality of light sources.

68. The method of claim 66, further comprising generating a database of a plurality of target area positions and light source identifiers corresponding to light source focused on the target area.

69. The method of claim 66, wherein a plurality of users utilize the plurality of light source to engage in a game that rewards a user that focuses light on the target area.

70. The method of claim 66, wherein the user is awarded a point every time the user focuses light on the target area.