Interactive directed light/sound system

• US 8,199,108 B2
• Filed: 08/17/2009
• Issued: 06/12/2012
• Est. Priority Date: 12/13/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Intellectual Ventures Holding 67 LLC (Intellectual Ventures LLC)
• Inventors: Bell, Matthew
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US12/542,633
• Publication Number:
  US 20100026624A1
• Time in Patent Office: 1,030 Days
• Field of Search: 345156-168, 345204-215, 348/211, 348/211.14, 348/212, 348/744
• US Class Current: 345/158
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H05B 47/125 by using cameras
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

An interactive directed beam system is provided. In one implementation, the system includes a projector, a computer and a camera. The camera is configured to view and capture information in an interactive area. The captured information may take various forms, such as, an image and/or audio data. The captured information is based on actions taken by an object, such as, a person within the interactive area. Such actions include, for example, natural movements of the person and interactions between the person and an image projected by the projector. The captured information from the camera is then sent to the computer for processing. The computer performs one or more processes to extract certain information, such as, the relative location of the person within the interactive area for use in controlling the projector. Based on the results generated by the processes, the computer directs the projector to adjust the projected image accordingly. The projected image can move anywhere within the confines of the interactive area.

Claims

1. An interactive audiovisual system comprising:

an image detection computing system configured to determine a position of at least a portion of a person in an interactive area based on one or more images of the interactive area received from an imaging device, wherein the position is determined without the need for a tracking device associated with at least the portion of the person;

an interactive media module configured to use the determined position to generate a video control signal and an audio control signal;

a video beam controller configured to receive the video control signal and to adjust a position of a video image projected from a video projection device based on at least the video control signal; and

an audio beam controller configured to receive the audio control signal and to adjust a direction of an audio signal emitted from an audio device based on at least the audio control signal.

2. The interactive audiovisual system of claim 1, wherein the audio signal is directed towards the video image to create an illusion that the video image is making noises or speaking.

3. The interactive audiovisual system of claim 2, wherein the video image comprises a representation of a person, an animated character, or an avatar.

4. The interactive audiovisual system of claim 1, wherein the audio signal is an audio beam.

5. The interactive audiovisual system of claim 1, wherein the images of the interactive area comprise indications of infrared light reflected by at least the portion of the person in the interactive area.

6. The interactive audiovisual system of claim 5, wherein the video image comprises a substantially visible light projection.

7. An interactive video system comprising:

an image detection computing system configured to determine a position of an object in an interactive area based on one or more images of the object, wherein the position is determined without the need for a tracking device associated with the object;

an interactive media module configured to generate a video control signal based on the determined position of the object; and

a video device configured to receive the video control signal and to adjust a position of a video image projected from the video device based on at least the video control signal.

8. The interactive video system of claim 7, wherein the image detection computing system includes one or more cameras.

9. The interactive video system of claim 7, wherein the object is at least a portion of a person.

10. The interactive video system of claim 7 wherein the position of the video image is adjusted to correspond to the determined position of the object.

11. The interactive video system of claim 7, wherein the video image comprises one or more of a spotlight, a slide projection, a gobo, an abstract shape, a logo, a text message, or a virtual character.

12. The interactive video system of claim 9, wherein the video image comprises a spotlight and wherein the video device adjusts the position of the spotlight to follow at least the portion of the person as the person moves within the interactive area.

13. The interactive video system of claim 7, wherein the image detection system is further configured to generate a model of the interactive area that indicates positions of one or more predetermined points of the video image in the interactive area, and the position of the object is determined based at least in part on the position of the object in reference to one or more of the predetermined points.

14. The interactive video system of claim 13, wherein the predetermined points include at least one corner of the video image in the interactive area.

15. A method of providing interactive video effects comprising:

receiving one or more images of an object within an interactive area;

determining a position of the object in the interactive area based on the one or more images, wherein the determining is performed without receiving information from a tracking device associated with the object;

generating a video control signal that indicates an updated position of a video image in the interactive area, wherein the updated position is determined based on at least the position of the object; and

adjusting a position of a video beam controller that transmits the video image according to the video control signal,

wherein at least some of the method is performed by a suitably configured computing system having one or more processors.

16. The method of claim 15, wherein the updated position of the video image substantially corresponds to the position of the object.

17. The method of claim 15, further comprising:

generating an audio control signal that indicates an updated target of a directed audio signal, wherein the updated target is adjusted based on at least the position of the object; and

adjusting a position of an audio beam controller in accordance with the audio control signal.

18. The method of claim 17, wherein the updated target of the directed audio signal is substantially a position of a virtual object.

19. A tangible computer-readable medium having stored thereon computer-executable instructions that, in response to execution by one or more computing devices, cause the one or more computing devices to perform operations comprising:

determining a position of a user in an interactive area based on one or more images of the interactive area received from one or more cameras;

determining an updated direction of a projected video image and an updated direction of a projected audio beam based on at least the position of the user;

initiating adjustment of a direction of a video beam controller in accordance with the updated direction of the projected video image; and

initiating adjustment of an audio beam controller in accordance with the updated direction of the projected audio beam.

20. The tangible computer-readable medium of claim 19, wherein determining the position of the user comprises determining portions of the one or more images that are foreground and determining portions of the one or more images that are background.

21. The tangible computer-readable medium of claim 19, wherein determining the updated direction of the projected video image and the updated direction of the projected audio beam comprises comparing the position of the user to a position of the video image in the interactive area.