Interactive directed light/sound system

• US 20040183775A1
• Filed: 12/15/2003
• Published: 09/23/2004
• Est. Priority Date: 12/13/2002
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Reactrix Systems Incorporated
• Inventors: Bell, Matthew
• Granted Patent: US 7,576,727 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H05B 47/125 by using cameras
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

An interactive directed beam system is provided. In one implementation, the system includes a projector, a computer and a camera. The camera is configured to view and capture information in an interactive area. The captured information may take various forms, such as, an image and/or audio data. The captured information is based on actions taken by an object, such as, a person within the interactive area. Such actions include, for example, natural movements of the person and interactions between the person and an image projected by the projector. The captured information from the camera is then sent to the computer for processing. The computer performs one or more processes to extract certain information, such as, the relative location of the person within the interactive area for use in controlling the projector. Based on the results generated by the processes, the computer directs the projector to adjust the projected image accordingly. The projected image can move anywhere within the confines of the interactive area.

Claims

1. An interactive directed beam system comprising:

an image detection system configured to capture information within an interactive area;

a first application configured to process the information captured by the image detection system; and

a second application configured to receive and use processed information from the first application to generate control information, the control information being used to control a directed beam projected at a location within the interactive area;

wherein the interactive area includes an object;

wherein the directed beam includes an image; and

wherein the information captured by the image detection system includes information relating to actions taken by the object within the interactive area.

2. The system of claim 1 wherein the image detection system includes a camera.

3. The system of claim 1 wherein the object includes a person;

and

wherein the actions taken by the object include natural movements of the person.

4. The system of claim 3 wherein the actions taken by the object include actions taken by the person with respect to the image.

5. The system of claim 3 wherein the actions taken by the object include interactions between the person and the image.

6. The system of claim 1 wherein the directed beam includes an audio stream aimed toward the location within the interactive area.

7. The system of claim 6 wherein the audio stream is aimed toward the location within the interactive area when the object is within or near the vicinity of the location.

8. The system of claim 1 wherein the second application is configured to generate the control information without the aid of information provided by a device affixed by the object.

9. The system of claim 1 wherein the processed information generated by the first application includes background and foreground information.

10. The system of claim 9 wherein the background and foreground information is used to identify a background of the interactive area and the object;

and

wherein the background and foreground information is used to generate the control information such that the location at which the directed beam is projected is within the background of the interactive area.

11. The system of claim 1 wherein the directed beam is used to provide a spotlight to follow the object within the interactive area.

12. The system of claim 1 wherein the image represents an intelligent virtual entity.

13. An interactive directed beam system comprising:

an image detection system configured to capture information within an interactive area, interactive area including an object, the information captured by the image detection system including information relating to actions taken by the object within the interactive area;

a computer configured to process the information captured by the image detection system and generate control information; and

a projector configured to receive and use the control information to control a directed beam, the directed beam being projected at a location within the interactive area.

14. The system of claim 13 wherein the directed beam includes an image;

and

wherein the object includes a person.

15. The system of claim 14 wherein the actions taken by the object include natural movements of the person.

16. The system of claim 14 wherein the actions taken by the object include actions taken by the person with respect to the image.

17. The system of claim 14 wherein the actions taken by the object include interactions between the person and the image.

18. The system of claim 14 wherein the image represents an intelligent virtual entity.

19. The system of claim 13 wherein the directed beam includes an audio stream aimed toward the location within the interactive area.

20. The system of claim 19 wherein the audio stream is aimed toward the location within the interactive area when the object is within or near the vicinity of the location.

21. The system of claim 13 wherein the computer is configured to generate the control information without the aid of information provided by a device affixed to the object.

22. The system of claim 13 wherein the processed information generated by the computer includes background and foreground information.

23. The system of claim 22 wherein the background and foreground information is used to identify a background of the interactive area and the object;

and

wherein the background and foreground information is used to generate the control information such that the location at which the directed beam is projected is within the background of the interactive area.

24. The system of claim 13 wherein the directed beam is used to provide a spotlight to follow the object within the interactive area.

25. An interactive directed beam system comprising:

an image detection system configured to capture information within an interactive area, the interactive area including an object, the information captured by the image detection system includes information relating to actions taken by the object within the interactive area;

a first application configured to process the information captured by the image detection system;

a second application configured to use the processed information from the first application to generate control information; and

a projector configured to use the control information to control one or more directed beams projected respectively at corresponding locations within the interactive area.

26. The system of claim 25 wherein the object includes a person.

27. The system of claim 26 wherein the actions taken by the object include natural movements of the person.

28. The system of claim 26 wherein the one or more directed beams include an image.

29. The system of claim 28 wherein the actions taken by the object include actions taken by the person with respect to the image.

30. The system of claim 28 wherein the actions taken by the object include interactions between the person and the image.

31. The system of claim 28 wherein the image represents an intelligent virtual entity.

32. The system of claim 25 wherein a first directed beam includes video content and a second directed beam includes audio content.

33. The system of claim 32 wherein the second directed beam is aimed toward its corresponding location within the interactive area when the object is within or near the vicinity of the corresponding location.

34. The system of claim 25 wherein the second application is configured to generate the control information without the aid of information provided by a device affixed to the object.

35. The system of claim 25 wherein the processed information generated by the first application includes background and foreground information.

36. The system of claim 35 wherein the background and foreground information is used to identify a background of the interactive area and the object;

and

wherein the background and foreground information is used to generate the control information such that the corresponding locations of the one or more directed beams are within the background of the interactive area.

37. The system of claim 25 wherein at least one of the one or more directed beams is used to provide a spotlight to follow the object within the interactive area.