Interactive directed light/sound system

• US 7,576,727 B2
• Filed: 12/15/2003
• Issued: 08/18/2009
• Est. Priority Date: 12/13/2002
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Intellectual Ventures Holding 67 LLC (Intellectual Ventures LLC)
• Inventors: Bell, Matthew
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): Nguyen; Kimnhung
• Application Number:
  US10/737,730
• Publication Number:
  US 20040183775A1
• Time in Patent Office: 2,073 Days
• Field of Search: 345156-158, 345/87, 348/211, 348/744, 348/211.14
• US Class Current: 345/158
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H05B 47/125 by using cameras
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

An interactive directed beam system is provided. In one implementation, the system includes a projector, a computer and a camera. The camera is configured to view and capture information in an interactive area. The captured information may take various forms, such as, an image and/or audio data. The captured information is based on actions taken by an object, such as, a person within the interactive area. Such actions include, for example, natural movements of the person and interactions between the person and an image projected by the projector. The captured information from the camera is then sent to the computer for processing. The computer performs one or more processes to extract certain information, such as, the relative location of the person within the interactive area for use in controlling the projector. Based on the results generated by the processes, the computer directs the projector to adjust the projected image accordingly. The projected image can move anywhere within the confines of the interactive area.

Claims

1. An interactive directed beam system comprising:

an image detection system configured to capture information within an interactive area, the captured information including information relating to unencumbered actions taken by a person within the interactive area, the unencumbered actions including those actions omitting a tracking or transmission device;

a vision processing system configured to process the information captured by the image detection system to generate a classification image that includes foreground and background information;

an interactive media engine configured to use the classification information to generate control information including information related to interaction with a video image displayed in a directed beam;

a directed beam controller configured to control a directed beam including a video image, the directed beam projected within the interactive area in response to the control information and information related to interaction with the video image displayed in the directed beam; and

a speaker system configured to generate a directed audio stream responsive to the control information, wherein the directed audio stream accompanies the projection of the directed beam, the directed audio stream delivering sound to the interactive area.

2. The system of claim 1 wherein the image detection system includes a camera.

3. The system of claim 1, wherein the unencumbered actions taken by a person within the interactive area include natural movements of the person.

4. The system of claim 3, wherein the natural movements of the person include actions taken by the person with respect to the video image.

5. The system of claim 1 wherein the sound from the directed audio stream is not audible by a person outside the interactive area.

6. The system of claim 5, wherein the directed audio stream is aimed toward the person within the interactive area utilizing a motorized mount to control the direction of the speaker system.

7. The system of claim 6, wherein the speaker system includes parabolic speakers.

8. The system of claim 6, wherein the speaker system includes an ultrasonic emitter. control the direction of the speaker system.

9. The system of claim 1, wherein the classification information identifies a background of the interactive area and the person, the classification information used by the interactive media engine and directed beam controller to cause the projector to project the directed beam within the background of the interactive area.

10. The system of claim 1, wherein the directed beam controller causes the projector to project an image that follows the person within the interactive area.

11. The system of claim 1, wherein the video image represents an intelligent virtual entity.

12. The system of claim 1 wherein the interactive area is a three-dimensional region.

13. An interactive directed beam system comprising:

an image detection system configured to capture information within an interactive area, the information captured by the image detection system including information relating to unencumbered actions taken by a person within the interactive area, the unencumbered actions including those actions omitting a tracking or transmission device;

a computer configured to process the information captured by the image detection system to generate control information including information related to interaction with a video image displayed in a directed beam;

a projector configured to receive and use the control information including information related to interaction with a video image displayed in a directed beam, the projector further configured to project a directed beam, the directed beam including a video image, the directed beam projected within the interactive area; and

a speaker system configured to generate a directed audio stream responsive to the control information and accompanying the directed beam, wherein the directed audio stream delivers sound to the interactive area.

14. The system of claim 13, wherein the unencumbered actions taken by the person include natural movements.

15. The system of claim 13,wherein the unencumbered actions taken by the person include actions taken by the person with respect to the video image.

16. The system of claim 13, wherein the video image represents an intelligent virtual entity.

17. The system of claim 13 wherein the information processed by the computer includes background and foreground information generated by the image detection system.

18. The system of claim 14, wherein the background and foreground information is used to identify a background of the interactive area and the person, the background and foreground information included in the control information such that the projector projects the directed beam within the background of the interactive area in response to the control information.

19. The system of claim 13, wherein directed audio stream follows the image within the interactive area.

20. ) The system of claim 13 wherein the interactive area is a three dimensional region.

21. The system of claim 13 wherein the directed audio stream is a narrow sound beam that is attenuated outside the interactive area.

22. The system of claim 13 wherein the sound of the directed audio stream is audible by a person only if the person is within the interactive area.

23. The system of claim 13 wherein the sound of the directed audio stream is audible by only one person within the interactive area.

24. The system of claim 13 further comprising a motorized mirror responsive to the control information and configured to reflect the directed beam within the interactive area.

25. A method f or directing an interactive beam, the method comprising:

capturing information using an image detection system, wherein the information captured by the image detection system includes information relating to unencumbered actions taken by a person within an interactive area, the unencumbered actions including those actions omitting a tracking or transmission device;

processing the information to generate a classification image that includes foreground and background information;

generating control information based upon the classification image, the control information including information related to interaction with a video image displayed in a directed beam;

projecting one or more directed beams within the interactive area using a projector configured to use the control information to control the one or more directed beams, the one or more of the directed beams including a video image; and

delivering sound to the interactive area using a directed audio stream responsive to the control information.

26. The method of claim 25, wherein the unencumbered actions taken by the person include natural movements of the person.

27. The method of claim 25, wherein the unencumbered actions taken by the person include actions taken by the person with respect to the video image.

28. The method of claim 25, wherein the video image represents an intelligent virtual entity.

29. The method of claim 25, wherein the directed audio stream is only audible by a person within the interactive area.

30. The method of claim 25, wherein the background and foreground information is used to identify a background of the interactive area and the person, the background and foreground information included in the control information such that at least one of the one or more directed beams are directed only within the background of the interactive area.

31. The method of claim 25 wherein at least one of the one or more directed beams includes a spotlight that follows the person within the interactive area.

32. The method of claim 25 wherein the interactive area is a three-dimensional region.