INTERACTIVE VIDEO PRESENTATION

• US 20100037273A1
• Filed: 08/07/2009
• Published: 02/11/2010
• Est. Priority Date: 08/07/2008
• Status: Abandoned Application

• Current Assignee: Respondr, LLC
• Original Assignee: Respondr, LLC
• Inventors: Dressel, Brian, Nyboer, Peter
• Application Number:
  US12/538,075
• Publication Number:
  US 20100037273A1
• Time in Patent Office: Days
• US Class Current: 725/105
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

A system in accordance with the invention includes an interactive video system that creates immersive multimedia experiences through responsive physical interaction and audience participation. The system transform floors, walls, screens, staging and other surfaces and video output devices into an interactive experience. Motion tracking and projection systems enable the combination of a background message to be manipulated in response to audience participation, including human body movements. Included within the system is a software application with a setup and programming user interface, used in conjunction with external hardware to which it is connected. External hardware includes, in one basic embodiment, one or more video projectors, one or more video cameras, and one or more computers. The computer receives input from the video cameras, and modifies the projected video based upon that input. A single system unit can be networked to other system units on a LAN, WAN, or global network.

Claims

1. A system for modifying a background image on a display screen based upon movement of a human user, the human user positioned at least partly within a stage area, comprising:

at least one computer system having memory storage and a processor;

at least one display surface;

at least one display output device connectable to said at least one computer system and operable to output a visible image to appear on said at least one display surface, said visible image created using the processor of said at least one computer system, said visible image outputted from said memory storage to said at least one display output device by said at least one computer system;

at least one tracking device, connectable to said computer, operable to detect a change in a position of a plurality of points defined by a shape of the part of the human within the stage area over time without a requirement for contact between the human user and the tracking device, the tracking device further operable to electronically transmit information pertaining to the change in a position to the computer;

at least one background image storable within said memory storage;

a software application at least partially stored within said memory storage, executable by said computer system, and operable to change said at least one background image based upon said information transmitted from said at least one tracking device and one or more visual effects, whereby said change to said at least one background image corresponds to a movement of the part of the human within the stage area, said software application further includes a scheduling interface enabling the selection of a plurality of background images, visual effects, tracking devices, and output display devices, selectable at designated time intervals.

2. The system of claim 1, wherein said display output device is selected from the group consisting of:

LCD display, LED display, CRT display, projected display, semi-transparent display, rear projection display, multitouch display, FTIR display.

3. The system of claim 1, wherein said tracking device is selected from the group consisting of:

video camera, video camera with visible light filter, video camera and IR light source, broken beam detector, motion sensor, IR detector, proximity detector, photography camera, multitouch device, FTIR device.

4. The system of claim 1, wherein at least two tracking devices are used, and whereby said plurality of points detected correspond to positions of said plurality of points in three dimensions.

5. The system of claim 1, wherein said visual effects are selected from the group consisting of:

liquid/gel, reveal, application, scrub, digital feedback, overlay, Flash, Unity3d, blur, fizz bubbles, menus, flies, bouncing ball, eyes, ice, particles, tiles, fire, tracers.

6. The system of claim 1, wherein a plurality of display surfaces are positionable adjacent to one another to form an enlarged display surface, and wherein said at least one display output device is operable to output a visible image on each of said plurality of display surfaces to produce a single coordinated image on said enlarged display surface.

7. The system of claim 1, said at least one computer comprises a plurality of computers, and wherein said plurality of computers are operable to be connected one to another in a network.

8. The system of claim 1, further comprising at least one interface device operably connectable to said at least one computer and said at least one tracking device, whereby a plurality of tracking devices are connectable to a single computer system.

9. The system of claim 1, wherein all elements of the system are connected to a single housing.

10. The system of claim 9, wherein said housing is selected from the group consisting of:

coffee table, low table, chair level table, tall standing table, lounge bar, kiosk, wall mounted unit, ceiling mounted unit, floor mounted unit.

11. The system of claim 9, further comprising a stalk, connected to said housing unit and having a proximal end and a distal end, wherein said at least one tracking device is movably connectable to said distal end.

12. The system of claim 1, wherein at least one of said at least one tracking device is contained within a housing, and said housing includes a mirror, said mirror movably positionable in connection with said housing, said mirror operable to reflect an image of the stage area to said at least one tracking device.

13. The system of claim 1, further including at least one transmission device operable to transmit wave energy, said wave energy detectable by said at least one tracking device, said wave energy operable to pass from said at least one transmission device to said stage area, a portion of said transmitted wave energy reflectable from said stage area to said at least one tracking device, said reflected portion changed by the part of the human within said stage area.

14. The system of claim 13, wherein said wave energy is infrared light.

15. The system of claim 13, wherein said at least one transmission device and said at least one tracking device are movably connectable to each other, whereby at least one of said at least one tracking device or at least one of said at least one transmission device may be positioned whereby transmitted energy may be directed to the stage area and reflected from said stage area to said at least one tracking device.

16. The system of claim 1, wherein at least one of said at least one computer system is connected to a network, and wherein said software application is responsive to instructions transmitted over said network.

17. The system of claim 16, wherein said scheduling interface may be controlled at a point on the network remote from said at least one computer.

18. The system of claim 1, further comprising a configuration interface enabling the adjustment of at least one tracking device to match a perspective of at least one display output device.

19. The system of claim 18, wherein said configuration interface enables the warping of a displayed image of at least one display surface.

20. A method of modifying a background image on a display screen based upon movement of a human user, the human user positioned at least partly within a stage area, comprising:

providing at least one computer system having memory storage and a processor;

positioning at least one display surface where it may be viewed;

connecting at least one display output device to the at least one computer system, the display output device operable to output a visible image to appear on the at least one display surface, the visible image created using the processor of the at least one computer system, the visible image outputted from the memory storage to the at least one display output device by the at least one computer system;

connecting at least one tracking device to the computer, the at least one tracking device operable to detect a change in a position of a plurality of points defined by a shape of the part of the human within the stage area over time without a requirement for contact between the human user and the tracking device, the tracking device further operable to electronically transmit information pertaining to the change in a position to the computer;

loading at least one background image into the memory storage;

executing a software application by the computer system, the software application at least partially stored within the memory storage, the software application operable to change the at least one background image based upon the information transmitted from the at least one tracking device and one or more visual effects, whereby the change to the background image corresponds to a movement of the part of the human within the stage area, the software application further operative to schedule the selection of a plurality of background images, visual effects, tracking devices, and output display devices, selectable at designated time intervals.