Three-dimensional (3D) video presentation system providing interactive 3D presentation with personalized audio responses for multiple viewers

• US 5,682,196 A
• Filed: 06/22/1995
• Issued: 10/28/1997
• Est. Priority Date: 06/22/1995
• Status: Expired due to Term

• Current Assignee: OpenTV, Inc. (Kudelski SA)
• Original Assignee: ACTV, Inc. (Kudelski SA)
• Inventors: Freeman, Michael J.
• Primary Examiner(s): Burgess, Glenton B.
• Application Number:
  US08/493,845
• Time in Patent Office: 859 Days
• Field of Search: 348/12, 348/13, 348/14, 348/19, 348/20, 348/40, 348/42, 348/39, 348/36, 348/38, 348/51, 395/118, 395/119, 395/155, 395/161, 273/438
• US Class Current: 725/139
• CPC Class Codes: A63F 2300/409 Data transfer via television network
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

The system of the present invention provides actual interactive choices to members of an audience in the form of three dimensional (3D) objects in space, and after each member of the audience reaches out at, points at, or looks at the 3D object of choice, the system responds and alters the audio and/or video feedback to each member. Specifically, a 3D video production is presented on a screen and at several points during the presentation a character or person, appearing on the screen, requests each user to respond to a question by physically selecting one of several possible 3D objects, the 3D objects appearing through the 3D effect to be floating directly in front of each user. The 3D answer options could be three 3D characters, for example. Selection of one of these objects is facilitated through a unique user interface unit, embodied in either a helmet, gun, or wand configuration. Each of these alternative user interface units allow the interactive selection to be made by physical gestures. The user interface unit is comprised of a detection device, a processor and associated circuitry, and attached headphones. Immediately upon making a selection, the user interface unit determines the choice made by the user, matches the choice with a distinct prerecorded audio feedback response, and presents to the user a distinct and individualized audio response. These personalized feedback responses are seamlessly communicated to each user through a set of headphones, and thus, amount to minimally perceived alterations from the common audio presentation. Interactive realism is enhanced through the preferred lip synching of the audio feedback response to the video character'"'"'s mouth movements.

Claims

1. An interactive video system for presenting a three dimensional video presentation, comprising:

a means for displaying a three dimensional video presentation, the presentation comprising a common audio and, at predetermined times, at least two selectable three dimensional video image options;

a means for selecting one of the three dimensional video image options;

a means, connected to the selecting means, for determining an appropriate audio feedback response, the audio feedback response chosen based on the selected three dimensional video image option; and

a means, connected to the determining means, for presenting the appropriate audio feedback response to a user, wherein the appropriate audio feedback response results in audio which is personalized to the individual user.

2. The interactive video system of claim 1, wherein the selecting means comprises:

a means for interacting with the three dimensional video presentation, the interacting means having an output, wherein the user is prompted to interact with the three dimensional video presentation and the user interactively responds by selecting a three dimensional video image option; and

a means, receiving one or more signals from the output of the interacting means, for detecting the three dimensional video image option pertaining to the user'"'"'s interactive response.

3. The interactive video system of claim 2, wherein the interacting means comprises:

a transmitter, located at the front of a movie theater, for emitting a reference beacon signal;

a helmet, having an inner surface and an outer surface, comprising;

a partition, connected to the helmet, protruding from the center of the helmet outer surface;

a first receiving device, connected to the helmet, extending outward from the helmet outer surface and to the left of the partition, wherein the first receiving device produces a detectable output signal when the first receiving device receives the reference beacon signal unobstructed from the transmitter, the receipt of the reference beacon signal being a function of the viewer head orientation;

a second receiving device, connected to the helmet, extending outward from the helmet outer surface and to the right of the partition, wherein the second receiving device produces a detectable output signal when the second receiving device receives the reference beacon signal unobstructed from the transmitter, and wherein the second receiving devices presents no output signal when no reference beacon signal is received due to blockage of the reference beacon signal by the partition.

4. The interactive video system of claim 2, wherein the interacting means comprises:

a transmitter, located at the front of a movie theater, for emitting a reference beacon signal;

a pointing device, the pointing device having a connecting surface, comprising;

a partition, attached to the connecting surface, protruding from the center of the connecting surface;

a first receiving device, connected to the connecting surface, extending outward from the connecting surface and to the left of the partition, wherein the first receiving device produces a detectable output signal when the first receiving device receives the reference beacon signal unobstructed from the transmitter, the receipt of the reference beacon signal being a function of the direction of the pointing device; and

a second receiving device, connected to the connecting surface, extending outward from the connecting surface and to the right of the partition, wherein the second receiving device produces a detectable output signal when the second receiving device receives the reference beacon signal unobstructed from the transmitter, and wherein the second receiving devices presents no output signal when no reference beacon signal is received due to blockage of the reference beacon signal by the partition.

5. The interactive video system of claim 2, wherein the detecting means comprises:

a means, receiving one or more signals from the output of the interacting means, for measuring the voltage assodated with the signals;

a means, connected to the voltage measuring means, for converting the voltages to digital values;

a means, connected to the converting means, for processing the digital values to determine the selected three dimensional video image option.

7. The interactive video system of claim 3, wherein the selecting means comprises:

a means, connected to the first and second receiving devices, for sensing the orientation of the user'"'"'s head in relation to the selected three dimensional video image option, wherein head orientation is determined based on the output of the first and second receiving devices, the head orientation indicated as being towards the left of the center of the theater when the second receiving device presents the detectable output signal and the first receiving means presents no output signal, the head orientation indicated as being directed towards the center of the theater when the first and second receiving devices present the detectable output signals, and the head orientation indicated as being to the right of the center of the theater when the first receiving device presents the detectable output signal and the second receiving device presents no output signal.

8. The interactive video system of claim 4, wherein the selecting means comprises:

a means, connected to the first and second receiving devices, for sensing the orientation of the user'"'"'s head in relation to the selected three dimensional video image option, wherein head orientation is determined based on the output of the first and second receiving devices, the head orientation indicated as being towards the left of the center of the theater when the second receiving device presents the detectable output signal and the first receiving means presents no output signal, the head orientation indicated as being directed towards the center of the theater when the first and second receiving devices present the detectable output signals, and the head orientation indicated as being to the right of the center of the theater when the first receiving device presents the detectable output signal and the second receiving device presents no output signal.

6. An interactive theater video system for presenting a three dimensional video presentation, comprising:

a means for displaying a three dimensional video presentation, comprising a common audio and, at predetermined times, at least one three dimensional video image option;

a means for selecting one of at least two selectable three dimensional video image options, comprising;

a means for interacting with the three dimensional video presentation, the interacting means having an output, wherein a user is prompted to interact with the three dimensional video presentation and the user interactively responds by picking a three dimensional image option; and

a means, connected to and receiving signals from the output of the interacting means, for detecting the three dimensional image option pertaining to the user'"'"'s interactive response;

a means, connected to the selection means, for determining an appropriate audio feedback response, the audio feedback response chosen based on the selected three dimensional video image option; and

a means, connected to the determining means, for presenting the appropriate audio feedback response to the viewer, wherein the appropriate audio feedback response results in an alteration from the common audio which is personalized to the individual user.

9. A user interface unit for responding to a three dimensional video presentation, the presentation comprising a common audio and, at predetermined times, at least two three dimensional video image options, comprising:

a means for selecting one of at least two three dimensional video image options, comprising;

a means for interacting with the three dimensional video presentation, the interacting means having an output, wherein a user is prompted to interact with the three dimensional video presentation and the user interactively responds by picking a three dimensional video image option; and

a means, connected to and receiving signals from the output of the interacting means, for detecting the three dimensional video image option pertaining to the user'"'"'s interactive response;

a means, connected to the selecting means, for determining an appropriate audio feedback response, the audio feedback response chosen based on the selected three dimensional video image option; and

a means, connected to the determining means, for presenting the appropriate audio feedback response to the user, wherein the appropriate audio feedback response results in an alteration from the common audio which is personalized to the individual user.

10. An interactive video system using three dimensional images in a movie theater type environment wherein individualized audio interactivity is provided in conjunction with presentations of the three dimensional image, comprising:

an infrared transmitter, located at the front of a movie theater, for transmitting an identification signal;

a means, located at the front of the movie theater, for presenting more three dimensional images;

at least one helmet having an outer and inner surface, comprising;

a partition, connected to the helmet, protruding from the center of the helmet outer surface;

a first receiving device, connected to the helmet, extending outward from the helmet outer surface on the left side of the partition, wherein the first receiving device presents an output signal when the first receiving device receives the identification signal unobstructed from the infrared transmitter and the first receiving device presents no output signal when no identification signal is received due to blockage of the identification signal by the partition;

a second receiving device, connected to the helmet, extending outward from the helmet outer surface on the right side of the partition, wherein the second receiving device presents an output signal when the second receiving device receives the identification signal unobstructed from the infrared transmitter and the second receiving device presents no output signal when no identification signal is received due to blockage of the identification signal by the partition;

a means, connected to the first and second receiving devices, for sensing the orientation of a user'"'"'s head in relation to the presenting means, wherein head orientation is determined based on the output of the first and second receiving devices, the head orientation indicated as being towards the left of the center of the theater when the second receiving device presents an output signal and the first receiving device presents no output signal, the head orientation indicated as being directed towards the center of the theater when the first and second receiving devices present the detectable output signals, and the head orientation indicated as being to the right of the center of the theater when the first receiving device presents an output signal and the second receiving device presents no output signal;

a means for receiving a plurality of separate audio channels;

a means, connected to the receiving means, for selecting between the separate audio channels based on the direction of the head orientation; and

a means for presenting the selected audio channel to the user.

11. An interactive video method for presenting a three dimensional video presentation, comprising:

displaying a three dimensional video presentation, comprising a common audio and, at predetermined times, at least two selectable three dimensional video image options;

selecting one of the three dimensional video image options;

determining an appropriate audio feedback response, the audio feedback response chosen based on the selected three dimensional video image option; and

presenting the appropriate audio feedback response to the user, wherein the appropriate audio feedback response results in audio which is personalized to the individual user.