Method and apparatus for virtual auditorium usable for a conference call or remote live presentation with audience response thereto

• US 9,131,016 B2
• Filed: 09/11/2007
• Issued: 09/08/2015
• Est. Priority Date: 09/11/2007
• Status: Active Grant

• Current Assignee: eJamming, Inc.
• Original Assignee: eJamming, Inc.
• Inventors: Glueckman, Alan Jay, Kantor, Gail Susan, Redmann, William Gibbens
• Primary Examiner(s): Tsang, Fan
• Assistant Examiner(s): Pope, Kharye
• Application Number:
  US11/900,232
• Publication Number:
  US 20090067349A1
• Time in Patent Office: 2,919 Days
• Field of Search: 379/202.01, 379/203.01, 379/204.01, 379/205.01, 379/206.01, 455/416, 370/260, 370/261, 370/262, 370/263, 370/264, 370/265, 348/14
• US Class Current: 1/1
• CPC Class Codes: H04L 65/1059 End-user terminal functionalities specially adapted for real-time communication
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/4053 without floor control

Abstract

A method and apparatus are disclosed for providing a virtual auditorium for a remote, live performance to a remote, distributed audience, wherein the performers receive the reaction of the audience members in substantially real time. The live performance can itself be distributed geographically, as taught in the prior art, and may be multimedia in nature, for example audio (monophonic, stereo, or multi-channel) can be augmented by images, video, MIDI, text (e.g., commentary, lyrics), etc. Further, the distributed audience members can receive each other'"'"'s reaction, also in substantially real time, whereby the virtual auditorium is created wherein the distributed audience members constitute a virtual assembly.

The same virtual auditorium, sans performers, can be used as a venue to conduct a conference call of arbitrary size without the expense of a central voice bridge.

Claims

1. A first station for use in a virtual auditorium, in which the first station is a first node, the first station comprising:

an input, said input accepting a first signal comprising audio from a participant;

a connection to a network, said first station having a configuration to communicate with at least a second and third node through said network;

an output, said output presenting to said participant at least a portion of a second signal comprising audio, the second signal received from the second node, said output further presenting to said participant at least a portion of a third signal comprising audio, the third signal received from the third node; and

,

a mixer, said mixer providing a fourth signal representative of at least the first and second signal, said first station sending the fourth signal to the third node, said mixer providing a fifth signal representative of at least the first and third signal, said first station sending the fifth signal to the second node;

wherein the configuration represents the position of the first node as being directly connected to the second and third nodes in a hierarchy and is provided by an organizing entity comprising a structured overlay network of which the first node is member, the structured overlay network comprising a distributed hash table, the configuration based on a query of the distributed hash table; and

,

one of the second and third signals comprises at least a portion of a sixth audio signal from a fourth node in the hierarchy that is not directly connected in the hierarchy to the first node.

2. The station of claim 1 wherein said input comprises a microphone and said output comprises at least one selected from the group of a headphone and a speaker.

3. The station of claim 2 wherein said input comprises a coder and said output comprises a decoder.

4. The station of claim 3 wherein said decoder comprises at least one CODEC selected from the group consisting of MP3 and AAC.

5. The station of claim 3 wherein said decoder comprises a CODEC optimized for VoIP.

6. The station of claim 3 wherein said second signal comprises an audio signal coded compatibly for said decoder.

7. The station of claim 6 wherein said second signal is stereo.

8. The station of claim 3 wherein said second signal is stereo.

9. The station of claim 2 wherein said second signal is stereo.

10. The station of claim 1 wherein said fourth signal comprises a copy of said second signal.

11. The station of claim 1 wherein said fourth signal comprises a sum including an attenuated copy of said second signal.

12. The station of claim 11 wherein said first signal is included in said sum.

13. The station of claim 1 wherein a latency between said second signal and said fourth signal is less than one second.

14. The station of claim 1 wherein a latency between said first signal and said fourth signal is less than one second.

15. A virtual auditorium comprising a plurality of stations of claim 1, wherein the configurations corresponding to each of said plurality of stations collectively produce an interconnection of said plurality of stations such that said first signal produced at any one of said plurality of stations is represented in the output corresponding to substantially every other one of said plurality of stations.

16. The virtual auditorium of claim 15, wherein said interconnection is a conference call.

17. The virtual auditorium of claim 15, wherein the first signal corresponding to a one of said plurality of stations comprises a performance and the corresponding output represents an audience response to said performance.

18. The virtual auditorium of claim 17, wherein said performance comprises a distributed performance.

19. The virtual auditorium of claim 15 wherein the configuration is provided through the network by an organizing entity that charges a fee.

20. The virtual auditorium of claim 15 wherein the configuration is provided through the network by an organizing entity that verifies that at least one of said participant and corresponding station has a subscription.

21. The virtual auditorium of claim 15 wherein said interconnection is the hierarchy.

22. The virtual auditorium of claim 15 wherein each configuration of each of said plurality of stations is based on the position in a virtual world of a corresponding avatar.

25. A second station for use in the virtual auditorium of claim 1, in which the second station is a fifth node, the second station comprising:

a second connection to the network, said second station configured as being directly connected a sixth node in the hierarchy and to communicate with the sixth node;

a second output for presenting to a second participant an eighth signal comprising audio received from the sixth node;

whereby said fifth node is a leaf node in the virtual auditorium.

26. The second station of claim 25, further comprising:

a second input, said second input accepting a seventh signal from the second participant, said second station sending said seventh signal to said sixth node.

27. The second station of claim 25 wherein the fifth node is the fourth node, the sixth node is the third node, the sixth signal is the seventh signal, and the eighth signal comprises at least a portion of the fourth signal, wherein the eighth signal is mixed by the third node.

28. The second station of claim 25 wherein the sixth node is the first node and the eighth signal comprises a mix of the first, second, and third signals.

29. The virtual auditorium of claim 21, in which, with respect to each first node, the second node is a parent to the first node, and the third node is a child of the first node.

23. A method for providing a virtual auditorium comprising steps of:

a) providing a first station to a participant, the first station having an input, an output, and a connection to a network;

b) joining a structured overlay network having a plurality of stations, the structured overlay network comprising a distributed hash table;

c) configuring the first station with the structured overlay network for communication with a portion of the plurality of stations based on a query of the distributed hash table, the portion of the plurality of stations being directly connected to the first station in a hierarchy;

d) capturing a first signal from the participant with the input;

e) sending at least a portion of said first signal to each directly connected station;

f) receiving a corresponding second signal from each directly connected station, one of the second signals comprising at least a portion of a third signal received by the corresponding second station from a third station not directly connected to the first station in the hierarchy;

g) providing at least a first portion of each second signal to the participant with the output;

h) only when the first station is configured as a non-leaf node in the hierarchy, forwarding from the first station at least a second portion of each second signal to each of the correspondingly different directly connected stations; and

,

wherein the sending (e) of the first signal and forwarding (h) of the second signals by the first station is together as a mix corresponding to each directly connected station;

whereby when steps a)-h) are performed with respect to each participant the hierarchy produces the virtual auditorium.

24. A method for performing to a remote audience comprising the method of claim 23, wherein the signal captured in step d) at a first station is a distributed performance and the signal received in step g) at the first station is a response by the remote audience.

30. A non-transitory computer-readable medium encoded with a computer program usable by the station of claim 23 for performing steps b), c), d), e), f), g), and h).

31. A method for providing a virtual auditorium for a plurality of participants comprising:

a) connecting a first computer to a plurality of second computers through a structured overlay network, the structured overlay network comprising a distributed hash table, the connecting based on a query of the distributed hash table, said first computer comprising an input for capturing audio from a first participant as a first signal, and an output for presenting audio to the first participant;

b) configuring the first computer in a hierarchy managed using the structured overlay network to provide the first signal to at least one second computer related to the first computer as one of a parent and a child in the hierarchy;

c) receiving a second signal from the at least one second computer;

d) presenting the second signal to the first participant with the output;

e) forwarding the second signal to each other second computer when the first computer is a non-leaf node in the hierarchy;

wherein the second signal comprises at least a portion of a third signal from a third computer, the third computer not related to the first computer as one of a parent and a child in the hierarchy.

32. A non-transitory computer-readable medium encoded with a computer program for execution by the first computer to perform steps b), c), d), and e) in the method of claim 31.