Chat room system to provide binaural sound at a user location

• US 8,627,213 B1
• Filed: 08/10/2004
• Issued: 01/07/2014
• Est. Priority Date: 08/10/2004
• Status: Active Grant

• Current Assignee: Valtrus Innovations Limited (f/k/a Dolya Holdco 9 Limited) (Key Patent Innovations Limited)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Jouppi, Norman Paul, Iyer, Subramoniam N.
• Primary Examiner(s): Kim, Matt
• Assistant Examiner(s): Pan, Yongjia
• Application Number:
  US10/915,939
• Time in Patent Office: 3,437 Days
• Field of Search: 715/753, 715/757, 715/758, 715/848, 709204-207
• US Class Current: 715/758
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04R 5/04 Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: H04S 1/002 Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution control circuits for electronic adaptation of the sound field H04S7/30
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

A chat room system is provided that includes sending a signal representative of a sound at a first user location to a second user location and establishing, in a chat room, a virtual first user location and a virtual second user location. It further includes establishing the orientation of a listening system at the second user location and processing the signal, using the orientation of the listening system, at a plurality of levels of realism to provide a binaural sound at the second user location having an analogous spatial relationship between the second user location and the first user location as the virtual spatial relationship between the virtual second user location and the virtual first user location.

Claims

1. A chat room method comprising:

sending a signal representative of a sound at a first user location to a second user location;

establishing, in a chat room, a first user at a virtual first user location and a second user at a virtual second user location, wherein chat room acoustics are a function of a number of users in the chat room such that increasing the number of users in the chat room reduces accuracy of a sound field simulated in the chat room;

processing the signal at one or more of a plurality of levels of realism related to sound to provide a binaural sound at the second user location having an analogous spatial relationship between the second user location and the first user location as a virtual spatial relationship between the virtual second user location and the virtual first user location; and

selecting a level of realism from the plurality of levels of realism related to sound based on at least one of a number of users in the chat room and a load on computational resources hosting the chat room system,

wherein for a first number of users a first level of realism is selected, processing the signal comprises using a frequency-independent sound model with frequencies that are attenuated or delayed,

wherein for a second number of users that is less than the first number of users a second level of realism is selected, processing the signal comprises using a frequency-dependent sound model with frequencies that are attenuated or delayed, and

wherein for a third number of users that is less than the second number of users a third level of realism is selected, processing the signal comprises using a reflection sound model, wherein a reflection from a structure or object is calculated.

2. The method as claimed in claim 1 further comprising:

sending a plurality of signals representative of additional user locations to the second user location;

establishing, in the chat room, virtual additional user locations; and

processing less than all the plurality of signals to provide the binaural sound.

3. The method as claimed in claim 1 further comprising:

sending a plurality of signals representative of additional user locations to the second user location;

establishing, outside the chat room, virtual additional user locations;

establishing an entry into the chat room; and

processing less than all the plurality of signals and simulating sound through the entry into the chat room to provide the binaural sound.

4. The method as claimed in claim 1 further comprising:

sending a plurality of signals representative of additional user locations to the second user location; and

processing the plurality of signals to provide the binaural sound at one of a plurality of levels of realism using head-related transfer functions and to convolve the plurality of signals at different levels of accuracy.

5. The method as claimed in claim 1 further comprising:

sending a plurality of signals representative of additional user locations to the second user location; and

processing the plurality of signals to provide the binaural sound at one of the plurality of levels of realism using the reflection sound model for at least one of less than all of the plurality of signals, less than full accuracy modeling of all of the plurality of signals, and a combination thereof.

6. The method as claimed in claim 1 wherein processing the signal further comprises echo cancellation for sound at the second user location due to sound from the second user location to the first user location and back to the second user location.

7. The method as claimed in claim 1 further comprising:

sending a plurality of signals representative of additional user locations to the second user location;

establishing, in a chat room, virtual additional user locations representative of the additional user locations; and

establishing a cone of silence around the virtual second user location and at least one of the virtual additional user locations to allow signals just between the second user location and at least one of the additional user locations corresponding to the at least one of the virtual additional user locations.

8. The method of claim 1, wherein if the first level of realism is selected, processing the signal comprises using the frequency-independent sound model and not using the frequency-dependent sound model and the reflection sound model.

9. The method of claim 1, wherein if the second level of realism is selected, processing the signal comprises using both the first level and the second level of realism and not the third level of realism.

10. The method of claim 1, wherein if the third level of realism is selected, processing the signal comprises using the first level, the second level, and the third level of realism.

11. A chat room system comprising:

a sending system for sending a signal representative of a sound at a first user location to a second user location;

a listening system for providing binaural sound at the second user location; and

a computer system for establishing, in a chat room, wherein chat room acoustics are a function of a number of users in the chat room such that increasing the number of users in the chat room reduces accuracy of a sound field simulated in the chat room, a first user at a virtual first user location and a second user at a virtual second user location, the computer system for processing the signal at one or more of a plurality of levels of realism related to sound to provide the binaural sound at the second user location having an analogous spatial relationship between the second user location and the first user location as a virtual spatial relationship between the virtual second user location and the virtual first user location, and selecting a level of realism from the plurality of levels of realism related to sound based on at least one of a number of users in the chat room and a load on computational resources hosting the chat room system,

wherein for a first number of users a first level of realism is selected and the computer system uses a frequency-independent sound model to provide the binaural sound at the second user location with frequencies that are attenuated or delayed,

wherein for a second number of users that is less than the first number of users a second level of realism is selected and the computer system uses a frequency-dependent sound model to provide the binaural sound at the second user location with frequencies that are attenuated or delayed, and

wherein for a third number of users that is less than the second number of users a third level of realism is selected and the computer system uses a reflection sound model to provide the binaural sound at the second user location, wherein a reflection from a structure or object is calculated.

12. The system as claimed in claim 11 further comprising:

additional computer systems for sending a plurality of signals representative of additional user locations to the second user location and for establishing, in the chat room, a plurality of additional user locations each providing a plurality of signals; and

the computer system is for processing less than all the plurality of signals to provide the binaural sound.

13. The system as claimed in claim 11 further comprising:

additional computer systems for;

sending a plurality of signals representative of additional user locations to the second user location;

establishing, outside the chat room, virtual additional user locations;

establishing an entry into the chat room; and

the computer system for processing less than all the plurality of signals and simulating sound through the entry into the chat room to provide the binaural sound.

14. The system as claimed in claim 11 wherein the computer system further provides for processing the signal at one of the plurality of levels of realism using a sound model calculating at least one of:

an interaural time difference, an interaural level difference, an angle-dependent output level, a distance level dependence;

a head-related transfer function, a human voice transfer function, a distance sound transmission transfer function; and

a combination thereof.

15. The system as claimed in claim 11 further comprising:

additional computer systems for sending a plurality of signals representative of additional user locations to the second user location; and

the additional computer systems processing the plurality of signals to provide the binaural sound at one of a plurality of levels of realism using head-related transfer functions and to convolve the plurality of signals at different levels of accuracy.

16. The system as claimed in claim 11 wherein the computer system further provides for processing the signal at one of the plurality of levels of realism and uses at least one of:

an interaural time difference, an interaural level difference, an angle-dependent output level, a distance level dependence;

a head-related transfer function processing for a second level of processing;

a head-related transfer function, a human voice transfer function, a distance sound transmission transfer function;

chat room reflection modeling, human torso reflection modeling, a multiple reflection; and

a combination thereof.

17. The system as claimed in claim 11 further comprising:

additional computer systems for sending a plurality of signals representative of sounds at a plurality of additional user locations to the second user location; and

the computer system for processing the plurality of signals to provide the binaural sound at one of the plurality of levels of realism using at least one of chat room reflection modeling for at least one of less than all of the plurality of signals, less than full accuracy modeling of all of the plurality of signals, and a combination thereof.

18. The system as claimed in claim 11 wherein the computer system further provides for echo cancellation for sound at the second user location due to sound from the second user location to the first user location and back to the second user location.

19. The system as claimed in claim 11 further comprising:

additional computer systems for;

sending a plurality of signals representative of sounds at a plurality of additional user locations to the second user location;

for establishing, in a chat room, virtual additional user locations representative of the plurality of additional user locations; and

the computer system for establishing a cone of silence around the virtual second user location and at least one of the virtual additional user locations to allow signals just between the second user location and the at least one of the additional user locations corresponding to the at least one of the virtual additional user locations.

20. The system of claim 11, wherein if the first level of realism is selected, processing the signal comprises using the frequency-independent sound model and not using the frequency-dependent sound model and the reflection sound model.

21. The system of claim 11, wherein if the second level of realism is selected, processing the signal comprises using both the first level and the second level of realism and not the third level of realism.

22. The system of claim 11, wherein if the third level of realism is selected, processing the signal comprises using the first level, the second level, and the third level of realism.