System and method for control of audio field based on position of user

• US 7,613,313 B2
• Filed: 01/09/2004
• Issued: 11/03/2009
• Est. Priority Date: 01/09/2004
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Juppi, Norman Paul, Iyer, Subramonlam Narayana, Slayden, April Marie
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): Paul, Disler
• Application Number:
  US10/754,933
• Publication Number:
  US 20050152565A1
• Time in Patent Office: 2,125 Days
• Field of Search: 381104-109, 381/77, 381 80- 82, 381/303, 381/306, 381/309, 381/56, 381 58- 59, 381/304, 700/245, 348/14, 348 1407- 1409, 348169-172, 348/208.14, 348/14.1
• US Class Current: 381/306
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

A system and method for control of an audio field based on the position of the user. In one embodiment, a system and a method for audio reproduction are provided. One or more audio signals are obtained that are representative of sounds occurring at a first location. The audio signals are communicated from the first location to a second location of a person. A position of the head of the person is determined in at least two dimensions at the second location by obtaining at least one image of the person. An audio field is reproduced at the second location from the audio signals, wherein sounds emitted by each means for reproducing are controlled based on the position of the head of the person. This may include controlling the volume of reproduction by each of a plurality of sound reproductions means based on the position of the head of the person. In another embodiment, delay associated with of reproduction may be controlled based on the position of the head of the person.

Claims

1. A system for audio reproduction comprising:

means for obtaining one or more audio signals that are representative of sounds occurring at a first location;

means for communicating the audio signals from the first location to a second location of a person;

means for determining a position of the head of the person in at least two dimensions at the second location by imaging the person; and

plural means for reproducing an audio field at the second location from the audio signals, wherein sounds emitted by each means for reproducing are controlled based on the position of the head of the person, wherein the plural means for reproducing are arranged spaced apart and directed toward a center and wherein a particular one of the audio signals applied to a particular one of the means for reproducing is time delayed based on the position of the person to maintain equal arrival times of the sounds to the person as the person moves around to different locations at the second location, wherein a perceived volume of the sound by the person is equal and independent of the position of the head of the person as the person moves around the second location.

2. The system according to claim 1, wherein the audio signals applied to the plural means for reproducing are multiplied by a ratio of a horizontal distance between the plural means for reproducing and the head of the person to a horizontal distance between the plural means for reproducing and the center.

3. The system according to claim 1, wherein said means for determining repeatedly determines the position of the person and wherein said means for reproducing is continuously controlled in response to changes in the position of the head of the person.

4. The system according to claim 1, wherein each of the plural means for reproducing comprises a speaker.

5. The system according to claim 1, wherein each of the plural means for reproducing comprises at least a pair of vertically arranged speakers.

6. The system according to claim 1, wherein the position of the person is determined in three dimensions, including horizontal and vertical directions.

7. The system according to claim 6, wherein each of the plural means for reproducing comprises at least a pair of vertically arranged speakers.

8. The system according to claim 7, wherein the volume of reproduction by each of a pair of vertically arranged speakers is based on the position of the head of the person in the vertical direction.

9. The system according to claim 8, wherein when the head of the person is positioned below a vertical threshold, substantially all of the sound reproduced by the pair of the speakers is reproduced by a vertically lower one of the pair and wherein when the head of the person is positioned above the vertical threshold, substantially all of the sound reproduced by the pair of speakers is reproduced by a vertically higher one of the pair.

10. The system according to claim 9, wherein the threshold is hysteretic.

11. The system according to claim 9, wherein when the head of the person transitions across the threshold, transitioning of the sounds from one speaker of the pair to the other is gradual.

12. The system according to claim 1, wherein the plural means for reproducing are arranged spaced apart and directed toward a center and wherein a particular one of the audio signals applied to a particular one of the means for reproducing is multiplied by a ratio of a horizontal distance between the particular means for reproducing and the head of the person to a horizontal distance between the particular means for reproducing and the center.

13. The system according to claim 1, wherein the particular one of the audio signals is multiplied by a factor related to the position to determine a desired signal level for the particular one of the audio signals and when the desired signal level is substantially different from a current signal level gradually adjusting the current signal level toward the desired signal level.

14. The system according to claim 13, wherein the sounds are digitally sampled at a sampling rate and the current signal level is incrementally adjusted in uniform increments, one adjustment for each of a predetermined number of samples.

15. The system according to claim 14, wherein the increment is related to a difference between the desired signal level and the current signal level.

16. The system according to claim 1, wherein the particular one of the audio signals is time delayed by:

computing a desired delay by determining a distance between the head of the person and the particular means for reproducing to determine a result and dividing the result by the speed of sound; and

when the desired delay is substantially different from a current delay, gradually adjusting the current delay toward the desired delay.

17. The system according to claim 16, wherein the sounds are digitally sampled at a sampling rate and the current delay is gradually adjusted by approximately between three and ten percent of the sampling rate.

18. The system according to claim 1, further comprising means for displaying visual images to the user including a source of the sounds.

19. A method for audio reproduction comprising:

obtaining one or more audio signals that are representative of sounds occurring at a first location;

communicating the audio signals from the first location to a second location of a person;

determining a position of the head of the person in at least two dimensions at the second location by imaging the person;

reproducing an audio field at the second location from the audio signals, wherein sounds emitted by each of plural means for reproducing are controlled based on the position of the head of the person, wherein a particular one of the audio signals is multiplied by a factor related to the position to determine a desired signal level for the particular one of the audio signals and when the desired signal level is substantially different from a current signal level gradually adjusting the current signal level toward the desired signal level; and

modifying the audio signals to achieve a time delay of the sounds emitted by the plural means for reproducing to maintain equal arrival times of the sounds to the person as the person moves around to different locations at the second location, wherein the audio signals applied to the plural means for reproducing are multiplied by a ratio of a horizontal distance between the plural means for reproducing and the head of the person to a horizontal distance between the plural means for reproducing and a center.

20. The method according to claim 19, wherein delay associated with volume of reproduction by each means for reproducing is controlled based on the position of the head of the person.

21. The method according to claim 19, wherein the audio field is controlled based on the position of the person'"'"'s head in three dimensions.

22. A telepresence system comprising:

a display booth having a plurality of cameras for obtaining images of a person within the display booth;

a computer system for determining a position of the head of the person in at least two dimensions from the images of the person; and

a plurality of speakers for reproducing an audio field at the display booth, wherein the audio field is controlled based on the position of the head of the person, wherein the plurality of speakers are arranged spaced apart and directed toward a center and wherein audio signals applied to the plurality of speakers are multiplied by a ratio of a horizontal distance between the plurality of speakers and the head of the person to a horizontal distance between the plurality of speakers for reproducing and the center.

23. The telepresence system according to claim 22, wherein volume of reproduction by each speaker is controlled based on the position of the head of the person.

24. The telepresence system according to claim 22, wherein delay associated with volume of reproduction by each speaker is controlled based on the position of the head of the person.

25. The telepresence system according to claim 22, wherein the audio field is controlled based on the position of the person'"'"'s head in three dimensions.