Processing Audio Data

• US 20120170767A1
• Filed: 12/28/2011
• Published: 07/05/2012
• Est. Priority Date: 12/29/2010
• Status: Abandoned Application

• Current Assignee: Skype S.Ã R.L. (Microsoft Corporation)
• Original Assignee: Skype S.Ã R.L. (Microsoft Corporation)
• Inventors: Astrom, Henrik, Vos, Koen, Sorensen, Karsten
• Application Number:
  US13/338,968
• Publication Number:
  US 20120170767A1
• Time in Patent Office: Days
• US Class Current: 381/77
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04M 1/2535 adapted for voice communication over an Internet Protocol [IP] network Voice over Internet Protocol (VoIP) network equipment and services H04M7/006; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate

Abstract

Method, user terminal, communication system and computer program product for processing audio data for transmission over a network in a communication session between the user terminal and a further user terminal. Samples of audio data which have a sampling frequency and which provide a digital representation of an analog audio signal are transmitted to the further user terminal in the communication session. During the communication session, an estimate of processing resources available for processing audio data in the communication session is repeatedly determined, and the sampling frequency is dynamically adjusted during the communication session based on the determined estimate of available processing resources.

Claims

1. A method of processing audio data for transmission over a network in a communication session between a first user terminal and a second user terminal, the method comprising:

transmitting samples of audio data which have a sampling frequency and which provide a digital representation of an analog audio signal from the first user terminal to the second user terminal in the communication session;

during the communication session, repeatedly determining an estimate of processing resources available for processing audio data in the communication session; and

dynamically adjusting the sampling frequency during the communication session based on the determined estimate of available processing resources.

2. The method of claim 1 further comprising sampling the analog audio signal at the first user terminal during the communication session to thereby generate said samples of audio data for transmission to the second user terminal.

3. The method of claim 2 wherein said step of sampling the analog audio signal comprises sampling the analog audio signal at the sampling frequency.

4. The method of claim 3 wherein said step of dynamically adjusting the sampling frequency comprises adjusting the frequency at which the analog audio signal is sampled.

5. The method of claim 2 wherein said step of sampling the analog audio signal comprises:

sampling the analog audio signal at an initial sampling frequency to generate intermediate samples of audio data having the initial sampling frequency; and

resampling the intermediate samples of audio data, thereby applying an adjustment to the initial sampling frequency of the audio data to thereby generate said samples of audio data at the sampling frequency.

6. The method of claim 5 wherein said step of dynamically adjusting the sampling frequency comprises adjusting the initial sampling frequency at which the analog audio signal is sampled.

7. The method of claim 5 wherein said step of dynamically adjusting the sampling frequency comprises adjusting the adjustment applied in the resampling step.

8. The method of claim 1 further comprising accessing an audio data file at the first user terminal to thereby retrieve said samples of audio data for transmission to the second user terminal.

9. The method of claim 1 wherein said processing resources comprise processing resources at the first user terminal.

10. The method of claim 1 wherein said processing resources comprise processing resources at a node, other than the first user terminal, which processes audio data in the communication session, and wherein said step of determining an estimate comprises receiving, at the first user terminal from the node, a sample frequency adjustment request based on an estimation of the processing resources available at the node.

11. The method of claim 10 wherein the node is the second user terminal or a network server.

12. The method of claim 1 wherein said step of dynamically adjusting the sampling frequency comprises:

increasing the sampling frequency when the determined estimate of available processing resources increases; and

decreasing the sampling frequency when the determined estimate of available processing resources decreases.

13. The method of claim 1 wherein said step of transmitting said samples of audio data comprises encoding the samples of audio data.

14. The method of claim 1 wherein said step of transmitting said samples of audio data comprises packetizing the samples of audio data into data packets for transmission to the second user terminal.

15. The method of claim 1 wherein the first user terminal is usable by a user and wherein a plurality of processes are executed at the first user terminal during the communication session, the method further comprising:

determining a combined measure of the user'"'"'s experience of said executed processes, wherein said step of dynamically adjusting the sampling frequency is based on the determined combined measure.

16. The method of claim 15 wherein the communication session includes the transmission of audio and video data between the first user terminal and the second user terminal and said plurality of processes comprises (i) a first process for processing the audio data;

and (ii) a second process for processing the video data.

17. The method of claim 1 wherein the communication session is a conference call between a plurality of participants including users of the first and second user terminals, and wherein the conference call is hosted at the first user terminal, the method comprising:

receiving audio data at the first user terminal from each of the participants in the conference call,

wherein said samples of audio data comprise audio data received from each of the participants in the conference call except the user of the second user terminal.

18. The method of claim 17 wherein said step of dynamically adjusting the sampling frequency is based on the number of participants in the conference call.

19. The method of claim 18 wherein said step of dynamically adjusting the sampling frequency comprises:

increasing the sampling frequency when the number of participants in the conference call decreases; and

decreasing the sampling frequency when the number of participants in the conference call increases.

20. The method of claim 1 further comprising determining the available network bandwidth which can be used in said step of transmitting said samples of audio data to the second user terminal, wherein said step of dynamically adjusting the sampling frequency is further based on said determined available network bandwidth.

21. The method of claim 1 wherein the audio data is speech data.

22. A user terminal for processing audio data for transmission over a network in a communication session between the user terminal and a further user terminal, the user terminal comprising:

means for transmitting samples of audio data which have a sampling frequency and which provide a digital representation of an analog audio signal to the further user terminal in the communication session;

means for repeatedly determining, during the communication session, an estimate of processing resources available for processing audio data in the communication session; and

means for dynamically adjusting the sampling frequency during the communication session based on the determined estimate of available processing resources.

23. The user terminal of claim 22 further comprising means for sampling the analog audio signal during the communication session to thereby generate said samples of audio data for transmission to the further user terminal.

24. The user terminal of claim 23 wherein said means for sampling comprises:

means for sampling the analog audio signal at an initial sampling frequency to generate intermediate samples of audio data having the initial sampling frequency; and

means for resampling the intermediate samples of audio data, thereby applying an adjustment to the initial sampling frequency of the audio data to thereby generate said samples of audio data at the sampling frequency.

25. The user terminal of claim 24 wherein said means for adjusting comprises means for adjusting the initial sampling frequency at which the analog audio signal is sampled.

26. The user terminal of claim 24 wherein said means for adjusting comprises means for adjusting the adjustment applied by the means for resampling.

27. The user terminal of claim 22 comprising a store for storing an audio data file, wherein the store is configured to allow access to an audio data file to thereby allow retrieval of said samples of audio data for transmission to the further user terminal.

28. The user terminal of claim 22 wherein the means for transmitting comprises means for encoding the samples of audio data.

29. The user terminal of claim 22 wherein the means for transmitting comprises means for packetizing the samples of audio data into data packets for transmission to the further user terminal.

30. A communication system comprising:

a user terminal configured to transmit samples of audio data which have a sampling frequency and which provide a digital representation of an analog audio signal to a further user terminal;

the user terminal configured to repeatedly determine, during the communication session, an estimate of processing resources available for processing audio data in the communication session; and

the user terminal configured to dynamically adjust the sampling frequency during the communication session based on the determined estimate of available processing resources and

the further user terminal in a communication session with the user terminal.

31. A computer program product comprising a non-transitory computer readable medium storing thereon computer readable instructions for execution by a processor at a first user terminal for processing audio data for transmission over a network in a communication session between the first user terminal and a second user terminal, the instructions comprising instructions for:

transmitting samples of audio data which have a sampling frequency and which provide a digital representation of an analog audio signal from the first user terminal to the second user terminal in the communication session;

during the communication session, repeatedly determining an estimate of processing resources available for processing audio data in the communication session; and

dynamically adjusting the sampling frequency during the communication session based on said determined estimate of available processing resources.