Audio acceleration

• US 8,560,331 B1
• Filed: 12/13/2010
• Issued: 10/15/2013
• Est. Priority Date: 08/02/2010
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Pereira, Rui Filipe Andrade, Gault, Andrew Buchanan
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US12/966,103
• Time in Patent Office: 1,037 Days
• Field of Search: 704/503
• US Class Current: 704/503
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82

Abstract

An audio receiving system includes logic configured to reduce the accumulation of delays caused by the late arrival of audio packets. This logic is configured to accelerate or decelerate presentation of a resulting audio stream in response to the detection of late packets. The acceleration is discontinued once the effects of the late packets have been compensated for. The audio receiving system is typically applied to applications in which lag is undesirable. These can include web conferencing, telepresence, and online video games.

Claims

1. An audio system comprising:

an input for receiving audio packets via a communication network;

audio monitoring logic for determining that one of the audio packets was late;

audio decoding logic for converting the audio packets to an audio stream;

audio processing logic for accelerating presentation of part of the audio stream to a user such that delay in the presentation of the audio stream is reduced; and

an audio output for presenting the audio stream to the user, wherein a processor executes the logic.

2. The system of claim 1, wherein the input includes an Ethernet port.

3. The system of claim 1, wherein the audio packets include video game audio data.

4. The system of claim 1, wherein the audio packets include voice audio data.

5. The system of claim 1, wherein the communication network includes the internet.

6. The system of claim 1, wherein the late audio packet was received out of sequence.

7. The system of claim 1, wherein the late audio packet was received at least 100 milliseconds late.

8. The system of claim 1, wherein the audio processing logic is configured to increment the acceleration of the presentation in a stepwise manner.

9. The system of claim 8, wherein the stepwise manner includes steps that each result in a less than 5 percent reduction in time required to present the accelerated part of the audio stream.

10. The system of claim 9, wherein the acceleration steps are applied between packets.

11. The system of claim 1, wherein the acceleration of the presentation is incremented when an audio packet is received late.

12. The system of claim 1, wherein the acceleration of the presentation is incremented each time an audio packet is received late.

13. The system of claim 1, wherein the delay is a result of the late audio packet.

14. The system of claim 1, wherein the audio processing logic is configured to reduce the acceleration of the audio stream when the accumulated delay is reduced to a predetermined level.

15. The system of claim 1, wherein the audio processing logic is configured to reduce the acceleration of the audio stream when the accumulated delay is eliminated.

16. The system of claim 1, wherein the audio processing logic is configured to reduce the acceleration of the audio stream in a stepwise manner.

17. The system of claim 16, wherein each step of the reduction is less than 5 percent.

18. The system of claim 1, wherein the acceleration is accomplished by sampling the audio data at a higher rate.

19. The system of claim 1, wherein the acceleration changes a pitch of the audio.

20. The system of claim 1, further comprising an audio server system configured to generate the audio packets.

21. A method of communicating audio packets, the method comprising:

providing a computing instructions to a client over a communication network, the computing instructions being configured to;

detect that a first audio packet was received late by the client, and

accelerate a rate at which an audio stream is presented to a user based on the first audio packet being received late; and

providing a series of audio packets to the client over the communication network, the series of audio packets including the first audio packet and being configured to be decoded to the audio stream, wherein the method is executed by a processor.

22. The method of claim 21, wherein the computing instructions are further configured to present the audio stream to the user.

23. The method of claim 21, wherein the computing instructions are further configured to convert the first audio packet to part of the audio stream.

24. The method of claim 21, wherein the computing instructions are further configured to receive the first audio packet via a communication network.

25. The method of claim 21, further comprising generating the audio packets.

26. The method of claim 21, further comprising reducing the acceleration of the presentation of the audio stream when a minimum delay in the presentation is reached.

27. A method of processing audio packets, the method comprising:

receiving a first audio packet via a communication network;

detecting that the first audio packet was received late;

converting the first audio packet to part of an audio stream;

accelerating a rate at which the audio stream is presented to a user based on the first audio packet being received late; and

presenting the audio stream to the user at the accelerated rate, wherein the method is executed by a processor.