Communication device and data processing method

• US 9,806,967 B2
• Filed: 12/09/2014
• Issued: 10/31/2017
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Minamino, Takanori, Nguyen, Khoi
• Primary Examiner(s): Dollinger, Tonia L
• Assistant Examiner(s): Dabipi, Dixon
• Application Number:
  US14/564,249
• Publication Number:
  US 20150350037A1
• Time in Patent Office: 1,057 Days
• CPC Class Codes: H04L 43/024 by adaptive sampling
• CPC Class Codes: H04L 43/087 Jitter
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS

Abstract

A packet reception state monitoring unit calculates a target stored data number as a target number of audio packets stored in a memory based on the variation in the reception intervals of audio packets, and a reproduction control unit controls the audio reproduction speed in accordance with the difference between the target stored data number and a memory-stored data number. When the memory-stored data number is smaller than the target stored data number, reproduction control is performed in a low-speed reproduction mode at a lower speed than a regular reproduction speed. When the memory-stored data number is larger than the target stored data number, reproduction control is performed in a high-speed reproduction mode at a higher speed than the regular reproduction speed. A reproduction speed changing process is performed, with hysteresis being given to transitions of the difference between the memory-stored data number and the target stored data number.

Claims

1. A communication device comprising:

a processor and a memory including instructions which, when executed by the processor, control;

monitoring reception intervals of packets received by a communication unit, and generating and outputting a target value as a parameter for a reproduction control process based on a variation in the packet reception intervals; and

performing reproduction control in accordance with the target value,

wherein the reproduction control is to control an audio reproduction speed or image frame reproduction, in which the audio reproduction speed is controlled in accordance with the target value, in which the target value is generated by calculating a target stored data number as a target number of audio packets to be stored in a memory based on the variation in the reception intervals of audio packets received by the communication unit, and in which the audio reproduction speed is controlled in accordance with a determination whether a difference between the target stored data number and a memory-stored data number that is the number of audio packets actually stored in the memory changes successively in a same direction.

2. The communication device according to claim 1, wherein the instructions, when executed by the processor, control making the target stored data number larger when the variation in the reception intervals of the audio packets received by the communication unit is wide, and the target stored data number smaller when the variation is narrow.

3. The communication device according to claim 1, wherein the instructions, when executed by the processor, control performing

the reproduction control in a low-speed reproduction mode at a lower speed than a regular reproduction speed when the memory-stored data number is smaller than the target stored data number, and

the reproduction control in a high-speed reproduction mode at a higher speed than the regular reproduction speed when the memory-stored data number is larger than the target stored data number.

4. The communication device according to claim 3, wherein the instructions, when executed by the processor, control changing the audio reproduction speed by giving hysteresis to a transition of the difference between the memory-stored data number and the target stored data number.

5. The communication device according to claim 3, wherein the instructions, when executed by the processor, control performing an audio reproduction speed control process to

increase the audio reproduction speed when a difference value between the memory-stored data number and the target stored data number continuously increases, and

reduce the audio reproduction speed when the difference value between the memory-stored data number and the target stored data number continuously decreases.

6. The communication device according to claim 1, wherein the instructions, when executed by the processor, control calculating a standard deviation of the reception intervals of audio packets received by the communication unit, to calculate the variation in the reception intervals of the audio packets.

7. The communication device according to claim 6, wherein the instructions, when executed by the processor, control making the target stored data number larger when the standard deviation in the reception intervals of the audio packets is large, and the target stored data number smaller when the standard deviation in the reception intervals is small.

8. The communication device according to claim 1, wherein the memory-stored data number is an average value of the numbers of packets stored in the memory in a predetermined period of time.

9. The communication device according to claim 1,

wherein the instructions, when executed by the processor, control:

calculating a target phase offset as a target value of a phase offset equivalent to a difference between a server vertical synchronization signal of a server transmitting packets and a client vertical synchronization signal of a client based on the variation in the reception intervals of image packets received by the communication unit, the client being the communication device, and

performing image reproduction control by determining the timing to reproduce an image frame in accordance with the target phase offset.

10. The communication device according to claim 9, wherein the instructions, when executed by the processor, control making the target phase offset larger when the variation in the reception intervals of the image packets received by the communication unit is wide, and the target phase offset smaller when the variation is narrow.

11. The communication device according to claim 10, wherein the instructions, when executed by the processor, when the variation in the reception intervals of the image packets is narrow, and the target phase offset is small, control setting a small phase offset and performing image reproduction with a shorter reproduction delay.

12. The communication device according to claim 10, wherein the instructions, when executed by the processor, when the variation in the reception intervals of the image packets is wide, and the target phase offset is large, control setting a large phase offset and performing image reproduction with a reduced possibility of intermittent reproduction due to a packet delay.

13. A data processing method implemented in a communication device, the method comprising:

monitoring reception intervals of packets received by a communication unit, and generating and outputting a target value as a parameter for a reproduction control process based on a variation in the packet reception intervals, the monitoring and the generating and outputting the target value being performed by a packet reception state monitoring unit; and

performing reproduction control in accordance with the target value generated by the packet reception state monitoring unit, the reproduction control being performed by a reproduction control unit,

wherein an audio reproduction speed or image frame reproduction is controlled in the reproduction control, in which the audio reproduction speed is controlled in accordance with the target value, in which the target value is generated by calculating a target stored data number as a target number of audio packets to be stored in a memory based on the variation in the reception intervals of audio packets received by the communication unit, and in which the audio reproduction speed is controlled in accordance with a determination whether a difference between the target stored data number and a memory-stored data number that is the number of audio packets actually stored in the memory changes successively in a same direction.