Audio-video data synchronization method, video output device, audio output device, and audio-video output system

• US 8,238,726 B2
• Filed: 02/05/2009
• Issued: 08/07/2012
• Est. Priority Date: 02/06/2008
• Status: Active Grant

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Takatsuji, Ayako, Yoshida, Junji, Yamada, Masazumi
• Primary Examiner(s): Nguyen, Huy T
• Application Number:
  US12/866,075
• Publication Number:
  US 20100315553A1
• Time in Patent Office: 1,279 Days
• Field of Search: None
• US Class Current: 386/338
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G09G 2370/047 using display data channel standard [DDC] communication
• CPC Class Codes: G09G 2370/12 Use of DVI or HDMI protocol in interfaces along the display data pipeline
• CPC Class Codes: G09G 2370/14 Use of low voltage differential signaling [LVDS] for display data communication
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams

Abstract

To provide an audio-video data synchronization method whereby an increase in the amount of control message transmission can be suppressed and the video output can be prevented from being interrupted. The audio-video data synchronization method includes: obtaining, by the audio output device, a first latency that is a period of time taken for the video output device to output the video, by receiving the display identification data that includes information indicating the first latency from the video output device when the indication of the connection validity status information changes from Invalid to Valid; adjusting, by the audio output device, timing of outputting the audio according to the first latency; obtaining, by the video output device, a second latency which is a period of time taken to output the video in the outputting; notifying the audio output device of the second latency by sending a control message from the video output device when the connection validity status information indicates Valid, the control message including information that indicates the second latency obtained in the obtaining of a second latency; and adjusting, by the audio output device, timing of outputting the audio according to the second latency.

Claims

1. An audio-video data synchronization method of synchronizing audio outputted from an audio output device and video outputted from a video output device in an audio-video output system including the audio output device and the video output device which are interconnected via a predetermined interface,

wherein the interface is capable of:

unidirectionally transmitting video data from the audio output device to the video output device;

unidirectionally transmitting, from the video output device to the audio output device, display identification data that indicates a reproduction capability of the video output device and connection validity status information that indicates validity status of a connection of the video output device; and

bidirectionally transmitting a control message,

said audio-video data synchronization method comprising;

authenticating with the video output device when the indication of the connection validity status information changes from Invalid to Valid;

sending the video data from the audio output device to the video output device via the interface while the connection validity status information indicates Valid, while the authentication performed in said authenticating is succeeding;

outputting the video from the video output device, using the video data sent in said sending;

obtaining, by the audio output device, a first latency that is a period of time taken for the video output device to output the video, by receiving the display identification data that includes information indicating the first latency from the video output device via the interface when the indication of the connection validity status information changes from Invalid to Valid;

adjusting, by the audio output device, timing of outputting the audio according to the first latency obtained in said obtaining of a first latency;

obtaining, by the video output device, a second latency which is a period of time taken to output the video in said outputting;

notifying the audio output device of the second latency by sending a control message from the video output device via the interface when the connection validity status information indicates Valid, the control message including information that indicates the second latency obtained in said obtaining of a second latency; and

adjusting, by the audio output device, timing of outputting the audio according to the second latency notified in said notifying.

2. The audio-video data synchronization method according to claim 1,

wherein the video output device includes a memory which is rewritable when the connection validity status information indicates Invalid and which stores the first latency,

the display identification data that includes the information indicating the first latency stored in the memory is obtained in said obtaining of a first latency, and

the first latency stored in the memory is not updated in said notifying.

3. The audio-video data synchronization method according to claim 2, further comprising

writing the second latency obtained in said obtaining of a second latency as the first latency into the memory, when the indication of the connection validity status information changes from Valid to Invalid.

4. The audio-video data synchronization method according to claim 1,

wherein the first latency is a predetermined period depending on the video output device.

5. The audio-video data synchronization method according to claim 1,

wherein the second latency obtained in said obtaining of a second latency is notified as the first latency in said notifying, when the indication of the connection validity status information changes from Valid to Invalid.

6. The audio-video data synchronization method according to claim 1,

wherein the second latency obtained in said obtaining of a second latency is notified in said notifying when a difference value between:

the first latency obtained in said obtaining of a first latency or a second latency having been previously notified in said notifying; and

the second latency obtained in said obtaining of a second latency, exceeds a predetermined threshold value.

7. The audio-video data synchronization method according to claim 1, further comprising

requesting a transmission of the second latency by sending a control message that includes information of the transmission request from the audio output device to the video output device,

wherein the second latency is notified in said notifying when the control message is sent in said requesting.

8. An audio-video data synchronization method of synchronizing audio outputted from an audio output device and video outputted from a video output device in an audio-video output system including the audio output device and the video output device which are interconnected via a predetermined interface, a first audio cable, and a second audio cable,

wherein the interface is capable of:

unidirectionally transmitting video data and first audio data from the audio output device to the video output device; and

bidirectionally transmitting a control message,

the first audio cable is capable of transmitting second audio data from the video output device to the audio output device, and

the second audio cable is capable of transmitting third audio data from the video output device to the audio output device,

said audio-video data synchronization method comprising;

sending, from the video output device to the audio output device;

a first latency which is a period of time taken for the video output device to output the video;

a second latency which is a period of time taken to output the video when the audio output device outputs the second audio data transmitted via the first audio cable; and

a third latency which is a period of time taken to output the video when the audio output device outputs the third audio data transmitted via the second audio cable;

specifying an audio switching to output the audio using one of the first audio data transmitted via the interface, the second audio data transmitted via the first audio cable, and the third audio data transmitted via the second audio cable; and

adjusting timing of outputting the audio according to the first latency sent in said sending when the audio output using the first audio data is specified in said specifying, adjusting timing of outputting the audio according to the second latency sent in said sending when the audio output using the second audio data is specified in said specifying, and adjusting timing of outputting the audio according to the third latency sent in said sending when the audio output using the third audio data is specified in said specifying, each said adjusting being performed by the audio output device.

9. A video output device which is connected to an audio output device via a predetermined interface,

wherein the interface is capable of:

unidirectionally transmitting video data from the audio output device to said video output device;

unidirectionally transmitting, from said video output device to the audio output device, display identification data that indicates a reproduction capability of said video output device and connection validity status information that indicates validity status of a connection of said video output device; and

bidirectionally transmitting a control message,

said video output device comprising;

a video data receiving unit configured to receive the video data from the audio output device via the interface;

a video output unit configured to output video using the video data received by the video data receiving unit;

a first latency sending unit configured to send the display identification data which includes information indicating a first latency that is a period of time taken for said video output unit to output the video, to the audio output device via the interface when the indication of the connection validity status information changes from Invalid to Valid; and

a second latency sending unit configured to send a control message which includes information indicating a second latency that is a period of time taken for said video output unit to output the video, to the audio output device via the interface when the connection validity status information indicates Valid.

10. An audio output device which is connected to a video output device via a predetermined interface,

wherein the interface is capable of:

unidirectionally transmitting video data from said audio output device to the video output device;

unidirectionally transmitting, from the video output device to said audio output device, display identification data that indicates a reproduction capability of the video output device and connection validity status information that indicates validity status of a connection of the video output device; and

bidirectionally transmitting a control message,

said audio output device comprising;

an authentication unit configured to authenticate with the video output device, when the indication of the connection validity status information changes from Invalid to Valid;

a video data sending unit configured to send the video data to the video output device via the interface while the connection validity status information indicates Valid, while the authentication performed by said authentication unit is succeeding;

a first latency receiving unit configured to receive the display identification data which includes information indicating a first latency that is a period of time taken for the video output device to output the video, from the video output device via the interface when the indication of the connection validity status information changes from Invalid to Valid;

a second latency receiving unit configured to receive a control message which includes information indicating a second latency that is a period of time taken for the video output device to output the video, from the video output device via the interface when the connection validity status information indicates Valid; and

an audio output unit configured to adjust timing of outputting audio according to one of the first latency received by said first latency receiving unit and the second latency received by said second latency receiving unit.

11. An audio-video output system comprising an audio output device and a video output device which are interconnected via a predetermined interface,

wherein the interface is capable of:

unidirectionally transmitting video data from the audio output device to said video output device;

unidirectionally transmitting, from said video output device to the audio output device, display identification data that indicates a reproduction capability of said video output device and connection validity status information that indicates validity status of a connection of said video output device; and

bidirectionally transmitting a control message,

said video output device comprising;

a video data receiving unit configured to receive the video data from the audio output device via the interface;

a video output unit configured to output video using the video data received by the video data receiving unit;

a first latency sending unit configured to send the display identification data which includes information indicating a first latency that is a period of time taken for said video output unit to output the video, to the audio output device via the interface when the indication of the connection validity status information changes from Invalid to Valid; and

a second latency sending unit configured to send a control message which includes information indicating a second latency that is a period of time taken to output the video, to the audio output device via the interface when the connection validity status information indicates Valid,

said audio output device comprising;

an authentication unit configured to authenticate with the video output device, when the indication of the connection validity status information changes from Invalid to Valid;

a video data sending unit configured to send the video data to the video output device via the interface while the connection validity status information indicates Valid, while the authentication performed by said authentication unit is succeeding;

a first latency receiving unit configured to receive the display identification data which includes information indicating a first latency, from the video output device via the interface when the indication of the connection validity status information changes from Invalid to Valid;

a second latency receiving unit configured to receive a control message which includes information indicating a second latency, from the video output device via the interface when the connection validity status information indicates Valid; and

an audio output unit configured to adjust timing of outputting audio according to one of the first latency received by said first latency receiving unit and the second latency received by said second latency receiving unit.