Synchronized transmission of audio and video data from a computer to a client via an interface

• US 20080250469A1
• Filed: 03/28/2008
• Published: 10/09/2008
• Est. Priority Date: 06/13/2003
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Agnoli, Giovanni M., Dillon, Jeffrey C., Delwiche, James A., Abt, John O., Yanowitz, Andrew, Bowman, Samuel R.
• Granted Patent: US 7,970,926 B2
• Time in Patent Office: Days
• US Class Current: 725/118
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2370/025 LAN communication management
• CPC Class Codes: G09G 2370/10 Use of a protocol of communication by packets in interfaces along the display data pipeline
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 21/4113 PC
• CPC Class Codes: H04N 21/43632 involving a wired protocol, e.g. IEEE 1394 high-speed IEEE 1394 serial bus H04L12/40052
• CPC Class Codes: H04N 21/64707 for transferring content from a first network to a second network, e.g. between IP and wireless

Abstract

A method for controlling data transmission between a computer and a video client via an interface, the method comprising: the computer polling the interface a first time to determine the size of the buffer on the interface; receiving a first buffer size value from the interface; sending a plurality of frames of video and audio data to the buffer on the interface such that a delay period exists between the sending of each frame; the computer polling the interface a second time to determine buffer size after the frames are sent to the interface; receiving a second buffer size value from the interface; and modifying the amount of time between the transmission of frames.

Claims

1-12. -12. (canceled)

13. In a system having a computer, a video client, and an interface coupled between the computer and video client, the interface having a buffer adapted to store data frames received from the computer to be sent to the video client, a method of performing data transmission flow control, the method comprising:

determining a first fill amount of the buffer;

sending a plurality of frames of data in an isochronous manner to the buffer via the interface such that a delay period exists between the sending of at least a portion of said plurality of frames;

determining a second buffer fill amount after the plurality of frames are sent to the buffer on the interface; and

varying the delay period between transmission of frames from the computer to the buffer on the interface based in part on the second buffer fill amount.

14. The method of claim 13, wherein the size of at least one frame of said plurality of frames varies to accommodate various video formats.

15. The method of claim 13, wherein each frame of said plurality of frames comprises a NTSC format frame.

16. The method of claim 13, wherein each frame of said plurality of frames comprises a PAL format frame.

17. The method of claim 13, wherein a video portion and an audio portion of each frame of said plurality of frames are of a predetermined size.

18. The method of claim 17, wherein any empty portions of the video portion and the audio portion of each frame in said plurality of frames are filled with zeros.

19. The method of claim 13, wherein said delay period existing between the sending of at least a portion of said plurality of frames comprises a delay period of the same size between each of said plurality of frames.

20. The method of claim 13, wherein said delay period existing between the sending of at least a portion of said plurality of frames comprises a delay period that varies in size between different sets of said plurality of frames.

21. A computer readable apparatus having a storage medium containing instructions which, when executed by a computer, perform data transmission flow control by:

polling an interface buffer in communication with the computer to determine a first buffer fill amount, the buffer storing data frames received from the computer, the buffer having a fill amount that varies with the amount of data contained in the buffer;

sending a plurality of frames of data in an isochronous manner to the buffer of the interface such that a delay period exists between the sending of at least some of the frames;

polling the interface to determine a second buffer fill amount, said polling to determine said second fill amount occurring after the plurality of frames are sent to the buffer; and

modulating the delay period between frames in a subsequent transmission from the computer to the buffer based at least in part on the relative size of the second buffer fill amount as compared with the first buffer fill amount.

22. The computer readable storage medium of claim 21, wherein a video portion and an audio portion of each frame of said plurality of frames are of a predetermined size.

23. The computer readable storage medium of claim 22, wherein said modulating comprises inserting delay periods of different sizes between transmission of at least two sets of sequential frames.

24. The computer readable storage medium of claim 21, wherein said modulating based at least in part on the relative size of the second buffer fill amount as compared with the first buffer fill amount comprises maintaining said buffer level at approximately an optimal level.

25. The computer readable storage medium of claim 21, wherein said modulating based at least in part on the relative size of the second buffer fill amount as compared with the first buffer fill amount comprises preventing an overflow condition and an underflow condition within said buffer.

26. The computer readable storage medium of claim 21, wherein said interface is in data communication with said computer via a standardized bus utilizing a serialized protocol.

27. The computer readable storage medium of claim 21, wherein the size of each frame of said plurality of frames varies to accommodate various video formats.

28. In a system having a computer, a video client, and an interface coupled between the computer and video client that facilitates data transmission between the computer and the video client, the interface connected to the computer via a standardized bus, the interface having a buffer for storing data frames received from the computer to be sent to the video client, an apparatus for performing data transmission flow control, the apparatus comprising:

apparatus adapted to determine the fill amount of the buffer on the interface at a first time;

apparatus adapted to send a plurality of frames of data in an isochronous manner to the buffer on the interface such that a delay period exists between the sending of at least a portion of the plurality of frames;

apparatus adapted to determine a second buffer fill amount after the plurality of frames are sent to the buffer on the interface; and

apparatus adapted to vary the delay period based at least in part on the second buffer fill amount and an optimal buffer fill level.

29. The apparatus of claim 28, wherein each frame of said plurality of frames comprises a NTSC format frame.

30. The apparatus of claim 28, wherein the size of at least several frames of said plurality of frames varies to accommodate various video formats.

31. The apparatus of claim 30, wherein said interface receives signals from said video client and converts said signals into a second plurality of frames, and sends one frame from said second plurality of frames to said computer at each vertical blanking interval.

32. A device adapted for performing data transmission flow control, comprising:

apparatus adapted to determine a first fill amount of a buffer on an interface between a computer and a video client;

apparatus adapted to send a plurality of frames of data in an isochronous manner to the buffer on the interface such that a delay period exists between the sending of each frame;

apparatus adapted to determine a second fill amount of the buffer on the interface after the frames are sent to the buffer on the interface; and

apparatus adapted to increase or decrease the delay period between the sending of frames to the buffer on the interface based at least in part on the second buffer fill amount.

33. The device of claim 32, wherein the size of at least one frame of said plurality of frames varies to accommodate various video formats.

34. The device of claim 32, wherein each frame of said plurality of frames comprises an NTSC format frame.

35. The device of claim 32, wherein each frame of said plurality of frames comprises a PAL format frame.

36. The device of claim 32, wherein a video portion and an audio portion of each frame of said plurality of frames are of a predetermined size.

37. The device of claim 36, wherein any empty portions of the video portion and the audio portion of each frame in said plurality of frames are filled with zeros.

38. The device of claim 32, wherein the interface is in data communication with the computer via a bus utilizing a serialized protocol.

39. A device adapted for performing data transmission flow control, comprising:

a computer readable storage medium containing instructions which, when executed by a computer, performs the acts of;

determining a first fill amount of a buffer on an interface between a computer and a video client, wherein the buffer on the interface facilitates data transmission between the computer and the video client;

sending a plurality of frames of data to the buffer on the interface such that a delay period exists between the sending of at least some of the plurality of frames;

determining a second fill amount of the buffer on the interface after the frames are sent to the buffer on the interface; and

modulating the delay period between transmission of individual ones of said frames from the computer to the buffer on the interface based in part on the second buffer fill amount.

40. The device of claim 39, wherein the size of at least one frame of said plurality of frames varies to accommodate various video formats.

41. The device of claim 39, wherein each frame of said plurality of frames comprises an NTSC format frame.

42. The device of claim 39, wherein each frame of said plurality of frames comprises a PAL format frame.

43. The device of claim 39, wherein a video portion and an audio portion of each frame of said plurality of frames are of a predetermined size.

44. The device of claim 39, wherein any empty portions of a video portion and an audio portion of each frame in said plurality of frames are filled with zeros.

45. The device of claim 39, wherein the interface is in data communication with the computer via a bus utilizing a serialized bus protocol.

46. A method of performing data transmission flow control, comprising:

determining a first fill amount of a buffer on an interface between a computer and video client, wherein the buffer on the interface facilitates data transmission between the computer and the video client;

sending a plurality of frames to the buffer on the interface such that a delay period exists between the sending of at least some of the frames;

determining a second fill amount of the buffer on the interface after the frames are sent to the buffer on the interface; and

if the second buffer fill amount value is smaller than an optimal fill amount, and smaller than the first buffer fill amount value, decreasing the delay period between the sending of said frames to the buffer on the interface, and if the second buffer fill amount value is larger than the optimal fill amount, and larger than the first buffer fill amount value, increasing the delay period between the sending of said frames to the buffer on the interface.

47. The method of claim 46, wherein the size of at least one frame of said plurality of frames varies to accommodate various video formats.

48. The method of claim 46, wherein each frame of said plurality of frames comprises an NTSC format frame.

49. The method of claim 46, wherein each frame of said plurality of frames comprises a PAL format frame.

50. The method of claim 46, wherein a video portion and an audio portion of each frame of said plurality of frames are of a predetermined size.

51. The method of claim 46, wherein any empty portions of a video portion or an audio portion of each frame in said plurality of frames are filled with zeros.

52. The method of claim 46, wherein the interface is in data communication with the computer via a bus utilizing a serialized bus protocol.