Dynamically modifying video and coding behavior

• US 9,020,048 B2
• Filed: 04/30/2009
• Issued: 04/28/2015
• Est. Priority Date: 04/30/2008
• Status: Active Grant

• Current Assignee: Zeevee, Inc.
• Original Assignee: Zeevee, Inc.
• Inventors: Greene, Jeremy A., Odryna, Victor, Benamara, Ali
• Primary Examiner(s): Dastouri, Mehrdad
• Assistant Examiner(s): DOBBS, KRISTIN SENSMEIER
• Application Number:
  US12/433,095
• Publication Number:
  US 20090274219A1
• Time in Patent Office: 2,189 Days
• Field of Search: 375/240.26, 375/240.12, 375/240.16
• US Class Current: 375/240.26
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A system and method that provides a connection path between a video source such as a personal computer (PC) and a high-definition television (HDTV). A control is provided for varying a quality level of a video signal with respect to latency of activities provided through the video signal channel. Output picture quality versus latency is adjusted on a dynamic basis. Observed mouse activities causes the output picture quality to be decreased rapidly with an attendant decrease in latency. A decrease in output picture quality and latency is maintained until the occurrence of a particular event, such as the expiration of a time interval from a last observed mouse event. If a limited number of mouse events are observed, then the output picture quality is increased to a point at which the limited mouse activity can be accommodated with an acceptable level of latency. If limited or no mouse events are observed for a given period of time, the output picture quality is increased, either rapidly or gradually, until output picture quality is restored or another mouse event is observed.

Claims

1. A method of dynamically controlling a video display apparatus that includes a frame buffer which is configured to receive frames, the method comprising:

receiving a plurality of input frames in a video input stream;

encoding the plurality of input frames in the video input stream to generate a plurality of output frames;

transmitting a first portion of the plurality of output frames at a first output frame rate to the video display apparatus, wherein the video display apparatus displays buffered frames at a display frame rate and the first output frame rate is approximately equal to the display frame rate such that a number of frames in the frame buffer remains relatively constant at a first number;

while transmitting the first portion of the plurality of output frames at the first output frame rate, detecting at least one user input;

in response to detecting the at least one user input, transmitting, for a predetermined period of time, a second portion of the plurality of output frames at a second output frame rate to the video display apparatus, wherein the second output frame rate is less than the display frame rate such that the number of frames in the frame buffer is reduced to a second number that is less than the first number; and

in response to expiration of the predetermined period of time, transmitting a third portion of the plurality of output frames at the first output frame rate to the video display apparatus such that the number of frames in the frame buffer remains relatively constant at the second number.

2. The method of claim 1, further comprising periodically transmitting, for the predetermined period of time, additional portions of the plurality of output frames at the second output frame rate to the video display apparatus to maintain the number of frames in the frame buffer at the second number.

3. The method of claim 1, wherein the predetermined period of time is a first predetermined period of time, and the method further comprises, in response to detecting an absence of user input for a second predetermined period of time, transmitting, for a third predetermined period of time, a fourth portion of the plurality of output frames at a third output frame rate to the video display apparatus, wherein the third output frame rate is greater than the display frame rate such that the number of frames in the frame buffer is increased to a third number that is greater than the second number.

4. The method of claim 3, wherein transmitting the fourth portion of the plurality of output frames at the third output frame rate includes adding at least one additional frame to the fourth portion of the plurality of output frames, the at least one additional frame being an inter-coded frame which indicates no difference between the at least one additional frame and one or more previous frames.

5. The method of claim 3, wherein transmitting for the third predetermined period of time includes transmitting for a period approximately equal to a period of ten to fifteen frame intervals.

6. The method of claim 1, wherein the predetermined period of time is a first predetermined period of time, and the method further comprises:

while transmitting the third portion of the plurality of output frames at the first output frame rate, detecting at least one pushbutton input; and

in response to detecting the at least one pushbutton input, transmitting, for a third predetermined period of time, a fourth portion of the plurality of output frames at a third output frame rate to the video display apparatus, wherein the third output frame rate is greater than the display frame rate such that the number of frames in the frame buffer is increased to a third number that is greater than the second number.

7. The method of claim 1, wherein transmitting the second portion of the plurality of output frames at the second output frame rate includes dropping input frames from the plurality of input frames prior to encoding.

8. The method of claim 1, wherein detecting the at least one user input includes detecting at least one of:

an indication of mouse movement, input from a keyboard, and input from a remote control device.

9. The method of claim 1, wherein an output frame of the third portion of the plurality of output frames is displayed with less delay between a time when the output frame is transmitted and a time when the output frame is displayed than an output frame of the first portion of the plurality of output frames.

10. The method of claim 1, wherein transmitting the portions of the plurality of output frames includes transmitting the portions of the plurality of output frames via a local area connection.

11. The method of claim 10, wherein transmitting the portions of the plurality of output frames via the local area connection includes transmitting the portions of the plurality of output frames over a coaxial cable connection.

12. The method of claim 1, wherein transmitting the third portion of the plurality of output frames includes transmitting output frames which display a cursor.

13. A method of dynamically controlling a video display apparatus that includes a frame buffer which is configured to receive frames, the method comprising:

receiving a plurality of input frames in a video input stream;

encoding the plurality of input frames in the video input stream to generate a plurality of output frames;

transmitting a first portion of the plurality of output frames at a first output frame rate to the video display apparatus, wherein the video display apparatus displays buffered frames at a display frame rate and the first output frame rate is approximately equal to the display frame rate such that a number of frames in the frame buffer remains relatively constant at a first number;

in response to detecting an absence of user input for a first predetermined period of time, transmitting, for a second predetermined period of time, a second portion of the plurality of output frames at a second output frame rate to the video display apparatus, wherein the second output frame rate is greater than the display frame rate such that the number of frames in the frame buffer is increased to a second number that is greater than the first number; and

in response to expiration of the second predetermined period of time, transmitting a third portion of the plurality of output frames at the first output frame rate to the video display apparatus such that the number of frames in the frame buffer remains relatively constant at the second number.

14. The method of claim 13, wherein transmitting for the second predetermined period of time includes transmitting for a period approximately equal to a period of ten to fifteen frame intervals.

15. The method of claim 13, wherein transmitting the second portion of the plurality of output frames at the second output frame rate includes adding at least one additional frame to the second portion of the plurality of output frames, the at least one additional frame being an inter-coded frame which indicates no difference between the at least one additional frame and one or more previous frames.

16. The method of claim 13, further comprising:

detecting at least one user input;

in response to detecting the at least one user input, transmitting, for a third predetermined period of time, a fourth portion of the plurality of output frames at a third output frame rate to the video display apparatus, wherein the third output frame rate is less than the display frame rate such that the number of frames in the frame buffer is reduced to a third number that is less than the second number; and

in response to expiration of the third predetermined period of time, transmitting a fifth portion of the plurality of output frames at the first output frame rate to the video display apparatus such that the number of frames in the frame buffer remains relatively constant at the third number.

17. The method of claim 16, further comprising periodically transmitting, for the third predetermined period of time, additional portions of the plurality of output frames at the third output frame rate to the video display apparatus to maintain the number of frames in the frame buffer at the third number.

18. The method of claim 16, further comprising, when transmitting the fourth portion of the plurality of output frames at the third output frame rate, dropping input frames from the plurality of input frames prior to encoding.

19. The method of claim 16, wherein detecting the at least one user input includes detecting at least one of:

an indication of mouse movement, input from a keyboard, and input from a remote control device.

20. The method of claim 16, wherein transmitting the fifth portion of the plurality of output frames includes transmitting output frames which display a cursor.

21. The method of claim 13, wherein transmitting the portions of the plurality of output frames includes transmitting the portions of the plurality of output frames via a local area connection.

22. The method of claim 21, wherein transmitting the portions of the plurality of output frames via the local area connection includes transmitting the portions of the plurality of output frames over a coaxial cable connection.

23. A method of dynamically controlling a video display apparatus that includes a frame buffer which is configured to receive frames, the method comprising:

receiving a plurality of input frames in a video input stream;

encoding the plurality of input frames in the video input stream to generate a plurality of output frames;

transmitting a first portion of the plurality of output frames at a first output frame rate to the video display apparatus, wherein the video display apparatus displays buffered frames at a display frame rate and the first output frame rate is approximately equal to the display frame rate such that a number of frames in the frame buffer remains relatively constant at a first number;

while transmitting the first portion of the plurality of output frames at the first output frame rate, detecting at least one pushbutton input;

in response to detecting at least one pushbutton input, transmitting, for a predetermined period of time, a second portion of the plurality of output frames at a second output frame rate to the video display apparatus, wherein the second output frame rate is greater than the display frame rate such that the number of frames in the frame buffer is increased to a second number that is greater than the first number; and

in response to expiration of the predetermined period of time, transmitting a third portion of the plurality of output frames at the first output frame rate to the video display apparatus such that the number of frames in the frame buffer remains relatively constant at the second number.

24. The method of claim 23, wherein transmitting the second portion of the plurality of output frames at the second output frame rate includes adding at least one additional frame to the second portion of the plurality of output frames, the at least one additional frame being an inter-coded frame which indicates no difference between the at least one additional frame and one or more previous frames.

25. A method of dynamically controlling a video display apparatus that includes a frame buffer which is configured to receive frames, the method comprising:

receiving a plurality of input frames in a video input stream;

encoding the plurality of input frames in the video input stream to generate a plurality of output frames;

transmitting a first portion of the plurality of output frames at a first output frame rate to the video display apparatus, wherein the video display apparatus displays buffered frames at a display frame rate and the first output frame rate is approximately equal to the display frame rate such that a number of frames in the frame buffer remains relatively constant at a first number;

while transmitting the first portion of the plurality of output frames at the first output frame rate, detecting an indication of mouse movement;

in response to detecting the indication of mouse movement, transmitting, for a first predetermined period of time, a second portion of the plurality of output frames at a second output frame rate to the video display apparatus, wherein the second output frame rate is less than the display frame rate such that the number of frames in the frame buffer is reduced to a second number that is less than the first number;

in response to expiration of the first predetermined period of time, transmitting a third portion of the plurality of output frames at the first output frame rate to the video display apparatus such that the number of frames in the frame buffer remains relatively constant at the second number;

while transmitting the third portion of the plurality of output frames at the second output frame rate, detecting at least one pushbutton input; and

in response to detecting the at least one pushbutton input, transmitting, for a second predetermined period of time, a fourth portion of the plurality of output frames at a third output frame rate to the video display apparatus, wherein the third output frame rate is greater than the display frame rate such that the number of frames in the frame buffer is increased to a third number that is greater than the second number.

26. An apparatus for dynamically controlling a video display apparatus that includes a frame buffer which is configured to receive frames, the apparatus comprising at least one processor;

and at least one memory including computer program code, the at least one processor being operative to execute code to;

receive a plurality of input frames in a video input stream;

encode the plurality of input frames in the video input stream to generate a plurality of output frames;

transmit a first portion of the plurality of output frames at a first output frame rate to the video display apparatus, wherein the video display apparatus displays buffered frames at a display frame rate and the first output frame rate is approximately equal to the display frame rate such that a number of frames in the frame buffer remains relatively constant at a first number;

detect at least one user input while transmitting the first portion of the plurality of output frames at the first output frame rate;

in response to detecting the at least one user input, transmit, for a first predetermined period of time, a second portion of the plurality of output frames at a second output frame rate to the video display apparatus, wherein the second output frame rate is less than the display frame rate such that the number of frames in the frame buffer is reduced to a second number that is less than the first number;

in response to expiration of the first predetermined period of time, transmit a third portion of the plurality of output frames at the first output frame rate to the video display apparatus such that the number of frames in the frame buffer remains relatively constant at the second number; and

in response to detecting an absence of user input for a second predetermined period of time, transmit, for a third predetermined period of time, a fourth portion of the plurality of output frames at a third output frame rate to the video display apparatus, wherein the third output frame rate is greater than the display frame rate such that the number of frames in the frame buffer is increased to a third number that is greater than the second number.

27. The apparatus of claim 26, wherein the at least one processor is further operative to execute code to, while transmitting the fourth portion of the plurality of output frames at the third output frame rate, add at least one additional frame to the fourth portion of the plurality of output frames, the at least one additional frame being an inter-coded frame which indicates no difference between the at least one additional frame and one or more previous frames.