Profile for frame rate conversion

• US 10,362,264 B2
• Filed: 08/20/2018
• Issued: 07/23/2019
• Est. Priority Date: 09/30/2008
• Status: Active Grant

• Current Assignee: Entropic Communications, LLC (SoftBank Group Corp.)
• Original Assignee: Entropic Communications, LLC (SoftBank Group Corp.)
• Inventors: van Eggelen, Edwin, de Kleijn, Jeroen, Bosma, Marco
• Primary Examiner(s): Lee, Michael
• Application Number:
  US16/105,488
• Publication Number:
  US 20180376102A1
• Time in Patent Office: 337 Days
• Field of Search: 348441
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 7/01 Conversion of standards , e.g. involving analogue television standards or digital television standards processed at pixel level

Abstract

The present application relates to a method for frame rate conversion. The present application relates also to a system for frame rate conversion and a computer comprising said frame rate. In addition, the present application relates to a computer readable medium having a computer program for performing said method. The method comprises defining a first frame rate profile with a first frame rate, defining at least a second frame rate profile with a second frame rate, rendering video frames at the first frame rate profile, detecting the quality of the rendered video frames, and switching from the first frame rate profile to the second frame rate profile at least depending on the detected quality of the rendered video frames.

Claims

1. A method, comprising:

detecting one or more dropped video frames in a plurality of video frames of a video stream rendered according to a first frame rate;

estimating a quality of the plurality of rendered video frames according to information about the one or more dropped video frames;

determining to switch to a second frame rate according to the estimated quality of the plurality of rendered video frames, wherein the second frame rate is achieved by inserting frames into the video stream;

detecting motion in a video frame of the video stream subsequent to the plurality of video frames of the video stream; and

switching to the second frame rate at a time determined by the motion detected in the subsequent video frame.

2. The method of claim 1, wherein the first frame rate produces a higher video quality than the second frame rate.

3. The method of claim 1, wherein the second frame rate is higher than the first frame rate.

4. The method of claim 1, wherein switching to the second frame rate comprises increasing the frame rate by adding a pull-down.

5. The method of claim 1, wherein switching to the second frame rate comprises increasing the frame rate by performing motion compensated interpolation.

6. The method of claim 1, wherein detecting motion in the video frame of the video stream comprises detecting motion beyond a defined motion range.

7. The method of claim 1, wherein a video renderer is operable to perform detecting the one or more dropped video frames.

8. The method of claim 1, wherein detecting motion comprises monitoring a plurality of motion vectors.

9. The method of claim 1, wherein a frame rate converter is operable to perform switching to the second frame rate.

10. A system, comprising:

a frame rate converter configured to switch from a first frame rate to a second frame rate according to a detected quality of a plurality of rendered video frames,

wherein a timing of the switch is according to motion detected in a video frame subsequent to the plurality of rendered video frames, and wherein the second frame rate is achieved by inserting frames into the video stream, and wherein the quality of the plurality of rendered video frames is detected according to information about one or more dropped video frames.

11. The system of claim 10, wherein the first frame rate results in a higher video quality than the second frame rate.

12. The system of claim 10, wherein the second frame rate is higher than the first frame rate.

13. The system of claim 10, wherein the frame rate converter is configured to switch to the second frame rate by adding a pull-down.

14. The system of claim 10, wherein the frame rate converter is configured to switch to the second frame rate by performing motion compensated interpolation.

15. The system of claim 10, wherein the system comprises a video renderer configured to detect the motion in the video frame of the video stream, wherein the motion is beyond a defined motion range.

16. The system of claim 10, wherein the system comprises a video renderer configured to detect the quality according to one or more dropped video frames.

17. The system of claim 10, wherein the system comprises a video renderer configured to detect the motion by monitoring a plurality of motion vectors.

18. The system of claim 10, wherein the system comprises an analyzer configured to analyze the detected quality of the rendered video frames.

19. The system of claim 10, wherein the system comprises an error detector configured to detect the quality of the plurality of rendered video frames according to information about the one or more dropped video frames.