Still block detection in a video sequence

• US 9,832,484 B2
• Filed: 05/20/2015
• Issued: 11/28/2017
• Est. Priority Date: 05/20/2015
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Kempf, Jeffrey Matthew, Morgan, Daniel Jay
• Primary Examiner(s): Aghevli, Reza
• Application Number:
  US14/718,004
• Publication Number:
  US 20160345021A1
• Time in Patent Office: 923 Days
• Field of Search: None
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation

Abstract

A video display system is configured to receive a sequence of image frames. Each frame is divided into a set of blocks. A center of mass is calculated for each block in a first frame and is saved for all blocks in the first frame. A center of mass is calculated for each block in a second frame. Motion between the first frame and the second frame is detected by comparing the center of mass of each block in the second frame to the center of mass of the corresponding block in the first frame, in which a still block is detected when a corresponding block in the first frame and the second frame have a same center of mass, and in which motion in a block is detected when a corresponding block in the first frame and the second frame have a different center of mass.

Claims

1. A method of operating a video display system, the method comprising:

receiving a sequence of image frames, including at least a first frame and a second frame;

dividing the first frame into a first set of blocks;

dividing the second frame into a second set of blocks, wherein each block in the second frame is spatially collocated with a respective block in the first frame;

calculating a respective center of mass of each block in the first and second frames;

detecting motion between the first frame and the second frame by comparing the respective center of mass of each block in the second frame to the respective center of mass of its spatially collocated block in the first frame, in which the block in the second frame is detected as being;

a still block when its respective center of mass is the same as the respective center of mass of its spatially collocated block in the first frame; and

a non-still block when its respective center of mass is different from the respective center of mass of its spatially collocated block in the first frame; and

reducing power to a circuit module in the video display system in response to detecting at least one still block in the second frame.

2. The method of claim 1, wherein reducing power to the circuit module includes:

reducing power to the circuit module during time(s) scheduled for processing still blocks in the second frame; and

not reducing power to the circuit module during time(s) scheduled for processing non-still blocks in the second frame.

3. The method of claim 1, wherein reducing power to the circuit module includes:

reducing power to the circuit module during time(s) scheduled for processing the entire second frame when all blocks in the second frame are still blocks.

4. The method of claim 1, wherein calculating the respective center of mass includes:

summing values of all pixels in each row of pixels in the block to form a respective summation value per row; and

selecting a row whose respective summation value is largest to be a vertical center of mass value of the block.

5. The method of claim 1, wherein calculating the respective center of mass includes:

multiplying a value of each pixel by its horizontal position to form a weighted pixel value; and

summing all of the weighted pixel values to form a weighted pixel summation value.

6. The method of claim 5, further including:

summing a value of each pixel to form a non-weighted pixel summation value; and

normalizing the weighted pixel summation value by the non-weighted pixel summation value to form a horizontal center of mass value of the block.

7. The method of claim 1, further including converting a video format of the sequence of image frames into a luminance/chroma format, wherein the respective center of mass of each block is based on the luminance values of the pixels in the block.

8. The method of claim 1, further including:

detecting a cadence of repeated image frames by determining a repeating pattern of image frames in which all blocks within the frame are still blocks;

wherein reducing power to the circuit module includes;

reducing power to the circuit module in accordance with the repeating pattern, such that power is reduced during time(s) scheduled for processing the repeated image frames.

9. The method of claim 1, further including compensating for latency between the first frame and the second frame by redesignating a set of still blocks surrounding a non-still block to instead be designated as non-still blocks.

10. A method of operating a video display system, the method comprising:

receiving a sequence of image frames, including at least a first frame and a second frame;

dividing the first frame into a first set of blocks;

dividing the second frame into a second set of blocks, wherein each block in the second frame is spatially collocated with a respective block in the first frame;

calculating a respective center of mass of each block in the first and second frames, wherein calculating the respective center of mass includes;

summing values of all pixels in each row of pixels in the block to form a respective summation value per row, selecting a row whose respective summation value is largest to be a vertical center of mass value of the block, multiplying a value of each pixel by its horizontal position to form a weighted pixel value, summing all of the weighted pixel values to form a weighted pixel summation value, summing a value of each pixel to form a non-weighted pixel summation value, and normalizing the weighted pixel summation value by the non-weighted pixel summation value to form a horizontal center of mass value of the block;

detecting motion between the first frame and the second frame by comparing the respective center of mass of each block in the second frame to the respective center of mass of its spatially collocated block in the first frame, in which the block in the second frame is detected as being;

a still block when its respective center of mass is the same as the respective center of mass of its spatially collocated block in the first frame; and

a non-still block when its respective center of mass is different from the respective center of mass of its spatially collocated block in the first frame; and

reducing power to a circuit module in the video display system in response to detecting at least one still block in the second frame.

11. The method of claim 10, further including:

summing a value of each pixel in the block to form a non-weighted pixel summation value; and

normalizing the weighted pixel summation value by the non-weighted pixel summation value to form the x coordinate of the respective center of mass of the block.

12. The method of claim 10, wherein reducing power to the circuit module includes:

reducing power to the circuit module during time(s) scheduled for processing the entire second frame when all blocks in the second frame are still blocks.

13. The method of claim 10, further including converting a video format of the sequence of image frames into a luminance/chroma format, wherein the respective center of mass of each block is based on the luminance values of the pixels in the block.

14. A device for processing image data, the device comprising:

a data port configured to receive a sequence of image frames, including at least a first frame and a second frame;

image processing logic configured to process the received sequence of image frames to form a sequence of processed image frames;

segregation logic configured to;

divide the first frame into a first set of blocks; and

divide the second frame into a second set of blocks, wherein each block in the second frame is spatially collocated with a respective block in the first frame;

center of mass (COM) logic configured to calculate a respective COM value of each block;

detection logic configured to detect motion between the first frame and the second frame by comparing the respective COM value of each block in the second frame to the respective COM value of its spatially collocated block in the first frame, in which the block in the second frame is detected as being;

a still block when its respective COM value is the same as the respective COM value of its spatially collocated block in the first frame; and

a non-still block when its respective COM value is different from the respective COM value of its spatially collocated block in the first frame; and

control logic configured to reduce power to the image processing logic in response to detection of at least one still block in the second frame.

15. The device of claim 14, wherein reducing power to the image processing logic includes:

reducing power to the image processing logic during time(s) scheduled for processing still blocks in the second frame; and

not reducing power to the image processing logic during time(s) scheduled for processing non-still blocks in the second frame.

16. The device of claim 14, wherein calculating the respective COM values includes:

summing values of all pixels in each row of pixels in the block to form a respective summation value per row, and selecting a row whose respective summation value is largest to be a vertical COM value of the block; and

multiplying a value of each pixel by its horizontal position to form a weighted pixel value, summing all of the weighted pixel values to form a weighted pixel summation value, summing a value of each pixel to form a non-weighted pixel summation value, and normalizing the weighted pixel summation value by the non-weighted pixel summation value to form a horizontal COM value of the block.

17. The device of claim 14, further including:

a frame buffer configured to receive the sequence of processed image frames; and

a projector device coupled to receive the processed image frames from the frame buffer.

18. The device of claim 14, further including:

a frame buffer configured to receive the sequence of processed image frames; and

a screen display coupled to receive the processed image frames from the frame buffer.