METHOD AND SYSTEM FOR ENCODING DIGITAL IMAGES, CORRESPONDING APPARATUS AND COMPUTER PROGRAM PRODUCT

• US 20150264357A1
• Filed: 03/02/2015
• Published: 09/17/2015
• Est. Priority Date: 03/11/2014
• Status: Abandoned Application

• Current Assignee: STMicroelectronics SRL (STMicroelectronics NV)
• Original Assignee: STMicroelectronics SRL (STMicroelectronics NV)
• Inventors: Alfonso, Daniele
• Application Number:
  US14/635,612
• Publication Number:
  US 20150264357A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/23 with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
• CPC Class Codes: H04N 19/54 using feature points or meshes
• CPC Class Codes: H04N 19/56 Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search

Abstract

Sequences of digital video images are encoded by dividing the images into coding units encodable with both Intra coding modes and Inter coding modes, detecting whether the coding units belong to the background or to the foreground of the digital video images, and selecting the encoding modes for the coding units belonging to the background out of Inter coding modes by excluding Intra coding modes. The encoding modes for the coding units belonging to the background may be selected out of Inter coding modes with null motion vector, and/or the encoding modes for the coding units belonging to the foreground may be selected out of Intra coding modes by excluding Inter coding modes or out of all the available Intra and Inter coding modes.

Claims

1. A method, comprising:

dividing a sequence of digital video images into coding units;

classifying coding units into background coding units and foreground coding units;

selecting encoding modes for coding units from a set of available encoding modes including a subset of Inter encoding modes having null motion vectors and a subset of Intra encoding modes, wherein encoding modes selected for coding units classified as background coding units are selected from the subset of Inter encoding modes having null motion vectors; and

encoding coding units using selected encoding modes.

2. The method of claim 1, comprising:

selecting encoding modes for coding units classified as foreground encoding units from the subset of Intra encoding modes.

3. The method of claim 1, comprising:

selecting encoding modes for coding units classified as foreground encoding units from the set of available encoding modes.

4. The method of claim 1, comprising:

summing values of pixels of a coding unit;

comparing the sum to a threshold value; and

classifying the coding unit based on the comparison.

5. The method of claim 1 wherein selecting encoding modes for coding units classified as background coding units includes disabling specific coding modes of the subset of Inter encoding modes for a current coding unit.

6. The method of claim 1, comprising:

applying blob extraction and tracking to frames of the sequence of digital video images;

generating a block-based motion field based on the blob extraction and tracking; and

encoding at least some coding units of the sequence of digital video images using Inter temporal prediction based on the block-based motion field.

7. The method of claim 6, comprising:

initializing video-encoding motion estimation based on the blob tracking.

8. The method of claim 7, comprising:

testing a set of motion vectors based on the blob tracking.

9. A device, comprising:

an input configured to receive digital video images; and

image processing circuitry configured to;

divide digital video images into coding units;

classify coding units into background coding units and foreground coding units;

select encoding modes for coding units from a set of available encoding modes including a subset of Inter encoding modes having null motion vectors and a subset of Intra encoding modes, wherein the image processing circuitry is configured to select encoding modes for coding units classified as background coding units from the subset of Inter encoding modes having null motion vectors; and

encode coding units using selected encoding modes.

10. The device of claim 9 wherein the image processing circuitry is configured to select encoding modes for coding units classified as foreground encoding units from the subset of Intra encoding modes.

11. The device of claim 9 wherein the image processing circuitry is configured to select encoding modes for coding units classified as foreground encoding units from the set of available encoding modes.

12. The device of claim 9 wherein the image processing circuitry is configured to:

sum values of pixels of a coding unit;

compare the sum to a threshold value; and

classify the coding unit based on the comparison.

13. The device of claim 9 wherein the image processing circuitry is configured to selectively disable encoding modes of the subset of Inter encoding modes for coding units classified as background coding units.

14. The device of claim 9 wherein the image processing circuitry is configured to:

apply blob extraction and tracking to frames of a sequence of digital video images;

generate a block-based motion field based on the blob extraction and tracking; and

encode at least some coding units of the sequence of digital video images using Inter temporal prediction based on the block-based motion field.

15. The device of claim 14 wherein the image processing circuitry is configured to:

initialize video-encoding motion estimation based on the blob tracking.

16. The device of claim 15 wherein the image processing circuitry is configured to:

test a set of motion vectors based on the blob tracking.

17. A system, comprising:

an image capture device configured to capture a sequence of video images; and

image processing circuitry coupled to the image capture device and configured to;

divide the sequence of digital video images into coding units;

classify coding units into background coding units and foreground coding units;

select encoding modes for coding units from a set of available encoding modes including a subset of Inter encoding modes having null motion vectors and a subset of Intra encoding modes, wherein the image processing circuitry is configured to select encoding modes for coding units classified as background coding units from the subset of Inter encoding modes having null motion vectors; and

encode coding units using selected encoding modes.

18. The system of claim 17 wherein the image processing circuitry is configured to select encoding modes for coding units classified as foreground encoding units from the set of available encoding modes.

19. The system of claim 17 wherein the image processing circuitry is configured to:

sum values of pixels of a coding unit;

compare the sum to a threshold value; and

classify the coding unit based on the comparison.

20. The system of claim 17 wherein the image processing circuitry is configured to:

apply blob extraction and tracking to frames of the sequence of digital video images;

generate a block-based motion field based on the blob extraction and tracking; and

encode at least some coding units of the sequence of digital video images using Inter temporal prediction based on the block-based motion field.

21. A non-transitory computer-readable medium whose contents configure an image processing device to perform a method, the method comprising:

dividing a sequence of digital video images into coding units;

classifying the coding units into background coding units and foreground coding units;

selecting encoding modes for coding units from a set of available encoding modes including a subset of Inter encoding modes having null motion vectors and a subset of Intra encoding modes, wherein encoding modes selected for coding units classified as background coding units are selected from the subset of Inter encoding modes having null motion vectors; and

encoding the coding units using the selected encoding modes.

22. The non-transitory computer-readable medium of claim 21 wherein the method comprises selecting encoding modes for coding units classified as foreground encoding units from the subset of Intra encoding modes.

23. The non-transitory computer-readable medium of claim 21 wherein the method comprises:

summing values of pixels of a coding unit;

comparing the sum to a threshold value; and

classifying the coding unit based on the comparison.

24. The non-transitory computer-readable medium of claim 21 wherein the method comprises:

applying blob extraction and tracking to frames of the sequence of digital video images;

generating a block-based motion field based on the blob extraction and tracking; and

encoding at least some coding units of the sequence of digital video images using Inter temporal prediction based on the block-based motion field.