Video coding reconstruction apparatus and methods

• US 7,496,236 B2
• Filed: 03/02/2004
• Issued: 02/24/2009
• Est. Priority Date: 08/12/1998
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Fogg, Chad
• Primary Examiner(s): Do; Anh Hong
• Application Number:
  US10/792,172
• Publication Number:
  US 20040170330A1
• Time in Patent Office: 1,820 Days
• Field of Search: 382/254, 382/232, 382/233, 382/260, 370/447, 370/521, 708/290, 707/101, 709/231, 375/E7.092, 375/E7.105, 375/E7.093, 375/E7.113, 375/E7.281, 348/716, 348/E5.062, 348/E5.077, 341/155, 341/110, 341/143
• US Class Current: 382/233
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/521 for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
• CPC Class Codes: H04N 19/523 with sub-pixel accuracy
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 5/14 Picture signal circuitry for video frequency region cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/21 Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84

Abstract

The present invention provides advanced encoding and advanced reconstruction apparatus and methods enabling low bitrate, enhanced coding and quality-enhanced reconstruction, among other aspects. Preferably operating in accordance with a super-domain model, the invention enables the superimposed use of advanced coding tools such as for determining the susceptibility of image data to optimization and degradation avoidance. Other preferred tools also include multi-dimensional diffusion, registration, meta data utilization, advanced constructs, image representation optimization and efficiency optimization. Advanced decoding further enables maximized utilization of received enhanced image data and other information, also preferably in accordance with a super-domain model. Advanced encoding preferably comprises reverse-superresolution encoding and advanced decoding preferably comprises advanced superresolution decoding, which can further be conducted in a distributed and/or cooperative manner.

Claims

1. A method for enhancing a digital signal, comprising:

receiving a compressed digital signal from a modulated communication and/or storage medium by a digital signal receiver; and

modifying the digital signal by a digital modifier such that an enhancement aspect is composited within a redundant aspect of the digital signal forming an enhanced digital signal;

decoding the compressed digital signal according to a standard method by a decoder to form a standard decoded frame;

demultiplexing meta data associated with the digital signal by a multiplexer;

upsampling the digital signal according to the meta data by an upsampler;

interpolating a first image frame prediction by an interpolator based on the results of the standard decoding and the upsampling; and

fusing the standard decoded frame, the interpolated standard decoded frame, and one or more previously enhanced frames by a fuser.

2. A method for diffusing data within standard-coded digital image data, comprising the steps of:

identifying a compressed image aspect in a series of compressed image representations by an identifier;

determining redundant representations of the compressed image aspect within the series of compressed image representations by a determiner; and

modifying a redundant representation by a modifier to form a modified-representation such that the aspect is more completely conveyed by the series of compressed image representations.

3. The method of claim 2, further comprising the steps of:

comparing the modified-representation with an alternatively-modified representation to form a comparison; and

causing the modified-representation or alternatively-modified representation to be formed in accordance with the comparison.

4. A modified representation formed according to the method of claim 2.

5. A diffuser comprising:

means for identifying an image aspect in a series of compressed image representations;

means for determining redundant representations of the image aspect within further series of image representations; and

means for modifying a redundant representation such that the aspect is more completely conveyed by the series of compressed image representations.

6. The diffuser of claim 5, wherein:

the means for identifying the image aspect in the series of compressed image representations comprises a compressed image aspect detector;

the means for determining redundant representations of the image aspect within further series of image representations comprises a redundant compressed image aspect representation detector coupled to the compressed image aspect detector; and

the means for modifying the redundant representation such that the aspect is more completely conveyed by the series of compressed image representations comprises a redundant representation modifier coupled to the redundant compressed image aspect representation detector.

7. A method of enhancing a video frame, comprising the steps of:

enhancing a first image frame in an encoder by an enhancer;

analyzing the first image frame by an analyzer to determine a coding and a reconstruction of the first image frame;

optimizing a sequential frame based at least partly on the coding and reconstruction of the first image frame by an optimizer;

injecting a controlled alias signal component into an encoded video signal in the encoder by an injector; and

describing the controlled alias signal component in meta-data associated with the encoded video signal by a describer.

8. A method of enhancing a video frame, comprising the steps of:

enhancing a first image frame in an encoder by an enhancer;

analyzing the first image frame by an analyzer to determine a coding and a reconstruction of the first image frame;

optimizing a sequential frame by an optimizer based at least partly on the coding and reconstruction of the first image frame;

fusing the first frame and the sequential frame by a fuser via an enhanced reconstruction technique such that the first frame and the sequential frame have a substantially consistent quality.