Method and apparatus for model-based recovery of packet loss errors

• US 8,516,534 B2
• Filed: 04/24/2009
• Issued: 08/20/2013
• Est. Priority Date: 04/24/2009
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Pratt, James, Sullivan, Marc, Crowe, Keith
• Primary Examiner(s): Pendleton, Brian
• Assistant Examiner(s): Lin, Jason K
• Application Number:
  US12/429,978
• Publication Number:
  US 20100275237A1
• Time in Patent Office: 1,579 Days
• Field of Search: None
• US Class Current: 725/116
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59

Abstract

A media processor having a controller operable to recognize a portion of a video stream in an Interactive TV (iTV) network having video compression artifacts corresponding to a stored model and perform model-based video correction of the portion recognized using synthetically generated images of objects in a captured video scene. Other embodiments are disclosed.

Claims

1. A method, comprising:

recognizing, by a set top box comprising a processor, a portion of a video stream in an Internet Protocol TV network having video compression artifacts corresponding to a stored model, the stored model including an image or a video model of an image background;

performing, by the set top box, model-based video correction of the portion recognized using synthetically generated images of objects in a captured video scene; and

delivering, by the set top box, to a presentation device a corrected portion of the video stream over a low bit rate connection,

wherein the model-based video correction corresponds to synthetic replacement of the artifacts according to a stored model of replacement images, and

wherein recognizing the portion of the video stream further comprises recognizing, within a captured video, a predetermined amount of compression artifacts for the portion of the video stream for an object having a stored corresponding model for the object.

2. The method of claim 1, wherein the stored model comprises images of grass, faces, skies, or mountains.

3. The method of claim 1, comprising creating a partially synthetic image of a face to correct a portion of a video stream having video compression artifacts corresponding to a stored model of the face.

4. The method of claim 1, comprising creating unrecognizable but visually acceptable synthesized images of individuals in a background of a video share stream.

5. The method of claim 4, comprising creating unrecognizable images of individuals in a background of a video share stream sufficient to avoid a right of publicity claim.

6. The method of claim 1, wherein the model-based video correction is a physical model based enhancement to a video image.

7. The method of claim 1, wherein the set top box contains a library of stored models, and wherein the presentation device corresponds to a cellular phone.

8. The method of claim 1, wherein a server contains a library of stored models retrieved by the set top box.

9. The method of claim 1, wherein the set top box uses a digital video recorder as a buffer for temporarily storing a corrected video stream.

10. The method of claim 1, comprising storing a corrected video stream at the set top box and forwarding the corrected video stream to a mobile phone.

11. A tangible computer-readable storage device, comprising computer instructions which, when executed by a processor, cause the processor to perform operations comprising:

recognizing within a captured video, a predetermined amount of compression artifacts for a portion of video for an object having a stored corresponding model for the object, the stored model including an image or a video model of an image background; and

synthesizing video using model-based video correction to provide a higher quality image for correcting defects in the captured video,

wherein the model-based video correction corresponds to synthetic replacement of artifacts in the captured video according to a stored model of replacement images.

12. The tangible computer-readable storage device of claim 11, wherein the captured video includes compression artifacts from video that have been compressed.

13. The tangible computer-readable storage device of claim 11, wherein the operations further comprise recognizing a portion of a video stream in an internet protocol television network having video compression artifacts corresponding to a stored model.

14. The tangible computer-readable storage device of claim 13, wherein the operations further comprise synthetically generating images of objects to correct defects in a captured video scene using model-based video correction of the portion recognized.

15. The tangible computer-readable storage device of claim 11, wherein the operations further comprise delivering a corrected portion of a video stream over a low bit rate connection.

16. The tangible computer-readable storage device of claim 11, wherein the stored model comprises images of grass, faces, skies, or mountains.

17. The tangible computer-readable storage device of claim 11, wherein the operations further comprise creating a partially synthetic image of a face to correct a portion of a video stream having video compression artifacts corresponding to a stored model of the face.

18. The tangible computer-readable storage device of claim 11, wherein the operations further comprise storing a corrected video stream and forwarding the corrected video stream to a mobile phone.

19. The tangible computer-readable storage device of claim 11, wherein the operations further comprise storing a corrected video stream at a set top box in an internet protocol television network and forwarding the corrected video stream to a mobile phone.

20. A media processor, comprising:

a memory to store instructions; and

a controller coupled to the memory, wherein responsive to executing the instructions, the controller performs operations comprising;

recognizing a portion of a video stream in an Interactive TV network having video compression artifacts corresponding to a stored model, the stored model including an image or a video model of an image background; and

performing model-based video correction of the portion recognized using synthetically generated images of objects to correct defects in a captured video scene,

wherein the model-based video correction corresponds to synthetic replacement of the artifacts according to a stored model of replacement images, and

wherein the controller recognizes, within a captured video, a predetermined amount of compression artifacts for a portion of video for an object having a stored corresponding model for the object.

21. The media processor of claim 20, wherein the operations further comprise delivering the corrected portion of the video stream over a low bit rate connection.

22. The media processor of claim 20, wherein the operations further comprise storing the corrected portion of the video stream, combine the corrected portion with a remaining portion of the video stream to form a corrected video stream, and forward the corrected video stream to a mobile phone.

23. The media processor of claim 20, wherein the operations further comprise creating a partially synthetic image of an object to correct a portion of a video stream having video compression artifacts corresponding to a stored model of the object.

24. The media processor of claim 20, wherein the operations further comprise creating unrecognizable but visually acceptable synthesized images of objects in a background of a video share stream.

25. A server, comprising:

a memory to store instructions; and

a controller coupled to the memory, wherein responsive to executing the instructions, the controller performs operations comprising;

recognizing within a captured video, a predetermined amount of compression artifacts for a portion of video for an object having a stored corresponding model for the object, the stored model including an image or a video model of an image background; and

synthesizing the portion of the video using model-based video correction according to a stored model of replacement images,

wherein the model-based video correction corresponds to synthetic replacement of the artifacts according to the stored model of replacement images.