Motion assisted data enhancement

• US 20070258654A1
• Filed: 04/07/2006
• Published: 11/08/2007
• Est. Priority Date: 04/07/2006
• Status: Active Grant

• Current Assignee: Mineral Lassen LLC (Intellectual Ventures LLC)
• Original Assignee: Essex PA LLC (Intellectual Ventures LLC)
• Inventors: Monro, Donald
• Granted Patent: US 7,783,079 B2
• Time in Patent Office: Days
• US Class Current: 382/254
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

Embodiments related to enhancing data are disclosed.

Claims

1. A method, comprising:

identifying one or more data points in a target frame and corresponding one or more data points in at least one adjacent frame;

creating a trace based at least in part upon the identified one or more data points in a target frame and at least one adjacent frame; and

estimating the value of the one or more data points in the target frame based at least in part upon values of the data points in the trace.

2. The method according to claim 1, further comprising determining motion vectors for one or more data points from a target frame and adjacent frames, which the trace is based at least in part upon.

3. The method according to claim 2, wherein the determining motion vectors comprises block matching of selected frames.

4. The method according to claim 2, wherein the determining motion vectors comprises optical flow of selected frames.

5. The method according to claim 1, further comprising receiving motion vectors for one or more data points from a target frame and adjacent frames, from which the trace is based at least in part upon.

6. The method according to claim 1, wherein said estimated value of the one or more data points is utilized in at least one frame other than the target frame.

7. The method according to claim 1, wherein the adjacent frames are adjacent in time.

8. The method according to claim 1, wherein the adjacent frames are more than one frame apart in time.

9. The method according to claim 1, wherein said estimating comprises creating a histogram of values based at least in part upon the data points utilized for the trace.

10. The method according to claim 9, wherein said estimating further comprises performing calculations utilizing the values of the histogram.

11. The method according to claim 10, wherein said estimating further comprises utilizing a value, based at least in part upon the determination that the value is within a determined range.

12. The method according to claim 11, wherein said estimating further comprises excluding a value, based at least in part upon the determination the value is outside a determined range.

13. The method according to claim 12, wherein the determined range is based at least in part upon a range of values of the data point within a sequence of frames.

14. The method according to claim 12, wherein the determined range is based at least in part upon a range of values of the data points utilized in the histogram.

15. The method according to claim 12, further comprising excluding all values from a frame, based at least in part upon a determination that a determined number of values within a frame are outside a determined range.

16. The method according to claim 12, further comprising terminating the trace in a particular direction, based at least in part upon the determination that all values in a frame are outside a determined range.

17. The method according to claim 1, wherein said estimating is based at least in part upon a temporal position of a frame with respect to the target frame.

18. The method according to claim 12, wherein said estimating is based at least in part upon a value of a data point outside the determined range.

19. The method according to claim 1, wherein said estimating is based at least in part upon a median of the values of the trace.

20. The method according to claim 1, wherein said estimating is based at least in part upon a mean of the values of the trace.

21. The method according to claim 1, wherein said estimating is based at least in part upon a mode of the values of the trace.

22. The method according to claim 1, wherein said estimating is based at least in part upon an adjacent trace.

23. The method according to claim 1, wherein creating a trace comprises filtering of potential data point values.

24. The method according to claim 1, wherein creating a trace comprises utilizing sub-pixel accuracy.

25. The method according to claim 1, wherein said estimating comprises determining a value based at least in part upon values adjacent the data point within a frame.

26. A computer program product capable of being stored on a computer readable medium comprising instructions that, if executed by a computing platform, result in motion assisted enhancement of data, by:

identifying one or more data points in a target frame and corresponding data points in at least one adjacent frame;

creating a trace based at least in part upon the identified one or more data points in a target frame and at least one adjacent frame; and

estimating the value of the one or more data points in the target frame based at least in part upon values of the data points in the trace.

27. The product according to claim 26, further comprising determining motion vectors for one or more data points from a target frame and adjacent frames, which the trace is based at least in part upon.

28. The product according to claim 27, wherein the determining motion vectors comprises block matching of selected frames.

29. The product according to claim 27, wherein the determining motion vectors comprises optical flow of selected frames.

30. The product according to claim 26, further comprising receiving motion vectors for one or more data points from a target frame and adjacent frames, from which the trace is based at least in part upon.

31. The product according to claim 26, wherein said estimated value of the one or more data points is utilized in one or more frames.

32. The product according to claim 26, wherein said estimating comprises creating a histogram of values based at least in part upon the data points utilized for the trace.

33. The product according to claim 32, wherein said estimating further comprises performing calculations utilizing the values of the histogram.

34. The product according to claim 33, wherein said estimating further comprises utilizing a value, based at least in part upon the determination that the value is within a determined range.

35. The product according to claim 34, wherein said estimating further comprises excluding a value, based at least in part upon the determination the value is outside a determined range.

36. The product according to claim 35, wherein the determined range is based at least in part upon a range of values of the data point within a sequence of frames.

37. The product according to claim 35, wherein the determined range is based at least in part upon a range of values of the data points within the histogram.

38. The product according to claim 26, wherein said estimating is based at least in part upon an adjacent trace.

39. The product according to claim 26, wherein creating a trace comprises filtering of potential data point values.

40. The product according to claim 26, wherein the creating a trace comprises utilizing sub-pixel accuracy.

41. The product according to claim 26, wherein said estimating comprises determining a data point value based at least in part upon data point values adjacent the data point within a frame.

42. A system for enhancing data, comprising:

means for identifying one or more data points in a target frame and corresponding data points in at least one adjacent frame;

means for creating a trace based at least in part upon the identified one or more data points in a target frame and at least one adjacent frame; and

means for estimating the value of the one or more data points in the target frame based at least in part upon values of the data points in the trace.

43. The system according to claim 42, further comprising means for determining motion vectors for one or more data points from a target frame and adjacent frames, which the trace is based at least in part upon.

44. The system according to claim 43, further comprising means for receiving motion vectors for one or more data points from a target frame and adjacent frames, from which the trace is based at least in part upon.