METHOD AND APPARATUS FOR PERFORMING IMAGE PROCESSING ACCORDING TO DISPARITY INFORMATION

• US 20130050420A1
• Filed: 03/18/2012
• Published: 02/28/2013
• Est. Priority Date: 08/22/2011
• Status: Abandoned Application

• Current Assignee: MediaTek, Inc.
• Original Assignee: Cheng-Tsai Ho, Chi-Cheng Ju, Ding-Yun Chen
• Inventors: Chen, Ding-Yun, Ho, Cheng-Tsai, Ju, Chi-Cheng
• Application Number:
  US13/423,266
• Publication Number:
  US 20130050420A1
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/111 Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
• CPC Class Codes: H04N 13/122 Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues H04N13/128 takes precedence
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals

Abstract

An exemplary image processing method includes obtaining disparity information, and generating output image data by performing an image processing operation upon input image data according to the disparity information. An exemplary image processing apparatus includes a disparity information acquisition circuit and an image processing circuit. The disparity information acquisition circuit is arranged for obtaining disparity information. The image processing circuit is coupled to the disparity information acquisition circuit, and arranged for generating output image data by processing input image data according to the disparity information.

Claims

1. An image processing method, comprising:

obtaining disparity information; and

generating output image data by performing an image processing operation upon input image data according to the disparity information.

2. The image processing method of claim 1, further comprising:

receiving a plurality of multi-view images;

wherein the step of obtaining the disparity information comprises;

deriving the disparity information from processing the multi-view images.

3. The image processing method of claim 1, further comprising:

receiving a plurality of multi-view images, wherein one of the multi-view images acts as the input image data.

4. The image processing method of claim 3, wherein the multi-view images are derived from a three-dimensional (3D) video input, and includes a pair of a left-eye image and a right-eye image, and the image processing method further comprises:

outputting the output image data to a two-dimensional (2D) display apparatus.

5. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

obtaining a target kernel filter according to the disparity information; and

applying the target kernel filter to one or more pixels of the input image data.

6. The image processing method of claim 5, wherein the step of obtaining the target kernel filter comprises:

referring to the disparity information to calculate coefficients of the target kernel filter.

7. The image processing method of claim 5, wherein the step of obtaining the target kernel filter comprises:

referring to the disparity information to select one of a plurality of pre-defined kernel filters as the target kernel filter.

8. The image processing method of claim 5, wherein the target kernel filter is a sharpness filter.

9. The image processing method of claim 8, wherein the image processing operation generates a sharper filter output when the disparity information has a larger disparity value.

10. The image processing method of claim 5, wherein the target kernel filter is a blur filter.

11. The image processing method of claim 10, wherein the image processing operation generates a more blurred filter output when the disparity information has a smaller disparity value.

12. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

performing color adjustment according to the disparity information.

13. The image processing method of claim 12, wherein the color adjustment is configured to adjust saturation of one or more pixels of the input image data.

14. The image processing method of claim 13, wherein the image processing operation increases the saturation when the disparity information has a larger disparity value, or the image processing operation decreases the saturation when the disparity information has a smaller disparity value.

15. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

adjusting brightness of one or more pixels of the input image data according to the disparity information.

16. The image processing method of claim 15, wherein the image processing operation increases the brightness when the disparity information has a larger disparity value, or the image processing operation decreases the brightness when the disparity information has a smaller disparity value.

17. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

adjusting contrast of one or more pixels of the input image data according to the disparity information.

18. The image processing method of claim 17, wherein the image processing operation increases the contrast when the disparity information has a larger disparity value, or the image processing operation decreases the contrast when the disparity information has a smaller disparity value.

19. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

obtaining a target gamma curve according to the disparity information; and

applying the target gamma curve to one or more pixels of the input image data.

20. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

obtaining a target tone mapping according to the disparity information; and

applying the target tone mapping to one or more pixels of the input image data.

21. The image processing method of claim 20, wherein the image processing operation increases a dynamic range when the disparity information has a larger disparity value, or the image processing operation decreases the dynamic range when the disparity information indicates a smaller disparity value.

22. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

moving one or more pixels of the input image data according to the disparity information.

23. The image processing method of claim 22, wherein the step of moving one or more pixels of the input image data comprises:

determining move magnitude according to the disparity information and a first parameter that defines a movement range; and

moving one or more pixels of the input image data according to the move magnitude and a second parameter that defines a move direction.

24. The image processing method of claim 23, wherein the step of moving one or more pixels of the input image data further comprises:

setting the first parameter and the second parameter by receiving a user interactive input or referring to a pre-defined parameter setting.

25. The image processing method of claim 23, wherein the image processing operation makes the move magnitude larger when the disparity information has a larger disparity value, or the image processing operation makes the move magnitude smaller when the disparity information has a smaller disparity value.

26. The image processing method of claim 23, wherein the image processing operation makes the move magnitude smaller when the disparity information has a larger disparity value, or the image processing operation makes the move magnitude larger when the disparity information has a smaller disparity value.

27. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

determining a gain value according to the disparity information; and

applying the gain value to one or more pixels of the input image data.

28. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

determining an offset value according to the disparity information; and

applying the offset value to one or more pixels of the input image data.

29. The image processing method of claim 1, wherein the step of performing the image processing operation comprises:

performing scaling upon at least one image object in the input image data according to the disparity information.

30. An image processing apparatus, comprising:

a disparity information acquisition circuit, arranged for obtaining disparity information; and

an image processing circuit, coupled to the disparity information acquisition circuit and arranged for generating output image data by processing input image data according to the disparity information.

31. The image processing apparatus of claim 30, further comprising:

a receiving circuit, coupled to the disparity information acquisition circuit and arranged for receiving a plurality of multi-view images;

wherein the disparity information acquisition circuit derives the disparity information from processing the multi-view images.

32. The image processing apparatus of claim 30, further comprising:

a receiving circuit, coupled to the image processing circuit and arranged for receiving a plurality of multi-view images;

wherein one of the multi-view images acts as the input image data.

33. The image processing apparatus of claim 32, wherein the multi-view images are derived from a three-dimensional (3D) video input, and includes a pair of a left-eye image and a right-eye image, and the image processing apparatus further comprises:

an output circuit, coupled to the image processing circuit and arranged for outputting the output image data to a two-dimensional (2D) display apparatus.

34. The image processing apparatus of claim 30, wherein the image processing circuit has a target kernel filter obtained according to the disparity information, and applies the target kernel filter to one or more pixels of the input image data.

35. The image processing apparatus of claim 34, wherein the image processing circuit refers to the disparity information to calculate coefficients of the target kernel filter.

36. The image processing apparatus of claim 34, wherein the image processing circuit comprises:

a plurality of pre-defined kernel filters; and

a selecting unit, arranged for referring to the disparity information to select one of the pre-defined kernel filters as the target kernel filter.

37. The image processing apparatus of claim 34, wherein the target kernel filter is a sharpness filter.

38. The image processing apparatus of claim 37, wherein the image processing circuit generates a sharper filter output when the disparity information has a larger disparity value.

39. The image processing apparatus of claim 34, wherein the target kernel filter is a blur filter.

40. The image processing apparatus of claim 39, wherein the image processing circuit generates a more blurred filter output when the disparity information has a smaller disparity value.

41. The image processing apparatus of claim 30, wherein the image processing circuit performs color adjustment according to the disparity information.

42. The image processing apparatus of claim 41, wherein the color adjustment is configured to adjust saturation of one or more pixels of the input image data.

43. The image processing apparatus of claim 42, wherein the image processing circuit increases the saturation when the disparity information has a larger disparity value, or the image processing circuit decreases the saturation when the disparity information has a smaller disparity value.

44. The image processing apparatus of claim 30, wherein the image processing circuit adjusts brightness of one or more pixels of the input image data according to the disparity information.

45. The image processing apparatus of claim 44, wherein the image processing circuit increases the brightness when the disparity information has a larger disparity value, or the image processing circuit decreases the brightness when the disparity information has a smaller disparity value.

46. The image processing apparatus of claim 30, wherein the image processing circuit is arranged to adjust contrast of one or more pixels of the input image data according to the disparity information.

47. The image processing apparatus of claim 46, wherein the image processing circuit increases the contrast when the disparity information has a larger disparity value, or the image processing circuit decreases the contrast when the disparity information has a smaller disparity value.

48. The image processing apparatus of claim 30, wherein the image processing circuit obtains a target gamma curve according to the disparity information, and applies the target gamma curve to one or more pixels of the input image data.

49. The image processing apparatus of claim 30, wherein the image processing circuit obtains a target tone mapping according to the disparity information, and applies the target tone mapping to one or more pixels of the input image data.

50. The image processing apparatus of claim 49, wherein the image processing circuit increases a dynamic range when the disparity information has a larger disparity value, or the image processing circuit decreases the dynamic range when the disparity information indicates a smaller disparity value.

51. The image processing apparatus of claim 30, wherein the image processing circuit moves one or more pixels of the input image data according to the disparity information.

52. The image processing apparatus of claim 51, wherein the image processing circuit comprises:

a calculating unit, arranged for determining move magnitude according to the disparity information and a first parameter that defines a movement range; and

a pixel moving unit, coupled to the calculating unit and arranged for moving one or more pixels of the input image data according to the move magnitude and a second parameter that defines a move direction.

53. The image processing apparatus of claim 52, wherein the first parameter and the second parameter are set by a user interactive input or a pre-defined parameter setting.

54. The image processing apparatus of claim 52, wherein the calculating unit makes the move magnitude larger when the disparity information has a larger disparity value, or the calculating unit makes the move magnitude smaller when the disparity information has a smaller disparity value.

55. The image processing apparatus of claim 52, wherein the calculating unit makes the move magnitude smaller when the disparity information has a larger disparity value, or the calculating unit makes the move magnitude larger when the disparity information has a smaller disparity value.

56. The image processing apparatus of claim 30, wherein the image processing circuit comprises:

a gain value determining unit, arranged for determining a gain value according to the disparity information; and

an adjusting unit, coupled to the gain value determining unit and arranged for applying the gain value to one or more pixels of the input image data.

57. The image processing apparatus of claim 30, wherein the image processing circuit comprises:

an offset value determining unit, arranged for determining an offset value according to the disparity information; and

an adjusting unit, coupled to the offset value determining unit and arranged for applying the offset value to one or more pixels of the input image data.

58. The image processing apparatus of claim 30, wherein the image processing circuit performs scaling upon at least one image object in the input image data according to the disparity information.