TRANSFORMING VIDEO DATA IN ACCORDANCE WITH THREE DIMENSIONAL INPUT FORMATS

• US 20110032329A1
• Filed: 05/13/2010
• Published: 02/10/2011
• Est. Priority Date: 08/06/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Bauza, Judit Martinez, Raveendran, Vijayalakshmi R.
• Granted Patent: US 9,083,958 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion

Abstract

In general, techniques are described for transforming video data in accordance with a three dimensional (3D) input format. As one example, an apparatus, such as a mobile or portable device, that includes a transformation module, a parameter discovery module and at least one interface implements the techniques. The parameter discovery module determines an input format supported by a 3D display device. The parameter discover module then configures the transformation module to transform two-dimensional (2D) video data into 3D video data so as to generate the 3D video data in accordance with the determined input format. The at least one interface receives 2D video data. The transformation module transforms the 2D video data to 3D video data so that the 3D video data complies with the determined input format. In this manner, the apparatus implements the techniques to transform video data in accordance with a determined 3D input format.

Claims

1. A method comprising:

determining, with a video processing device, one or more parameters that define capabilities supported by a three-dimensional (3D) display device, wherein the one or more parameters include an input format supported by the 3D display device;

configuring the video processing device to transform two-dimensional (2D) video data into 3D video data so as to generate the 3D video data in accordance with the determined input format;

receiving 2D video data; and

transforming the 2D video data to 3D video data so that the 3D video data complies with the determined input format.

2. The method of claim 1, wherein determining one or more parameters comprises automatically determining the one or more parameters that define the capabilities supported by the 3D display device.

3. The method of claim 1, wherein determining one or more parameters comprises interfacing with the 3D display device in accordance with a display interface protocol to determine the one or more parameters.

4. The method of claim 3, wherein the display interface protocol comprises one of a high-definition multimedia interface (HDMI) protocol, a wireless HDMI (WHDMI) protocol, a mobile display digital interface (MDDI), a wireless MDDI (WMDDI) and a mobile industry processor interface (MIPI).

5. The method of claim 1, further comprising:

receiving additional 3D video data that complies with a different input format not supported by the 3D display device; and

transforming the additional 3D video data that complies with the different input format to the 3D video data that complies with the determined input file format.

6. The method of claim 1, further comprising configuring the video processing device based on the determined parameters so as to define the transformation of the 2D video data for playback by the 3D display device.

7. The method of claim 1, wherein the parameters comprise at least one of supported contrasts, a current contrast, supported sharpness, a current sharpness, supported color temperatures, a current color temperature, a supported brightness, a current brightness, a supported resolution, a current resolution, a supported display format, a current display format, a supported color setting, a current color setting, a supported input format, a display type, a display manufacturer, a supported depth range, a current depth range, a supported location for a convergence plane, a current location of the convergence plane, a supported degree of smoothness of background objects, a current degree of smoothness of background objects, a supported eye-distance configuration, a current eye-distance configuration, a supported dominant-eye configuration, a current dominant-eye configuration, a supported number of views, a current number of views, a supported viewing distance, a current viewing distance, a supported viewing angle, a current viewing angle, a supported display location of the 3D video content within a screen, and a current location of the 3D video content within the screen.

8. The method of claim 1, further comprising:

presenting a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices;

presenting a second user interface that receives input data selecting a source of the 2D video data;

communicating with the selected source to receive the 2D video data; and

communicating with the selected 3D display device to automatically determine the one or more parameters.

9. The method of claim 1, further comprising:

presenting a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices;

presenting a second user interface that receives input data selecting a source of video data;

communicating with the selected source to receive the video data;

communicating with the selected 3D display device to automatically determine the one or more parameters; and

transforming the video data to 3D video data so that the 3D video data complies with the determined input format.

10. The method of claim 1, further comprising:

presenting a user interface that receives input data defining one or more user preferences,

configuring the device to transform video data into 3D video data so as to generate 3D video data in accordance with the defined user preferences.

11. The method of claim 10, wherein the user preferences include at least one of a desired sharpness, a desired contrast, a desired display format, a desired color temperature, desired color settings, a desired brightness, a desired maximum depth range, a desired location of a convergence plane, a desired degree of smoothness of background objects, a desired eye-distance configuration, a desired dominant-eye configuration, a desired number of views, a desired viewing distance, a desired viewing angle, and a desired display location and resolution of the 3D video content within the screen.

12. The method of claim 10, wherein presenting a user interface that receives input data defining one or more user preferences includes presenting a user interface that receives input data defining one or more global user preferences that apply globally to any application and one or more application-specific user preferences that apply only to a particular one or more applications.

13. The method of claim 1, further comprising, simultaneously with forwarding the generated 3D video data to the 3D display device, forwarding either a 2D version of the generated 3D video data or the generated 3D video data to an internal display included within the device so as to preview the 3D video data in either two-dimensions or three-dimensions.

14. The method of claim 1, further comprising:

while transforming the video data, determining one or more metrics using a Human Visual System (HVS) model that reflect a quality of 3D visualization of the generated 3D video data with respect to a human visual system; and

while transforming the video data, reconfiguring the video processing device based on the determined one or more metrics to refine the generation of the 3D video data.

15. The method of claim 1, wherein the input format comprises one or more of an input transmission format and an input storage format.

16. The method of claim 14,

wherein the one or more of an input transmission format and an input storage format comprises one or more of a 2D-plus-depth input format, a 2D-plus-depth-occlusion-and-global-effects input format, and a multiview stream input format, and

wherein the 2D-plus-depth-occlusion-and-global-effects input format defines one or more of a transparency, a global illumination model and an atmospheric effect.

17. The method of claim 1, wherein the video processing device comprises one of a mobile cellular phone, a mobile computing device, a portable device and a handset device.

18. The method of claim 1, further comprising forwarding the generated 3D video data to the 3D display device.

19. An apparatus comprising:

a transformation module;

a parameter discovery module that determines one or more parameters that define capabilities supported by a three-dimensional (3D) display device, wherein the one or more parameters include an input format supported by the 3D display device and configures the transformation module to transform two-dimensional (2D) video data into 3D video data so as to generate the 3D video data in accordance with the determined input format; and

at least one interface to receive 2D video data,

wherein the transformation module transforms the 2D video data to 3D video data so that the 3D video data complies with the determined input format.

20. The apparatus of claim 19, wherein the parameter discovery module automatically determines the one or more parameters that define the capabilities supported by the 3D display device.

21. The apparatus of claim 19, wherein the parameter discovery module interfaces with the 3D display device in accordance with a display interface protocol to determine the one or more parameters.

22. The apparatus of claim 21, wherein the display interface protocol comprises one of a high-definition multimedia interface (HDMI) protocol, a wireless HDMI (WHDMI) protocol, a mobile display digital interface (MDDI), a wireless MDDI (WMDDI) and a mobile industry processor interface (MIPI).

23. The apparatus of claim 19,

wherein the at least one interface receives additional 3D video data that complies with a different input format not supported by the 3D display device, and

wherein the transformation module transforms the additional 3D video data that complies with the different input format to the 3D video data that complies with the determined input file format.

24. The apparatus of claim 19, wherein the parameter discovery module configures the transformation module based on the determined parameters so as to define the transformation of the 2D video data for playback by the 3D display device.

25. The apparatus of claim 19, wherein the parameters comprise at least one of supported contrasts, a current contrast, supported sharpness, a current sharpness, supported color temperatures, a current color temperature, a supported brightness, a current brightness, a supported resolution, a current resolution, a supported display format, a current display format, a supported color setting, a current color setting, a supported input format, a display type, a display manufacturer, a supported depth range, a current depth range, a supported location for a convergence plane, a current location of the convergence plane, a supported degree of smoothness of background objects, a current degree of smoothness of background objects, a supported eye-distance configuration, a current eye-distance configuration, a supported dominant-eye configuration, a current dominant-eye configuration, a supported number of views, a current number of views, a supported viewing distance, a current viewing distance, a supported viewing angle, a current viewing angle, a supported display location of the 3D video content within a screen, and a current location of the 3D video content within the screen.

26. The apparatus of claim 19, further comprising a user interface module that presents a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices and a second user interface that receives input data selecting a source of the 2D video data,

wherein the at least one interface communicates with the selected source to receive the 2D video data and with the selected 3D display device to automatically determine the one or more parameters.

27. The apparatus of claim 19, further comprising a user interface module that presents a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices and a second user interface that receives input data selecting a source of video data,

wherein the at least one interface communicates with the selected source to receive the video data and with the selected 3D display device to automatically determine the one or more parameters, and

wherein the transformation module transforms the video data to 3D video data so that the 3D video data complies with the determined input format.

28. The apparatus of claim 19, further comprising:

a user interface module that presents a user interface that receives input data defining one or more user preferences; and

a human visual system (HVS) feedback module that configures the transformation module to transform video data into 3D video data so as to generate 3D video data in accordance with the defined user preferences.

29. The apparatus of claim 28, wherein the user preferences include at least one of a desired sharpness, a desired contrast, a desired display format, a desired color temperature, desired color settings, a desired brightness, a desired maximum depth range, a desired location of a convergence plane, a desired degree of smoothness of background objects, a desired eye-distance configuration, a desired dominant-eye configuration, a desired number of views, a desired viewing distance, a desired viewing angle, and a desired display location and resolution of the 3D video content within the screen.

30. The apparatus of claim 28, wherein the user interface module presents a user interface that receives input data defining one or more global user preferences that apply globally to any application and one or more application-specific user preferences that apply only to a particular one or more applications.

31. The apparatus of claim 19, further comprising an internal display that displays, simultaneously with forwarding the generated 3D video data to the 3D display device, either a 2D version of the generated 3D video data or the generated 3D video data so as to preview the 3D video data in either two-dimensions or three-dimensions.

32. The apparatus of claim 19, further comprising:

a human visual system (HVS) feedback module that, while the transformation module transforms the video data, determines one or more metrics using an HVS model that reflects a quality of 3D visualization of the generated 3D video data with respect to an HVS and, while the transformation transforms the video data, reconfigures the transformation module based on the determined one or more metrics to refine the generation of the 3D video data.

33. The apparatus of claim 19, wherein the input format comprises one or more of an input transmission format and an input storage format.

34. The apparatus of claim 33,

wherein the one or more of an input transmission format and an input storage format comprises one or more of a 2D-plus-depth input format, a 2D-plus-depth-occlusion-and-global-effects input format, and a multiview stream input format, and

wherein the 2D-plus-depth-occlusion-and-global-effects input format defines one or more of a transparency, a global illumination model and an atmospheric effect.

35. The apparatus of claim 19, wherein the apparatus comprises one of a video processing device, a mobile cellular phone, a mobile computing device, a portable device and a handset device.

36. The apparatus of claim 19, wherein the at least one interface forwards the generated 3D video data to the 3D display device.

37. A computer-readable storage medium comprising instructions that cause a processor to:

determine one or more parameters that define capabilities supported by a three-dimensional (3D) display device, wherein the one or more parameters include an input format supported by the 3D display device;

configure a video processing device to transform two-dimensional (2D) video data into 3D video data so as to generate the 3D video data in accordance with the determined input format;

receive 2D video data; and

transform the 2D video data to 3D video data so that the 3D video data complies with the determined input format.

38. An apparatus comprising:

means for transforming video data;

means for determining one or more parameters that define capabilities supported by a three-dimensional (3D) display device, wherein the one or more parameters include an input format supported by the 3D display device,

means for configuring the transformation module to transform two-dimensional (2D) video data into 3D video data so as to generate the 3D video data in accordance with the determined input format; and

means for receiving 2D video data,

wherein the means for transforming video data transforms the 2D video data to 3D video data so that the 3D video data complies with the determined input format.

39. The apparatus of claim 38, wherein means for determining one or more parameters comprises means for automatically determining the one or more parameters that define the capabilities supported by the 3D display device.

40. The apparatus of claim 38, wherein the means for determining comprises means for interfacing with the 3D display device in accordance with a display interface protocol to determine the one or more parameters.

41. The apparatus of claim 38,

wherein means for receiving comprises means for receiving additional 3D video data that complies with a different input format not supported by the 3D display device, and

wherein means for transforming comprises means for transforming the additional 3D video data that complies with the different input format to the 3D video data that complies with the determined input file format.

42. The apparatus of claim 38, further comprising:

means for presenting a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices;

means for presenting a second user interface that receives input data selecting a source of the 2D video data,

wherein the means for receiving includes means for communicating with the selected source to receive the 2D video data and with the selected 3D display device to automatically determine the one or more parameters.

43. The apparatus of claim 38, further comprising:

means for presenting a user interface that receives input data defining one or more user preferences; and

means for configuring the transformation module to transform video data into 3D video data so as to generate 3D video data in accordance with the defined user preferences.

44. The apparatus of claim 43, wherein means for presenting includes means for presenting a user interface that receives input data defining one or more global user preferences that apply globally to any application and one or more application-specific user preferences that apply only to a particular one or more applications.

45. The apparatus of claim 38, further comprising means for displaying, simultaneously with forwarding the generated 3D video data to the 3D display device, either a 2D version of the generated 3D video data or the generated 3D video data so as to preview the 3D video data in either two-dimensions or three-dimensions.

46. The apparatus of claim 38, further comprising means for determining, while the transformation module transforms the video data, one or more metrics using an HVS model that reflects a quality of 3D visualization of the generated 3D video data with respect to an HVS and, while the transformation transforms the video data, reconfigures the transformation module based on the determined one or more metrics to refine the generation of the 3D video data.

47. The apparatus of claim 38, wherein the apparatus comprises one of a video processing device, a mobile cellular phone, a mobile computing device, a portable device and a handset device.

48. The apparatus of claim 38, further comprising means for forwarding the generated 3D video data to the 3D display device.