PREPARING VIDEO DATA IN ACCORDANCE WITH A WIRELESS DISPLAY PROTOCOL

• US 20110032334A1
• Filed: 05/13/2010
• Published: 02/10/2011
• Est. Priority Date: 08/06/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Soliman, Samir S., Martinez Bauza, Judit, Raveendran, Vijayalakshmi R.
• Granted Patent: US 9,131,279 B2
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/139 Format conversion, e.g. of frame-rate or size
• CPC Class Codes: H04N 21/2381 Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/4381 Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/440218 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 conversion of standards in analogue television systems H04N7/01
• CPC Class Codes: H04N 21/44231 Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

In general, techniques are described for preparing video data in accordance with a wireless display protocol. For example, a portable device comprising a module to store video data, a wireless display host module and a wireless interface may implement the techniques of this disclosure. The wireless display host module determines one or more display parameters of a three-dimensional (3D) display device external from the portable device and prepares the video data to generate 3D video data based on the determined display parameters. The wireless interface then wirelessly transmits the 3D video data to the external 3D display device. In this way, a portable device implements the techniques to prepare video data in accordance with a wireless display protocol.

Claims

1. A portable device comprising:

a module to store video data;

a wireless display host module that determines one or more display parameters of a three-dimensional (3D) display device external from the portable device, and prepares the video data to generate 3D video data based on the determined display parameters; and

a wireless interface that wirelessly transmits the 3D video data to the external 3D display device.

2. The portable device of claim 1, wherein the wireless display host module prepares the video data by processing one or more of the video data and metadata associated with the video data in accordance with one or more of the display parameters.

3. The portable device of claim 1,

wherein the wireless display host module prepares the video data to generate 3D video data in accordance with a wireless display protocol;

and

wherein the wireless interface wirelessly transmits the 3D video data to the external 3D display device in accordance with the wireless display protocol.

4. The portable device of claim 3, further comprising a video processing module that transforms two-dimensional (2D) video data into the 3D video data,

wherein the wireless display host module automatically determines the display parameters, and wherein the display parameters include an input format supported by the 3D display device, and configures the transformation module so that the transformation module generates the 3D video data in accordance with the automatically determined input format.

5. The portable device of claim 3, wherein the wireless display protocol comprises a transport protocol that encapsulates each of a plurality of video data and a plurality of depth data segments of the 3D video data in a different one of a plurality of packets.

6. The portable device of claim 5,

wherein the transport protocol comprises an application layer transport protocol, and

wherein the application layer transport protocol comprises a real-time transport protocol (RTP).

7. The portable device of claim 5, wherein the transport protocol further encapsulates metadata associated with the depth data segments.

8. The portable device of claim 1, wherein the wireless interface wirelessly transmits the 3D video data to a wireless display client module coupled to the external 3D display device, and wherein the wireless display host module and the wireless display client module both support a wireless display protocol.

9. The portable device of claim 1, further comprising a transformation module that transforms two-dimensional (2D) video data into the 3D video data,

wherein the wireless display host module automatically determines the display parameters, and wherein the display parameters include an input format supported by the 3D display device, and configures the transformation module so that the transformation module generates the 3D video data in accordance with the automatically determined input format.

10. The portable device of claim 9, wherein the input format comprises one of a 2D-plus-depth input format, a 2D-plus-depth-occlusion-and-global-effects input format, and a multiview stream input format, and

wherein the 2D-plus-depth-occlusion-and-global-effects input format defines one or more of a transparency, a global illumination model and an atmospheric effect.

11. The portable device of claim 9, further comprising a user interface module that presents a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices, wherein the wireless interface wirelessly communicates with the selected 3D display device to automatically determine the display parameters.

12. The portable device of claim 9, further comprising a user interface module that presents a user interface that receives input data defining one or more user preferences, wherein the wireless display host module configures the transformation module so that the transformation module generates the 3D video data in accordance with the defined user preferences.

13. The portable device of claim 1, further comprising a transformation module that transforms the video data to generate the 3D video data;

and

a Human Visual System (HVS) feedback module that, while the transformation module transforms the video data, determines one or more metrics using a HVS model that reflect a quality of 3D visualization of the generated 3D video data with respect to a human visual system and reconfigures the transformation module based on the determined one or more metrics to refine the generation of the 3D video data.

14. The portable device of claim 13, wherein the wireless interface transmits the 3D video data to the 3D display device as the 3D video data is generated.

15. The portable device of claim 13, further comprising a user interface module that presents a user interface that receives input data defining one or more user preferences, wherein the HVS feedback module configures the transformation module so as to generate 3D video data in accordance with the defined user preferences.

16. The portable device of claim 1, wherein the portable device comprises one of a mobile cellular phone, a mobile computing device, a portable device and a handset device.

17. A method comprising:

storing, with a portable device, video data;

determining, with a wireless display host module of the portable device, one or more display parameters of a three-dimensional (3D) display device external from the portable device;

preparing, with the wireless display host module, the video data to generate 3D video data based on the determined display parameters; and

transmitting, with the portable device, the 3D video data to the external 3D display device.

18. The method of claim 17, wherein preparing the video data comprises processing one or more of the video data and metadata associated with the video data in accordance with one or more of the display parameters.

19. The method of claim 17,

wherein preparing the video data comprises preparing the video data to generate the 3D video data in accordance with a wireless display protocol;

and

wherein transmitting the 3D video data comprises transmitting the 3D video data to the external 3D display device in accordance with the wireless display protocol.

20. The method of claim 19, further comprising transforming, with a transformation module of the portable device, two-dimensional (2D) video data into the 3D video data,

wherein determining the one or more display parameters comprises automatically determining the one or more display parameters, and

wherein the display parameters include an input format supported by the 3D display device, and

the method further comprises configuring the transformation module so that the transformation module generates the 3D video data in accordance with the automatically determined input format.

21. The method of claim 19, wherein the wireless display protocol comprises a transport protocol that encapsulates each of a plurality of video data and a plurality of depth data segments of the 3D video data in a different one of a plurality of packets.

22. The method of claim 21,

wherein the transport protocol comprises an application layer transport protocol, and

wherein the application layer transport protocol comprises a real-time transport protocol (RTP).

23. The method of claim 21, wherein the transport protocol further encapsulates metadata associated with the depth data segments.

24. The method of claim 17, wherein transmitting the 3D video data comprises wirelessly transmitting the 3D video data to a wireless display client module coupled to the external 3D display device, and wherein the wireless display host module and the wireless display client module both support a wireless display protocol.

25. The method of claim 17, further comprising transforming, with a transformation module of the portable device, two-dimensional (2D) video data into the 3D video data,

wherein determining the one or more display parameters comprises automatically determining the one or more display parameters, and

wherein the display parameters include an input format supported by the 3D display device, and

the method further comprising configuring the transformation module so that the transformation module generates the 3D video data in accordance with the automatically determined input format.

26. The method of claim 25, wherein the input format comprises one of a 2D-plus-depth input format, a 2D-plus-depth-occlusion-and-global-effects input format, and a multiview stream input format, and

wherein the 2D-plus-depth-occlusion-and-global-effects input format defines one or more of a transparency, a global illumination model and an atmospheric effect.

27. The method of claim 25, further comprising:

presenting a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices; and

wirelessly communicating with the selected 3D display device to automatically determine the display parameters.

28. The method of claim 25, further comprising:

presenting a user interface that receives input data defining one or more user preferences; and

configuring the transformation module so that the transformation module generates the 3D video data in accordance with the defined user preferences.

29. The method of claim 17, further comprising:

transforming, with a transformation module of the portable device, the video data to generate the 3D video data;

while the transformation module transforms the video data, determining one or more metrics using a HVS model that reflect a quality of 3D visualization of the generated 3D video data with respect to a human visual system; and

while the transformation module transforms the video data, reconfiguring the transformation module based on the determined one or more metrics to refine the generation of the 3D video data.

30. The method of claim 29, wherein transmitting the 3D video data comprises transmitting the 3D video data to the 3D display device as the 3D video data is generated.

31. The method of claim 29, further comprising:

presenting a user interface that receives input data defining one or more user preferences; and

configuring the transformation module so as to generate 3D video data in accordance with the defined user preferences.

32. The method of claim 17, wherein the portable device comprises one of a mobile cellular phone, a mobile computing device, a portable device and a handset device.

33. A portable device comprising:

means for storing video data;

means for determining one or more display parameters of a three-dimensional (3D) display device external from the portable device;

means for preparing the video data to generate 3D video data based on the determined display parameters; and

means for transmitting the 3D video data to the external 3D display device.

34. The portable device of claim 33, wherein the means for preparing the video data comprises means for processing one or more of the video data and metadata associated with the video data in accordance with one or more of the display parameters.

35. The portable device of claim 33,

wherein the means for preparing the video data comprises means for preparing the video data to generate the 3D video data in accordance with a wireless display protocol;

and

wherein the means for transmitting the 3D video data comprises means for transmitting the 3D video data to the external 3D display device in accordance with the wireless display protocol.

36. The portable device of claim 35, further comprising means for transforming two-dimensional (2D) video data into the 3D video data,

wherein the means for determining the one or more display parameters comprises means for automatically determining the one or more display parameters, and

wherein the display parameters include an input format supported by the 3D display device, and

the portable device further comprises means for configuring the means for transforming so that the means for transforming generates the 3D video data in accordance with the automatically determined input format.

37. The portable device of claim 35, wherein the wireless display protocol comprises a transport protocol that encapsulates each of a plurality of video data and a plurality of depth data segments of the 3D video data in a different one of a plurality of packets.

38. The portable device of claim 37,

wherein the transport protocol comprises an application layer transport protocol, and

wherein the application layer transport protocol comprises a real-time transport protocol (RTP).

39. The portable device of claim 37, wherein the transport protocol further encapsulates metadata associated with the depth data segments.

40. The portable device of claim 33, wherein the means for transmitting the 3D video data comprises means for wirelessly transmitting the 3D video data to a wireless display client module coupled to the external 3D display device, and wherein the wireless display host module and the wireless display client module both support a wireless display protocol.

41. The portable device of claim 33, further comprising:

means for transforming two-dimensional (2D) video data into the 3D video data,

wherein the means for determining the one or more display parameters comprises means for automatically determining the one or more display parameters, and

wherein the display parameters include an input format supported by the 3D display device; and

means for configuring means for transforming so that means for transforming generates the 3D video data in accordance with the automatically determined input format.

42. The portable device of claim 41, wherein the input format comprises one of a 2D-plus-depth input format, a 2D-plus-depth-occlusion-and-global-effects input format, and a multiview stream input format, and

wherein the 2D-plus-depth-occlusion-and-global-effects input format defines one or more of a transparency, a global illumination model and an atmospheric effect.

43. The portable device of claim 41, further comprising:

means for presenting a first user interface that receives input data selecting the 3D display device from among a plurality of 3D display devices; and

means for wirelessly communicating with the selected 3D display device to automatically determine the display parameters.

44. The portable device of claim 41, further comprising:

means for presenting a user interface that receives input data defining one or more user preferences; and

means for configuring the means for transforming so that the means for transforming generates the 3D video data in accordance with the defined user preferences.

45. The portable device of claim 33, further comprising:

means for transforming the video data to generate the 3D video data;

means for determining, while transforming the video data, one or more metrics using a HVS model that reflect a quality of 3D visualization of the generated 3D video data with respect to a human visual system; and

means for reconfiguring, while transforming the video data, the means for transforming based on the determined one or more metrics to refine the generation of the 3D video data.

46. The portable device of claim 45, wherein the means for transmitting the 3D video data comprises means for transmitting the 3D video data to the 3D display device as the 3D video data is generated.

47. The portable device of claim 45, further comprising:

means for presenting a user interface that receives input data defining one or more user preferences; and

means for configuring the means for transforming so as to generate 3D video data in accordance with the defined user preferences.

48. The portable device of claim 33, wherein the portable device comprises one of a mobile cellular phone, a mobile computing device, a portable device and a handset device.

49. A computer-readable storage medium comprising instructions that cause a processor to:

store video data;

determine one or more display parameters of a three-dimensional (3D) display device external from the portable device;

prepare the video data to generate 3D video data based on the determined display parameters; and

transmit the 3D video data to the external 3D display device.