Transforming multimedia data for delivery to multiple heterogeneous devices

• US 20030110297A1
• Filed: 10/29/2002
• Published: 06/12/2003
• Est. Priority Date: 12/12/2001
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Visharam, Mohammed Z., Tabatabai, Ali J., Walker, Toby
• Application Number:
  US10/283,738
• Publication Number:
  US 20030110297A1
• Time in Patent Office: Days
• US Class Current: 709/246
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

A multimedia presentation is transformed for playback on multiple heterogeneous target devices. A transformation operation is selected based on capabilities of the target device and used to create an adapted version of the multimedia presentation from a source version of the multimedia presentation. The adapted version contains adapted media data corresponding to a source version of media data for the multimedia presentation. In one aspect, the adapted version of the multimedia presentation also includes adapted composition data corresponding to a source version of composition data for the multimedia presentation. In another aspect, the adapted media data is created from a source version of description data for the multimedia presentation.

Claims

1. A method comprising:

selecting a transformation operation from a plurality of transformation operations based on capabilities of a target device; and

creating an adapted version of a multimedia presentation for the target device from a source version of the multimedia presentation using the selected transformation operation, the adapted version of the multimedia presentation comprising adapted media data corresponding to a source version of media data for the multimedia presentation.

2. The method of claim 1, wherein creating an adapted version comprises:

transforming a source version of description data for the multimedia presentation into a target version of the description data; and

generating the adapted media data from the target version of the description data.

3. The method of claim 1, wherein creating an adapted version comprises:

deriving the source version of the media data from a source version of description data for the multimedia presentation; and

transforming the source version of the media data into the adapted media data.

4. The method of claim 1, wherein creating an adapted version comprises:

preparing an adapted media object for each of a plurality of media objects in the source version of the media data.

5. The method of claim 1, wherein creating an adapted version comprises:

adapting at least one of a spatial resolution and a temporal resolution if the source version of the media data includes at least one of video data and image data.

6. The method of claim 1, wherein creating an adapted version comprises:

adapting a bit rate of the source version of the media data according to a desired bit rate.

7. The method of claim 6, wherein the desired bit rate is based at least one of user preferences, transmission medium bandwidth, and target device capabilities.

8. The method of claim 1, wherein creating an adapted version comprises:

generating a summarized form of the source version of the media data.

9. The method of claim 1, wherein the adapted version of the multimedia presentation further comprises adapted composition data corresponding to a source version of composition data for the multimedia presentation.

10. The method of claim 9, wherein creating an adapted version comprises:

generating the adapted composition data based on the capabilities of the target device and properties of the adapted media data.

11. The method of claim 9, wherein creating an adapted version comprises:

transforming a source version of description data for the multimedia presentation into a target version of the description data; and

generating the adapted composition data from the target version of the description data.

12. The method of claim 9, wherein creating an adapted version comprises:

deriving the source version of the composition data from a source version of description data for the multimedia presentation; and

transforming the source version of the composition data into the adapted composition data.

13. The method of claim 9, wherein the adapted composition data comprises spatial and temporal layout, and synchronization information for a plurality of media objects in the adapted media data.

14. The method of claim 9, wherein the source version of the multimedia presentation further comprises the source version of the composition data.

15. The method of claim 1, wherein selecting a transformation operation comprises sequencing selected transformation operations to meet optimization criteria.

16. The method of claim 1, wherein the transformation operation is selected according to a set of rules.

17. The method of claim 1, wherein the capabilities of the target device include properties of a medium for delivering the adapted multimedia presentation to the target device.

18. The method of claim 1, wherein selecting a transformation operation is further based on user preferences.

19. The method of claim 1 further comprising:

delivering the adapted version of the multimedia presentation to the target device.

20. The method of claim 1 further comprising:

receiving at least one of a source version of media data, composition data, and description data for the source version of the multimedia presentation.

21. A machine-readable medium having instructions to cause a machine to perform a method comprising:

selecting a transformation operation from a plurality of transformation operations based on capabilities of a target device; and

creating an adapted version of a multimedia presentation for the target device from a source version of the multimedia presentation using the selected transformation operation, the adapted version of the multimedia presentation comprising adapted media data corresponding to a source version of media data for the multimedia presentation.

22. The machine-readable medium of claim 21, wherein creating an adapted version comprises:

transforming a source version of description data for the multimedia presentation into a target version of the description data; and

generating the adapted media data from the target version of the description data.

23. The machine-readable medium of claim 21, wherein creating an adapted version comprises:

deriving the source version of the media data from a source version of description data for the multimedia presentation; and

transforming the source version of the media data into the adapted media data.

24. The machine-readable medium of claim 21, wherein creating an adapted version comprises:

preparing an adapted media object for each of a plurality of media objects in the source version of the media data.

25. The machine-readable medium of claim 21, wherein creating an adapted version comprises:

adapting at least one of a spatial resolution and a temporal resolution if the source version of the media data includes at least one of video data and image data.

26. The machine-readable medium of claim 21, wherein creating an adapted version comprises:

adapting a bit rate of the source version of the media data according to a desired bit rate.

27. The machine-readable medium of claim 26, wherein the desired bit rate is based at least one of user preferences, transmission medium bandwidth, and target device capabilities.

28. The machine-readable medium of claim 21, wherein creating an adapted version comprises:

generating a summarized form of the source version of the media data.

29. The machine-readable medium of claim 21, wherein the adapted version of the multimedia presentation further comprises adapted composition data.

30. The machine-readable medium of claim 29, wherein creating an adapted version comprises:

generating the adapted composition data based on the capabilities of the target device and properties of the adapted media data corresponding to a source version of composition data for the multimedia presentation.

31. The machine-readable medium of claim 29, wherein creating an adapted version comprises:

transforming a source version of description data for the multimedia presentation into a target version of the description data; and

generating the adapted composition data from the target version of the description data.

32. The machine-readable medium of claim 29, wherein creating an adapted version comprises:

deriving the source version of the composition data from a source version of description data for the multimedia presentation; and

transforming the source version of the composition data into the adapted composition data.

33. The machine-readable medium of claim 29, wherein the adapted composition data comprises spatial and temporal layout, and synchronization information for a plurality of media objects in the adapted media data.

34. The machine-readable medium of claim 29, wherein the source version of the multimedia presentation further comprises the source version of the composition data.

35. The machine-readable medium of claim 21, wherein selecting a transformation operation comprises sequencing selected transformation operations to meet optimization criteria.

36. The machine-readable medium of claim 21, wherein the transformation operation is selected according to a set of rules.

37. The machine-readable medium of claim 21, wherein the capabilities of the target device include properties of a medium for delivering the adapted multimedia presentation to the target device.

38. The machine-readable medium of claim 21, wherein selecting a transformation operation is further based on user preferences.

39. The machine-readable medium of claim 21, wherein the method further comprises:

delivering the adapted version of the multimedia presentation to the target device.

40. The machine-readable medium of claim 21, wherein the method further comprises:

receiving at least one of a source version of media data, composition data, and description data for the source version of the multimedia presentation.

42. The system of claim 21, wherein the transformation process further causes the processor, when creating an adapted version, to transform a source version of description data for the multimedia presentation into a target version of the description data, and generate the adapted media data from the target version of the description data.

43. The system of claim 21, wherein the transformation process further causes the processor, when creating an adapted version, to derive the source version of the media data from a source version of description data for the multimedia presentation, and transform the source version of the media data into the adapted media data.

44. The system of claim 21, wherein the transformation process further causes the processor, when creating an adapted version, to preparing an adapted media object for each of a plurality of media objects in the source version of the media data.

45. The system of claim 21, wherein the transformation process further causes the processor, when creating an adapted version, to adapt at least one of a spatial resolution and a temporal resolution if the source version of the media data includes at least one of video data and image data.

46. The system of claim 21, wherein the transformation process further causes the processor, when creating an adapted version, to adapt a bit rate of the source version of the media data according to a desired bit rate.

47. The system of claim 46, wherein the desired bit rate is based at least one of user preferences, transmission medium bandwidth, and target device capabilities.

41. A system comprising:

a processor coupled to a memory through a bus;

a transformation process executed by the processor from the memory to cause the processor to select a transformation operation from a plurality of transformation operations based on capabilities of a target device, and create an adapted version of a multimedia presentation for the target device from a source version of the multimedia presentation using the selected transformation operation, the adapted version of the multimedia presentation comprising adapted media data corresponding to a source version of media data for the multimedia presentation.

48. The system of claim 41, wherein the transformation process further causes the processor, when creating an adapted version, to generate a summarized form of the source version of the media data.

49. The system of claim 41, wherein the adapted version of the multimedia presentation further comprises adapted composition data corresponding to a source version of composition data for the multimedia presentation.

50. The system of claim 49, wherein the transformation process further causes the processor, when creating an adapted version, to generate the adapted composition data based on the capabilities of the target device and properties of the adapted media data.

51. The system of claim 49, wherein the transformation process further causes the processor, when creating an adapted version, to transform a source version of description data for the multimedia presentation into a target version of the description data, and generate the adapted composition data from the target version of the description data.

52. The system of claim 49, wherein the transformation process further causes the processor, when creating an adapted version, to derive the source version of the composition data from a source version of description data for the multimedia presentation, and transform the source version of the composition data into the adapted composition data.

53. The system of claim 49, wherein the adapted composition data comprises spatial and temporal layout, and synchronization information for a plurality of media objects in the adapted media data.

54. The system of claim 49, wherein the source version of the multimedia presentation further comprises the source version of the composition data.

55. The system of claim 41, wherein the transformation process further causes the processor, when selecting a transformation operation, to sequence selected transformation operations to meet optimization criteria.

56. The system of claim 41, wherein the transformation operation is selected according to a set of rules.

57. The system of claim 41, wherein the capabilities of the target device include properties of a medium for delivering the adapted multimedia presentation to the target device.

58. The system of claim 41, wherein the transformation process further causes the processor to base the selection of a transformation operation on user preferences.

59. The system of claim 41 further comprising an interface coupled to the processor through the bus, and wherein the transformation process further causes the processor to deliver the adapted version of the multimedia presentation to the target device through the interface.

60. The system of claim 41 further comprising an interface coupled to the processor through the bus, and wherein the transformation process further causes the processor to receive at least one of a source version of media data, composition data, and description data for the source version of the multimedia presentation through the interface.

61. An apparatus comprising:

means for selecting a transformation operation from a plurality of transformation operations based on capabilities of a target device; and

means for creating an adapted version of a multimedia presentation for the target device from a source version of the multimedia presentation using the selected transformation operation, the adapted version of the multimedia presentation comprising adapted media data corresponding to a source version of media data for the multimedia presentation.

62. The apparatus of claim 61, wherein the means for creating comprises:

means for transforming a source version of description data for the multimedia presentation into a target version of the description data; and

means for generating the adapted media data from the target version of the description data.

63. The apparatus of claim 61, wherein the means for creating comprises:

means for deriving the source version of the media data from a source version of description data for the multimedia presentation; and

means for transforming the source version of the media data into the adapted media data.

64. The apparatus of claim 61, wherein the adapted version of the multimedia presentation further comprises adapted composition data corresponding to a source version of composition data for the multimedia presentation.

65. The apparatus of claim 64, wherein the means for creating comprises:

means for generating the adapted composition data based on the capabilities of the target device and properties of the adapted media data.

66. The apparatus of claim 64, wherein the means for creating comprises:

means for transforming a source version of description data for the multimedia presentation into a target version of the description data; and

means for generating the adapted composition data from the target version of the description data.

67. The apparatus of claim 64, wherein the means for creating comprises:

means for deriving the source version of the composition data from a source version of description data for the multimedia presentation; and

means for transforming the source version of the composition data into the adapted composition data.

68. The apparatus of claim 64, wherein the source version of the multimedia presentation further comprises the source version of the composition data.

69. The apparatus of claim 61 further comprises means for delivering the adapted version of the multimedia presentation to the target device.

70. The apparatus of claim 61 further comprises means for receiving at least one of a source version of media data, composition data, and description data for the source version of the multimedia presentation.