Methods and apparatus for adapting multimedia content for client devices

• US 6,345,279 B1
• Filed: 04/23/1999
• Issued: 02/05/2002
• Est. Priority Date: 04/23/1999
• Status: Expired due to Term

• Current Assignee: SINOEAST CONCEPT LIMITED (Tencent Holdings Limited)
• Original Assignee: International Business Machines Corporation
• Inventors: Smith, John R., Li, Chung-Sheng, Mohan, Rakesh
• Primary Examiner(s): Corrielus, Jean M.
• Application Number:
  US09/298,576
• Time in Patent Office: 1,019 Days
• Field of Search: 707/103, 707/3, 707/102, 707/10, 707/513, 707/104, 707/5, 707/501, 707/203, 707/514, 709/224, 709/203, 709/217, 709/226, 709/231, 709/232, 709/227, 709/246, 709/235, 370/252, 713/201
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A method of adapting multimedia content to a client device, wherein the multimedia content includes one or more items and the client device has capabilities and resources associated therewith, is provided. The method includes transcoding the multimedia content into a plurality of transcoded content versions, wherein the plurality of transcoded content versions have different modalities and resolutions associated therewith. Next, the transcoded content versions that are not compatible with client device capabilities are filtered out. Then, at least a portion of the resources associated with the client device are allocated among the one or more items of the multimedia content. Lastly, one or more of the transcoded versions of the multimedia content are selected to generate a customized content based on allocation of the client device resources.

Claims

1. A method of adapting multimedia content to a client device, the multimedia content including one or more items and the client device having capabilities and resources associated therewith, the method comprising the steps of:

transcoding the multimedia content into a plurality of transcoded content versions, the plurality of transcoded content versions having different modalities and resolutions associated therewith;

filtering out the transcoded content versions that are not compatible with client device capabilities;

allocating at least a portion of the resources associated with the client device among the one or more items of the multimedia content; and

selecting one or more of the transcoded versions of the multimedia content to generate a customized content based on allocation of the client device resources.

2. The method of claim 1, wherein the multimedia content includes at least one World Wide Web document.

3. The method of claim 1, wherein the multimedia content includes at least one of a video item, an image item, a graphics item, a text item, and an audio item.

4. The method of claim 1, wherein the transcoding step further includes the steps of:

separating the multimedia content into individual content items; and

converting the individual content items to different resolutions and modalities.

5. The method of claim 1, wherein the capabilities associated with the client device include at least one of a color capability, an audio capability, a video capability, an image capability, and a text capability.

6. The method of claim 1, wherein the capabilities associated with the client device includes a decompression capability.

7. The method of claim 1, wherein the resources associated with the client device include at least one of a screen size, a bandwidth, a storage capacity, a content wait time ability, and a payment ability.

8. The method of claim 1, wherein the transcoding step includes separating the multimedia content into individual content items.

9. The method of claim 8, wherein the allocating step further includes assigning a priority to a content item.

10. The method of claim 9, wherein the priority is assigned by an author of the multimedia content.

11. The method of claim 9, wherein the priority is assigned by an application associated with the multimedia content.

12. The method of claim 9, wherein the priority is assigned in response to a user request.

13. The method of claim 9, wherein the priority is assigned in response to a match score.

14. The method of claim 9, wherein the priority is assigned as a function of the importance attributed to a content item.

15. The method of claim 9, wherein the allocating step further includes assigning a fidelity measure value to each content version.

16. The method of claim 15, wherein the allocating step further includes computing a product of the priority and the fidelity value for each content version.

17. The method of claim 15, further including the step of including the assigned fidelity measure value in the multimedia content.

18. The method of claim 9, further including the step of including the assigned priority in the multimedia content.

19. The method of claim 1, wherein the transcoded versions selected satisfy at least a portion of the resource allocations.

20. The method of claim 1, further including the step of organizing at least one of the one or more items and at least a portion of the transcoded content versions associated therewith in a data structure.

21. The method of claim 20, further including the step of including the data structure in the multimedia content.

22. The method of claim 1, wherein the resources allocated to at least a portion of the transcoded versions of the content items are a function of priorities.

23. A method of adapting multimedia content to a client device, the multimedia content including one or more items and the client device having capabilities and resources associated therewith, the method comprising the steps of:

transcoding the multimedia content into a plurality of transcoded content versions, the plurality of transcoded content versions having different modalities and resolutions associated therewith;

filtering out the transcoded content versions that are not compatible with client device capabilities;

allocating at least a portion of the resources associated with the client device among the one or more items of the multimedia content; and

selecting one or more of the transcoded versions of the multimedia content to generate a customized content based on allocation of the client device resources;

wherein the transcoding step includes separating the multimedia content into individual content items, and wherein the allocating step further includes assigning a priority to a content item, assigning a fidelity measure value to each content version, computing a product of the priority and the fidelity value for each content version, and at least substantially maximizing a sum of the products for the content versions such that the resources associated with the client device are not exceeded.

24. The method of claim 23, wherein the maximizing step results in determining the portion of the resources associated with the client device which are allocated to each content item.

25. A method of adapting multimedia content to a client device, the multimedia content including one or more items and the client device having capabilities and resources associated therewith, the method comprising the steps of:

transcoding the multimedia content into a plurality of transcoded content versions, the plurality of transcoded content versions having different modalities and resolutions associated therewith;

filtering out the transcoded content versions that are not compatible with client device capabilities;

allocating at least a portion of the resources associated with the client device among the one or more items of the multimedia content; and

selecting one or more of the transcoded versions of the multimedia content to generate a customized content based on allocation of the client device resources;

wherein the resources allocated to at least a portion of the transcoded versions of the content items are a linear scaling function of the resources that would otherwise be allocated to the items.

26. Apparatus for adapting multimedia content to a client device, the multimedia content including one or more items and the client device having capabilities and resources associated therewith, the apparatus comprising:

at least one processor operable to transcode the multimedia content into a plurality of transcoded content versions, the plurality of transcoded content versions having different modalities and resolutions associated therewith, to filter out the transcoded content versions that are not compatible with client device capabilities, to allocate at least a portion of the resources associated with the client device among the one or more items of the multimedia content, and to select one or more of the transcoded versions of the multimedia content to generate a customized content based on allocation of the client device resources; and

memory, coupled to the at least one processor, for storing at least a portion of results associated with one or more of the operations performed in accordance with the at least one processor.

27. The apparatus of claim 26, wherein the multimedia content includes at least one World Wide Web document.

28. The apparatus of claim 26, wherein the multimedia content includes at least one of a video item, an image item, a graphics item, a text item, and an audio item.

29. The apparatus of claim 26, wherein the capabilities associated with the client device include at least one of a color capability, an audio capability, a video capability, an image capability, and a text capability.

30. The apparatus of claim 26, wherein the resources associated with the client device include at least one of a screen size, a bandwidth, a storage capacity, a content wait time ability, and a payment ability.

31. An article of manufacture for adapting multimedia content to a client device, the multimedia content including one or more items and the client device having capabilities and resources associated therewith, comprising a machine readable medium containing one or more programs which when executed implement the steps of:

transcoding the multimedia content into a plurality of transcoded content versions, the plurality of transcoded content versions having different modalities and resolutions associated therewith;

filtering out the transcoded content versions that are not compatible with client device capabilities;

allocating at least a portion of the resources associated with the client device among the one or more items of the multimedia content; and

selecting one or more of the transcoded versions of the multimedia content to generate a customized content based on allocation of the client device resources.