Device and method for modality conversion of multimedia contents
First Claim
1. A device for adaptively converting a modality of multimedia contents, the device comprising:
- an input for receiving data specifying multimedia contents, metadata of the multimedia contents, and user preference for the modality conversion; and
a converter for converting the modality of the input multimedia contents;
wherein the input is adapted for receiving a multimedia contents item which comprises a unit expressible in any one of different modalities, the unit being the whole of the multimedia contents item or being a portion of the multimedia contents item, wherein the user preference for the modality conversion comprises a qualitative preference and a quantitative preference, wherein the qualitative preference indicates a sequence of modalities according to the user preference for the modalities, and the quantitative preference indicates a relative quantitative importance of at least two of the modalities to the user;
wherein the converter is for expressing the unit in a modality in which the unit is to be transmitted to the user, the converter using at least the qualitative preference in determining the modality in which the unit is to be transmitted;
wherein the converter comprises;
means for predicting an overlapped contents model using the input multimedia contents and input metadata of the contents, the overlapped contents model specifying, for each said modality and an associated range of resource values, a contents value curve which specifies, for the associated modality, a relationship between (i) a resource value in the associated range of resource values and (ii) a content value, wherein at least two of the contents value curves intersect inside one of the ranges;
means for modifying the overlapped contents model using the user preference for the modality conversion; and
means for determining a resource restriction and expressing the multimedia contents according to the resource restriction in a form corresponding to a maximum contents value of the modified overlapped contents model.
3 Assignments
0 Petitions
Accused Products
Abstract
The present invention relates to a method of systematically and synthetically accessing modality conversion that is an important part in the contents adaptive conversion process of a universal multimedia access system. The present invention provides an effective method of solving a problem, which is incurred at the time of modality conversion and still remains as one of difficult problems incurred during adaptive contents conversion. For this purpose, the present invention includes overlapped contents modeling newly proposed to determine modality conversion, a method of flexibly and clearly expressing and applying user preference for the modality conversion, and a resource allocation method of distributing resources among complicated contents based on the user preference. As a result, the integration of the above three methods provides a synthetic solution, particularly, to a problem incurred in the modality conversion and, generally, to a problem incurred in the adaptive conversion of contents.
-
Citations
21 Claims
-
1. A device for adaptively converting a modality of multimedia contents, the device comprising:
-
an input for receiving data specifying multimedia contents, metadata of the multimedia contents, and user preference for the modality conversion; and a converter for converting the modality of the input multimedia contents; wherein the input is adapted for receiving a multimedia contents item which comprises a unit expressible in any one of different modalities, the unit being the whole of the multimedia contents item or being a portion of the multimedia contents item, wherein the user preference for the modality conversion comprises a qualitative preference and a quantitative preference, wherein the qualitative preference indicates a sequence of modalities according to the user preference for the modalities, and the quantitative preference indicates a relative quantitative importance of at least two of the modalities to the user; wherein the converter is for expressing the unit in a modality in which the unit is to be transmitted to the user, the converter using at least the qualitative preference in determining the modality in which the unit is to be transmitted; wherein the converter comprises; means for predicting an overlapped contents model using the input multimedia contents and input metadata of the contents, the overlapped contents model specifying, for each said modality and an associated range of resource values, a contents value curve which specifies, for the associated modality, a relationship between (i) a resource value in the associated range of resource values and (ii) a content value, wherein at least two of the contents value curves intersect inside one of the ranges; means for modifying the overlapped contents model using the user preference for the modality conversion; and means for determining a resource restriction and expressing the multimedia contents according to the resource restriction in a form corresponding to a maximum contents value of the modified overlapped contents model. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method of adaptively converting a modality of multimedia contents, the method comprising:
-
receiving, by a device, multimedia contents and metadata of the multimedia contents from an outside source, wherein the multimedia contents comprise a multimedia contents item comprising a unit expressible in any one of different modalities, the unit being the whole of the multimedia contents item or being a portion of the multimedia contents item; receiving, by the device, user preference for modality conversion, wherein the user preference for the modality conversion comprises a qualitative preference and a quantitative preference, wherein the qualitative preference indicates a sequence of modalities according to the user preference for the modalities, and the quantitative preference indicates a relative quantitative importance of at least two of the modalities to the user; adaptively converting, by the device, a modality of the input multimedia contents according to the metadata of the contents and at least the quantitative preference; and outputting, by the device, the converted multimedia contents; wherein the method further comprises additionally receiving a resource restriction, wherein the adaptive conversion of the modality is performed while additionally considering the resource restriction; wherein the adaptive converting of the modality comprises; predicting an overlapped contents model using the input multimedia contents and the input metadata of the contents, the overlapped contents model specifying, for each said modality and an associated range of resource values, a contents value curve which specifies, for the associated modality, a relationship between (i) a resource value in the associated range of resource values and (ii) a content value, wherein at least two of the contents value curves intersect inside one of the ranges; modifying the overlapped contents model using the user preference for modality conversion; and converting a modality of the multimedia contents to allow the multimedia contents to be represented in a form corresponding to a maximum contents value of the modified overlapped contents model under the resource restriction. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A device for adaptively converting a modality of multimedia contents, the device comprising:
-
means for receiving a multimedia contents item and metadata of the multimedia contents item from an outside source; means for receiving user preference for modality conversion of the multimedia item, the user preference being represented by a sequence of modalities and a weight of each modality, wherein; the sequence indicates a sequence of modalities according to the user preference for the modalities; and the weights indicate relative quantitative importance of each modality to the user; means for obtaining an overlapped contents model specifying, for each said modality and an associated range of resource values, a contents value curve which specifies, for the associated modality, a relationship between (i) a resource value in the associated range of resource values and (ii) a content value, wherein at least two of the contents value curves intersect inside one of the ranges; means for modifying the overlapped contents model using the user preference for the modality conversion; means for adaptively converting a modality of the input multimedia contents item according to the metadata of the contents and the user preference for the modality conversion; and means for outputting the converted multimedia contents item; wherein the means for modifying is to remove or not remove one or more of the contents value curves from the overlapped contents model in accordance with the sequence; wherein the means for modifying is for adjusting the contents value curves in accordance with the weights if the weights are not equal to each other; and the means for adaptively converting is for converting based on the overlapped contents model generated by the means for modifying.
-
-
18. A method for providing a multimedia contents item to a user'"'"'s terminal over a network, the method comprising:
-
(1) obtaining, by a device, data specifying;
(i) a unit, wherein the unit is a portion or a whole of the multimedia contents item and the unit is expressed in at least a first modality, wherein the unit is also expressible in one or more modalities other than the first modality, (ii) user preference for modality of the multimedia contents item, and (iii) metadata providing an indication of preferences in conversion of the multimedia contents item from the first modality to the one or more modalities other the first modality;(2) for the unit performing operations of; (2A) obtaining, by the device, a resource restriction, and determining from the resource restriction, the metadata and the user preference whether or not the unit is to be converted to a modality other than the first modality before transmission to the terminal; (2B) if it is determined by the device, in operation (2A), that the unit is to be modality-converted, then performing, by the device, modality conversion of the unit and transmitting the modality-converted unit over the network to the terminal, wherein modality conversion is conversion to a different modality; (2C) if it is determined by the device, in operation (2A), that the unit is NOT to be modality-converted, then transmitting the unit over the network to the terminal without modality conversion of the unit; wherein the metadata comprise data representing a contents model which associates resources with content values for the modalities; and the method further comprises; (3) determining, by the device, whether or not the contents model is to be modified based on the user preference; (4) if the user preference indicates that the contents model is to be modified, then modifying, by the device, the contents model based on the user preference; (5) if the user preference indicates that the contents model is NOT to be modified, then NOT modifying, by the device, the contents model based on the user preference; wherein operation (2A) is performed using the contents model provided by operations (3)-(5); wherein the operation (2A) maximizes the contents value based on the contents model provided by the operations (3)-(5); wherein the contents model in the metadata is an overlapped contents model which specifies, for each said modality and an associated range of resource values, a contents value curve which specifies, for the associated modality, a relationship between (i) a resource value in the associated range of resource values and (ii) a content value, wherein at least two of the contents value curves intersect inside one of the ranges; wherein the user preference comprises a weight associated with each of one or more of the modalities, and at least two of the modalities are associated with different weights; and in the operation (4), the associated contents value curves are modified to increase the content values associated with the modality of a greater weight relative to the content values associated with the modality of a smaller weight. - View Dependent Claims (19)
-
-
20. A device for providing a multimedia contents item to a terminal over a network, the device being for:
-
(1) obtaining data specifying;
(i) a unit, wherein the unit is a portion or a whole of the multimedia contents item, and the unit is expressed in at least a first modality, wherein the unit is also expressible in one or more modalities other than the first modality, and (ii) user preference for modality of the multimedia contents item;(2) for the unit, performing operations of; (2A) obtaining, by the device, a resource restriction, and determining from the resource restriction and the user preference whether or not the unit is to be converted to a modality other than the first modality before transmission to the terminal; (2B) if it is determined by the device, in operation (2A), that the unit is to be modality-converted, then performing, by the device, modality conversion of the unit and transmitting the modality-converted unit over the network to the terminal, wherein modality conversion is conversion to a different modality; (2C) if it is determined by the device, in operation (2A), that the unit is NOT to be modality-converted, then transmitting the unit over the network to the terminal without modality conversion of the unit; wherein operation (1) also comprises receiving metadata providing an indication of preferences in conversion of the multimedia contents item from the first modality to the one or more modalities other the first modality; and wherein the determining operation in (2A) depends on the metadata, and the metadata comprise data representing a contents model which associates resources with content values for the modalities; and the method further comprises; (3) determining, by the device, whether or not the contents model is to be modified based on the user preference; (4) if the user preference indicates that the contents model is to be modified, then modifying, by the device, the contents model based on the user preference; (5) if the user preference indicates that the contents model is NOT to be modified, then NOT modifying, by the device, the contents model based on the user preference; wherein operation (2A) is performed using the contents model provided by operations (3)-(5); wherein the operation (2A) maximizes the contents value based on the contents model provided by the operations (3)-(5); wherein the contents model in the metadata is an overlapped contents model which specifies, for each said modality and an associated range of resource values, a contents value curve which specifies, for the associated modality, a relationship between (i) a resource value in the associated range of resource values and (ii) a content value, wherein at least two of the contents value curves intersect inside one of the ranges; wherein the user preference comprises a weight associated with each of one or more of the modalities; and if at least two of the modalities are associated with different weights, then operation (4) is performed in which the associated contents value curves are modified to increase the content values associated with the modality of a greater weight relative to the content values associated with the modality of a smaller weight. - View Dependent Claims (21)
-
Specification