MULTILEVEL SEMIOTIC AND FUZZY LOGIC USER AND METADATA INTERFACE MEANS FOR INTERACTIVE MULTIMEDIA SYSTEM HAVING COGNITIVE ADAPTIVE CAPABILITY

• US 20090132441A1
• Filed: 08/17/2006
• Published: 05/21/2009
• Est. Priority Date: 08/23/2005
• Status: Active Grant

• Current Assignee: Syneola SA
• Original Assignee: Syneola SA
• Inventors: Muller, Myrian, Hess, Joseph
• Granted Patent: US 8,280,827 B2
• Time in Patent Office: Days
• US Class Current: 706/11
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8453 by locking or enabling a set of features, e.g. optional functionalities in an executable program
• CPC Class Codes: H04N 21/85403 by describing the content as an MPEG-21 Digital Item
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A multilevel semiotic and fuzzy logic user and metadata interface means includes: an interactive user interface means comprising at least one multilevel semiotic means addressable by a user and a fuzzy logic descriptor set module for storing multiple fuzzy logic descriptor sets; a metadata layer for linking said multilevel semiotic means to interactivity points present in content of the multimedia representation and defined by the metadata layer such that each level of each of the multilevel semiotic means identifies an interactivity point in the content and allows by selection of the interactivity point to perform a selectively varying content manipulation and to receive a resulting interactive presentation of content according to the selection: and a user control device for addressing the multilevel semiotic means.

Claims

1. Multilevel semiotic and fuzzy logic user and metadata interface means for varying content manipulation of an interactive multimedia representation in a multimedia system, comprising:

(a) an interactive user interface means comprising at least one multilevel semiotic means addressable by a user and a fuzzy logic descriptor set module for storing multiple fuzzy logic descriptor sets,

each fuzzy logic descriptor set being related to a respective level of each of said multilevel semiotic means and describing at least one level of significance of interactivity corresponding to said respective level of each of said multilevel semiotic means, said level of significance being directly related to the importance of a level addressed and thus selected by the user of said multilevel semiotic means,

each fuzzy logic descriptor set defining at least one fuzzy semiotic membership function definable by and based on the addressing of a level of each of said multilevel semiotic means and at least one significance attributed to said level;

(b) a metadata layer for linking said multilevel semiotic means to interactivity points present in the content of said multimedia representation and defined by said metadata layer such that each level of each of said multilevel semiotic means identifies an interactivity point in said content and allows by selection of said interactivity point to perform a selectively varying content manipulation and to receive a resulting interactive presentation of content according to said selection; and

(c) a user control device for addressing said multilevel semiotic means.

2. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, further comprising

(d) a logic layer for storing said fuzzy logic descriptor set module, and further storing a user preference engine that defines a user profile based on the addressing of a user of a level of said multilevel semiotic means.

3. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, further comprising

(d) a content layer for storing a content resource and access module, and wherein said metadata layer maps said interactivity points to content resources stored in said content resource and access module.

4. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 2, said logic layer further comprising a fuzzy pondering factor level comprising pondering factors, or random interjections expressed in fuzzy logic functions and applied to the interactive process between the user and the system.

5. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 2, said logic layer further comprising a cognitive adaptive multimedia expert system for evaluating said user profile.

6. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 5, wherein said cognitive adaptive multimedia expert system comprises,

i. a content inference module where the pre-programmed fuzzy descriptor sets belonging to the multilevel semiotic sign, to the content, and to the fuzzy pondering factors are put into context with the real time user actions and are expressed as user preference rules within the context of the application;

ii. a random function generator that is capable of injecting random behavior, character compliance or defiance, surprise or tension elements;

iii. an adaptive expert system processor; and

iv. a data evaluation module.

7. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein each level of said multilevel semiotic means comprises one or more sub-levels addressable by the user.

8. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means is displayable in said interactive content.

9. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means can be displayed on said user control device.

10. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 9, wherein said multilevel semiotic means is downloadable onto said user control device by external communication means.

11. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means consists of a plurality of concentric circles, each circle representing an addressable level.

12. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means consists of a plurality of similar shapes arranged as a Russian nesting doll, each nested shape representing an addressable level.

13. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means is a semiotic iconic, symbolic, indexical or other semiotic sign.

14. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic and fuzzy logic user and metadata interface means is complemented or triggered by interactive exchange between user and application and between users via the application of images, music, sounds, vibrations, pressure, scents, imprints, temperature, breath and other physico-chemical expressions of emotions or other qualitative reactions.

15. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means is operable to communicate with the user in spoken or otherwise sound related fashion and wherein said user communicates with said multilevel semiotic means in spoken or otherwise sound related fashion.

16. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 15, wherein certain spoken or otherwise sound related messages are linked to a particular level of the multilevel semiotic and fuzzy logic user and metadata interface means and to the corresponding fuzzy descriptor levels.

17. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic means is displayed for a predetermined period of time during which a user may address said semiotic means.

18. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 17, wherein said user preference engine is arranged to update said user profile when no level is addressed within said predetermined period of time, or when a level is addressed.

19. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 2, further comprising information output means for reading said user profiles externally.

20. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multilevel semiotic sign includes in one of the levels of said multilevel semiotic sign an electronic address allowing a user to send immediately a voice, text, AV or combined message, preformatted or open, to said electronic address.

21. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 20, wherein said electronic address corresponds to an SMS, an MMS or other fixed and mobile communication address addressable by fixed and portable AV and text communication means.

22. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 20, wherein a content of said message is used as a pondering in the evaluation of the user.

23. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 6, wherein said cognitive adaptive multimedia expert system further comprises a data evaluation module for processing data and files related to user, content, interactivity, content resource, preferences or results of qualitative voting, betting, and selecting.

24. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 23, wherein said cognitive adaptive multimedia expert system further comprises a content evaluation module for further off-line processing of said data and files processed by said data evaluation module.

25. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 6, wherein a first multilevel semiotic means is provided, and once selected by said user control device, at least a second multilevel semiotic means and a number of other semiotic signs representing objects, items, situations, and characteristics are provided and are selectable by said user control device.

26. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 25, wherein said number of other semiotic signs are also multilevel signs, where each respective level identifies an attribute of the item signified by the sign, an object, a character, a situation, and a characteristic.

27. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 25, wherein said number of other semiotic signs correspond to actual objects and the like existing in the content.

28. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 25, wherein said cognitive adaptive multimedia expert system further comprises a content resource and access module for generating different episodes and outcomes as a function of said selected objects.

29. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 25, wherein said objects are linked to said at least second multilevel semiotic means, as a function of which a corresponding fuzzy logic descriptor set is arranged to define a corresponding fuzzy semiotic membership function based on the selection and linkage of said objects between said first and at least second multilevel semiotic means.

30. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 25, wherein said cognitive adaptive multimedia expert system is arranged to analyze said corresponding fuzzy descriptor sets which result from the users choices as well as one or more fuzzy pondering factors and user preference rules established by said content inference module so as to address said content resource and access module.

31. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multimedia representation is a documentary, a docu-fiction, or an interactive AV representation.

32. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 1, wherein said multimedia representation is a game.

33. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 32, wherein said game is a multiplayer game, having a first player that is the user of said user control device, and having a second player that is virtual.

34. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 32, wherein said game is a multiplayer game, having a first player that is the user of said user control device, and having a second player that is a second user.

35. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 25, wherein the meanings of said second multilevel semiotic means relate to surprise, danger, comfort, state of mind, physical conditions, mental preparedness, and level of security and the attributes and conditions, and wherein said meanings relate to the content as well as to the user or external factors.

36. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 32, wherein said meanings of said second multilevel semiotic means express attitude, character or role aspects of the user and at least a second player in the game.

37. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 4, wherein said pondering factors are selected from the group consisting of time, duration of staying within the content of a multilevel semiotic means level, and sequence of addressing a multilevel semiotic means level.

38. Multilevel semiotic and fuzzy logic user and metadata interface means according to claim 21, wherein said other fixed and mobile communication address is an e-mail or a URL.