SYSTEMS AND METHODS FOR AUDIO-MARKING OF INFORMATION ITEMS FOR IDENTIFYING AND ACTIVATING LINKS TO INFORMATION OR PROCESSES RELATED TO THE MARKED ITEMS

• US 20080052083A1
• Filed: 08/28/2007
• Published: 02/28/2008
• Est. Priority Date: 08/28/2006
• Status: Abandoned Application

• Current Assignee: Josef Berger, Shaul Shalev
• Original Assignee: Josef Berger, Shaul Shalev
• Inventors: Berger, Josef, Shalev, Shaul
• Application Number:
  US11/845,922
• Publication Number:
  US 20080052083A1
• Time in Patent Office: Days
• US Class Current: 704/500
• CPC Class Codes: G06F 16/748 Hypervideo linking data to content, e.g. by linking an URL to a video object in the context of video distribution systems H04N21/858
• CPC Class Codes: H04M 3/487 Arrangements for providing information services, e.g. recorded voice services or time announcements

Abstract

Systems and methods of creating and utilizing audio-marking of specific information items for pointing at the existence of Additional Information and Processes (AIPs) related to such information items and, when required, activating preset links to such specific AIPs. The invention describes processes and methods that enable authorized creation, insertion and activation of Audio-based Marking-Signals (“AMSs”) in association with streaming or playing of audio-related information files, containing the Marked Information Items (MIIs), for enabling precise identification and activation of identified accessible links to AIPs related to the MIIs. Users of the system and methods, who operate communication devices and are able to sense the AMSs, can correlate the AMS existence and type to a specific MII, and, if interested, activate links to specific MII-related AIPs, using short command messages for receiving the relevant information or activating relevant processes.

Claims

1. A method comprising:

a) marking information items within data files by coupling selected Audio, Audiovisual or Audio Sensual Marking-Signals (AMSs) with a Marked Information Item (MII), targeted at notifying users and programs about additional accessible information or processes (AIPs) related to the MII, and where the AMSs are programmed as one of the groups consisting of;

i) embedded signals, superimposed within streamed or file-transferred audio or audio-visual data;

ii) externally generated signals, which are on-line synchronized with the audio or audio-visual streaming or playing of the data containing the MII;

iii) internally generated by a device receiving the MII containing file in response to an AMS trigger;

b) defining, storing, and enable retrieving of;

i) MII and its related characteristics together with;

ii) the types and content of AMSs coupled to the MII;

iii) the types and content of AIPs coupled to the MII;

iv) the links to access and activate AIPs related to the MII; and

v) the activation and authorization rules related to an AIP activation.

2. The method of claim 1 further comprising methods for enabling:

a) activating selected AMSs while streaming or playing the MIIs containing data for signaling users and programs about an existence of identified and accessible links to AIPs that are related to said MIIs and are accessible to and usable by authorized receiving entities;

b) receiving activation commands, sent by users or programs, utilizing communicating devices and usable communication infrastructure;

c) verifying, and then accepting or rejecting activation commands in accordance with method'"'"'s activation and authorization rules, correlated with detectable identifiers and data which are extractable from the said received command; and

d) activating the requested processes and distributing the additional requested information, in accordance with activation and authorization rules and said extractable identifiers and data embedded in the activation commands, combined with user'"'"'s or program'"'"'s characteristics, if accessible to the method operator.

3. The method of claim 1 further comprising a series of processes which are utilized for creation or editing of a marked information item, linked to additional information or processes:

a) selecting at least one marked information item (MII) to be marked by a marking signal;

b) defining at least one additional accessible information or process (AIP) related to the at least one information item, said defining including at least one AIP characteristic selected from the group consisting of;

i) locations where such AIPs are stored, ii) a means to access or activate such AIPs and, iii) authorizations required to access the AIP;

c) selecting at least one type of Audio marking signal (AMS) to be used for marking at least one MII;

d) combining AMSs with MIIs to enable synchronous onset of the AMSs with related MIIs, enabling users to identify the MIIs through receiving the AMSs;

e) defining and storing retrievable relations between the created or edited MII and related at least one AMS, at least one AIP, the links to access and activate the AIPs, and other MII characteristics such as related activation and authorization rules, and at least one activation command set for activating the at least one AIP or to search for stored MII or its related entities;

f) defining rules of utilizing activation commands to be generated by an authorized user or a program, to be used upon receiving AMS, or while searching the MII related archive, for accessing at least one of AIPs related to at least one of MIIs;

g) online managing data distribution and process activation through;

i) transmitting a selected AMS in correlation with a selected MII, to selected potential recipients exposed to data containing the selected MII;

ii) receiving and decoding activation messages in correlation with transmittal of an MII-AMS combination for identifying a sender of a command, its relevant authorizations and requested related AIPs;

iii) verifying authorizations of requested receiver, to access or receive at least one requested AIPs;

iv) identifying authorized requested AIPs, and when required by process, personalize the data per requirements of authorized user or MII generator or editor or distributor;

v) enabling access of the relevant authorized users to the relevant AIPs including distribution of data through communication channels.

4. The method of claim 1, wherein said MII includes information selected from a group consisting of audio words, sentences, description of an object, expressions, names, a typical audio signal or string of audio-signals, story, song, recognizable specific persons'"'"' voices or tunes, head-lines, events, a general subject described in a played audio or an audio-visual clip, or hidden information item embedded in the data file, wherein said hidden relates to its limited exposure to users who should not be exposed to the MII.

5. The method of claim 1, wherein accessible links to related information or processes can be further retrieved or activated by submitting activation commands of said links, containing extractable data in accordance with at least one of a group consisting of:

i) temporal-correlation with said AMS, ii) an AMS identifier, iii) an MII identifier, iv) an identifier of the data-file containing the MII;

v) an identifier of the activation message sender, vi) an identifier of the requested receiver of the AIP.

6. The method of claim 1, wherein the accessible links to related information or processes can be further retrieved or activated by submitting activation commands of such links which can activate audio or audio-visual correlation between audio or audio-visual content related to the MII, said correlation is based on at least one of i) the MII content or ii) the AMS content or iii) content combining the AMS and its background, iv) content included or related to the MII containing file.

7. The method of claim 1, wherein the AMS comprises signals including at least one of an audio tone, an agreed audio expression, an audio background, audio or audio visual enhancements of the MII, a vibrating or audio-sensual signal, a signal combining components which are unheard or unseen by human bare ears or eyes, a voice signature typical to specific person(s), or a flashing light or audiovisual display, configured either as a single component signal or a train of several components, capable of being heard, or heard and seen, or sensed and recognized, by an authorized user or a program utilizing the streamed or played content, as an indication of links between the MII and additional retrievable information or additional linked processes (AIPs) that can be activated by submitting an activation command which can be correlated to the AMS-MII combination.

8. The method of claim 1, wherein the AMS either i) is super-imposed within the streamed or played data, or ii) generated externally to the device used for streaming or playing of the data, and wherein the AMS is activated in correlation with an onset of the MII, namely within a certain time-interval before, during, or after or any optional combination of before, during, and after the onset of the MII.

9. The method of claim 1, wherein said AMS is selected by at least one of the group consisting of:

a) an MII creator or editor, utilizing a library of AMSS, offered to users by a service operator, b) an MII creator or editor, utilizing a library which is personalized by an individual user or a group of users, c) a user of the method wherein MIIs in a played file adopt specific AMSs based on specific user'"'"'s preferences, priorities or other personalized selection, and wherein selected AMSs contain a variety of different audio or audio-visual or audio sensual signals, part of which can be linked to at least one of the group consisting of;

i) certain combinations of MII and AIP types, ii) types of the links between MII and certain AIPs, iii) an identity of the MII creators and editors, said method iv) authorizations required for activating AIPs, v) financial parameters related to activating the AIP, vi) technical requirements related to the device receiving the AIP, further including the following step in conjunction with claim 1—

a′

) enabling generation of preset linkage between characteristics of different audio-components constructing the AMS and certain alternative types of attached links and certain alternative types of additional linked information or processes (AIPs), or other predefined parameters connected to links between the MII and AIPs such as a predefined MII creator, user or editor preferences, and AIPs activation costs and technical limitations.

10. The method of claim 1 wherein authorization criteria together with the activation rules of related AIPs are defined cumulatively by authorized entities including activation message senders, data-receiving entities, original MII creator, authorized MII editors, and service operators, and translated into at least one of the methods selected from the group consisting of:

i) a denial of an activation command related to such AIPs sent by an unauthorized user, or sent not in accordance with the activation rules, ii) a audible message of the authorizations required and activation rules, played in accordance with the activation of MII-AMS combination, and iii) masking of relevant AMSs, related to AIPs that are either one of unauthorized for or inaccessible to or pre-rejected by a user or a program, while playing or streaming MII containing files to such users or programs.

11. The method of claim 1 wherein authorization can be granted to at least one of:

a) preauthorized list of identified users or programs, where identification is based on submission of either i) agreed pass-codes, or ii) usernames such as user selected name or the identity of the device used for submitting activation-commands, or for connection to AIPs or iii) a combination of pass-codes and usernames wherein a username can be an agreed name including the identity of the device sending the command or the device to which the AIP should be linked;

b) preauthorized members of specific user-groups, based on a user'"'"'s affiliation to a specific group, which requires identification of user'"'"'s affiliation with or without a requirement for an individual user identification;

c) users who are not preauthorized but allowed due to their characteristics or affiliation to obtain either temporary (time or event limited) or permanent authorization; and

d) entire user-base defined by geographical boundaries, or communication network coverage, or period of time, or participants of a certain event or a combination of part of these parameters.

12. The method of claim 1 wherein storing all or part of the relations between MII and related AMSs, AIPs, the links for accessing and activating relevant AIPs, MII creators and editors, and relevant activation and authorization rules, is designed to enable simplified methods for search&

find MIIs or their related entities and then activate related AIPs, using their registered characteristics, based on search algorithms and parameters such as, but not limited to, the data files containing the MIIs, the MII type, the AMS used, the MII creator or editors, the type of AIPs, the type of links to AIPs, the required features of the devices used to activate the AIPs, wherein the search and find commands are submitted by an authorized user, utilizing a device including and not limited to, i) the device which is used to activate the AIPs and ii) the device which is used to receive the AIPs iii) a device which is used for search purposes.

13. The method of claim 1 further applied to complementing the current art IVR (Interactive Voice Response) menu-tree architecture based systems and methods, comprising at least one of the methods:

a) retrieval of additional linked information or processes from alternatively linked sources, being the AIPs, added by marking selected information items (MIIs) by AMSs in accordance with predefined set of activation and authorization rules;

b) creation of short-cuts between branching junctions of the said IVR based menu-tree, wherein the short-cut is the AIP and the new branching point is defined by an MII-AMS combination;

c) implementation of additional activation and authorization rules and authorization acquisition processes, wherein the authorization process is the AIP, marked by an MII-AMS combination in relevant branching point;

d) personalizing an IVR process for specific users or, user-groups through optimizing branching junctions using the MII, AMS, AIP linking.

14. An interactive communication system, configured to stream or play interactive audio and audio-visual content utilizing devices comprising:

a server or distributed computerized-entities based on devices functioning together as a distributed server;

a communication infrastructure used for linking system users with servers and computerized entities for enabling distributed server functionalities;

a set of instructions programmed into said server, and distributed computerized entities, said instructions comprising;

a) means for marking information items within data files by coupling selected Audio, Audiovisual or Audio Sensual Marking-Signals (AMSS) with a Marked Information Item (MII), targeted at notifying users and programs about additional accessible information or processes (AIPs) related to the MII, and where the AMSs are programmed as one of the groups consisting of;

i) embedded signals, superimposed within streamed or file-transferred audio or audio-visual data;

ii) externally generated signals, which are on-line synchronized with the audio or audio-visual streaming or playing of the data containing the MII;

iii) internally generated by a device receiving the MII containing file in response to an AMS trigger;

b) means for defining, storing and enable retrieving of;

i) MII and its related characteristics together with;

ii) the types and content of AMSs coupled to the MII;

iii) the types and content of AIPs coupled to the MII;

iv) the links to access and activate AIPs related to the MII; and

v) the activation and authorization rules related to an AIP activation.

15. The interactive communication system of claim 14 further comprising:

a) means for activating selected AMSs while streaming or playing the MIIs containing data for signaling users and programs about an existence of identified and accessible links to AIPs that are related to said MIIs and are accessible to and usable by authorized receiving entities;

b) means for receiving activation commands, sent by users or programs, utilizing communicating devices and usable communication infrastructure;

c) means for verifying, and then accepting or rejecting activation commands in accordance with method'"'"'s activation and authorization rules, correlated with detectable identifiers and data which are extractable from the said received command, and;

d) means for activating the requested processes and distributing the additional requested information, in accordance with activation and authorization rules and said extractable identifiers and data embedded in the activation commands, combined with user'"'"'s or program'"'"'s characteristics, if accessible to the method operator.

16. The system of claim 14 wherein the a user or a program can sense the said AMS via the device output ports such as speaker, earphone, vibrator, display, light signals, data-ports, using at least one of the following communication alternatives:

a) utilizing the device which is used for receiving the MII containing file through the same communication channel used to receive the said file, wherein the AMSs are superimposed within the played file, b) utilizing the device of a) and another system component transmitting synchronous AMS to a channel different than one used by the device for receiving the MII containing file, c) utilizing a synchronized device for receiving the AMSs, other than the one used to receive the said MII containing file, d) utilizing application embedded in the device used for receiving the MII containing file and AMS triggers linked to it and generating a synchronous AMS by the device, based on AMS timing and type as defined by the trigger.

17. The devices of claim 14, used for at least one of:

a) receiving streamed or playing stored audio or audiovisual content containing MIIs and related AMSs or AMS-trigger to be translated to AMS by the device;

b) activating links to AIPs, in response to exposure to MIIs-AMS combinations;

c) linking to AIPs in response to approving activation commands by the server;

d) receiving the outcome of an activated AIP;

e) search and retrieve MIIs and later activate related AIPs by manipulating system'"'"'s archive;

f) create, edit and archive MII'"'"'s within a given data file, wherein managing the above tasks is based on at least one of means supported by the existing functionality, I/O ports and memory of the device—

i) the device'"'"'s preset memory, accessible to users, coupled with its standard “

call”

or “

send”

command, ii) DTMF (Dual-Tone Multi-Frequency) functionality of the device, iii) IVR (Interactive Voice Response) functionality of the device and the server, iv) Internet protocol communication instructions, and iv) Proprietary application imported from the system and operated using the device'"'"'s operating system.

18. The system of claim 14, wherein said devices are programmed to become a computerized-entity handling part of the server functionality, in a distributed server configuration, utilizing application software activated by the device or by a remote server, for managing at least one function out of the following group using:

a) means for managing authorizations prior to sending activation commands by a device user or program;

b) means for personalizing user'"'"'s AMS library as kept either within device memory or at remote memory;

c) means for generating/Masking AMSs by internal device procedure, synchronized with signals from streamed/played data file;

d) means for creating MIIs and related AMSs and AIPs within files to be stored within at list one of;

i) devices memory, ii) other sites that are linkable utilizing communication infrastructure;

e) means for managing the archiving of MIIs and their related AMSs, AIPs, links to AIPs and related activation and authorization rules, within at least one of;

i) devices memory, ii) other sites that are linkable utilizing communication infrastructure;

f) means for receiving and verifying activation commands related to AIPs stored within at least one of;

i) the device memory ii) a remote memory;

g) means for activating AIPs in response to authorized activation command, said AIP is store in at least one of;

i) the device memory ii) a remote memory.

19. The system of claim 14 further comprising transmission of activation commands through a server to information sites, wherein the commands originate from one of:

a) a communicating device used to receive the MII containing files, b) a communicating device pre-authorized by the system but not identical to the one used to receive the MII containing files, c) a non-preauthorized communication device enabling transmission of activation commands ones its user or program obtained authorization by the system, wherein said commands are delivered through at least one of the following alternatives—

i) national or regional wireless networks supporting end-to-end communication between a mobile device and activation-commands-receiver site, such as, but not limited to cellular, one or two-way messaging, regional/municipal Wi-Fi, WiMax, ii) local wireless link such as Blue-Tooth, IRDA or Wi-Fi networks for connecting the user'"'"'s device and an activation-command-receivers through local link utilizing local communicating device connected to a wireless or wire-line computer networking system, iii) wire-line communication network connecting the command source and command receiver, such as conventional telephony system, LAN/WAN configuration, Cable TV network iv) web-based transmission wherein the command sender logs into the service-provider site for sending the activation commands.

20. The communication system of claim 14 wherein the information containing the MII and AMS combinations is transmitted to a group of information recipients through channels that do not necessarily support two-way communication, such as, but not limited to:

a) broadcasting through radio or TV channels;

b) broadcasting or multicasting or uni-casting utilizing at least one of;

the internet infrastructure, Governmental information distribution channels, local advertisement media, Intranets;

c) broadcasting and multi-casting to a group of recipients within a well-defined geographical or network boundaries, such as, but not limited to recipients within theatres, business-campuses, work-groups, stadiums, schools, hospitals, limited urban districts, internet based chats or conferences, wherein the activation commands for linking the AIPs to recipients, are submitted to a the server using devices other than the ones used for receiving the MIIs-AMSs combinations, and wherein the system identifies the requested AIPs by a correlation check that includes at least one of the following means;

i) timing correlation of the activation command and the transmitted AMS-MII combination ii) identifiers that are extractable from the activation command, iii) pieces of content related to at least one of the MII, the AMS, and the MII-containing file, transmitted by the user of the system to the server or submitted by a program on the receiving device, iv) verification dialogue managed between the activation command sender servers, and, wherein the system includes means that enables it to link default AIPs to the relevant devices of recipients who cannot be categorized by the system, and, when the AIP activators can be categorized, the system includes means to link personalized AIPs to relevant receiving devices.

21. The system of claim 14 further comprising an archiving subsystem and archive search and retrieve algorithms that include at least one of:

a) means for storing and retrieving all or part of relations between the AMSs, MIIs, MII type, transferred file information containing the MIIs, location of the MIIs within such information, links to retrievable AIPs, location and types of such related AIPS, a creator or editor of MII-AMS-AIP combination, activation and authorization rules related to each AIP;

b) means for enabling authorized users or a program access to data stored in such archives without a need to play or stream all of the MII containing files;

c) means for enabling authorized user or program to activate search queries, retrieve search results and activate retrieved AIPs;

d) means for enabling an authorized user or a program to extract the archived data using a simple predefined activation command sent by an authorized communication device or a program;

e) means for enabling an authorized user to import part or all of the archive into at least one communicating device and to manipulate the archive without requiring the support of the server; and

f) means for enabling an authorized user to import the necessary parts of the archive software into at least one communicating device, enabling the user to manage a personalized archive.