Method and system for communicating between a sender and a recipient via a personalized message including an audio clip extracted from a pre-existing recording

• US 10,333,876 B2
• Filed: 05/08/2018
• Issued: 06/25/2019
• Est. Priority Date: 06/30/2011
• Status: Active Grant

• Current Assignee: Audiobyte LLC
• Original Assignee: Audiobyte LLC
• Inventors: Guthery, Scott, Van Den Bosch, Richard, Vo, Brian, Leung, Nolan, Blacker, Andrew, Van Suchtelen, John
• Primary Examiner(s): Washburn, Daniel C
• Assistant Examiner(s): Nguyen, Timothy
• Application Number:
  US15/973,822
• Publication Number:
  US 20180262452A1
• Time in Patent Office: 413 Days
• Field of Search: 704235
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 20/123 Shopping for digital content
• CPC Class Codes: G06Q 20/26 Debit schemes, e.g. "pay now"
• CPC Class Codes: G06Q 20/305 using wired telephone networks
• CPC Class Codes: G06Q 20/3274 using a pictured code, e.g. barcode or QR-code, being displayed on the M-device
• CPC Class Codes: G06Q 20/384 using social networks
• CPC Class Codes: G06Q 20/386 using messaging services or messaging apps using mobile network messaging services for payment, e.g. SMS G06Q20/3255
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0273 Determination of fees for advertising
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/52 for supporting social networking services

Abstract

A method of communicating between a sender and a recipient via a personalized message, including steps of: (a) identifying text, via the user interface of a communication device, of a desired lyric phrase from within a pre-existing audio recording; (b) selecting visual data, such as an image or video, to be paired with the desired lyric phrase; (c) extracting audio substantially associated with the desired lyric phrase from the pre-existing recording into a desired audio clip; (d) inputting personalized text via the user interface; (e) creating the personalized message with the sender identification, the personalized text and access to the desired audio clip; and (e) sending an electronic message to the electronic address of the recipient. Clips may be generated automatically based on a relevance score. The electronic message may be a text message, instant message, or email message; this message may alternatively have a link to the personalized message.

Claims

1. A computer program product embodied on a non-transitory computer readable medium, comprising code executable by a computer having a processor and a user interface and arranged to communicate with at least one audio and visual file messaging software-as-a-service platform, to cause the computer to carry out the following steps:

accessing the at least one audio and visual file messaging software-as-a-service platform;

communicating to the at least one audio and visual file messaging software-as-a-service platform a set of first information, the set of first information including a message personalized for an intended recipient;

selecting, via the user interface, at least one category of pre-existing audio and visual files to be retrieved;

retrieving, from the at least one audio messaging software-as-a-service platform, a plurality of pre-existing audio and visual files, said plurality of pre-existing audio and visual files associated with the at least one selected category, wherein each of the plurality of pre-existing audio and visual files further comprise a desired phrase;

amending the at least one audio and visual file to include a text, the text corresponding to the desired phrase from the plurality of the pre-existing audio and visual files; and

directing the at least one audio and visual file messaging software-as-a-service platform, via the user interface, to generate and output the amended audio and visual file, and deliver the amended file as a message of at least one of audio and visual data for the intended recipient.

2. The computer program product embodied on a non-transitory computer readable medium of claim 1, further comprising:

generating, via an audio extraction engine, the plurality of audio/visual files;

associating metadata regarding the content of the plurality of audio/visual files to each of the audio and visual files in the plurality of audio/visual files; and

storing the plurality of audio/visual files in a database.

3. The computer program product embodied on a non-transitory computer readable medium of claim 1, further comprising:

displaying the message personalized for an intended recipient on the visual file that is transmitted to the intended recipient.

4. The computer program product embodied on a non-transitory computer readable medium of claim 1, wherein the user interface is one of a graphical user interface and an audio interface.

5. The computer program product embodied on a non-transitory computer readable medium of claim 1, wherein the personalized message is played as an audio message of for the intended recipient.

6. The computer program product embodied on a non-transitory computer readable medium of claim 1, wherein the audio and visual files are categorized and searchable according to at least one of text information, artist, genre, and emotion.

7. The computer program product embodied on a non-transitory computer readable medium of claim 1, further comprising:

uploading content from a user to the database of pre-existing audio and visual files.

8. The computer program product embodied on a non-transitory computer readable medium of claim 7, further comprising:

tagging metadata to the uploaded content.

9. The computer program product embodied on a non-transitory computer readable medium of claim 8, wherein the metadata is generated by the user after the content is uploaded.

10. The computer program product embodied on a non-transitory computer readable medium of claim 8, wherein the metadata is automatically generated by the audio extraction engine and is based on the characteristics of the uploaded content.

11. The computer program product embodied on a non-transitory computer readable medium of claim 1, further comprising:

accessing the software-as-a-service program through an icon embedded in a messenger program.