System and process for embedding electronic messages and documents with pieces of digital music automatically composed and generated by an automated music composition and generation engine driven by user-specified emotion-type and style-type musical experience descriptors

• US 10,311,842 B2
• Filed: 04/17/2017
• Issued: 06/04/2019
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: Shutterstock Incorporated
• Original Assignee: Amper Music, Inc. (Shutterstock Incorporated)
• Inventors: Silverstein, Andrew H.
• Primary Examiner(s): Warren, David S
• Application Number:
  US15/489,709
• Publication Number:
  US 20170263228A1
• Time in Patent Office: 778 Days
• Field of Search: 84610
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/021 Background music, e.g. for video sequences, elevator music musical accompaniment G10H2210/005
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/105 Composing aid, e.g. for supporting creation, edition or modification of a piece of music
• CPC Class Codes: G10H 2210/111 Automatic composing, i.e. using predefined musical rules
• CPC Class Codes: G10H 2210/115 using a random process to generate a musical note, phrase, sequence or structure using a random process to build a rhythm pattern G10H2210/356; random rhythm pattern selection G10H2210/366
• CPC Class Codes: G10H 2210/341 Rhythm pattern selection, synthesis or composition Rhythm analysis G10H2210/071; accompaniment G10H2210/005
• CPC Class Codes: G10H 2220/101 for graphical creation, edition or control of musical data or parameters
• CPC Class Codes: G10H 2240/081 Genre classification, i.e. descriptive metadata for classification or selection of musical pieces according to style analysis genre G10H2210/036
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
• CPC Class Codes: G10H 2240/305 Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes
• CPC Class Codes: G10H 2250/311 Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation musical analysis G10H2210/031; neural networks G06N3/02
• CPC Class Codes: G10L 25/15 the extracted parameters being formant information

Abstract

An automated music composition and generation system and process allowing system users to produce and deliver electronic messages and documents, such as text, SMS and email, augmented with automatically-composed music generated using user-selected emotion-type and style-type musical experience descriptors. The automated music composition and generation system includes an automated music composition and generation engine operably connected to a system user interface, and the infrastructure of the Internet. Mobile and desktop client machines provide text, SMS and/or email services supported on the Internet. Each client machine has a text application, SMS application and/or email application augmented by the addition of automatically-composed music by systems users using the automated music composition and generation engine. By selecting and providing musical emotion and style descriptors to the engine, music is automatically composed, generated, and embedded in text, SMS and/or email messages for delivery to other client machines over the infrastructure of the Internet.

Claims

1. An automated music composition and generation system allowing users to produce and deliver electronic messages embedded with pieces of digital music automatically composed and generated by an automated music composition and generation engine driven by user-selected emotion-type and/or style-type musical experience descriptors, said automated music composition and generation system comprising:

a plurality of client machines deployed on the infrastructure of the Internet,

wherein each said client machine supports at least one electronic messaging service providing a graphical user interface (GUI) for producing and delivering electronic messages;

an automated music composition and generation engine operably connected to the infrastructure of the Internet, for automatically composing and generating a piece of digital music in response to emotion-type and/or style-type musical experience descriptors provided to said automated music composition and generation engine; and

a communication server operably connected to the infrastructure of the Internet and said automated music composition and generation engine, for serving pieces of digital music automatically composed and generated by said automated music composition and generation engine;

wherein a system user uses said GUI supported by said client machine to select an electronic message and provide emotion-type and/or style-type musical experience descriptors to said automated music composition and generation engine for use in automatically composing and generating a piece of digital music and embedding the piece of digital music into said electronic message so that when said electronic message is reviewed, said piece of digital music is served from said communication server and experienced with said electronic message; and

wherein said automated music composition and generation engine, once initiated by the system user, automatically transforms said provided emotion-type and style-type musical experience descriptors into a set of music-theoretic system operating parameters, which are used by said automated music composition and generation engine to automatically compose and generate the piece of digital music for embedding into said electronic message.

2. The automated music composition and generation system of claim 1, wherein said electronic message is selected from the group consisting of email messages, SMS messages and text messages.

3. The automated music composition and generation system of claim 1, wherein said emotion-type and/or style-type musical experience descriptors comprise linguistic and/or graphical-icon based musical experience descriptors.

4. The automated music composition and generation system of claim 1, wherein each said client machine comprises a client application supporting (i) the selection of said electronic message, and (ii) the embedding of said piece of digital music into said electronic message by embedding a URL into said electronic message, specifying the location of the piece of digital music served from said communication server.

5. The automated music composition and generation system of claim 1, wherein said client machines are selected from the group consisting of desktop computers, mobile smartphones, and mobile computers;

and wherein said communication server comprises one or more information servers selected from the group consisting of web servers, application servers and database servers.

6. An automated music composition and generation system allowing users to produce and deliver electronic documents embedded with pieces of digital music automatically composed and generated using user-selected emotion-type and/or style-type musical experience descriptors, said automated music composition and generation system comprising:

a plurality of client machines deployed on the infrastructure of the Internet,

wherein each said client machine supports at least one electronic document service providing a graphical user interface (GUI) for producing and delivering electronic documents;

an automated music composition and generation engine operably connected to the infrastructure of the Internet, for automatically composing and generating a piece of digital music in response to emotion-type and/or style-type musical experience descriptors provided to said automated music composition and generation engine; and

a communication server operably connected to the infrastructure of the Internet and said automated music composition and generation engine, for serving pieces of digital music automatically composed and generated by said automated music composition and generation engine;

wherein a system user uses said GUI supported by said client machine to select an electronic document and provide emotion-type and/or style-type musical experience descriptors to said automated music composition and generation engine for use in automatically composing and generating a piece of digital music and embedding the piece of digital music into said electronic document so that when said electronic document is reviewed, said piece of digital music is served from said communication server and experienced with said electronic document;

wherein said automated music composition and generation engine, once initiated by the system user, automatically transforms said provided emotion-type and style-type musical experience descriptors into a set of music-theoretic system operating parameters, which are used by said automated music composition and generation engine to automatically compose and generate the piece of digital music for embedding into said electronic document.

7. The automated music composition and generation system of claim 6, wherein electronic document is selected from the group consisting of a text-based document, an html document, an audio-based document, and a video-based document.

8. The automated music composition and generation system of claim 6, wherein said client machines are selected from the group consisting of desktop computers, mobile smartphones, and mobile computers;

and wherein said communication server comprises one or more information servers selected from the group consisting of web servers, application servers and database servers.

9. The automated music composition and generation system of claim 6, wherein each said client machine comprises a client application supporting (i) the selection of said electronic document, and (ii) the embedding of said piece of digital music into said electronic document by embedding a URL into said electronic document, specifying the location of the piece of digital music served from said communication server.

10. The automated music composition and generation system of claim 6, wherein said emotion-type and/or style-type musical experience descriptors comprise linguistic and/or graphical-icon based musical experience descriptors.

11. An automated music composition and generation process supporting the use of emotion-type and/or style-type musical experience descriptors to produce electronic messages embedded with pieces of digital music automatically composed and generated using said emotion-type and style-type music experience descriptors, said automated music composition and generation process comprising the steps of:

(a) a system user accessing an automated music composition and generation system deployed on the infrastructure of the Internet and having a system interface for receiving emotion-type and/or style-type musical experience descriptors;

(b) said system user selecting an electronic message to be embedded with a piece of digital music automatically composed and generated by said automated music composition and generation system;

(c) said system user providing emotion-type and/or style-type musical experience descriptors to the system interface of said automated music composition and generation system;

(d) said system user initiating said automated music composition and generation system to automatically compose and generate a piece of digital music based on said emotion-type and/or style-type musical experience descriptors provided to said system interface,

wherein said automated music composition and generation engine, once initiated by the system user, automatically transforms said provided emotion-type and/or style-type musical experience descriptors into a set of music-theoretic system operating parameters, which are used by said automated music composition and generation engine to automatically compose and generate the piece of digital music for embedding into said electronic message;

(e) said system user either (i) accepting the piece of digital music composed and generated for said electronic message, or (ii) rejecting the piece of digital music and providing feedback to said system interface including providing updated musical experience descriptors and requesting said automated music composition and generation system to re-compose the piece of digital music based on the updated musical experience descriptors, so as to provide a final piece of digital music for embedding into said electronic message;

(f) embedding the final piece of digital music into said electronic message so that the final piece of digital music is served from a communication server; and

(g) delivering said electronic message to a client system operably connected to the infrastructure of the Internet, for review of said electronic message while said final piece of digital music is being served from said communication server and experienced with said electronic message.

12. The automated music composition and generation process of claim 11, wherein each said client machine comprises a client application supporting (i) the selection of said electronic message, and (ii) the embedding of said final piece of digital music into said electronic message by embedding a URL into said electronic message, specifying the location of the piece of digital music served from said communication server.

13. The automated music composition and generation process of claim 11, wherein said electronic message is selected from the group consisting of email messages, SMS messages and text messages.

14. The automated music composition and generation process of claim 11, wherein said emotion-type and/or style-type musical experience descriptors comprise linguistic and/or graphical-icon based musical experience descriptors.

15. The automated music composition and generation process of claim 11, wherein said client machines are selected from the group consisting of desktop computers, mobile smartphones, and mobile computers;

and wherein said communication server comprises one or more information servers selected from the group consisting of web servers, application servers and database servers.

16. An automated music composition and generation process supporting the use of emotion-type and/or style-type musical experience descriptors to produce electronic documents embedded with pieces of digital music automatically composed and generated using emotion-type and style-type musical experience descriptors, said automated music composition and generation process comprising the steps of:

(a) a system user accessing an automated music composition and generation system deployed on the infrastructure of the Internet and having a system interface;

(b) said system user selecting an electronic document to be embedded with a piece of digital music automatically composed and generated by said automated music composition and generation system;

(c) said system user providing emotion-type and/or style-type musical experience descriptors to the system interface of said automated music composition and generation system;

(d) said system user initiating said automated music composition and generation system to automatically compose and generate a piece of digital music based on said emotion-type and/or style-type musical experience descriptors provided to said system interface,

wherein said automated music composition and generation engine, once initiated by the system user, automatically transforms said provided emotion-type and/or style-type musical experience descriptors into a set of music-theoretic system operating parameters, which are used by said automated music composition and generation engine to automatically compose and generate the piece of digital music for embedding into said electronic document;

(e) said system user accepting the piece of digital music composed and generated for said electronic document, or rejecting the piece of digital music and providing feedback to said system interface, including providing updated musical experience descriptors and requesting said automated music composition and generation system to re-compose the piece of digital music based on the updated musical experience descriptors, so as to provide a final piece of digital music for linking to said electronic document;

(f) embedding the final piece of digital music into said electronic document so that the final piece of digital music is served from a communication server; and

(g) delivering said electronic document to a client system operably connected to the infrastructure of the Internet, for review of said electronic document while said final piece of digital music is being served from said communication server and experienced with said electronic document.

17. The automated music composition and generation process of claim 16, wherein each said client machine comprises a client application supporting (i) the selection of said electronic document, and (ii) the embedding of the final piece of digital music into said electronic document by embedding a URL into said electronic document, specifying the location of the final piece of digital music served from said communication server.

18. The automated music composition and generation process of claim 16, wherein electronic document is selected from the group consisting of a text-based document, an html document, an audio-based document, and a video-based document.

19. The automated music composition and generation process of claim 16, wherein said emotion-type and/or style-type musical experience descriptors comprise linguistic and/or graphical-icon based musical experience descriptors.

20. The automated music composition and generation process of claim 16, wherein said client machines are selected from the group consisting of desktop computers, mobile smartphones, and mobile computers;

and wherein said communication server comprises one or more information servers selected from the group consisting of web servers, application servers and database servers.