MACHINES, SYSTEMS, PROCESSES FOR AUTOMATED MUSIC COMPOSITION AND GENERATION EMPLOYING LINGUISTIC AND/OR GRAPHICAL ICON BASED MUSICAL EXPERIENCE DESCRIPTORS

• US 20170092247A1
• Filed: 09/29/2015
• Published: 03/30/2017
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: Shutterstock Incorporated
• Original Assignee: Amper Music, Inc. (Shutterstock Incorporated)
• Inventors: Silverstein, Andrew H.
• Granted Patent: US 9,721,551 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/021 Background music, e.g. for video sequences, elevator music musical accompaniment G10H2210/005
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/105 Composing aid, e.g. for supporting creation, edition or modification of a piece of music
• CPC Class Codes: G10H 2210/111 Automatic composing, i.e. using predefined musical rules
• CPC Class Codes: G10H 2210/115 using a random process to generate a musical note, phrase, sequence or structure using a random process to build a rhythm pattern G10H2210/356; random rhythm pattern selection G10H2210/366
• CPC Class Codes: G10H 2210/341 Rhythm pattern selection, synthesis or composition Rhythm analysis G10H2210/071; accompaniment G10H2210/005
• CPC Class Codes: G10H 2220/101 for graphical creation, edition or control of musical data or parameters
• CPC Class Codes: G10H 2240/081 Genre classification, i.e. descriptive metadata for classification or selection of musical pieces according to style analysis genre G10H2210/036
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
• CPC Class Codes: G10H 2240/305 Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes
• CPC Class Codes: G10H 2250/311 Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation musical analysis G10H2210/031; neural networks G06N3/02
• CPC Class Codes: G10L 25/15 the extracted parameters being formant information

Abstract

Automated music composition and generation machine, systems and methods, and architectures that allow anyone, without possessing any knowledge of music theory or practice, or expertise in music or other creative endeavors, to instantly create unique and professional-quality music, synchronized to any kind of media content, including, but not limited to, video, photography, slideshows, and any pre-existing audio format, as well as any object, entity, and/or event, wherein the system user only requires knowledge of ones own emotions and/or artistic concepts which are to be expressed in a piece of music that will ultimately composed by the automated composition and generation system of the present invention.

Claims

1-39. -39. (canceled)

40. An automated music composition and generation system driven by emotion-type and style-type musical experience descriptors and time and/or space parameters supplied by a system user, comprising:

a system user interface for enabling system users to provide emotion-type and style-type musical experience descriptors and time and/or space parameters to said automated music composition and generation system for processing; and

an automated music composition and generation engine, operably connected to said system user interface, and including a plurality of function-specific subsystems cooperating together to compose and generate one or more digital pieces of music, each of which contains a set of musical notes arranged and performed using an orchestration of one or more musical instruments selected for the digital piece of music;

wherein said automated music composition and generation engine including an arrangement of various function-specific subsystems including;

a parameter transformation subsystem for receiving said emotion-type and style-type musical experience descriptors and time and/or space parameters from said system user interface, and processing and transforming said parameters and producing music-theoretic based parameters for use by one or more of said function-specific subsystems during automated music composition and generation;

an orchestration subsystem for automatically orchestrating said piece of music being composed for performance by an ensemble of one or more virtual-instruments;

a digital piece creation subsystem for creating a digital version of the orchestrated piece of digital music, employing one or more automated virtual-instrument music synthesis techniques; and

a feedback and learning subsystem for supporting a feedback and learning cycle within said automated music composition and generation system,

wherein said system user provides a rating a produced piece of orchestrated music and/or music preferences, in response to experiencing a piece of orchestrated music composed by said automated music composition and generation system, and

wherein said automated music composition and generation system automatically generates an updated piece of music based on said ratings and/or preferences provided by said system user.

41. The automated music composition and generation system of claim 40, wherein said system user interface receives a piece of digital media selected from the group consisting of a video, an audio-recording, an image, or an event marker, and said automated music composition and generation system generates said digital piece of music for musically scoring said piece of digital media, and then combining the piece of digital music and piece of digital media to produced a piece of musically-scored digital media that is supplied back to said system user via said system user interface for experiencing and review.

42. The automated music composition and generation system of claim 40, wherein said automated music composition and generation engine further comprises a controller code creation subsystem for creating controller code for the orchestrated piece of music;

43. The automated music composition and generation system of claim 42, wherein said automated music composition and generation engine further comprises:

a general rhythm generation subsystem for generating a general rhythm for the piece of music being composed;

a general pitch generation subsystem for generating chords for the piece of music being composed;

a melody rhythm generation subsystem for generating a melody rhythm for the piece of music being composed; and

a melody pitch generation subsystem for generating a melody pitch for the piece of music being composed.

44. The automated music composition and generation system of claim 43, wherein said general rhythm generation subsystem comprises one or more of the following subsystems:

a length generation subsystem;

a tempo generation subsystem;

a meter generation subsystem;

a key generation subsystem;

a beat calculator subsystem;

a tonality generation subsystem;

a measure calculator subsystem;

a song form generation subsystem;

a sub-phrase length generation subsystem;

a number of chords in sub-phrase calculator subsystem;

a phrase length generation subsystem;

an unique phrase generation subsystem;

a number of chords in phrase calculator subsystem;

a chord length generation subsystem;

an unique sub-phrase generation subsystem;

an instrumentation subsystem;

an instrument selector subsystem; and

a timing generation subsystem.

45. The automated music composition and generation system of claim 43, wherein said general pitch generation subsystem comprises one or more of the following subsystems:

an initial chord generation subsystem;

a sub-phrase chord progression generation subsystem;

a phrase chord progression generation subsystem; and

a chord inversion generation subsystem;

wherein said melody rhythm generation subsystem comprises a melody sub-phrase length generation subsystem, a melody sub-phrase generation subsystem, a melody phrase length generation subsystem, a melody unique phrase generation subsystem, a melody length generation subsystem, and a melody note rhythm generation subsystem.

46. The automated music composition and generation system of claim 43, wherein said melody pitch generation subsystem comprises one or more of the following subsystems:

an initial pitch generation subsystem;

a sub-phrase pitch generation subsystem;

a phrase pitch generation subsystem; and

a pitch octave generation subsystem.

47. The automated music composition and generation system of claim 43, wherein said orchestration subsystem comprises an orchestration generation subsystem.

48. The automated music composition and generation system of claim 43, wherein said controller code creation subsystem comprises a controller code generation subsystem.

49. The automated music composition and generation system of claim 42, wherein said digital piece creation subsystem comprises one or more of the following subsystems:

a digital audio sample audio retriever subsystem;

a digital audio sample organizer subsystem;

a piece consolidator subsystem;

a piece format translator subsystem; and

a piece deliverer subsystem.

50. The automated music composition and generation system of claim 42, wherein said feedback and learning subsystem comprises one or more of the following subsystems:

a feedback subsystem;

a music editability subsystem;

a preference saver subsystem;

a musical kernel subsystem;

a user taste subsystem;

a population taste subsystem;

a user preference subsystem; and

a population preference subsystem.

51. The automated music composition and generation system of claim 42, wherein said system user is a human being.

52. The automated music composition and generation system of claim 42, wherein one or more of said music-theoretic parameters comprise probability-based music-theoretic parameters.

53. Automated music composition and generation process driven by emotion-type and style-type musical experience descriptors and time and/or space parameters supplied by a system user, comprising the steps of:

(a) said system user providing a set of emotion-type and style-type musical experience descriptors and time and/or space parameters, to a system user interface operably connected to an automated music composition and generation engine constructed from various function-specific subsystems that are configured for automatically composing and generating a piece of music in response to said set of emotion-type and style-type musical experience descriptors and time and/or space parameters;

(b) transforming said set of emotion-type and style-type parameters and time and/or space parameters into a set of music-theoretic parameters;

(c) providing said set of music-theoretic parameters to said function-specific subsystems within said automated music composition and generation engine; and

(d) said function-specific subsystems processing said set of music-theoretic parameters and using one or more automated virtual-instrument music synthesis methods to automatically compose and generate a piece of digital music; and

(e) delivering the piece of digital music to said system user for review and evaluation.

54. The automated music composition and generation process of claim 53, which further comprises:

(e) said system user providing feedback to said system user interface, relating to the system user'"'"'s rating of the produced piece of music and/or preferences; and

(f) using said feedback to generate another piece of digital music for review and evaluation by said system user.

55. The automated music composition and generation process of claim 53, wherein said system user interface comprises a client machine in communication with a data processing center comprising web servers, application servers and database (RDBMS) servers operably connected to the infrastructure of the Internet.

56. The automated music composition and generation process of claim 53, wherein one or more of said music-theoretic parameters comprise probability-based music-theoretic parameters.

57. The automated music composition and generation process of claim 53, wherein said system user interface comprises a client machine in communication with a data processing center comprising a web server, an application server and a database (RDBMS) server operably connected to the infrastructure of the Internet.

58. The automated music composition and generation process of claim 53, wherein said function-specific subsystems comprise:

a digital piece creation subsystem for creating a digital version of the orchestrated piece of digital music, employing one or more automated virtual-instrument music synthesis techniques.

59. Automated music composition and generation process driven by emotion-type and style-type musical experience descriptors and time and/or space parameters supplied by a system user, comprises the steps of:

(a) the system user providing a set of emotion-type and style-type musical experience descriptors and time and/or space parameters, to a system user interface operably connected to an automated music composition and generation engine constructed from various function-specific subsystems that are configured for automatically composing and generating a piece of music in response to said set of emotion-type and style-type musical experience descriptors and time and/or space parameters;

(b) transforming said set of emotion-type and style-type parameters and time and/or space parameters into a set of music-theoretic parameters;

(c) providing said set of music-theoretic parameters to said function-specific subsystems within said automated music composition and generation engine;

(d) said function-specific subsystems processing said set of music-theoretic parameters to automatically compose and generate a piece of digital music;

(e) delivering the piece of digital music to said system user for review and evaluation;

(f) said system user providing feedback to said automated music composition and generation engine relating to the system user'"'"'s rating of the produced piece of music and/or preferences; and

(g) using said feedback to generate another piece of digital music for review and evaluation by said system user.