Sonification of biometric data, state-songs generation, biological simulation modelling, and artificial intelligence

• US 10,369,323 B2
• Filed: 07/06/2017
• Issued: 08/06/2019
• Est. Priority Date: 01/15/2016
• Status: Active Grant

• Current Assignee: Robert Mitchell Joseph
• Original Assignee: Robert Mitchell Joseph
• Inventors: Joseph, Robert Mitchell
• Primary Examiner(s): Natnithithadha, Navin
• Assistant Examiner(s): Reddy, Sunita
• Application Number:
  US15/642,691
• Publication Number:
  US 20170326331A1
• Time in Patent Office: 761 Days
• Field of Search: 600 26- 28
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61M 2021/0027 by the hearing sense
• CPC Class Codes: A61M 21/00 Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
• CPC Class Codes: A61M 21/02 for inducing sleep or relaxation, e.g. by direct nerve stimulation, hypnosis, analgesia for massage A61H; electrotherapy A61N, e.g. applying alternating or intermittent electric currents for producing anaesthesia A61N1/36021
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders

Abstract

Embodiments are generally directed to methods, systems and devices for generating and playing back a personalized state song representing a target state of a user. In one scenario, a computer system accesses biometric data corresponding to various bodily systems of a user. The computer system encodes the biometric data into data structures that are configured for modeling using an algorithm that is specific to the user. The computer system models the encoded biometric data to identify specified patterns in the encoded biometric data, and these identified patterns are used to generate a personalized algorithm that corresponds with the identified patterns unique to the user. The computer system then synthesizes a state song using the personalized algorithm, which represents a specific biometric state for one of the bodily systems, and plays back the state song to the user to induce the user to the specific biometric state.

Claims

1. A method, implemented at a computer system that includes at least one processor, for generating and playing back a personalized state song representing a target state of a user, the method comprising:

accessing one or more portions of biometric data corresponding to one or more bodily systems of the user;

encoding the one or more portions of biometric data into data structures that are configured for modeling using an algorithm that is specific to the user;

modeling the encoded biometric data to identify one or more specified patterns, found in rhythmic recurrences of at least one of frequencies and amplitudes, or repeated highs and lows, in the encoded biometric data, the identified patterns being used to generate a personalized algorithm that corresponds with the identified patterns unique to the user, the personalized algorithm comprising lines of sound which sonify the encoded biometric data;

synthesizing a state song using the personalized algorithm, the state song representing a specific biometric state for at least one of the bodily systems, using the lines of sound to create endogenous music; and

playing back the state song to the user to induce the user to the specific biometric state.

2. The method of claim 1, wherein modeling the encoded biometric data further comprises:

identifying one or more relationships between different types of biometric data;

wherein generating the personalized algorithm implements as input the identified relationships between the different types of biometric data.

3. The method of claim 2, wherein the different types of biometric data are received from specialized biomedical devices.

4. The method of claim 1, wherein the encoding is performed at a transcoding engine that includes an encoding layer configured to encode the biometric data into musical elements by mapping the biometric data according to at least one of sampling rate, filters, reverb or compression.

5. The method of claim 4, wherein a default mapping is established for each type of biometric data.

6. The method of claim 1, wherein the encoding is performed at a transcoding engine that includes an encoding layer configured to encode the biometric data into musical elements by mapping different types of the biometric data to different instruments or sounds.

7. The method of claim 6, wherein an artificial intelligence engine is implemented to learn musical patterns that make music acoustically desirable, and wherein the learned musical patterns are used when mapping different types of biometric data to the instruments or sounds.

8. The method of claim 1, wherein the state song is played back to the user in reaction to the user reaching a specified, undesirable biometric state.

9. The method of claim 1, wherein the state song is played back to the user proactively to prevent the user from reaching a specified, undesirable biometric state.

10. The method of claim 1, further comprising rendering a graph that is an isomorphic representation of the one or more portions of biometric data to create a digital twin of the user.

11. A computer system, comprising:

one or more processors;

system memory;

a data accessing module configured to access one or more portions of biometric data representing operations of one or more bodily systems of a user;

an encoding layer configured to encode the one or more portions of biometric data, wherein encoding prepares the data for modeling at a modeling layer;

the modeling layer configured to identify one or more specified patterns, found in rhythmic recurrences of at least one of frequencies and amplitudes, or repeated highs and lows, in the encoded biometric data, wherein the identified patterns are used to generate a personalized algorithm that corresponds with the identified patterns unique to the user, the personalized algorithm comprising lines of sound which sonify the encoded biometric data;

a synthesis layer that uses the personalized algorithm to synthesize a state song representing a specific biometric state for at least one of the bodily systems, using the lines of sound to create endogenous music; and

a playback module that plays the synthesized state song back to the user to induce the user to the specific biometric state.

12. The computer system of claim 11, wherein identifying specified patterns in the encoded biometric data further comprises identifying noise in the biometric data.

13. The computer system of claim 11, further comprising a filtering layer that is configured to filter at least a portion of identified noise in the biometric data.

14. The computer system of claim 11, further comprising an artificial intelligence layer configured to examine one or more existing songs and provide one or more musical elements as input to the synthesis layer indicating how the state song is to be generated.

15. The computer system of claim 11, further comprising a sharing layer configured to provide the synthesized state song to one or more other users.

16. The computer system of claim 11, further comprising a graphical user interface (GUI) that allows users to specify how biometric data from different biological systems is to be mapped to, instruments, or sounds.

17. A method, implemented at a computer system that includes at least one processor, for controlling state dependent behaviors of a user, the method comprising:

obtaining biometric data from one or more data capture devices placed in contact with the user, the biometric data comprising different types of biometric data;

associating at least some of the obtained biometric data with a plurality of specified instruments or sounds, each instrument or sound being mapped to a different type of biometric data;

compiling at least some of the instruments or sounds into a composition or song of endogenous music arranged to represent a targeted state; and

providing the composition or song back to the user to induce the user to the targeted state.

18. The method of claim 17, wherein endogenous music is combined with exogenous music.

19. The method of claim 17, further comprising providing one or more genre filters for the obtained biometric data.

20. The method of claim 17, wherein the biometric data is moved to a service oriented architecture (SOA) that provides one or more services including distributed processing and distributed storage.