BIOMETRIC-MUSIC INTERACTION METHODS AND SYSTEMS

• US 20150093729A1
• Filed: 04/29/2014
• Published: 04/02/2015
• Est. Priority Date: 09/07/2012
• Status: Active Grant

• Current Assignee: Huma Therapeutics Ltd.
• Original Assignee: BioBeats Inc. (Huma Therapeutics Ltd.)
• Inventors: Morelli, Davide, Plans, David, Cocco, Gabriele, Kassam, Nadeem
• Granted Patent: US 10,459,972 B2
• Time in Patent Office: Days
• US Class Current: 434/236
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/02416 using photoplethysmograph signals, e.g. generated by infrared radiation A61B5/14552 takes precedence
• CPC Class Codes: A61B 5/0816 Measuring devices for examining respiratory frequency measuring frequency of electric signals G01R23/00
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G10H 1/0025 Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece automatically producing a series of tones G10H1/26
• CPC Class Codes: G10H 2210/111 Automatic composing, i.e. using predefined musical rules
• CPC Class Codes: G10H 2210/125 Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
• CPC Class Codes: G10H 2210/391 Automatic tempo adjustment, correction or control
• CPC Class Codes: G10H 2220/005 Non-interactive screen display of musical or status data graphical user interfaces specifically adapted for electrophonic musical instruments G10H2220/091; fingering displays G10H2220/041
• CPC Class Codes: G10H 2220/361 Mouth control in general, i.e. breath, mouth, teeth, tongue or lip-controlled input devices or sensors detecting, e.g. lip position, lip vibration, air pressure, air velocity, air flow or air jet angle
• CPC Class Codes: G10H 2220/371 Vital parameter control, i.e. musical instrument control based on body signals, e.g. brainwaves, pulsation, temperature, perspiration; biometric information signals from body positions or movements G10H2220/321
• CPC Class Codes: G10H 2220/395 Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing. conductor baton movement sensing G10H2220/206, angle sensing without reference to gravity G10H2220/391; player body joint angle sensing G10H2220/321
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
• CPC Class Codes: G10H 2230/015 : PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used touch-screen interfaces G10H2220/096
• CPC Class Codes: G10H 2240/251 : Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analog or digital, e.g. DECT GSM, UMTS smartphone, PDA or palmtop used for musical purposes G10H2230/015; mobile ringtone G10H2230/021
• CPC Class Codes: G10H 2240/311 : MIDI transmission G10H2240/056 takes precedence
• CPC Class Codes: G10H 2240/325 : Synchronizing two or more audio tracks or files according to musical features or musical timings synchronised lyrics, e.g. for karaoke G10H2220/011
• CPC Class Codes: G10H 2250/011 : Genetic algorithms, i.e. using computational steps analogous to biological selection, recombination and mutation on an initial population of, e.g. sounds, pieces, melodies or loops to compose or otherwise generate, e.g. evolutionary music or sound synthesis

Abstract

A system and method for the automatic, procedural generation of musical content in relation to biometric data. The systems and methods use a user'"'"'s device, such as a cell phone to capture image data of a body part, and derive a biometric signal from the image data. The biometric signal includes biometric parameters, which are used by a music generation engine to generate music. The music generation can also be based on user-specific data and quality data related to the biometric detection process.

Claims

1. A biometric data processing system comprising:

a biometric interface configured to acquire biometric data sets from distinct biometric sensor platforms, each biometric data set corresponding to an individual; and

a biometric processing engine coupled with the biometric interface and configured to;

obtain the biometric data sets;

derive a group biometric state as a function of the biometric data sets;

generate a media presentation based on the group biometric state; and

configure a presentation computing system to render the media presentation.

2. The system of claim 1, further comprising a plurality of smart phones configured to operate as the biometric sensors.

3. The system of claim 1, wherein the group biometric state comprises an average biometric.

4. The system of claim 3, wherein the average biometric includes an average of at least one of the following:

a heart rate, a breath rate, a galvanic value, a movement, a tension, a stress level, a perfusion, an airway patency, and a blood pressure.

5. The system of claim 1, wherein the group biometric state comprises a biometric range.

6. The system of claim 5, wherein the biometric range comprises at least one of the following:

a statistical spread, a confidence level, a minimum value, and a maximum value.

7. The system of claim 1, wherein at least some of the biometric data sets include geolocation information.

8. The system of claim 1, wherein at least some of the biometric data sets include timestamp information.

9. The system of claim 1, wherein at least some of the biometric data sets include orientation information.

10. The system of claim 1, wherein the media presentation comprises multimedia.

11. The system of claim 1, wherein the media presentation comprises at least one of the following types of content:

an image, a video, a graphic, a real-time generated graphic, audio, a rhythm, a game, an advertisement, and a melody.

12. The system of claim 1, wherein the media presentation comprises animated content responsive to the group biometric state.

13. The system of claim 1, further comprising a content database storing content indexed according a group biometric state attribute namespace.

14. The system of claim 13, wherein the biometric processing engine is further configured to derive group attributes from the biometric data sets.

15. The system of claim 14, wherein the group biometric state includes attributes that adhere to the attribute namespace.

16. The system of claim 14, wherein the processing engine is further configured to generate the media presentation from content objects from the content database as a function of the group attributes.

17. A method comprising:

configuring a mobile device to operate as a content management engine;

acquiring, by the content management engine, biometric data from the mobile device;

deriving, by the content management engine, bio-state of an entity as a function of the biometric data;

generating, by the content management engine, a content list from the bio-state; and

configuring the mobile device to render content associated with the content list.

18. The method of claim 17, wherein the bio-state comprises a physiological state.

19. The method of claim 17, wherein the bio-state comprises a psychological state.

20. The method of claim 17, wherein the mobile device comprises at least one of the following:

a phone, a tablet, a phablet, a vehicle, a gaming device, and a medical device.

21. The method of claim 17, wherein the step of generating the content list includes classifying content according to an ontological classification scheme according to bio-state attributes representative of the bio-state.

22. The method of claim 21, wherein the bio-state attributes include at least one of the following:

stress levels, endurance levels, galvanic response, emotional characteristics, and vocal tone.

23. The method of claim 17, wherein the content list comprises at least one of the following types of content:

image data, audio data, music data, video data, game data, shopping data, medical data, and family data.

24. The method of claim 17, wherein the content list comprises a music playlist.

25. The method of claim 17, wherein the content list comprises play rules that govern playback of content identified by the list.

26. The method of claim 25, wherein the play rules operate as a function of the bio-state.

27. The method of claim 26, wherein the play rules operate as a function of the bio-state as feedback.

28. The method of claim 26, wherein the play rules operate as a function of the bio-state in real-time.

29. The method of claim 17, wherein the step of configuring the mobile device to render the content list occurs substantially in real-time with respect to the step of deriving the bio-state.

30. The method of claim 29, wherein the step of configuring the mobile device to render the content list occurs substantially within one minute to the step of deriving the bio-state.

31. A therapy system comprising:

a biosensor interface configured to acquire biometric data; and

a therapy engine coupled with the biosensor interface and configured to;

obtain the biometric data via the biosensor interface;

construct a digital therapy regimen associated with a therapy as a function of the biometric data, the digital therapy regime comprising rendering instructions; and

configure a device to render the digital therapy regimen according to the rendering instructions.

32. The system of claim 31, wherein the digital therapy regimen is associated with a chest therapy.

33. The system of claim 31, wherein the digital therapy regimen is associated with a mindfulness therapy.

34. The system of claim 31, further comprising a therapy template database configured to store template objects representing the therapy.

35. The system of claim 34, wherein the therapy engine is further configured to identify at least one of the template objects based on the biometric data.

36. The system of claim 31, wherein the digital therapy regimen is constructed based on an active cycle breathing exercise template.

37. The system of claim 31, wherein the digital therapy regimen is constructed based on a pranic breathing exercise template.

38. The system of claim 31, wherein the biosensor interface comprise a photoplethysmograph.

39. The system of claim 38, wherein the photoplethysmograph comprises a smart phone.

40. The system of claim 31, wherein the biosensor interface comprises a smart phone.

41. The system of claim 31, wherein the therapy engine comprises a mobile computing device configured to operate as the therapy engine.

42. The system of claim 41, wherein the mobile computing device comprises at least one of the following:

a cell phone, a media player, a medical device, a vehicle, a tablet, a phablet, and a game device.

43. The system of claim 41, wherein the therapy engine comprises a remote server configured to operate as the therapy engine.

44. The system of claim 41, wherein the digital therapy regimen comprises instructions to generate at least one of the following modalities of data:

audio data, image data, video data, haptic data, kinesthetic data, olfactory data, and taste data.

45. The system of claim 41, wherein the digital therapy regimen comprises instructions to generate a multi-modal therapy as the therapy via the device.

46. The system of claim 41, wherein therapy engine is further configured to obtain additional biometric data as the biometric data in response to a previously rendered therapy regimen.

47. The system of claim 41, wherein the biometric data comprises at least one of the following:

a breath rate, image data, audio data, accelerometer data, pulse oximetry data, EKG data, EEG data, galvanic data, and temperature data.