Multi-factor control of ear stimulation

• US 10,406,376 B2
• Filed: 11/01/2016
• Issued: 09/10/2019
• Est. Priority Date: 03/27/2015
• Status: Expired due to Fees

• Current Assignee: Aurenar Incorporated
• Original Assignee: Equality, LLC
• Inventors: Goodall, Eleanor V., Hyde, Roderick A., Ishikawa, Muriel Y., Kare, Jordin T., Kitzan, Melanie K., Leuthardt, Eric C., Malamud, Mark A., Malaska, Stephen L., Myhrvold, Nathan P., Scheid, Brittany, Sharadin, Katherine E., Sweeney, Elizabeth A., Tegreene, Clarence T., Whitmer, Charles, Wood, Jr., Lowell L., Wood, Victoria Y. H.
• Primary Examiner(s): Matthews, Christine H
• Assistant Examiner(s): Lannu, Joshua Daryl D
• Application Number:
  US15/340,217
• Publication Number:
  US 20170113057A1
• Time in Patent Office: 1,043 Days
• CPC Class Codes: A61B 5/00 Measuring for diagnostic purposes radiation diagnosis A61B6/00; diagnosis by ultrasonic, sonic or infrasonic waves A61B8/00; Identification of persons
• CPC Class Codes: A61B 5/12 Audiometering
• CPC Class Codes: A61B 5/4005 for evaluating the sensory system A61B5/12, A61B5/4058 take precedence
• CPC Class Codes: A61B 5/4094 Diagnosing or monitoring seizure diseases, e.g. epilepsy
• CPC Class Codes: A61B 5/4806 Sleep evaluation A61B5/4821 takes precedence; devices for inducing sleep A61M21/02
• CPC Class Codes: A61B 5/6816 Ear lobe
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: A61N 1/0456 Specially adapted for transcutaneous electrical nerve stimulation [TENS]
• CPC Class Codes: A61N 1/0472 Structure-related aspects
• CPC Class Codes: A61N 1/0484 Garment electrodes worn by the patient
• CPC Class Codes: A61N 1/36021 for treatment of pain
• CPC Class Codes: A61N 1/36025 for treating a mental or cerebral condition
• CPC Class Codes: A61N 1/36031 using physiological parameters for adjustment
• CPC Class Codes: A61N 1/36036 of the outer, middle or inner ear
• CPC Class Codes: A61N 1/37247 User interfaces, e.g. input or presentation means
• CPC Class Codes: A61N 2/002 in combination with another treatment
• CPC Class Codes: A61N 2/006 for magnetic stimulation of nerve tissue
• CPC Class Codes: A61N 2/02 using magnetic fields produced by coils, including single turn loops or electromagnets A61N2/12 takes precedence
• CPC Class Codes: A61N 2005/0647 the applicator adapted to be worn on the head
• CPC Class Codes: A61N 5/0622 Optical stimulation for exciting neural tissue
• CPC Class Codes: A61N 7/00 : Ultrasound therapy lithotripsy A61B17/22, A61B17/225; massage using supersonic vibration A61H23/00 ; using ultrasound for introducing media into the body A61M37/0092
• CPC Class Codes: A63F 13/212 : using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/424 : involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
• CPC Class Codes: G06T 7/00 : Image analysis
• CPC Class Codes: G06V 40/15 : Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Systems and related methods for controlling an ear stimulation device with a personal computing device are described. Multiple factors, including a mood of the user, a user control input, and a secondary factor input are used in controlling the ear stimulation device. Secondary factors include, a variety of factors relating to or influencing the state of the user, including but not limited to, environmental conditions, sleep, diet, or various activities of the user. User inputs can be open-ended or selected from a menu, for example. In an aspect, a correlation module correlates mood of the user to other factors, and control of stimulation is based thereon. In various aspects, the system is also responsive to inputs from sensors or computing networks. In an aspect, the earpiece delivers an audio output such as music from an audio player.

Claims

1. A computer program product comprising:

a non-transitory signal-bearing medium bearing;

one or more audio delivery instructions for controlling delivery of an audio signal from an audio signal source to an audio earpiece via an audio output of a personal computing device, the audio earpiece having operably coupled thereto an ear stimulation device configured to stimulate a nerve innervating a pinna of an ear of the user;

one or more mood assessment instructions for

receiving mood-related input from the user via a first input structure operably coupled to the personal computing device; and

assessing a mood of the user based at least in part upon the mood-related input;

one or more secondary factor input instructions for receiving at least one input relating to at least one secondary factor relating to the user via a second input structure operably coupled to the personal computing device;

one or more user control instructions for receiving via a third input structure of the personal computing device, at least one user control input for controlling at least one user-controllable stimulation parameter of the ear stimulation device;

one or more stimulator control instructions for determining at least one stimulus control parameter based on at least one of the mood of the user, the at least one secondary factor, and the at least one user control input; and

one or more controller interface instructions for communicating the at least one stimulus control parameter to a stimulator controller adapted to control the ear stimulation device responsive to the at least one stimulus control parameter.

2. The computer program product of claim 1, wherein the one or more stimulator control instructions include one or more instructions for coordinating delivery of the audio signal with delivery of at least one stimulus with the ear stimulation device.

3. The computer program product of claim 1, wherein the first input structure of the personal computing device includes a touch screen, a keyboard, or a microphone.

4. The computer program product of claim 1, wherein the secondary input structure of the personal computing device includes at least one of a touch screen, a keyboard, a microphone, a device interface, a data input, a USB port, a wireless interface, a serial port, or a parallel port.

5. The computer program product of claim 1, including one or more recommendation delivery instructions for presenting a recommendation to the user.

6. The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for generating the recommendation.

7. The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for receiving at least one of a recommendation from a medical care provider, a recommendation from an insurance company, a recommendation from a service provider, a recommendation from an advisor, a recommendation from a computation-based system, a recommendation from a social media source, a recommendation via a computing network, a recommendation based on patients similar to the user, or information regarding whether the user has accepted or rejected the recommendation.

8. The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for generating the recommendation based on at least one of information regarding a response of the user to a past treatment regimen, information obtained via social media, information regarding at least one preference of at least one social media contact of the user, information regarding at least one preference of at least one peer of the user, information regarding at least one preference of at least one role model of the user, information from an insurance company, information from a service provider, a predicted response of the user to a treatment regimen, or at least one correlation between the mood of the user and at least one of the at least one secondary factor or the at least one stimulus control parameter.

9. The computer program product of claim 5, wherein the one or more recommendation delivery instructions include one or more instructions for presenting to the user at least one of a recommendation for a configuration of a neural stimulus or a recommendation for a secondary stimulus to be delivered in association with the neural stimulus.

10. The computer program product of claim 1, including one or more physiological data instructions for receiving at least one physiological data signal including at least one physiological parameter of the user.

11. The computer program product of claim 10, wherein the one or more physiological data instructions include one or more instructions for receiving the at least one physiological data signal from at least one of a blood pressure sensor, a heart rate sensor, a chemical sensor, a biosensor, a pH sensor, a blood oxygen sensor, a galvanic skin response sensor, an EEG sensor, an EMG sensor, an ECG sensor, a wearable item, an eye tracking system, an acoustic sensor, a motion sensor, a force transducer, or an activity sensor.

12. The computer program product of claim 10, wherein the one or more physiological data instructions include one or more instructions for receiving the at least one physiological data signal from at least one of at least one sensor, at least one computing network, or at least one remote sensing system.

13. The computer program product of claim 1, wherein the one or more user control instructions include one or more instructions for receiving user input for controlling at least one of stimulus pulse amplitude, stimulus pulse duration, stimulus frequency, stimulus pulse pattern, or stimulus pulse envelope.

14. The computer program product of claim 1, including one or more external control instructions for receiving an external control input for controlling at least one externally controllable stimulation parameter of the ear stimulation device.

15. The computer program product of claim 14, wherein the at least one externally controllable stimulation parameter includes at least one of stimulus pulse amplitude, stimulus pulse duration, stimulus frequency, stimulus pulse pattern, or stimulus pulse envelope.

16. The computer program product of claim 14, wherein the one or more external control instructions include one or more instructions for receiving the external control input via a computing network or a communication network, receiving the external control input from an external party or entity, or receiving the external control input from a medical care provider.

17. The computer program product of claim 1, including at least one of one or more correlation instructions for determining at least one correlation between the mood of the user and at least one of the at least one secondary factor and the at least one stimulus control parameter;

or one or morel data transfer instructions for providing data relating to the user to an external party or entity.

18. The computer program product of claim 1, wherein the audio signal source includes at least one of an audio player application, a web radio application, a radio receiver, a telephone receiver, or a hearing aid.

19. The computer program product of claim 1, wherein the one or more mood assessment instructions includes at least one of one or more ecological momentary assessment instructions, one or more activity assessment instructions, or one or more image processing instructions for determining a mood of the user based on image analysis of an image of the user detected with a user-facing camera of the personal computing device.

20. The computer program product of claim 1, wherein the one or more secondary factor input instructions include one or more instructions for receiving at least one of an input from the user, an input from a sensor, or an input via a computing network.

21. The computer program product of claim 1, wherein the one or more secondary factor input instructions include one or more instructions for receiving at least one of an input relating to an environmental condition of the user, an input relating to a sleep pattern of the user, an input relating to a medical history of the user, an input relating to an activity of the user, an input relating to a diet of the user, or an input relating to an appetite of the user.

22. The computer program product of claim 1, wherein the one or more secondary factor input instructions include one or more instructions for receiving at least one open ended comment from the user or to provide a drop down menu of selectable items and receive from the user a selection from the drop down menu.

23. The computer program product of claim 17, wherein the one or more data transfer instructions include one or more instructions for providing the data to the external party or entity via at least one of a computing network or a communication network.

24. The computer program product of claim 1, wherein the one or more stimulator control instructions include one or more instructions for determining the at least one stimulus control parameter by overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a medical-care provider control input;

overriding a medical-care provider control input based on the at least one user control input for controlling the at least one user-controllable stimulation parameter;

overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a computing system-generated stimulus control parameter;

or overriding a computing system-generated stimulus control parameter based on the at least one user control input for controlling the at least one user-controllable stimulation parameter.

25. The computer program product of claim 1, wherein the one or more stimulator control instructions include one or more instructions for determining the at least one stimulus control parameter to provide an initial setting of the ear stimulation device based on the at least one user-controllable stimulation parameter or to update a setting of the ear stimulation device based on the at least one user-controllable stimulation parameter.

26. A method of controlling an ear stimulation device with a personal computing device, comprising:

receiving an audio signal at the personal computing device from an audio signal source;

delivering the audio signal to an audio earpiece worn by a user via an audio output of the personal computing device, the audio earpiece having operably coupled thereto an ear stimulation device configured to stimulate a nerve innervating a pinna of an ear of the user;

receiving, via a first input structure operably coupled to the personal computing device, a mood-related input from the user;

assessing a mood of the user based at least in part upon the mood-related input;

receiving, via a second input structure operably coupled to the personal computing device, at least one input relating to at least one secondary factor relating to the user;

receiving, via a third input structure operably coupled to the personal computing device, at least one user control input for controlling at least one user-controllable stimulation parameter of the ear stimulation device;

determining at least one stimulus control parameter based on at least one of the mood of the user, the at least one secondary factor, and the at least one user control input; and

communicating at least one stimulus control parameter to a stimulator controller, the stimulator controller adapted to control the ear stimulation device responsive to the at least one stimulus control parameter.

27. The method of claim 26, including coordinating delivery of the audio signal with delivery of at least one stimulus with the ear stimulation device.

28. The method of claim 26, including presenting a recommendation to the user.

29. The method of claim 28, including receiving the recommendation from at least one of an external party, an external entity, an insurance company, a service provider, an advisor, a computation-based system, a social media source, or a computing network.

30. The method of claim 28, including at least one of delivering the recommendation based on patients similar to the user;

generating the recommendation;

providing the recommendation to an external party or entity;

or receiving information regarding whether the user has accepted or rejected the recommendation.

31. The method of claim 28, including at least one of generating the recommendation module based at least in part on at least one correlation between the mood of the user and at least one of the at least one secondary factor or the at least one stimulus control parameter;

generating the recommendation based on at least one of information regarding a response of the user to a past treatment regimen, information obtained via social media, information regarding at least one preference of at least one social media contact of the user, information regarding at least one preference of at least one peer of the user, information regarding at least one preference of at least one role model of the user, information from an insurance company, or information from a service provider;

generating the recommendation with a computation-based system;

or generating the recommendation based on a predicted response of the user to a treatment regimen.

32. The method of claim 28, wherein presenting the recommendation includes at least one of presenting the recommendation for a configuration of a neural stimulus or presenting a recommendation for a secondary stimulus to be delivered in association with the neural stimulus.

33. The method of claim 26, including receiving at least one physiological data signal including at least one physiological parameter of the user.

34. The method of claim 33, wherein receiving the at least one physiological data signal includes at least one of

receiving the at least one physiological data signal from a sensor;

receiving the at least one physiological data signal from a sensor located on the audio earpiece operably coupled to the ear stimulation device;

receiving the at least one physiological data signal from a sensor located on a second audio earpiece located on a second ear of the user, wherein the audio earpiece having the ear stimulation device operably coupled thereto is a first audio earpiece worn on a first ear of the user;

receiving the at least one physiological data signal from at least one computing network;

receiving the at least one physiological data signal from at least one remote sensing system;

or

receiving the at least one physiological data signal from at least one of a blood pressure sensor, a heart rate sensor, a chemical sensor, a biosensor, a pH sensor, a blood oxygen sensor, a galvanic skin response sensor, an EEG sensor, an EMG sensor, an ECG sensor, a wearable item, an eye tracking system, an acoustic sensor, a motion sensor, a force transducer, or an activity sensor.

35. The method of claim 26, wherein receiving the at least one user control input for controlling the at least one user-controllable stimulation parameter includes receiving at least one user input for controlling at least one of stimulus pulse amplitude, stimulus pulse duration, stimulus frequency, stimulus pulse pattern, or stimulus pulse envelope.

36. The method of claim 26, wherein receiving the audio signal at the personal computing device from the audio signal source includes at least one of receiving the audio signal from an audio player application, receiving the audio signal from a web radio application, receiving the audio signal from a radio receiver, receiving the audio signal from a telephone receiver, or receiving the audio signal from a hearing aid.

37. The method of claim 26, wherein receiving the mood-related input includes at least one of receiving user input via a user interface device or;

receiving an image of the user with a user-facing camera of the personal computing device and determining a mood of the user based on image analysis of the image of the user with image processing software;

or receiving at least one input via a touch screen, a keyboard, or a microphone.

38. The method of claim 26, wherein receiving the mood-related input includes receiving mood-related input relating to at least one of depression, stress, or emotion.

39. The method of claim 26, wherein receiving the at least one input relating to the at least one secondary factor includes at least one of receiving at least one input via at least one of a touch screen, a keyboard, a microphone, a device interface, a data input, a USB port, a wireless interface, a serial port, or a parallel port;

receiving at least one input from the user;

receiving at least one input from a sensor;

receiving at least one input via a computing network;

receiving at least one input relating to an environmental condition of the user;

receiving at least one input relating to a sleep pattern of the user;

receiving at least one input relating to an activity of the user;

receiving at least one input relating to a diet of the user;

receiving at least one input relating to an appetite of the user;

receiving at least one open ended comment from the user;

or providing a drop down menu of selectable items and receiving from the user a selection from the drop down menu.

40. The method of claim 26, including at least one of determining at least one correlation between the mood of the user and at least one of the at least one secondary factor and the at least one stimulus control parameter;

receiving an external control input for controlling at least one externally controllable stimulation parameter of the ear stimulation device;

or providing data relating to the user to an external party or entity.

41. The method of claim 26, including receiving an external control input for controlling at least one externally controllable stimulation parameter of the ear stimulation device;

wherein receiving the external control input includes at least one of receiving the external control input via a computing network;

receiving the external control input via a communication network;

receiving the external control input from an external party or entity;

or receiving the external control input from a medical care provider.

42. The method of claim 26, including providing data relating to the user to an external party or entity, wherein providing the data to the external party or entity includes at least one of providing the data via a computing network, providing the data via a communication network, or providing the data to a medical care provider.

43. The method of claim 26, wherein determining the at least one stimulus control parameter includes at least one of overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a medical-care provider control input;

overriding a medical-care provider control input based on the at least one user control input for controlling the at least one user-controllable stimulation parameter;

overriding the at least one user control input for controlling the at least one user-controllable stimulation parameter based on a computing system-generated stimulus control parameter;

overriding a computing system-generated stimulus control parameter based on the at least one user control input for controlling the at least one user-controllable stimulation parameter;

determining an initial setting of the ear stimulation device based on the at least one user-controllable stimulation parameter;

or updating a setting of the ear stimulation device based on the at least one user-controllable stimulation parameter.