Earphone-based game controller and health monitor

• US 8,730,048 B2
• Filed: 06/18/2012
• Issued: 05/20/2014
• Est. Priority Date: 06/18/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Shen, Guo Bin, Jiang, Xiaofan
• Primary Examiner(s): Tweel, Jr., John A
• Application Number:
  US13/526,331
• Publication Number:
  US 20130335226A1
• Time in Patent Office: 701 Days
• Field of Search: 340/573.1, 340/692, 381/74, 381/309, 381/310
• US Class Current: 340/573.1
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/217 using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: G08B 21/0446 worn on the body to detect changes of posture, e.g. a fall, inclination, acceleration, gait
• CPC Class Codes: H04R 5/033 Headphones for stereophonic communication details thereof, e.g. relating to batteries, cables or control elements H04R1/10
• CPC Class Codes: H04S 7/304 For headphones

Abstract

Design and operation techniques for an earphone-based game controller and health monitor are described herein. In one example, two “ear bud” style earphones are configured as I/O devices, each including a speaker to output sound and an accelerometer to receive an input of motion imparted by a user. The I/O devices may be connected to a mobile device, such as a cellular phone. Accordingly, the I/O devices may be inserted into a user'"'"'s ears for listening or may be used as game controllers, such as by moving one I/O device in each hand. In a further example, a thermometer may be used in at least one of the I/O devices, and may gather health data by measuring the temperature of the user. And in a further example, a microphone may be used in at least one I/O device to gather heart rate and respiration-quality data regarding the user.

Claims

1. A system, comprising:

an audio jack, having two audio conductors and a microphone conductor, adapted for connection to a mobile device;

a power converter to input a signal on a first of the two audio conductors and to provide a power output;

two I/O devices, each I/O device comprising;

a speaker to output sound based on input from a second of the two audio conductors; and

an accelerometer, powered by the power output and configured to output a signal;

a processing unit, powered by the power output, and configured for;

receiving signals output from each of the accelerometers associated with each of the two I/O devices;

processing the received signals to provide a complex output of accelerometer data; and

providing data representing the complex output on the microphone conductor.

2. The system of claim 1, additionally comprising:

a thermometer, on at least one of the two I/O devices, to output a signal to the processing unit, the signal based on a temperature sensed by the thermometer;

wherein the processing unit combines the received signals output from the accelerometers with the signal based on the temperature sensed by the thermometer for transmission on the microphone conductor of the audio jack.

3. The system of claim 1, additionally comprising:

an application, configured for operation on the mobile device;

wherein portions of the complex output of accelerometer data are interpreted by the application to have a meaning associated with combined movement of the two accelerometers.

4. The system of claim 1, additionally comprising:

an application, configured for operation on the mobile device;

wherein portions of the complex output of accelerometer data are interpreted by the application to have a meaning associated with independent movement of the two accelerometers.

5. An ear bud system, comprising:

a power converter to input a signal on a first audio conductor and to provide a power output;

first and second I/O devices, comprising;

first and second speakers, respectively, responsive to a second audio conductor; and

first and second accelerometers, respectively, powered by the power output and configured to output first and second accelerometer signals, respectively;

a thermometer, in at least one of the two I/O devices, to output a thermometer signal, the thermometer signal based on a temperature sensed by the thermometer; and

a processing unit, configured for;

combining the first and second accelerometer signals into a complex accelerometer output, portions of which may be evaluated in a first manner, considering combined movement of the first and second accelerometers, and portions of which may be evaluated in a second manner, considering separate movement of the first and second accelerometers; and

multiplexing the complex accelerometer output and the thermometer signal as output on a microphone conductor.

6. The ear bud system of claim 5, additionally comprising:

an application, configured for operation on a mobile device; and

a sensor application programming interface (API), configured for operation on the mobile device and configured for communication with the application;

wherein the application is configured to access the thermometer signal and the complex accelerometer output by operation of the sensor API.

7. The ear bud system of claim 5, additionally comprising:

a sensor application programming interface (API), configured for operation on the mobile device;

an application, configured for operation on the mobile device and to communicate with the first and second accelerometers and the thermometer by operation of the sensor API, wherein the application is configured to;

examine the complex accelerometer output;

distinguish portions of the complex accelerometer output to be evaluated in the first manner from portions to be evaluated in the second manner; and

utilize the distinguished portions as input to video game elements displayed on the mobile device.

8. The ear bud system of claim 5, additionally comprising:

a sensor application programming interface (API), configured for operation on the mobile device;

an application, configured for operation on the mobile device and to communicate with the first and second accelerometers and the thermometer by operation of the sensor API, wherein the application is configured to;

recording temperature data;

providing a warning to a user if the temperature data is not within an acceptable range; and

communicating the recorded temperature data and warnings to a remote facility.

9. The ear bud system of claim 5, additionally comprising:

a sensor application programming interface (API), configured for operation on the mobile device as an interface to an audio jack port of the mobile device;

an application, configured for operation on the mobile device and to communicate with the two I/O devices by operation of the sensor API, wherein the application is configured to;

examine the complex output to determine if a meaning has been assigned to combined movements of the first and second accelerometer signals;

use movements associated with the first and second accelerometer signals in a combined manner if a meaning has been assigned; and

use movements associated with the first and second accelerometer signals separately if no meaning has been assigned.

10. The ear bud system of claim 5, additionally comprising:

a microphone, in at least one of the two I/O devices, to output sound data, the sound data based on a sound sensed by the microphone; and

an application, configured for operation on a mobile device and to receive the sound data from the microphone and the complex accelerometer output, wherein the application is configured to;

recognize data from the microphone and the complex accelerometer output indicating that a user has fallen; and

provide a warning to a remote facility reporting the fall.

11. The ear bud system of claim 5, additionally comprising:

a microphone, in at least one of the two I/O devices, to output sound data, the sound signal based on a sound sensed by the microphone; and

an application, configured for operation on a mobile device and to receive the sound data from the microphone, wherein the application is configured to;

recognize respiration and coughing sounds made by a user;

provide a warning to the user if the recognized sounds indicate a health problem; and

communicate data documenting the recognized sounds to a remote facility.

12. The ear bud system of claim 5, additionally comprising:

a microphone, in at least one of the two I/O devices, to output sound data, the sound data based on a sound sensed by the microphone; and

an application, configured for operation on a mobile device and to receive the sound data, wherein the application is configured to;

recognize sounds of an automobile; and

provide a warning to a user indicating presence of the automobile in response to the recognized sounds.

13. The ear bud system of claim 5, additionally comprising:

a microphone, in at least one of the two I/O devices, to output sound data, the sound data based on a sound sensed by the microphone; and

an application, configured for operation on a mobile device and to receive the sound data, wherein the application is configured to;

recognize heart and blood circulation sounds made by a user;

provide a warning to the user if the recognized sounds indicate a health problem; and

communicate data documenting recognized heart and blood circulation sounds to a remote facility.

14. The ear bud system of claim 5, additionally comprising:

a microphone, in at least one of the two I/O devices, to output sound data, the sound data based on a sound sensed by the microphone; and

an application, configured for operation on a mobile device and to receive the sound data from the microphone, wherein the application is configured to;

measure a heart rate of a user;

recommend music, based on the measured heart rate, to be played through the first and second speakers.

15. The ear bud system of claim 5, additionally comprising:

an application, configured for operation on a mobile device, and configured to adjust a frequency or amplitude of the signal sent on the first audio converter to thereby control the power output from the power converter.

16. The ear bud system of claim 5, wherein the first and second I/O devices are configured for insertion into an ear of a user, and wherein the first and second I/O devices additionally comprise:

a microphone, located inside at least one I/O device;

a gyroscope, located inside at least one I/O device; and

a magnetometer, located inside at least one I/O device;

wherein the processing unit multiplexes data from the microphone, the gyroscope and the magnetometer onto the microphone conductor.

17. A method of data input to a mobile device, comprising:

providing a signal carried by a first of two audio conductors to each of first and second speakers in first and second ear bud units, respectively;

converting a second of the two audio conductors into a power supply;

providing power from the power supply to first and second accelerometers in the first and second ear buds, respectively;

processing signals received from the first and second accelerometers to create complex accelerometer data;

sending the complex accelerometer data to an application running on the mobile device;

interpreting the complex accelerometer data to distinguish portions of the complex accelerometer data wherein a separate meaning is applied to data from each of the two accelerometers from portions of complex accelerometer data wherein a combined meaning is applied to accelerometer data from the two accelerometers; and

altering a screen display of the mobile device based in part on the interpreted complex accelerometer data.

18. The method of claim 17, wherein:

the application running on the mobile device is a video game; and

altering the screen display of the mobile device base includes using separate meanings of the two accelerometers to perform separate functions, respectively, each function controlling a separate element defined on the screen display.

19. The method of claim 17, additionally comprising:

multiplexing a signal from a thermometer with the complex accelerometer data for transmission on a microphone conductor that is in communication with the mobile device;

interpreting the signal to determine a body temperature of a user;

recording interpreted data; and

transmitting a warning if the interpreted data is out of a healthy range.

20. The method of claim 17, additionally comprising:

multiplexing a signal from a microphone with the complex accelerometer data for transmission on a microphone conductor that is in communication with the mobile device;

interpreting the signal to determine breathing rate, cough rate and respiration sounds;

recording data associated with the interpreted signal; and

transmitting a warning if the recorded data is out of a healthy range.