Monitoring device with voice interaction

• US 10,058,290 B1
• Filed: 09/26/2016
• Issued: 08/28/2018
• Est. Priority Date: 06/21/2013
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Proud, James
• Primary Examiner(s): Haupt, Kristy A
• Application Number:
  US15/276,772
• Time in Patent Office: 701 Days
• Field of Search: None
• CPC Class Codes: A61B 2560/0252 using ambient temperature
• CPC Class Codes: A61B 2562/0204 Acoustic sensors
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/0816 Measuring devices for examining respiratory frequency measuring frequency of electric signals G01R23/00
• CPC Class Codes: A61B 5/113 occurring during breathing
• CPC Class Codes: A61B 5/14532 for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/4815 Sleep quality
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: A61B 5/749 Voice-controlled interfaces
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

A user monitoring device system has a user monitoring device that includes one or more microphones, a transmitter and sensors to determine air quality, sound level/quality, light quality and ambient temperature near the user. The transmitter serves as a communication system. A motion detection apparatus detects a user'"'"'s movement information. The motion detection apparatus and the monitoring system assist to determine at least one of: user sleep information and sleep behavior information, or user respiration information. A cloud based system is in communication with the monitoring device and the motion detection apparatus. The cloud based system includes a user database. A speech recognition system is coupled to the cloud based system.

Claims

1. A user monitoring device system, comprising:

a user monitoring device that includes one or more microphones, a transmitter and sensors to determine air quality, sound level/quality, light quality and ambient temperature near the user, the transmitter serving as a communication system;

a motion detection apparatus configured to detect a user'"'"'s movement information, the motion detection apparatus and the monitoring system configured to assist to determine at least one of;

user sleep information and sleep behavior information, or user respiration information;

a cloud based system in communication with the monitoring device and the motion detection apparatus, the cloud based system including a user database; and

a speech recognition system coupled to the cloud based system and configured to initiate communication based on identifying a voice command.

2. The system of claim 1, further comprising:

a feedback control system or subsystem at the cloud based system.

3. The system of claim 2, wherein the feedback control system or subsystem is at the monitoring device.

4. The system of claim 2, wherein the feedback control system or subsystem is standalone.

5. The system of claim 2, wherein the monitoring device in operation communicates the feedback signal or alert to the user.

6. The system of claim 2, further comprising:

a closed-loop system that provides control data to the monitoring device.

7. The system of claim 2, wherein the feedback system or subsystem in operation terminates the feedback signal or alert if a predetermined maximum alert duration has expired.

8. The system of claim 2, wherein when a maximum feedback signal or alert duration is not reached, the feedback signal or alert is held at current signal settings.

9. The system of claim 1, wherein the device is a mobile device.

10. The system of claim 1, wherein the cloud based system in operation compares a measured sensor signal from a sensor to a threshold level.

11. The system of claim 10, wherein the threshold level is predefined or tailored relative to a monitoring device user or patient.

12. The system of claim 10, wherein the feedback system or subsystem in operation provides that when the measured sensor signal does not equal or exceed the threshold level, the measured sensor signal or is adjusted until the measured sensor signal falls within a desired range of an expected threshold level.

13. The system of claim 12, wherein the feedback system or subsystem in operation provides that when the desired feedback signal or alert level is reached, the feedback or alert signal responses are maintained at the current settings to maintain the measured sensor signal within the desired range of the threshold.

14. The system of claim 12, wherein the feedback system or subsystem in operation detects an amplitude or frequency of the measured sensor signal.

15. The system of claim 12, wherein the feedback system or subsystem in operation recognizes an intended alert pattern based on a morphology of the measured sensor signal.

16. The system of claim 12, wherein the feedback system or subsystem in operation analyzes a frequency power band of the measured sensor signal for correspondence to frequency and amplitude.

17. The system of claim 12, wherein the feedback system or subsystem in operation evaluates a measured sensor signal waveform for correspondence to a frequency or amplitude.

18. The system of claim 1, wherein voice commands are sent from the monitoring device to a cloud server.

19. The system of claim 18, wherein the monitoring device and server are in communication with a contact name database.

20. The system of claim 18, wherein the server is coupled to an automatic speech recognizer (ASR).

21. The system of claim 20, wherein the server is coupled to a parser.

22. The system of claim 21, wherein the server is coupled to a rules database.

23. The system of claim 22, wherein the server is coupled to a communication engine.

24. The system of claim 1, wherein the speech recognition system includes one or more of:

a phoneme dictionary, a pronunciation dictionary, a grammar rules module, an extractor, an updater, and a recognizer.