Home control system using galvanic skin response and heart rate and method thereof

• US 20060142968A1
• Filed: 12/19/2005
• Published: 06/29/2006
• Est. Priority Date: 12/29/2004
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Youn-ho, Han, Dae-ho
• Application Number:
  US11/305,187
• Publication Number:
  US 20060142968A1
• Time in Patent Office: Days
• US Class Current: 702/120
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/02405 Determining heart rate variability
• CPC Class Codes: A61B 5/0533 Measuring galvanic skin response
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/4809 Sleep detection, i.e. determining whether a subject is asleep or not
• CPC Class Codes: A61B 5/4812 Detecting sleep stages or cycles
• CPC Class Codes: F24F 11/30 for purposes related to the operation of the system, e.g. for safety or monitoring
• CPC Class Codes: F24F 11/526 giving audible indications
• CPC Class Codes: F24F 11/58 using Internet communication
• CPC Class Codes: F24F 11/64 using pre-stored data
• CPC Class Codes: F24F 11/66 Sleep mode
• CPC Class Codes: F24F 2110/00 Control inputs relating to air properties
• CPC Class Codes: F24F 2120/00 Control inputs relating to users or occupants

Abstract

A home control system using galvanic skin responses and heart rate information and a method thereof. Whether a user is awake is judged using a galvanic skin response sensor, and the extent of stress of a user is determined using the user'"'"'s heart rate, thereby extracting a user'"'"'s emotional state and sleeping state. Furthermore, based on these, various systems in the home network of a user are controlled according to the user'"'"'s emotional state and sleeping state. In addition, those control results are stored in a database so as to create the optimum control conditions.

Claims

1. A home control system comprising:

a user monitor which periodically outputs user information of at least one user, the user information including a sleeping stage of the user and a stress index of the user;

a home server which receives and stores the user information in a database and generates a facility control command based on the user information stored in the database; and

a home facility system which receives the facility control command and controls an environment inside a home of the user based on the facility control command.

2. The home control system as claimed in claim 1, wherein the user monitor measures a galvanic skin response of the user and a heart rate of the user, determines the sleeping stage based on the galvanic skin response, and determines the stress index based on the heart rate.

3. The home control system as claimed in claim 2, further comprising:

a sensor system which outputs home state information to the home server, the home state information including at least one of a temperature, a humidity, and an illumination of an area inside the home; and

a network which connects the home server, the user monitor, the sensor system, and the home facility system.

4. The home control system as claimed in claim 3,

wherein the home server stores the home state information in correspondence with the user information in the database, creates a sleeping environment for each of a plurality of sleeping stages, and creates the facility control command based on the sleeping environments;

and

wherein the home facility system controls at least one of a temperature, a humidity, and an illumination inside a home based on the facility control command.

5. The home control system as claimed in claim 3, wherein the network is a wireless local area network or a wireless personal area network.

6. The home control system as claimed in claim 4, wherein the home server calculates average values of the home state information in each sleeping stage and determines the sleeping environment for each sleeping stage based on the average value of the home state information, the average values being calculated in a case where the user information and the home state information is stored in the database for more than a certain period of time and the stress index is less than a predetermined value.

7. The home control system as claimed in claim 6, wherein the database stores control result information, including the sleeping stage, the stress index, the home state information, and a received time, together in a corresponding relationship.

8. The home control system as claimed in claim 7, wherein the average values are the averages of the temperature, the humidity, and the illumination of the control result information for which the stress index is less than a predetermined value, and wherein the control result information is extracted and sorted by sleeping stage.

9. The home control system as claimed in claim 6, wherein the facility control command is used to control the home facility system so that the home state information according to the sleeping stage becomes the average values.

10. The home control system as claimed in claim 9, wherein the facility control command is not changed so long as the sleeping stage is not changed.

11. The home control system as claimed in claim 6, wherein a ratio of the average value calculated for an initial certain period of time to the values measured after the initial certain period of time is calculated.

12. The home control system as claimed in claim 4, wherein a Heart Rate Variability (HRV) is measured from a maximum peak interval of an R wave or photoplethysmography (PPG), and the stress index is calculated by applying the HRV to a frequency conversion analysis.

13. The home control system as claimed in claim 3, wherein the sensor system comprises:

a sensor controller which is connected to the network, and outputs the home state information according to a request received from the home server; and

at least one sensor which measures at least one of the temperature, the humidity, and the illumination within the area, and outputs the measured temperature, humidity, or illumination to the sensor controller.

14. The home control system as claimed in claim 3, wherein the home facility system comprises:

an air conditioner which controls a temperature and a humidity of air in the area according to the facility control command;

at least one lighting facility which controls an illumination of the area according to the facility control command.

15. The home control system as claimed in claim 3, further comprising an aroma injector which injects aromas into the area according to an injection command from the home server, wherein the injection command is transmitted form the home server to the aroma injector if the stress index is more than a predetermined value.

16. The home control system as claimed in claim 15, wherein, if a user'"'"'s predetermined wake-up time arrives, the home server transmits a command to the aroma injector for injecting an aroma having a stimulant composition.

17. A home control system comprising:

a user monitor which periodically outputs user information of at least one user, the user information indicating whether a user is in a waking state and a stress index of the user;

a home server which receives and stores the user information in a database and generates a facility control command based on the user information stored in the database; and

a home facility system which receives the facility control command and provides broadcast information to the user based on the facility control command.

18. The home control system as claimed in claim 17, wherein the user information includes an emotional state of the user,

wherein the user monitor measures a galvanic skin response of the user and a heart rate of the user, determines whether the user is in the waking state based on the galvanic skin response, determines the stress index based on the heart rate, and classifies the emotional state into one of a plurality of stages on the basis of whether the user is in the waking state and the stress index, and

wherein the home facility system provides at least one of digital television (TV) broadcast signals, information regarding the broadcast signals, image signals, and audio signals according to the facility control command.

19. The home control system as claimed in claim 18, wherein the home facility system includes:

a tuner which receives the digital TV broadcast signals including Electric Program Guide (EPG) signals;

a set-top box which outputs the EPG signals according to a request of the home server, receives a facility control command including an EPG user interface associated with a broadcast program recommended based on an emotional state of a user, and inserts the EPG user interface into the broadcast signals; and

a digital TV which displays the EPG user interface and the broadcast signals.

20. The home control system as claimed in claim 19, wherein the home server stores a genre of the broadcast program that the user is watching and the emotional state in the database at a time the emotional state is received, and

wherein the genre of the broadcast program is classified by searching text of a description of the broadcast program for keywords associated with each genre.

21. The home control system as claimed in claim 20, wherein the EPG user interface comprises information regarding the broadcast program, from among broadcast programs that are extracted from the EPG signals and to be broadcasted after the extraction, whose genre is identical to the genre of the broadcast program that is stored most in correspondence with the emotional state from amongst all the broadcast genres in the database.

22. The home control system as claimed in claim 21, wherein the digital TV receives a selection command for one of the broadcast programs included in the displayed EPG user interface, outputs corresponding selection information to the set-top box, and displays a broadcast program of a broadcast channel changed by the set-top box based on the selection information.

23. A home control method comprising:

periodically providing user information of at least one user, the user information including a sleeping stage of the user and a stress index of the user;

storing the user information in a database; and

generating a facility control command based on the user information stored in the database;

controlling an environment inside a home of the user based on the facility control command.

24. The home control method as claimed in claim 23, wherein the providing the user information comprises:

measuring a galvanic skin response of the user and a heart rate of the user;

determining the stress index based on the heart rate; and

determining the sleeping stage based on the galvanic skin response.

25. The home control method as claimed in claim 24, further comprising providing home state information including at least one of a temperature, a humidity, and an illumination of an area inside a home,

wherein the storing the user information comprises storing the home state information in correspondence with in the user information in the database on the basis of a received time, and

wherein generating the facility control command comprises creating a sleeping environment for each of a plurality of sleeping stages, and generating the facility control command based on the sleeping environments, and

wherein the controlling the environment comprising controlling at least one of a temperature, an humidity, and an illumination inside a home based on the facility control command.

26. The home control method as claimed in claim 25, wherein, in the controlling the environment, average values of the home state information in each sleeping stage is calculated, the average values being calculated in a case where the stress index is less than a predetermined value, and the sleep information and the home state information is stored in the database for more than a certain period of time, and the sleeping environment is judged.

27. The home control method as claimed in claim 25, wherein the database stores control result information including the sleeping stage, the stress index, the home state information, and a received time together in a corresponding relationship.

28. The home control method as claimed in claim 27, wherein the average values are the averages of the temperature, the humidity, and the illumination of the control result information for which the stress index is less than the predetermined value, and wherein the control result information is extracted from the control result information and sorted by the sleeping stage.

29. The home control method as claimed in claim 27, wherein the facility control command is used to control the environment so that the home state information according to the sleeping stage is made to be the average values.

30. The home control method as claimed in claim 29, wherein the facility control command is not changed so long as the sleeping stage is not changed.

31. The home control method as claimed in claim 26, wherein a ratio of the average values calculated for an initial certain period of time to the values measured after the initial certain period of time is calculated.

32. The home control method as claimed in claim 24, wherein a Heart Rate Variability (HRV) is measured from a maximum peak interval of an R wave or photoplethysmography (PPG), and the stress index is determined by applying the HRV to a frequency conversion analysis.

33. The home control method as claimed in claim 25, further comprising a injecting aromas into the user'"'"'s sleeping space if the stress index is more than a predetermined value.

34. The home control method as claimed in claim 24, further comprising injecting an aroma having a stimulant composition when a predetermined wake-up time arrives.

35. A home control method comprising:

periodically providing user information of at least one user, the user information indicating whether a user is in a waking state and a stress index of the user;

storing the user information in a database; and

generating a facility control command based on user information stored in the database;

providing broadcast information to the user based on the facility control command.

36. The home control method as claimed in claim 35, wherein the user information includes an emotional state of the user,

wherein the providing the user information comprises:

measuring a galvanic skin response of the user and a heart rate of the user;

determines whether the user is in the waking state based on the galvanic skin response;

determining the stress index based on the heart rate; and

classifying the emotional state into one of a plurality of stages on the basis of whether the user is in the waking state and the stress index, and

wherein the providing the broadcast information comprises providing at least one of digital television (TV) broadcast signals, information regarding the broadcast signals, image signals, and audio signals according to the facility control command

37. The home control method as claimed in claim 35, wherein the providing the broadcast information comprises:

receiving the digital broadcast signals including Electric Program Guide (EPG) signals, including information on a program that is being broadcasted;

receiving the facility control command including an EPG user interface including information regarding a program which is recommended based on an emotional state of the user and inserting the EPG user interface into the broadcast signals; and

displaying the EPG user interface and image signals.

38. The home control method as claimed in claim 36, wherein, when the emotional state is provided, a genre of the broadcast that the user is watching and the emotional state are stored in the database in accordance with a receiving time of the emotional state.

39. The home control method as claimed in claim 38, wherein the genre of the broadcast is classified by searching a text of a description of the broadcast for keywords associated with each broadcast genre.

40. The home control method as claimed in claim 39, wherein the EPG user interface comprises information regarding the broadcast program from amongst the broadcast programs that are extracted from the EPG signals and to be broadcasted after the extraction, whose genre is identical to the genre of the broadcast program that is stored most in correspondence with the emotional state from amongst all the genres in the database.

41. The home control method as claimed in claim 40, wherein, in the displaying the EPG UI and the broadcast signals, a selection command is received for one of the broadcast programs included in the output EPG UI, and a broadcast program of a broadcast channel changed based on the selection information is displayed.