System and method of controlling external apparatus connected with device

• US 9,722,811 B2
• Filed: 04/06/2015
• Issued: 08/01/2017
• Est. Priority Date: 09/10/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chun, Hae-in, Kim, Yang-wook, Ko, Jae-woo, Shin, Hang-sik, Park, Se-jun, Jung, Jae-ho
• Primary Examiner(s): SMALL, NAOMI J
• Application Number:
  US14/679,749
• Publication Number:
  US 20150222450A1
• Time in Patent Office: 848 Days
• Field of Search: 340 582
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/21 Programming remote control devices via third means
• CPC Class Codes: G08C 2201/42 Transmitting or receiving remote control signals via a network
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 67/303 Terminal profiles

Abstract

A method of controlling an external apparatus includes: receiving an input command of a user and biometric information of the user from a device; determining a condition for controlling the external apparatus and operation of the external apparatus based on the received input command of the user and the received biometric information of the user; and providing a control command for controlling the operation of the external apparatus if the determined condition is satisfied.

Claims

1. A server configured to control an external apparatus, the server comprising:

a communicator configured to receive an input command of a user and biometric information of the user from a device, wherein the input command includes a voice command; and

a controller configured to;

analyze the voice command,

determine a condition for controlling the external apparatus and operation of the external apparatus based on the analyzed voice command of the user and the received biometric information of the user,

receive sensing data generated by another external device,

determine whether the determined condition is satisfied based on the sensing data received front the another external device, and

provide a control command for controlling the operation of the external apparatus to the external apparatus in response to the determined condition being satisfied,

wherein the biometric information of the user is obtained by the device when the voice command is input by the user into the device.

2. The server of claim 1, wherein the biometric information of the user is generated by a wearable device connected to the device and is provided to the device by the wearable device.

3. The server of claim 1, wherein the controller is configured to determine the condition and the operation, according to an intention of the user which is determined based on the input command of the user, the biometric information of the user, and a type of the external apparatus.

4. The server of claim 1, wherein the external apparatus is one of a plurality of the external apparatuses, and

the controller is configured to select some of the external apparatuses and determine operation of the selected external apparatuses.

5. The server of claim 1, wherein the communicator is configured to receive condition information of a house of the user or information of a location of the device,

the controller is configured to determine whether the determined condition is satisfied based on the condition information or the information of the location of the device,

the external apparatus is a home appliance in the house of the user, and

the controller is configured to determine an ON/OFF state and a function of the external apparatus.

6. The server of claim 5, wherein the condition information is generated by the another external apparatus and the device, and

the condition information comprises information about at least one among a temperature and a humidity in the house of the user.

7. The server of claim 1, wherein the control command is generated by sequentially arranging a plurality of control commands with respect to the external apparatus to execute the determined operation.

8. The server of claim 1, wherein the external apparatus is one of a plurality of external apparatuses,

the biometric information comprises at least one among a heart rate, a body temperature, and a blood flow rate at an end of a hand of the user,

the plurality of external apparatuses comprises an air conditioner and a heater, and

the condition for controlling at least one among the air conditioner and the heater is determined based on the at least one among the heart rate, the body temperature and the blood flow rate at the end of the hand of the user.

9. The server of claim 1, wherein the communicator is configured to receive apparatus information of the external apparatus from the device,

the apparatus information comprises information about an identification value of the external apparatus, a type of the external apparatus, and a command used to control the external apparatus, and

the control command comprises some commands selected among commands included in the apparatus information.

10. The server of claim 1, wherein the voice command is a phrase including an instruction of the user,

a current user'"'"'s intention, at a time that the voice command is input, is determined from the instruction, and

the controller is configured to determine the condition for controlling the external apparatus and operation of the external apparatus based on the current user'"'"'s intention and the biometric information.

11. A method of controlling an external apparatus, the method comprising:

receiving an input command of a user and biometric information of the user from a device, wherein the input command includes a voice command;

analyzing the voice command;

determining a condition for controlling the external apparatus and operation of the external apparatus based on the analyzed voice command of the user and the received biometric information of the user;

receiving sensing data generated by another external device;

determining whether the determined condition is satisfied based on the sensing data received from the another external device; and

providing a control command for controlling the operation of the external apparatus to the external apparatus in response to the determined condition being satisfied,

wherein the biometric information of the user is obtained by the device when the voice command is input by the user into the device.

12. The method of claim 11, wherein the biometric information of the user is generated by a wearable device connected to the device and is provided to the device by the wearable device.

13. The method of claim 11, wherein the determining the condition for controlling the external apparatus and the operation of the external apparatus comprises:

determining the condition and the operation, according to an intention of the user which is determined based on the input command of the user, the biometric information of the user, and a type of the external apparatus.

14. The method of claim 11, wherein the external apparatus is one of a plurality of external apparatuses, and

the determining the operation of the external apparatus comprises selecting some of the plurality of external apparatuses and determining operation of the selected external apparatuses.

15. The method of claim 11, further comprising:

receiving condition information of a house of the user; and

determining whether the determined condition is satisfied based on the condition information,

wherein the external apparatus is a home appliance in the house of the user, and

the determining the operation of the external apparatus comprises determining an ON/OFF state and a function of the external apparatus.

16. The method of claim 15, wherein the condition information is generated by the another external apparatus and the device, and

the condition information comprises information about at least one among a location of the device, a temperature in the house of the user, and a humidity in the house of the user.

17. A non-transitory computer-readable recording medium having recorded thereon a computer program which, when executed by a computer system, causes the computer system to perform the method of claim 11.

18. A server configured to control an external apparatus, the server comprising:

a communicator configured to receive an input command of a user and biometric information of the user from a device, wherein the input command includes a voice command; and

a controller configured to;

analyze the voice command,

determine a condition for controlling the external apparatus and operation of the external apparatus based on the analyzed voice command of the user and the received biometric information of the user,

receive sensing data generated by another external device,

determine whether the determined condition is satisfied based on the sensing data received front the another external device, and

provide a control command for controlling the operation of the external apparatus to the external apparatus in response to the determined condition being satisfied,

wherein the biometric information of the user is obtained by the device when the voice command is input by the user into the device.

19. A method of controlling an external apparatus, the method comprising:

receiving an input command of a user and biometric information of the user from a device, wherein the input command includes a voice command;

analyzing the voice command;

determining a condition for controlling the external apparatus and operation of the external apparatus based on the analyzed voice command of the user and the received biometric information of the user;

receiving sensing data generated by another external device;

determining whether the determined condition is satisfied based on the sensing data received from the another external device; and

providing a control command for controlling the operation of the external apparatus to the external apparatus in response to the determined condition being satisfied,

wherein the biometric information of the user is obtained by the device when the voice command is input by the user into the device.

20. A non-transitory computer-readable recording medium having recorded thereon a computer program which, when executed by a computer system, causes the computer system to perform the method of claim 19.