System and method of controlling external apparatus connected with device

• US 10,567,189 B2
• Filed: 07/20/2017
• Issued: 02/18/2020
• Est. Priority Date: 09/10/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Ko, Jae-woo, Shin, Hang-sik, Park, Se-jun, Kim, Yang-wook, Chun, Hae-in, Jung, Jae-ho
• Primary Examiner(s): Small, Naomi J
• Application Number:
  US15/654,829
• Publication Number:
  US 20170317845A1
• Time in Patent Office: 943 Days
• Field of Search: 340 582
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/21 Programming remote control devices via third means
• CPC Class Codes: G08C 2201/42 Transmitting or receiving remote control signals via a network
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04L 12/2803 Home automation networks
• CPC Class Codes: H04L 67/303 Terminal profiles

Abstract

A mobile device includes a memory configured to store a program; and a processor configured to control one or more external apparatuses by executing the program. The program includes commands which, when executed by the processor, cause the processor to identify the one or more external apparatuses communicable with and controllable by the mobile device, from a plurality of external apparatuses; provide apparatus information of the one or more external apparatuses, to a server; receive, from the server, control information for controlling the one or more external apparatuses for a user'"'"'s intention; and transmit a control command to the one or more external apparatuses based on the received control information.

Claims

1. A mobile device comprising:

a memory configured to store a program; and

a processor configured to control one or more external apparatuses, among a plurality of external apparatuses, by executing the program,

wherein the program comprises commands which, when executed by the processor, cause the processor to;

identify the one or more external apparatuses, which are communicable with and controllable by the mobile device, from the plurality of external apparatuses,

obtain an input command of a user and biometric information of the user, wherein the input command includes a voice command;

provide the input command of a user and the biometric information and apparatus information of the one or more external apparatuses, to a server,

receive, from the server, a control information for controlling the one or more external apparatuses, the control information being generated based on whether a control condition for controlling a first external apparatus among the one or more external apparatuses is satisfied based on a sensing data received from a second external apparatus among the one or more external apparatuses, wherein the control condition is determined based on the apparatus information and a user'"'"'s intention, and the user'"'"'s intention is determined in consideration of the voice command and the biometric information, and

transmit a control command to the first external apparatus based on the received control information,

wherein the biometric information of the use is obtained by the mobile device when the voice command is input by the user into the mobile device.

2. The mobile device of claim 1, wherein the input command is generated by the mobile device based on at least one among a text input by the user, a voice of the user, and a gesture of the user.

3. The mobile device of claim 1, wherein the one or more external apparatuses include a third external apparatus for checking whether the control condition according to the user'"'"'s intention is satisfied.

4. The mobile device of claim 1, wherein the control information is generated, by the server, based on the input command and the apparatus information.

5. The mobile device of claim 3, wherein the control information is generated based on the control condition.

6. The mobile device of claim 5, wherein the control information comprises information for checking whether the control condition is satisfied and information for controlling an operation of at least one among the mobile device and the first external apparatus when the control condition is satisfied.

7. The mobile device of claim 3, wherein the control information comprises a plurality of control commands for controlling an operation of at least one among the mobile device and the first external apparatus, the control command being one of the plurality of control commands, and

the plurality of control commands are executed by at least one among the mobile device and the first external apparatus in a predetermined order.

8. The mobile device of claim 1, wherein the first external apparatus includes a home appliance.

9. The mobile device of claim 1, wherein the second external apparatus includes an outdoors apparatus.

10. A method for controlling one or more external apparatuses, the method being performed by a mobile device and comprising:

identifying the one or more external apparatuses, which are communicable with and controllable by the mobile device, from a plurality of external apparatuses;

obtaining an input command of a user and biometric information of the user, wherein the input command includes a voice command;

providing the input command, the biometric information and apparatus information of the one or more external apparatuses, to a server;

receiving, from the server, a control information for controlling the one or more external apparatuses, the control information being generated based on

whether a control condition for controlling a first external apparatus among the one or more external apparatuses is satisfied based on a sensing data received from a second external apparatus among the one or more external apparatuses, wherein the control condition is determined based on the apparatus information and a user'"'"'s intention, and the user'"'"'s intention is determined in consideration of the voice command and the biometric information; and

transmit a control mainland to the first external apparatus based on the received control information,

wherein the biometric information of the user is obtained by the mobile device when the voice command is input by the user into the mobile device.

11. The method of claim 10, wherein the input command is generated by the mobile device based on at least one among a text input by the user, a voice of the user, and a gesture of the user.

12. The method of claim 10, wherein the one or more external apparatuses include a third external apparatus for checking whether the control condition according to the user'"'"'s intention is satisfied.

13. The method of claim 10, wherein the received control information is generated, by the server, based on the input command and the apparatus information.

14. The method of claim 12, wherein the control information is generated based on the control condition.

15. The method of claim 14, wherein the control information comprises information for checking whether the control condition is satisfied and information for controlling an operation of at least one among the mobile device and the first external apparatus when the control condition is satisfied.

16. The method of claim 12, wherein the control information comprises a plurality of control commands for controlling an operation of at least one among the mobile device and the first external apparatus, the control command being one of the plurality of control commands, and

the plurality of control commands are executed by at least one among the mobile device and the first external apparatus in a predetermined order.

17. A non-transitory computer-readable recording medium having recorded thereon a computer program which, when executed by a computer system, causes the computer system to execute the method of claim 10.