Method and apparatus for controlling a home device remotely in a home network system

• US 9,978,260 B2
• Filed: 12/18/2013
• Issued: 05/22/2018
• Est. Priority Date: 12/18/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Keun-Cheol, Kweon, Ji-Hyeon, Kim, Kyung-Jae, Choi, Jae-Won
• Primary Examiner(s): Barakat, Mohamed
• Application Number:
  US14/132,388
• Publication Number:
  US 20140167931A1
• Time in Patent Office: 1,616 Days
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/31 Voice input
• CPC Class Codes: G08C 2201/41 Remote control of gateways
• CPC Class Codes: G08C 2201/42 Transmitting or receiving remote control signals via a network
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04L 12/2818 from a device located outside both the home and the home network access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment

Abstract

Provided is a remote control method and apparatus in a home network system including multiple home devices. The remote control method includes receiving operation state information from the respective multiple home devices, receiving a control command for operation control of at least one of the multiple home devices from a user device, determining a control target home device based on the control command, sending the control command to the determined control target home device, receiving processing result information corresponding to execution of the control command from the control target home device, and transmitting the processing result information to the user device.

Claims

1. A remote control method in a home network system comprising at least one home device, the remote control method comprising:

receiving, from the at least one home device, operation state information and arrangement information of the at least one home device;

receiving, from a user device, a request for providing the operation state information and the arrangement information of the at least one home device;

recognizing a first voice command by a user-specific voice recognition with a user profile, the user profile including a user-specific voice information and a user-specific authority information;

generating a first control command based on the recognition of the first voice command, the first control command indicating a control target home device and an operation of the control target home device;

transmitting, to the user device, the arrangement information and the operation state information;

receiving, from the user device, a second control command for an operation control of the at least one home device;

determining the control target home device based on the first control command or the second control command; and

transmitting, to the determined control target home device, the first control command or the second control command.

2. The remote control method of claim 1, further comprising:

receiving, from the control target home device, processing result information corresponding to execution of the first control command or the second control command; and

transmitting, to the user device, the processing result information,

wherein the second control command received from the user device is generated by recognizing a second voice command.

3. The remote control method of claim 1, wherein the second control command comprises at least one of identification information of the at least one home device, control details for the operation control, or authentication information of the user device.

4. The remote control method of claim 1, wherein the determining of the control target home device comprises excluding a home device, which has a malfunction possibility because a value indicating an operation state exceeds a reference value, among the at least one home device.

5. The remote control method of claim 1, wherein the arrangement information comprises floor plan information indicating a room-specific arrangement of the at least one home device.

6. The remote control method of claim 1, further comprising:

transmitting, to the user device, image information comprising image data, the image data being acquired by controlling at least one first home device equipped with a camera among the at least one home device, if an image information request for the control target home device is received from the user device.

7. The remote control method of claim 1, further comprising:

interpreting a voice command received from the at least one home device; and

generating a control command for the operation control of the at least one home device.

8. The remote control method of claim 7, wherein the voice command is recognized by a voice recognition sensor mounted on the at least one home device.

9. The remote control method of claim 8, further comprising:

registering the user profile comprising user-specific voice information for voice recognition and user-specific authority information for the operation control of the at least one home device.

10. The remote control method of claim 9, further comprising determining whether to execute the control command based on the user profile, in response to the control command being received.

11. The remote control method of claim 1, wherein the user device comprises at least one of a smart television (TV), a mobile terminal, a tablet personal computer (PC), a remote controller, or an internet protocol (IP)-based wired/wireless phone.

12. The remote control method of claim 1,

wherein the arrangement information is determined by detecting a location of the at least one home device, and

wherein the location of the at least one home device is detected based on using an RF tag or a sensor, wherein the RF tag or the sensor is included in the at least one home device.

13. A gateway apparatus for remote control in a home network system comprising at least one home device, the gateway apparatus comprising:

at least one transceiver configured to communicate with the at least one home device and a user device in a wired/wireless manner; and

at least one processor configured to;

control the at least one transceiver to;

receive, from the at least one home device, operation state information and arrangement information of the at least one home device,

receive, from the user device, a request for providing the operation state information and the arrangement information of the at least one home device,

transmit, to the user device, the arrangement information and the operation state information, and

receive, from the user device, a second control command for operation control of the at least one home device,

recognize a first voice command by a user-specific voice recognition with a user profile, the user profile including a user-specific voice information and a user-specific authority information,

generate a first control command based on the recognition of the first voice command, the first control command indicating a control target home device and an operation of the control target home device,

determine the control target home device based on the first control command or the second control command, and

further control the at least one transceiver to;

transmit, to the determined control target home device, the first control command or the second control command.

14. The gateway apparatus of claim 13,

wherein at least one processor further configured to control the at least one transceiver to:

receive, from the control target home device, processing result information corresponding to execution of the second control command, and

transmit, to the user device, the processing result information, and

wherein the second control command received from the user device is generated by recognizing a second voice command.

15. The gateway apparatus of claim 13, wherein the second control command comprises at least one of identification information of the at least one home device, control details for the operation control, or authentication information of the user device.

16. The gateway apparatus of claim 13, wherein the at least one processor is further configured to control an operation of excluding a home device which has a malfunction possibility because a value indicating an operation state exceeds a reference value, among the at least one home device.

17. The gateway apparatus of claim 13, wherein the arrangement information comprises floor plan information indicating a room-specific arrangement of the at least one home device.

18. The gateway apparatus of claim 13, wherein the at least one processor is further configured to control an operation of transmitting, to the user device, image information comprising image data, the image data being acquired by controlling at least one first home device equipped with a camera among the at least one home device, if an image information request for the control target home device is received from the user device.

19. The gateway apparatus of claim 13, wherein the at least one processor is further configured to control an operation of interpreting a voice command received from the at least one home device and generating a control command for the operation control of the at least one home device.

20. The gateway apparatus of claim 19, wherein the voice command is recognized by a voice recognition sensor mounted on the at least one home device.

21. The gateway apparatus of claim 20, wherein the at least one processor is further configured to control an operation of registering the user profile comprising user-specific voice information for voice recognition and user-specific authority information, for the operation control of the at least one home device.

22. The gateway apparatus of claim 21, wherein the at least one processor is further configured to control an operation of determining whether to execute the control command based on the user profile, in response to the control command being received.

23. The gateway apparatus of claim 13, wherein the user device comprises at least one of a smart television (TV), a mobile terminal, a tablet personal computer (PC), a remote controller, or an internet protocol (IP)-based wired/wireless phone.

24. The gateway apparatus of claim 13,

wherein the arrangement information is determined by detecting a location of the at least one home device, and

wherein the location of the at least one home device is detected based on using an RF tag or a sensor, wherein the RF tag or the sensor is included in the at least one home device.

25. A remote control method in a home network system comprising at least one home device, the remote control method comprising:

transmitting, to a gateway apparatus, a request for providing operation state information and arrangement information of the at least one home device;

receiving, from the gateway apparatus, the arrangement information and the operation state information of the at least one home device, wherein the arrangement information and the operation state information are received by the gateway apparatus from the at least one home device;

transmitting, to the gateway apparatus, a second control command for operation control of the at least one home device in order for the gateway apparatus to determine a control target home device; and

receiving, from the gateway apparatus, processing result information corresponding to execution of the second control command,

wherein the gateway apparatus is configured to;

recognize a voice command by a user-specific voice recognition with a user profile, the user profile including a user-specific voice information and a user-specific authority information,

generate a first control command based on the recognition of the voice command, the first control command indicating a control target home device and an operation of the control target home device, and

determine the control target home device based on the first control command.

26. The remote control method of claim 25, wherein the second control command comprises at least one of identification information of at least one home device, control details for the operation control, or authentication information of the user device.

27. The remote control method of claim 25, wherein the arrangement information comprises floor plan information indicating a room-specific arrangement of the at least one home device.

28. The remote control method of claim 25, further comprising registering the user profile comprising voice information of the user and user-specific authority information for the operation control of the at least one home device in the gateway apparatus.

29. The remote control method of claim 28, further comprising receiving a notification message indicating whether the user is a registered user based on the user profile from the gateway apparatus.

30. The remote control method of claim 28, further comprising receiving a notification message indicating whether authority of the user is given to the first control command based on the user profile from the gateway apparatus.

31. The remote control method of claim 25,

wherein the arrangement information is determined by detecting a location of the at least one home device, and

wherein the location of the at least one home device is detected based on using an RF tag or a sensor, wherein the RF tag or the sensor is included in the at least one home device.

32. A user device for remote control in a home network system comprising at least one home device, the user device comprising:

at least one transceiver configured to communicate with a gateway apparatus; and

at least one processor configured to control the at least one transceiver to;

transmit, to the gateway apparatus, a request for providing operation state information and arrangement information of the at least one home device,

receive, from the gateway apparatus, the arrangement information and the operation state information of the at least one home device, wherein the arrangement information and the operation state information are received by the gateway apparatus from the at least one home device,

transmit, to the gateway apparatus, a second control command for operation control of the at least one home device in order for the gateway apparatus to determine a control target home device, and

receive, from the gateway apparatus, processing result information corresponding to execution of the second control command,

wherein the gateway apparatus is configured to;

recognize a voice command by a user-specific voice recognition with a user profile, the user profile including a user-specific voice information and a user-specific authority information,

generate a first control command based on the recognition of the voice command, the first control command indicating a control target home device and an operation of the control target home device, and

determine the control target home device based on the first control command.

33. The user device of claim 32, wherein the second control command comprises at least one of identification information of the at least one home device, control details for the operation control, or authentication information of the user device.

34. The user device of claim 32, wherein the arrangement information comprises floor plan information indicating a room-specific arrangement of the at least one home device.

35. The user device of claim 32, wherein the at least one processor is further configured to control an operation of registering the user profile comprising voice information of the user and user-specific authority information for the operation control of the at least one home device in the gateway apparatus.

36. The user device of claim 35, wherein the at least one processor is further configured to control an operation of receiving a notification message indicating whether the user is a registered user based on the user profile from the gateway apparatus.

37. The user device of claim 35, wherein the at least one processor is further configured to control an operation of receiving a notification message indicating whether authority of the user is given to the first control command based on the user profile from the gateway apparatus.

38. The user device of claim 32,

wherein the arrangement information is determined by detecting a location of the at least one home device, and

wherein the location of the at least one home device is detected based on using an RF tag or a sensor, wherein the RF tag or the sensor is included in the at least one home device.