Remote control system, remote control apparatus and remote control method

• US 8,704,644 B2
• Filed: 10/14/2010
• Issued: 04/22/2014
• Est. Priority Date: 11/10/2009
• Status: Active Grant

• Current Assignee: Lenovo Innovations Ltd Hong Kong (Lenovo Group Ltd.)
• Original Assignee: NEC Corporation
• Inventors: Uno, Hiroyuki
• Primary Examiner(s): Lee, Benjamin C
• Assistant Examiner(s): BLACK-CHILDRESS, RAJSHEED O
• Application Number:
  US13/502,915
• Publication Number:
  US 20120206245A1
• Time in Patent Office: 1,286 Days
• Field of Search: None
• US Class Current: 340/12.26
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/92 Universal remote control

Abstract

Provided is a remote operation system capable of coordinating the operations of a plurality of devices without harming the familiar, intuitive behavior style of remote control operation. The remote operation system is provided with: a remote operation device which captures images of each of a plurality of devices connected to a network and specifies the devices to be operated, and which transmits operation scenario information on the coordinated operations performed among the plurality of devices to be operated, the coordinated operations being determined by the combination of the types of the specified devices to be operated; and a network control unit which outputs operation commands for executing operations specified by the operation scenario information received, to the devices specified by the operation scenario information received, when the network accommodating the plurality of devices is constructed and the operation scenario information is transmitted from the remote operation device.

Claims

1. A remote control system comprising:

a remote control apparatus for identifying control-object apparatuses by capturing respective images of a plurality of apparatuses belonging to a desired control scenario and connected to a network, and for transmitting control scenario information concerning cooperative operation among a plurality of control-object apparatuses which are determined by a combination of types of the identified said control-object apparatuses; and

a network control unit for constituting said network, by containing said plurality of apparatuses, and for, on receiving said control scenario information from said remote control apparatus, outputting, to said apparatuses prescribed in the received control scenario information, control orders for causing said apparatuses to execute operations prescribed in the received control scenario information.

2. The remote control system according to claim 1, wherein

said remote control apparatus comprises:

an image comparison unit for identifying said control-object apparatuses by comparing said apparatuses each captured in an image with image information for comparison stored in the image comparison unit;

a control scenario information search unit for acquiring control scenario information determined by a combination of types of the identified said control-object apparatuses from control scenario registration information storing said control scenario information; and

a communication unit for transmitting the acquired said control scenario information to the outside.

3. The remote control system according to claim 2, wherein

said network control unit comprises:

a communication unit for receiving said control scenario information from the outside;

a control scenario analysis unit for analyzing said control-object apparatuses prescribed by said control scenario information and operation contents prescribed by said control scenario information for each control-object apparatus, and for outputting control-object apparatus information specifying each control-object apparatus and operation contents information for each control-object apparatus;

a control order data generation unit for generating and outputting control order data corresponding to each control-object apparatus, on the basis of said control-object apparatus information and said operation contents information transmitted from said control scenario analysis unit; and

an apparatus connecting unit equipped with ports to connect respective ones of a plurality of said apparatuses, the apparatus connecting unit for, on the basis of said control order data outputted by said control order data generation unit, identifying said ports connecting respective ones of said control-object apparatuses and transmitting control order data corresponding to respective ones of said control-object apparatuses.

4. The remote control system according to claim 2, wherein:

said network control unit is equipped with a memory unit for storing apparatus type information, connection position information, and address information prescribed by said network, of said apparatuses connected to the network control unit, as connected device information; and

said remote control apparatus is equipped with an image registration control unit for performing a process of registering captured images of said apparatuses as images for comparison, wherein the image registration control unit acquires said connected device information from said network control unit and registers the captured images of said apparatuses, relating them to said connected device information, as said images for comparison.

5. The remote control system according to claim 4, wherein

said remote control apparatus is equipped with a control scenario registration control unit for performing a process of registering said control scenario information, wherein the control scenario registration control unit registers, for each control scenario, apparatus type information concerning a plurality of said control-object apparatuses participating corresponding control and operation information prescribed for each control-object apparatuses, along with control scenario identification information for identifying a corresponding control scenario, as said control scenario registration information, and transmits the registered control scenario registration information to said network control unit.

6. The remote control system according to claim 5, wherein

said network control unit stores in said memory unit said control scenario registration information transmitted from said remote control apparatus, with said connection position information and said address information in said connected device information added to said apparatus type information concerning control-object apparatuses included in the control scenario registration information.

7. The remote control system according to claim 6, wherein:

said control scenario information search unit of said remote control apparatus outputs said control scenario identification information included in the acquired said control scenario information via said communication unit; and

on receiving said control scenario identification information via said communication unit, said control scenario analysis unit of said network control unit retrieves said control scenario information corresponding to the said control scenario identification information from said control scenario registration information stored in said memory unit, and analyzes said control-object apparatuses and operation contents for each of the control-object apparatuses prescribed by the retrieved control scenario information.

8. The remote control system according to claim 3, wherein

said communication unit of said remote control apparatus communicates with said communication unit of said network control unit directly or via a mobile communication network.

9. A remote control apparatus for remotely controlling a plurality of apparatuses contained in a network control unit, the remote control apparatus comprising:

a control-object apparatus identification unit for capturing respective images of a plurality of said apparatuses belonging to a desired control scenario, and thereby identifying apparatuses to control; and

a control scenario output unit for outputting control scenario information prescribing operations of each apparatus in cooperative operation among a plurality of control-object apparatuses which are determined by a combination of types of the identified

said control-object apparatuses, wherein,

receiving said control scenario information, said network control unit causes said control-object apparatuses to execute operations prescribed by the control scenario information.

10. The remote control apparatus according to claim 9, wherein:

said control-object apparatus identification unit comprises an image comparison unit for comparing said apparatuses captured in images with image information for comparison it stores, and thereby identifying said control-object apparatuses; and

said control scenario output unit comprises a control scenario information search unit for acquiring control scenario information determined by a combination of types of the identified said control-object apparatuses from control scenario registration information storing said control scenario information, and a communication unit for transmitting the acquired said control scenario information to the outside.

11. The remote control apparatus according to claim 10, further comprising an image registration control unit for performing a process of registering captured images of said apparatuses as images for comparison, wherein

said image registration control unit acquires, from said network control unit, connected apparatus information stored in said network control unit, including apparatus type information, connection position information, and address information prescribed by said network, of said apparatuses connected to the network control unit, and registers the captured images of said apparatuses as said images for comparison, relating them to said connected apparatus information.

12. The remote control apparatus according to claim 11, further comprising a control scenario registration control unit for performing a process of registering said control scenario information, wherein

the control scenario registration control unit registers, for each control scenario, apparatus type information concerning a plurality of said control-object apparatuses participating corresponding control and operation information prescribed for each control-object apparatus, along with control scenario identification information for identifying a corresponding control scenario, as said control scenario registration information, and transmits the registered control scenario registration information to said network control unit.

13. The remote control apparatus according to claim 12, wherein,

on acquiring said control scenario information, said control scenario information search unit outputs either said control scenario identification information or type information concerning said control-object apparatuses and operation information prescribed for each control-object apparatus, which are included in the control scenario information, via said communication unit.

14. The remote control apparatus according to claim 10, wherein

said communication unit communicates with said network control unit directly or at least via a mobile communication network.

15. A remote control method comprising the steps of:

capturing by a remote control apparatus respective images of a plurality of apparatuses belonging to a desired control scenario and connected to a network control unit, and thereby identifying control-object apparatuses by the remote control apparatus;

transmitting control scenario information concerning cooperative operation among a plurality of control-object apparatuses determined by a combination of types of the identified said control-object apparatuses by said remote control apparatus; and

outputting by said network control unit, to the apparatuses prescribed by the received said control scenario information, control orders causing the apparatuses to execute operations prescribed by the received said control scenario information.

16. The remote control method according to claim 15, wherein

said capturing and identifying step includes comparing said apparatuses captured in images with stored image information for comparison to identify said control-object apparatuses;

and

said transmitting step includes acquiring, from control scenario registration information storing said control scenario information, control scenario information determined by a combination of types of the identified said control-object apparatuses, and transmitting the acquired said control scenario information to the outside.

17. The remote control method according to claim 16, wherein

said outputting step comprises:

receiving said control scenario information from the outside;

analyzing said control-object apparatuses prescribed by said control scenario information and operation contents prescribed by said control scenario information for each control-object apparatus, and outputting control-object apparatus information identifying each control-object apparatus and operation contents information for each control-object apparatus;

generating and outputting control order data corresponding to each control-object apparatus, on the basis of said control-object apparatus information and said operation contents information outputted at said analyzing step; and

, on the basis of said control order data outputted at said generating and outputting step, identifying ports connecting respective ones of said control-object apparatuses and transmitting control order data corresponding to respective ones of said control-object apparatuses.

18. The remote control method according to claim 17, further comprising:

storing type information, connection position information, and address information prescribed by said network, of said apparatuses connected to said network control unit, as connected device information; and

registering images of said apparatuses captured by said remote control apparatus as said images for comparison, wherein

said registering step includes acquiring said connected device information from said network control unit, and registering the captured images of said apparatuses as said images for comparison, relating them to said connected device information.

19. The remote control method according to claim 18, further comprising

registering said control scenario information by said remote control apparatus, wherein

said registering step includes:

registering, for each control scenario, apparatus type information concerning a plurality of said control-object apparatuses participating corresponding control and operation information prescribed for each control-object apparatus, along with control scenario identification information identifying a corresponding control scenario, as said control scenario registration information; and

transmitting the registered control scenario registration information also to said network control unit.

20. The remote control method according to claim 19, further comprising

storing said control scenario registration information transmitted from said remote control apparatus by said network control unit, with said connection position information and said address information stored in said storing step added to apparatus type information concerning said control-object apparatuses included in the control scenario registration information.

21. The remote control method according to claim 20, wherein:

said acquiring step includes outputting said control scenario identification information included in the acquired said control scenario information; and

said analyzing step includes retrieving said control scenario information corresponding to the received said control scenario identification information from said control scenario registration information, and analyzing said control-object apparatuses and operation contents for each of the control-object apparatuses prescribed by the retrieved control scenario information.