Method and system for remote control, and remote-controlled user interface

• US 9,594,502 B2
• Filed: 02/29/2012
• Issued: 03/14/2017
• Est. Priority Date: 12/21/2011
• Status: Active Grant

• Current Assignee: KT Corporation
• Original Assignee: KT Corporation
• Inventors: Lee, Young Hoon, Kang, Chan Hui, Kim, Jong Cheol, Kim, Hyun Ho
• Primary Examiner(s): Edwards, Jerrah
• Assistant Examiner(s): WEBER, TAMARA L
• Application Number:
  US14/368,139
• Publication Number:
  US 20140371954A1
• Time in Patent Office: 1,840 Days
• US Class Current: 1/1
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/70 Device selection
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/02 including a Bluetooth interface
• CPC Class Codes: H04M 2250/06 including a wireless LAN interface

Abstract

A method and system for remote control and remote-controlled user interface. A remote control method of target terminal by a mobile communication terminal comprises: displaying a plurality of control methods for remote control of the target terminal; when one of the plurality of control methods is selected, displaying a control screen corresponding to the selected control method; and when a control attribute value displayed in the control screen is set, transmitting a control message comprising the set control attribute value to the target terminal, wherein the control methods include at least one of a directional touch, a tilt and a pattern input by continuous touch.

Claims

1. A method for remotely controlling a target terminal by a mobile communication terminal, the method comprising:

displaying a plurality of control methods on a display of the mobile communication terminal;

displaying a control screen corresponding to a selected control method based on a selection of control method from the displayed plurality of control methods, the control screen comprising an interface configured for setting a moving pattern and a control attribute value for the target terminal according to the selected control method; and

transmitting to the target terminal a control message comprising a set moving pattern and a set control attribute value based on a setting of the moving pattern and the control attribute value in the control screen,

wherein each of the plurality of control methods comprises at least an input pattern configured to be drawn by a continuous touch on a region of the control screen, and

wherein the input pattern drawn by the continuous touch corresponds to the moving pattern set for the target terminal according to the selected control method.

2. The remote control method of claim 1, wherein, in response to receiving a selection of another control method with a directional touch from the plurality of control methods, displaying the control screen having at least one of:

a moving direction setting region to set at least one of moving direction and a moving distance of the target terminal and a moving speed setting region to set moving speed of the target terminal using the directional touch.

3. The remote control method of claim 1, wherein, in response to receiving a selection of another control method with a directional touch from the plurality of control methods, displaying the control screen having an action setting region to set a moving direction and a moving speed of the target terminal using the directional touch.

4. The remote control method of claim 2, wherein the transmitting the control message further comprises calculating a direction and a length of touch input via the control screen as a control attribute value for at least one of the moving direction, moving distance, and moving speed.

5. The remote control method of claim 1, wherein, in response to receiving a selection of another control method with a tilt from the plurality of control methods, displaying the control screen having at least one of:

a moving direction setting region to set at least one of moving direction and moving distance of the target terminal and a moving speed setting region to set moving speed of the target terminal using the tilt.

6. The remote control method of claim 5, wherein the moving direction setting region comprises an avatar relating to the target terminal in which the avatar moves within the moving direction setting region according to a tilt angle and a duration of the tilt of the mobile communication terminal.

7. The remote control method of claim 5, wherein the transmitting the control message further comprises calculating a tilt angle and a duration of the tilt of the mobile communication terminal as a control attribute value for the moving direction and moving distance, and calculating a setting value corresponding to touch input to the moving speed setting region as a control attribute value for the moving speed.

8. The remote control method of claim 1, wherein, in response to receiving a selection of another control method with a tilt from the plurality of control methods, the control screen to set moving direction and moving speed of the target terminal by using motion comprising a tilt of the mobile communication terminal is displayed,

wherein the control screen comprises a fingerprint region where a user of the mobile communication terminal contacts the control screen, and

wherein, when motion comprising the tilt is performed while the user is in contact with the fingerprint region, setting a moving direction and a moving speed of the target terminal.

9. The remote control method of claim 8, wherein the transmitting the control message further comprises calculating motion comprising the tilt of the mobile communication terminal as a control attribute value for the moving direction and moving speed in which the motion comprising the tilt directs the screen of the mobile communication terminal to an up, down, left or right direction.

10. The remote control method of claim 1, wherein, in response to receiving a selection of another control method with the input pattern drawn by the continuous touch from the plurality of control methods, displaying the control screen having at least one of:

a moving path setting region to set a moving path of the target terminal and a moving speed setting region to set moving speed of the target terminal according to the pattern by the continuous touch.

11. The remote control method of claim 10, wherein the moving path setting region comprises a plurality of nodes in an n×

n grid, where n is a positive integer and further comprising forming the pattern by the continuous touch passing each node by the continuous touch.

12. The remote control method of claim 10, wherein the transmitting the control message further comprises:

calculating the input pattern as a control attribute value for the moving path, and calculating a setting value corresponding to the touch input to the moving speed setting region as a control attribute value for the moving speed.

13. The remote control method of claim 1, wherein the control method further comprises a control based on emotion selected by a user of the mobile communication terminal, and

wherein, in response to receiving a selection of another control method with the control based on emotion selected by a user from the plurality of control methods, displaying the control screen to set at least one of:

a moving direction, a moving pattern, a moving speed, text to speech (TTS) and color and lighting speed of a light-emitting part of the target terminal.

14. The remote control method of claim 1, wherein said one of the plurality control methods further comprises a control of contents stored in the target terminal,

wherein, in response to receiving a selection of another control method with the control of contents from the plurality of control methods, displaying the control screen to set at least one of:

a playback, pausing the playback, and an output method of the contents stored in the target terminal.

15. The remote control method of claim 1, wherein the control screen displays a plurality of concentric circles, each having a respectively different radius, and an avatar within at least one of the plurality of concentric circles, and

a tilt of the mobile communication terminal causes a movement of both the avatar and the target terminal,

a first tilt of the mobile communication terminal, at a first azimuth angle, causes the avatar to appear outside of a radius of a smallest circle of the plurality of concentric circles but within a radius of a second smallest of the plurality of concentric circles, the second smallest circle having a radius greater than that of the smallest circle,

a second tilt of the mobile communication terminal, at a second azimuth angle, causes the avatar to appear outside of the radius of the second smallest circle, and

the first tilt causes a lesser movement of the target terminal than the second tilt, wherein

the first and the second azimuth angles are measured with respect to a user holding the mobile communication terminal.

16. The remote control method of claim 1, wherein a movement speed of the target terminal is caused to increase by shaking the mobile communication terminal.

17. The remote control method of claim 1, wherein another of the plurality of control methods further comprises at least one of a directional touch and a tilt of the mobile communication terminal.

18. The remote control method of claim 1, wherein the moving pattern is a moving pattern of motion of a robot.

19. A user interface of remotely controlling a target terminal by a mobile communication terminal, comprising:

a plurality of control methods displayed on a display of the mobile communication terminal; and

a displayable control screen corresponding to a selected control method based on a selection of the selected control method from the displayed plurality of control methods, the control screen comprising an interface configured for setting a moving pattern and a control attribute value for the target terminal according to the selected control method,

wherein each of the plurality of control methods comprises at least an input pattern configured to be drawn by a continuous touch on a region of the control screen,

wherein the input pattern drawn by the continuous touch corresponds to the moving pattern set for the target terminal according to the selected control method,

wherein the control screen using the pattern drawn by the continuous touch comprises at least one of;

a moving path setting region to set a moving path of the target terminal and the moving speed setting region according to the input pattern drawn by the continuous touch, and

wherein the pattern is drawn by the continuous touch.

20. The user interface of claim 19, wherein another of the plurality of control methods comprises a directional touch,

wherein the control screen using the direction touch comprises a first action setting region to set at least one of:

a moving direction, a distance and a speed of the target terminal by using the directional touch,

wherein the first action setting region comprises a first touch region and a second touch region in a bar type indicating up/down direction, and

wherein the first touch region corresponds to a control of a left driver of the target terminal and the second touch region corresponds to control of a right driver of the target terminal.

21. The user interface of claim 20, wherein touch in an up or down direction in the first touch region or the second touch region, converts a direction of the target terminal and simultaneous touch in the up or down direction in the first touch region and the second touch region moves the target terminal in the up or down direction.

22. The user interface of claim 21, wherein the first action setting region further comprises a moving speed setting region to set moving speed of the target terminal, and wherein the first touch region and second touch region further set moving speed of the target terminal through the directional touch when the first action setting region is without the moving speed setting region.

23. The user interface of claim 19, wherein the first action setting region comprises a cross-typed touch region indicating up, down, left, and right direction, and

wherein each direction of the cross-typed touch corresponds to each moving direction of the target terminal.

24. The user interface of claim 19, wherein another of the plurality of control methods comprises a tilt,

wherein the control screen using the tilt comprises a second action setting region to set at least one of the moving direction, the distance and the speed of the target terminal by using the tilt of the mobile communication terminal, and

wherein the second action setting region displays a plurality of concentric circles having different radius, and

wherein an avatar relating to the target terminal is displayed in one of the plurality of concentric circles based on calculating at least one of a moving distance and a direction of the avatar.

25. The user interface of claim 24, wherein the avatar moves in the plurality of concentric circles according to a tilt angle and a duration of the tilt of the mobile communication terminal and moving distance, direction and speed of the target terminal are set according to moving distance, direction and speed of the avatar moving in the plurality of concentric circles.

26. The user interface of claim 24, wherein the second action setting region comprises a fingerprint region where a user of the mobile communication terminal contacts the fingerprint region of the control screen,

wherein a motion comprising a tilt is performed while the user is in contact with the fingerprint region, moving direction, and speed of the target terminal, is set.

27. The user interface of claim 19, wherein the moving path setting region comprises a plurality of nodes in an n×

n grid, wherein n is a positive integer and the pattern is formed by the continuous touch passing through said each node by the continuous touch.

28. The user interface of claim 19, wherein another of the plurality of control methods further comprises a control based on an emotion selected by a user of the mobile communication terminal, and

wherein the control screen of the other control method based on the emotion selected by a user sets at least one of:

a moving direction, a moving pattern, a moving speed, text to speech (TTS) and color and lighting speed of a light-emitting part of the target terminal.

29. The user interface of claim 19, wherein said one of the plurality of control methods further comprises a control of contents stored in the target terminal,

wherein the control screen of the control of contents sets at least one of a playback, pausing of the playback and an output method of the contents stored in the target terminal.

30. The user interface of claim 19, wherein a total length of a bar of the bar type is the moving distance of the target terminal and an input at half of the total length of the bar causes target terminal to move half of the moving distance.

31. A remote control system comprising:

a mobile communication terminal configured to display a plurality of control methods on a display of the mobile communication terminal, to display a control screen corresponding to a selected control method based on a selection of the selected control method from the displayed plurality of control methods, the control screen comprising an interface configured for setting a moving pattern and a control attribute value for the target terminal according to the selected control method, and to transmit a control message comprising a set moving pattern and a set control attribute value based on a setting of the moving pattern and the control attribute value in the control screen; and

the target terminal configured to receive the control message from the mobile communication terminal, configured to extract the set moving pattern and the set control attribute value, and configured to operate based on the set moving pattern and the set control attribute value,

wherein the selected control method comprises at least a pattern input by continuous touch on the control screen displayed on the mobile communication terminal.

32. The remote control system of claim 31, wherein the mobile communication terminal, when a directional touch and a tilt is selected from the control methods, displays the control screen having at least one of a first region to set at least one of a moving direction and a distance of the target terminal and a second region to set a moving speed of the target terminal.

33. The remote control system of claim 31, wherein, when a directional touch and a tilt is selected from the control methods, the mobile communication terminal displays the control screen having an action setting region to set at least one of moving direction, distance and speed of the target terminal.

34. The remote control system of claim 31, wherein, when the input pattern drawn by the continuous touch is selected from the control methods, the mobile communication terminal displays the control screen having at least one of a first region to set a moving path of the target terminal and a second region to set a moving speed of the target terminal.

35. The remote control system of claim 31, wherein, when a control of the target terminal is based on an emotion from the control methods, the mobile communication terminal displays the control screen to set at least one of a moving direction, a moving pattern, a moving speed, text to speech (TTS) and a color and a lighting speed of a light-emitting part of the target terminal.

36. The remote control system of claim 31, wherein, when a control of contents is selected from the control methods, the mobile communication terminal displays the control screen to set at least one of a playback, pausing of the playback and an output method of the contents stored in the target terminal.

37. The remote control system of claim 31, wherein, when a control of the target terminal is based on an emotion from the control methods, the mobile communication terminal displays words indicating emotions and wherein the target terminal displays an emotion based on one of the displayed words selected via the mobile communication terminal.

38. The remote control system of claim 31, wherein, when a control of the target terminal is based on an emotion from the control methods, the mobile communication terminal displays icons indicating emotions and wherein the target terminal displays an emotion based on one of the displayed icons selected via the mobile communication terminal.

39. The remote control system of claim 31, wherein the mobile communication terminal is implemented by a first processor and the target terminal is implemented by a second processor.