REMOTE CONTROL SYSTEM FOR ELECTRONIC DEVICE AND REMOTE CONTROL METHOD THEREOF

• US 20110216011A1
• Filed: 09/10/2009
• Published: 09/08/2011
• Est. Priority Date: 10/10/2008
• Status: Active Grant

• Current Assignee: Shenzhen Taishan Online Technology Company Limited
• Original Assignee: Shenzhen Taishan Online Technology Company Limited
• Inventors: Zhou, Kun, Cheng, Jun, Zhao, Wenchuang, Shi, Danwei, Lv, Shunzhi
• Granted Patent: US 8,648,811 B2
• Time in Patent Office: Days
• US Class Current: 345/169
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

A remote control system for electronic device and remote control method thereof, the remote control system comprises a controlled apparatus and a remote controller. The controlled apparatus comprises a processing control system (121) and an instruction execution unit (125) in which at least a video capturing device (122,126) connected to the controlled apparatus is also included. At least a characteristic composition is included on the remote controller, at least a video capturing device (122,126) is used for collecting the characteristic composition on the remote controller the processing control system (121) is used for processing the collected characteristic composition images, parsing into the respective instructions, and giving the instruction execution unit (125) the instructions to execute.

Claims

1. A remote control system, comprises a controlled apparatus (120) and a remote controller (100), the controlled apparatus (120) comprises a processing control system (121) and an instruction execution unit (125), wherein, the remote control system further comprises at least a video capturing device (122) connected to the controlled apparatus (120);

at least a characteristic composition (111) is arranged on surface of the remote controller (110), the at least a video capturing device (122) is used for collecting the characteristic composition (111) on the remote controller (110);

the processing control system (121) is used for processing the collected characteristic composition (111) images, parsing into the corresponding instructions, and giving the instruction execution unit (125) the instructions to execute.

2. The remote control system according to claim 1, wherein, the processing control system (121) further comprises a characteristic composition extraction unit (123), and an instruction parsing unit (124);

the characteristic composition extraction unit (123) is used for identifying and processing the characteristic composition (111) image collected by the video capturing device (122), then obtaining a image position of the characteristic composition (111);

the instruction parsing unit (124) is used for generating instructions corresponding to the image position of the characteristic composition (111), and giving the instruction execution unit (125) the instructions to execute.

3. The remote control system according to claim 2, wherein, the controlled apparatus (120) further comprises a display used for indicating position of the remote controller (110);

the processing control system (121) further comprises a screen mapping unit used for mapping the image position of the characteristic composition (111) to screen position of the display.

4. The remote control system according to claim 2, wherein, the remote controller (110) further comprises at least a key, and a wireless transmitting apparatus (112), the controlled apparatus (120) further comprises a wireless receiving apparatus (128);

when the at least a key on the remote controller (110) is pressed, the wireless transmitting apparatus (112) transmits key number to the wireless receiving apparatus (128), and the instruction parsing unit (124) generates a corresponding instruction according to the key number.

5. The remote control system according to claim 2, wherein, the instruction parsing unit (124) is further used to generate a corresponding instruction according to moving track of the characteristic composition (111).

6. The remote control system according to claim 5, wherein, the moving track of the characteristic composition (111) is an image point sequence of the characteristic composition (111) extracted by the characteristic composition extraction unit (123).

7. The remote control system according to claim 5, wherein, the controlled apparatus (120) further comprises at least two video capturing devices (122), the processing control system (121) further comprises a 3D reconstructing unit (129) used for computing 3D space coordinates of the characteristic composition (111) according to the characteristic composition (111) images extracted by the characteristic composition extraction unit (123), the moving track of the characteristic composition (111) is a 3D space coordinate sequence of the characteristic composition (111) computed by the 3D reconstructing unit (129).

8. The remote control system according to claim 1, wherein, the video capturing device (122) is a common camera and the characteristic composition (111) is a centrosymmetric composition which is significantly different from an environmental image.

9. The remote control system according to according to claim 1, wherein, the video capturing device (122) is a camera provided with an infrared ray filter, and the characteristic composition (111) is a centrosymmetric body provided with infrared ray reflective coating.

10. A remote control method of an electronic device, the electronic device comprises a controlled apparatus (120) and a remote controller (100) with a characteristic composition (111) on its surface, the controlled apparatus (120) comprises a processing control system (121), an instruction execution unit (125) and at least a video capturing device (122) separately connected with the processing control system (121);

the remote control method comprises following steps;

A. collects characteristic composition (111) image on the remote controller (100), and transmits the characteristic composition (111) image to the processing control system (121) via the video capturing device (122);

B. identifies and processes image of the collected characteristic composition (111), parses the image of the collected characteristic composition (111) into corresponding instructions, and gives the instruction execution unit (125) the instructions via the processing control system (121);

C. executes the instructions provided by the processing control system (121) via the instruction execution unit (125).

11. The remote control method according to claim 10, wherein, the remote controller (110) further comprises a wireless transmitting apparatus (112), the controlled apparatus (120) further comprises a wireless receiving apparatus (128), wherein, the method comprises following steps:

B1) processes key instructions received by the wireless receiving apparatus (128), and transmits the key instructions to the instruction execution unit (125) to execute via the processing control system (121), wherein, the key instructions are transmitted by the remote controller (110) through its wireless transmitting apparatus (112).

12. The remote control method according to claim 10, wherein, the controlled apparatus (120) further comprises a display connected with the wireless transmitting apparatus (112), wherein, the method comprises following steps:

B2) identifies and processes image of the collected characteristic composition (111) by the processing control system (121);

B3) map the characteristic composition (111) to the screen of the display for displaying;

B4) parse into corresponding instructions according to the position of the remote controller mapped on the screen of the display and the trigger of the remote controller.

13. The remote control method according to claim 12, wherein, the method comprises following steps:

B5) identify and process image of the collected characteristic composition (111) collected by the video capturing device (122), and obtain image position of the characteristic composition (111);

B6) generate corresponding instructions according to the image positions of the characteristic composition (111), and transmit the instructions to the instruction execution unit (125) to execute.

14. The remote control method according to claim 12, wherein, the controlled apparatus (120) further comprises at least two video capturing devices (125), and the method comprises following steps:

extract image of the characteristic composition (111) from video images of the at least two video capturing devices (125) separately;

for extracted image of each characteristic composition (111), compute the 3D space coordinate of the characteristic composition (111);

represent moving track of the characteristic composition (111) by 3D space coordinate point sequence of the characteristic composition (111).

15. A remote control system, comprises a controlled apparatus (120) and a remote controller (100), the controlled apparatus (120) comprises a processing control system (121) and an instruction execution unit (125), wherein, the processing control system (121) further comprises a characteristic composition extraction unit (123), an instruction parsing unit (124), the characteristic composition extraction unit (123) is connected to a plurality of video capturing devices (122), extracts image of the characteristic composition from obtained video image, and processes and determines position of the extracted image the instruction parsing unit (124) is used for interpreting moving track of the characteristic composition extracted by the characteristic composition extraction unit (123) to corresponding instruction according to predetermined mapping relationship between the moving track of the characteristic composition and instruction and gives the instruction execution unit (125) the instruction to execute.

16. The remote control system according to claim 15, wherein, the instruction parsing unit (124) comprises an identifying unit which forms the characteristic composition images extracted by the characteristic extraction unit (123) into a sequence according to the time order, then identifies the moving track to corresponding motion mode.

17. The remote control system according to claim 15, wherein, the processing control system (121) further comprises a coordinate mapping unit (127), which is used to show the position of the remote controller on the display after computing according to moving position of the remote controller characteristic component obtained by the characteristic extraction unit (123) while the instruction parsing unit (124) is transmitting corresponding instruction.

18. The remote control system according to claim 17, wherein, the process of mapping the position of the remote controller from the image coordinate to the screen coordinate of the display is:

supposing the screen width is Width_scr, the height is Height_scr, then point (u,v) on the screen satisfies following conditions;

Width_scr, Height_scr are natural numbers, u is a nonnegative integer smaller than Width_scr, and v is a nonnegative integer smaller than Height_scr;

supposing the width of the imaging plane is Width_cam, the height is Height_cam, supposing the operation area of the remote controller is an area imaging in a certain rectangle, supposing the left top angular point is (x_ul, y_ul), and the right top angular point is (x_lr, y_lr), wherein, x_ul, y_ul, x_lr, y_lr are all integers, and 0≦

x_ul<

x_lr<

Width_scr, 0≦

y_ul<

y_lr<

Height_scr;

supposing the position of the remote controller in the imaging plane of the camera is (x_cam,y_cam), (x_scr,y_scr) the position is after mapping to the screen coordinate system, then the mapping relationship can be expressed as follows;

19. The remote control system according to claim 15, wherein, the remote controller (110) comprises a left key (310), a right key (320) and a signal transmitter (112) connected to the left key (310) and the right key (320), wherein, the controlled apparatus (120) comprises a wireless receiving apparatus (128) for receiving instruction transmitted from the wireless transmitting apparatus (112) on the remote controller (110), and transmitting the instruction to the processing control system (121) for processing.

20. The remote control system according to claim 15, wherein, the processing control system (121) further comprises a 3D reconstructing unit (129) arranged between the characteristic extraction unit (123) and the instruction parsing unit (124), and the 3D reconstructing unit (129) is used for 3D reconstructing the obtained moving track of the remote controller characteristic composition (111), then identifying control instruction from the 3D track position by the instruction parsing unit (124).