Method and apparatus for controlling device using three-dimensional pointing

• US 20050225453A1
• Filed: 01/28/2005
• Published: 10/13/2005
• Est. Priority Date: 04/10/2004
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yang, Jing, Cho, Joon-kee, Chang, Wook, Bang, Won-chul, Cho, Sung-jung, Choi, Eun-seok, Kim, Dong-yoon, Oh, Jong-koo, Kang, Kyoung-ho
• Application Number:
  US11/044,059
• Publication Number:
  US 20050225453A1
• Time in Patent Office: Days
• US Class Current: 340/825.690
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 2201/40 Remote control systems using repeaters, converters, gateways
• CPC Class Codes: G08C 2201/91 Remote control based on location and proximity

Abstract

A method for controlling a predetermined control-targeted device using three dimensional pointing, wherein the method includes: calculating position information of a controlling apparatus; calculating attitude information of a controlling apparatus; calculating sight line information of the controlling apparatus by using the position information and the attitude information of the controlling apparatus; selecting the predetermined control-targeted device by using the sight line information of the controlling apparatus; and controlling the selected control-targeted device.

Claims

1. A method for controlling a control-targeted device using a three dimensional pointing, the method comprising:

calculating position information of a controlling apparatus;

calculating attitude information of the controlling apparatus;

calculating sight line information of the controlling apparatus based on the position information and the attitude information of the controlling apparatus;

selecting the control-targeted device based on the sight line information of the controlling apparatus; and

controlling the control-targeted device.

2. The method of claim 1, wherein in the calculating the position information, a wireless communication protocol Ultra Wide Band is used to calculate the position information of the controlling apparatus.

3. The method of claim 1, wherein the calculating of the attitude information comprises:

calculating a roll angle φ and

a pitch angle θ

of the controlling apparatus based on the following equation;

$\left[\begin{array}{c}\mathrm{\varphi <br><br>}\\ \mathrm{\theta <br><br>}\end{array}\right]=\left[\begin{array}{c}\arctan <br><br>\text{\hspace{1em}<br><br>}<br><br>2<br><br>\left(-A_{\mathrm{by}}^s,-A_{\mathrm{bz}}^s\right)\\ \arctan <br><br>\text{\hspace{1em}<br><br>}<br><br>2<br><br>(A_{\mathrm{bx}}^s,\sqrt{{\left(A_{\mathrm{by}}^s\right)}^2+{\left(A_{\mathrm{bz}}^s\right)}^2}\end{array}\right]$

where A_s^bx, A_s^by, A_s^bz are gravitational acceleration measured on a X-axis, a Y-axis, and a Z-axis; and

calculating a Yaw angle of the controlling apparatus based on the following equation;

$\begin{array}{c}\left[\begin{array}{c}{M}_{\mathrm{nx}}\\ M_{\mathrm{ny}}\\ M_{\mathrm{nz}}\end{array}\right]=\left[\begin{array}{ccc}\cos <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\theta <br><br>}& \sin <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\theta <br><br>}<br><br>\text{\hspace{1em}<br><br>}<br><br>\sin <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\varphi <br><br>}& \sin <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\theta <br><br>cos}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\varphi <br><br>}\\ 0& \cos <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\varphi <br><br>}& -\sin <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\varphi <br><br>}\\ -\sin <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\theta <br><br>}& \cos <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\theta <br><br>sin\varphi <br><br>}& \cos <br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\theta <br><br>cos\varphi <br><br>}\end{array}\right]<br><br>\left[\begin{array}{c}{M}_{\mathrm{bx}}\\ M_{\mathrm{by}}\\ M_{\mathrm{bz}}\end{array}\right]<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{and}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{\Psi <br><br>}\\ ={\tan }^{-1}<br><br>\left(\begin{array}{c}-M_{\mathrm{ny}}\\ M_{\mathrm{nx}}\end{array}\right)\end{array}$

where M_bx, M_by, M_bz are X-axis, Y-axis and Z-axis terrestrial magnetism values of the controlling apparatus measured in a three-axis terrestrial magnetism sensor, and M_nx, M_ny, M_nz are terrestrial magnetism values of the measured terrestrial magnetism values on a navigation frame.

4. The method of claim 1, wherein the selecting the control-targeted device comprises:

receiving position information of the control-targeted device;

calculating a distance between a sight line of the controlling apparatus and the control-targeted device based on the position information of the control-targeted device; and

selecting the control-targeted device that is positioned at a closest distance to the controlling apparatus among distances between a plurality of control-targeted devices and the controlling apparatus.

5. The method of claim 1, wherein the selecting the control-targeted device comprises:

receiving the position information of the control-targeted device;

calculating a distance between a sight line of the controlling apparatus and the control-targeted device based on the position information of the control-targeted device;

selecting candidate control-targeted devices positioned within a predetermined distance from a sight line of the controlling apparatus; and

selecting the control-targeted device, which a user intends to control, among the candidate control-targeted devices.

6. The method of claim 5, wherein the selecting the control-targeted device among the candidate control-targeted devices comprises:

measuring a motion of the controlling apparatus; and

selecting the control-targeted device corresponding to the measured motion of the controlling apparatus, among the candidate control-targeted devices.

7. The method of claim 5, further comprising displaying the candidate control-targeted devices on a display unit of the controlling apparatus.

8. The method of claim 7, wherein the selecting the control-targeted device among the candidate control-targeted devices further comprises displaying a control-targeted device corresponding to the measured motion of the controlling apparatus, among the candidate control-targeted devices, on the display unit of the controlling apparatus.

9. The method of claim 1, wherein the controlling the control-targeted device comprises:

recognizing a predetermined motion pattern of the controlling device;

generating a control signal corresponding to the predetermined motion pattern of the controlling apparatus; and

transmitting the control signal to the control-targeted device.

10. The method of claim 1, wherein the controlling the control-targeted device comprises:

obtaining functions corresponding to the control-targeted device;

displaying the functions on a display unit of the controlling apparatus;

selecting a specific function among the functions displayed on the display unit;

generating a control signal corresponding to the specific function; and

transmitting the control signal to the control-targeted device.

11. The method of claim 9, wherein in the transmitting the control signal, if there is not an obstacle between the controlling apparatus and the selected control-targeted device and the control-targeted device is controlled using the same type of communication used by the controlling apparatus, the control signal is directly transmitted to the control-targeted device.

12. The method of claim 10, wherein in the transmitting the control signal, if there is not an obstacle between the controlling apparatus and the control-targeted device and the control-targeted device is controlled using the same type of communication used by the controlling apparatus, the control signal is directly transmitted to the control-targeted device.

13. The method of claim 9, wherein the transmitting the control signal comprises:

transmitting the control signal to a remote controller which is separate from the controlling apparatus if there is an obstacle between the controlling apparatus and the control-targeted device; and

transmitting the control signal from the remote controller to the control-targeted device.

14. The method of claim 10, wherein the transmitting the control signal comprises:

transmitting the control signal to a remote controller separate from the controlling apparatus if there is an obstacle between the controlling apparatus and the control-targeted device; and

transmitting the control signal from the remote controller to the control-targeted device.

15. The method of claim 9, wherein the transmitting the control signal comprises:

transmitting the control signal to a remote controller separate from the controlling apparatus if the control-targeted device and the controlling apparatus utilize different types of communication;

converting the control signal into a converted control signal corresponding to a communication type of the control-targeted device; and

transmitting the converted control signal to the control-targeted device.

16. The method of claim 10, wherein the transmitting the control signal comprises:

transmitting the control signal to a remote controller separate from the controlling apparatus if the selected control-targeted device and the controlling apparatus utilize different types of communication;

converting the control signal into a converted control signal corresponding to a communication type of the control-targeted device; and

transmitting the converted control signal to the control-targeted device.

17. An apparatus for controlling a control-targeted device using a three dimensional pointing, the apparatus comprising:

a position calculating unit which calculates position information of a controlling apparatus;

an attitude calculating unit which calculates attitude information of the controlling apparatus;

a sight-line calculating unit which calculates sight-line information of the controlling apparatus based on the position information and the attitude information of the controlling apparatus;

a control-targeted device selecting unit which selects the control-targeted device based on the sight line information of the controlling apparatus; and

a controlling unit which controls the control-targeted device.

18. The apparatus of claim 17, wherein the position calculating unit uses a wireless communication protocol Ultra Wide Band to calculate the position information of the controlling apparatus.

19. The apparatus of claim 17, wherein the control-targeted device selecting unit comprises:

a storage media which stores the position information of the control-targeted device;

a distance calculating unit which calculates a distance from a sight line of the controlling apparatus to the control-targeted device based on the position information of the control-targeted device; and

a control-targeted device detecting unit which detects a control-targeted device disposed at a closest distance from the sight line of the controlling apparatus based on the distance calculated by the distance calculating unit.

20. The apparatus of claim 17, wherein the attitude calculating unit comprises:

a sensor unit which measures an attitude value of the controlling apparatus; and

a processor unit which calculates the attitude information of the controlling apparatus based on the measure attitude value.

21. The apparatus of claim 20, wherein the sensor unit comprises a three-axis acceleration sensor and a three-axis terrestrial magnetism sensor.

22. The apparatus of claim 17, wherein the controlling unit comprises:

a display unit which displays a control state of the controlling apparatus;

a storage media which stores functions of a plurality of control-targeted devices and control signal data corresponding to the functions;

a control signal generating unit which generates a control signal based on the control signal data corresponding to a predetermined function of the control-targeted device; and

a processor unit which controls the display unit, the storage media and the control signal generating unit.

23. A system for controlling a control-targeted device using a three dimensional pointing, the system comprising:

a controlling apparatus; and

a home server which stores position information of the control-targeted device,

wherein the controlling apparatus comprises;

a position calculating unit which calculates position information of the controlling apparatus;

an attitude calculating unit which calculates attitude information of the controlling apparatus;

a sight-line calculating unit which calculates sight-line information of the controlling apparatus based on the position information and the attitude information of the controlling apparatus;

a control-targeted device selecting unit which selects the control-targeted device based on the sight line information of the controlling apparatus; and

a controlling unit which controls the control-targeted device.

24. A system for controlling a control-targeted device using a three dimensional pointing, the system comprising:

a controlling apparatus which selects and controls a control-targeted device based on position information of the control-targeted device and sight-line information of the controlling apparatus pointing the control-targeted device;

a home server which stores the position information of the control-targeted device; and

a remote controller which receives a control signal generated by the controlling apparatus and transmits the control signal to the control-targeted device.

25. The system of claim 24, wherein the remote controller converts the control signal into a converted control signal that can be received by the control-targeted device and transmits the converted signal to the control-targeted device.