USER INTERFACE SYSTEM BASED ON POINTING DEVICE

• US 20090251559A1
• Filed: 06/11/2009
• Published: 10/08/2009
• Est. Priority Date: 11/20/2002
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: DEKKER, TIM, MEKENKAMP, GERHARDUS ENGBERTUS
• Granted Patent: US 8,537,231 B2
• Time in Patent Office: Days
• US Class Current: 348/222.100
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 2201/61 Password, biometric
• CPC Class Codes: G08C 2201/71 Directional beams
• CPC Class Codes: G08C 2201/92 Universal remote control
• CPC Class Codes: G08C 2201/94 Smart cards

Abstract

The user interaction system comprises a portable pointing device (101) connected to a camera (102) and sending pictures to a digital signal processor (120), capable of recognizing an object (130) and a command given by the user (100) by moving the pointing device (101) in a specific way, and controlling an electrical apparatus (110) on the basis of this recognition. (Characteristic) pattern generation means (116) can be included in the system for facilitating object recognition.

Claims

1. User interaction system, comprising:

an electrical apparatus (110);

a portable pointing device (101, 300) operable by a user for pointing to a region in space;

a camera (102) taking a picture; and

a digital signal processor (120), capable of receiving and processing the picture, and capable of transmitting user interface information (I) derived from the picture to the electrical apparatus (1 10),

wherein the camera (102) is connected to the pointing device (101, 300) so that in operation it images the region pointed to characterized in that the user interaction system further comprises a pattern creation means (116) to exhibit a characteristic pattern that is created for identification purpose by the pointing device of the pattern creation means associated apparatus.

2. The user interaction system as in claim 1, wherein the digital signal processor (120) is further arranged to recognize the direction of the pointer relative to the localization beacon.

3. The user interaction system as in claim 1, further comprising motion sensing means (304) for enabling estimating a motion or a motion trajectory (400, 410) of the pointing device.

4. The user interaction system as in claim 1, wherein the motion or the motion trajectory (400, 410) of the pointing device is estimated on basis of successive pictures imaged by the camera (102) at respective instances of time.

5. User interaction system as claimed in claim 2, wherein the transmitted user interface information (I) includes at least one feature selected from the group consisting of motion speed, and motion direction of the pointing device (101).

6. User interaction system as claimed in claim 3, wherein the transmitted user interface information (I) includes at least one feature selected from the group consisting of motion trajectory (400) of the pointing device (101) and a characteristic signature derived from the motion trajectory (400) of the pointing device (101).

7. User interaction system as claimed in claim 1, wherein the pointing device (101) further comprises feedback means for providing the user with additional information.

8. User interaction system as claimed in claim 7, wherein said feedback means is selected from the group consisting of light (312), sound (314), a display (316) and force feedback means (306).

9. User interaction system as in claim 1, wherein the user interface information (I) comprises apparatus control data for controlling operation of the electrical apparatus (110).

10. Pointing device (101, 300) for use in a user interaction system as in claim 1, characterized in that it comprises the digital signal processor (120) and a camera (102) and wherein the pointing device is capable of sending a picture to the digital signal processor (120).

11. Pointing device (101, 300) as in claim 10, comprising a characteristic projector (320) for optically projecting a characteristic pattern towards a region pointed to.

12. Pointing device (101, 300) as in claim 1, comprising a programmable user interface code generator (309) and a wireless transmitter (310) for transmitting the code to the electrical apparatus (110).

13. Electrical apparatus (110) for use in a user interaction system as in claim 1, characterized in that interface means are comprised which allow the electrical apparatus (110) to send information about supported commands to a pointing device (101, 300) based on an “

identify supported commands”

call of the pointing device (101, 300) to the electrical apparatus (110).