USER INTERFACE APPARATUS AND USER INTERFACING METHOD BASED ON WEARABLE COMPUTING ENVIRONMENT

• US 20110148755A1
• Filed: 12/16/2010
• Published: 06/23/2011
• Est. Priority Date: 12/18/2009
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: JEONG, Hyun-Tae, LEE, Dong-Woo, SON, Yong-Ki, CHO, Il-Yeon, LIM, Jeong-Mook
• Application Number:
  US12/970,354
• Publication Number:
  US 20110148755A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

Provided is a user interface apparatus based on wearable computing environment, which is worn on a user, including: a sensor unit including at least one sensor worn on the user and outputting a plurality of sensing signals according to a positional change of a user'"'"'s arm or a motion of a user'"'"'s finger; and a signal processing unit outputting a user command corresponding to the 3D coordinates of the user'"'"'s arm and the motion of the user'"'"'s finger from the plurality of sensing signals output from the sensor unit and, controlling an application program running in a target apparatus using the user command.

Claims

1. A user interface apparatus based on wearable computing environment comprising:

a sensor unit including at least one sensor worn on a user and, outputting a plurality of sensing signals according to a positional change of a user'"'"'s arm or a motion of a user'"'"'s finger; and

a signal processing unit outputting a user command corresponding to a 3D coordinates of the user'"'"'s arm and the motion of the user'"'"'s finger from the plurality of sensing signals output from the sensor unit and, controlling an application program running in a target apparatus using the user command.

2. The user interface apparatus of claim 1, wherein:

the plurality of sensing signals include a first sensing signal and a second sensing signal, and the sensor unit includes;

at least one motion sensor disposed in the vicinity of an elbow and outputting a first sensing signal according to the positional change of the user'"'"'s arm; and

a finger motion sensor disposed to be adjacent to the at least one motion sensor, sensing the motion of the user'"'"'s finger, and outputting a second sensing signal.

3. The user interface apparatus of claim 2, wherein:

the at least one motion sensor is implemented by at least one of acceleration sensor, geomagnetic sensor, and gyro sensor.

4. The user interface apparatus of claim 2, wherein:

the finger motion sensor is implemented by at least one of electromyogram sensor, piezo-electric sensor, and optical signal sensor.

5. The user interface apparatus of claim 2, wherein:

the finger motion sensor is disposed on a wrist of the user.

6. The user interface apparatus of claim 1, wherein:

the sensor unit is worn on both arms and output the plurality of sensing signals according to positional changes of both arms and motions of fingers of both hands.

7. The user interface apparatus of claim 1, wherein:

the signal processing unit includes

a previous-position storing unit having a previous position coordinates of the user'"'"'s arm stored therein; and

a coordinate calculating unit calculating a position displacement of the user'"'"'s arm from the plurality of sensing signals and the previous position coordinates and, calculating the 3D coordinates according to the current position of the user'"'"'s arm by using the position displacement.

8. The user interface apparatus of claim 7, wherein:

the signal processing unit further includes a correction unit correcting the plurality of sensing signals for correcting shaking of the user'"'"'s arm or hand.

9. The user interface apparatus of claim 1, wherein:

the signal processing unit includes;

a command storing unit having a plurality of commands stored therein; and

a command extracting unit extracting one command from among the plurality of commands according to the plurality of sensing signals and, outputting the extracted one command as a user command.

10. The user interface apparatus of claim 1, wherein:

the user interface apparatus is worn on a plurality of users and

the plurality of users control the application program running in the target apparatus in cooperation with each other by using the user interface apparatus.

11. The user interface apparatus of claim 10, wherein:

the target apparatus includes a session managing unit and a message managing unit for controlling the application program according to the 3D coordinates and the user commands output from the individual user interface apparatuses of the plurality of users.

12. A user interfacing method based on wearable computing environment comprising:

sensing a positional change of a user'"'"'s arm or a motion of a user'"'"'s finger to output a first sensing signal and a second sensing signal;

calculating a 3D coordinates according to a current position of the user'"'"'s arm from the first sensing signal;

outputting a user command corresponding to the motion of the user'"'"'s finger from the second sensing signal at the 3D coordinates; and

controlling an application program running in a target apparatus according to the 3D coordinates and the user command.

13. The user interfacing method of claim 12, wherein:

the calculating of the 3D coordinates includes

calculating a position displacement of the user'"'"'s arm according to the first sensing signal from the stored previous position coordinates of the user'"'"'s arm; and

calculating the 3D coordinates according to the current position of the user'"'"'s arm from the previous position coordinates by using the position displacement.

14. The user interfacing method of claim 13, wherein:

the calculating of the 3D coordinates further includes correcting the first sensing signal for correcting shaking of the user'"'"'s arm.

15. The user interfacing method of claim 12, wherein:

the outputting the user command includes

extracting one command according to the second sensing signal from among the plurality of commands stored; and

outputting the extracted one command as the user command.

16. The user interfacing method of claim 12, wherein:

the sensing the positional change includes

sensing the position of the user'"'"'s arm according to a movement and, outputting the first sensing signal; and

sensing the motion of the user'"'"'s finger according to a movement and, outputting the second sensing signal.