TERMINAL DEVICE

• US 20090267893A1
• Filed: 04/22/2009
• Published: 10/29/2009
• Est. Priority Date: 04/23/2008
• Status: Active Grant

• Current Assignee: KDDI Corporation
• Original Assignee: KDDI Corporation
• Inventors: Kato, Haruhisa, Yoneyama, Akio
• Granted Patent: US 8,259,064 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0338 Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

An operation estimating portion 2 estimates an input operation on the basis of motions of a nail and a finger which are shot, the directions, the number thereof or others. On the basis of estimation results of the input operation, a controller 3 controls display content on a display 4 and an application now in execution. The operation estimating portion 2 includes a skin region extractor 21 for extracting a skin region (first region) containing a nail region (second region) from a shot image, a nail region extractor 22 for extracting the nail region from the thus extracted skin region, and a motion detector 23 for following up a temporal change in the thus extracted nail region to detect motions of the nail region, thereby estimating the input operation on the basis of detection results of the motion detector 23.

Claims

1. A terminal device which is provided with a camera for shooting a subject continuously and a display,

the terminal device including:

first feature extraction means for extracting a feature from a shot image,

first region extraction means for applying the extracted feature to a first learning model to extract a first region,

second region extraction means for applying a feature of the first region to a second learning model to extract a second region which is a part of the first region,

motion detection means for detecting motions of the second region, and

control means for controlling the terminal device on the basis of the detected motions.

2. The terminal device as set forth in claim 1, wherein the motion detection means includes at least any one of counter for detecting the number of second regions, scaling detection means for detecting the scaling of a second region, moving detection means for detecting the moving of the second region, and direction detection means for detecting the direction of the second region.

3. The terminal device as set forth in claim 2, wherein the control means allows an object on the display to move depending on the motion of the second region.

4. The terminal device as set forth in claim 3, wherein the number of second regions is allocated to an axis which is used as a reference for moving the object.

5. The terminal device as set forth in claim 4, wherein the first number of the second region is allocated to the x axis, the second number of the second region is allocated to the y axis, and the third number of the second region is allocated to the z axis.

6. The terminal device as set forth in claim 2, wherein the control means controls a color tone of the display, depending on motions of the second region.

7. The terminal device as set forth in claim 6, wherein the number of the second regions is allocated to a color component to be controlled.

8. The terminal device as set forth in claim 2, wherein the terminal device is provided with a speaker, and

the control means controls sound output from the speaker on the basis of motions of the second region.

9. The terminal device as set forth in claim 8, the number of the second regions is allocated to a frequency range to be controlled.

10. The terminal device as set forth in claim 9, wherein the first number of the second region is allocated to a magnitude of sound.

11. The terminal device as set forth in claim 1, wherein the first region is a region of the skin and the second region is a region of the nail.