Terminal device

• US 8,259,064 B2
• Filed: 04/22/2009
• Issued: 09/04/2012
• Est. Priority Date: 04/23/2008
• Status: Expired due to Fees

• Current Assignee: KDDI Corporation
• Original Assignee: KDDI Corporation
• Inventors: Kato, Haruhisa, Yoneyama, Akio
• Primary Examiner(s): Sniezek, Andrew L
• Application Number:
  US12/428,087
• Publication Number:
  US 20090267893A1
• Time in Patent Office: 1,231 Days
• Field of Search: None
• US Class Current: 345/158
• CPC Class Codes: G06F 2203/0338 Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

An operation estimating portion estimates an input operation on the basis of motions of a nail and a finger which are shot, the directions, the number thereof or others. On the basis of estimation results of the input operation, a controller controls display content on a display and an application now in execution. The operation estimating portion includes a skin region extractor for extracting a skin region (first region) containing a nail region (second region) from a shot image, a nail region extractor for extracting the nail region from the thus extracted skin region, and a motion detector for following up a temporal change in the thus extracted nail region to detect motions of the nail region, thereby estimating the input operation on the basis of detection results of the motion detector.

Claims

1. A terminal device which is provided with a camera for shooting a subject continuously and a display,

the terminal device including:

first feature extraction means for extracting a feature from a shot image,

skin region extraction means for applying the extracted feature to a first learning model to extract a skin region,

nail region extraction means for applying a feature of the skin region to a second learning model to extract at least one nail region which is a part of the skin region,

motion detection means for detecting motions of the nail region, and

control means for controlling the terminal device on the basis of the detected motions.

2. The terminal device as set forth in claim 1, wherein the motion detection means includes at least any one of a counter for detecting a number of the nail region, scaling detection means for detecting a scaling of the nail region, moving detection means for detecting movement of the nail region, and direction detection means for detecting a direction of the movement of the nail region.

3. The terminal device as set forth in claim 2, wherein the control means allows an object on the display to move depending on the movement of the nail region.

4. The terminal device as set forth in claim 3, wherein the number of the nail region is allocated to an axis which is used as a reference for moving the object.

5. The terminal device as set forth in claim 4, wherein a first number of the nail region is allocated to the x axis, a second number of the nail region is allocated to the y axis, and a third number of the nail region is allocated to the z axis.

6. The terminal device as set forth in claim 2, wherein the control means controls a color tone of the display, depending on the movement of the nail region.

7. The terminal device as set forth in claim 6, wherein the number of the nail region is allocated to a color component to be controlled.

8. The terminal device as set forth in claim 2, wherein the terminal device is provided with a speaker, and

the control means controls sound output from the speaker on the basis of the movement of the nail region.

9. The terminal device as set forth in claim 8, a first number of the nail region is allocated to a frequency range, and a second number of the nail region is allocated to a magnitude of sound to be controlled.