Operating input device for reducing input error

• US 8,363,010 B2
• Filed: 03/21/2008
• Issued: 01/29/2013
• Est. Priority Date: 03/23/2007
• Status: Active Grant

• Current Assignee: DENSO Corporation
• Original Assignee: DENSO Corporation
• Inventors: Nagata, Takashi
• Primary Examiner(s): Moon, Seokyun
• Application Number:
  US12/076,757
• Publication Number:
  US 20080231608A1
• Time in Patent Office: 1,775 Days
• Field of Search: 345156-158, 345/173, 345/175
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

An operating input device is provided in which input errors can be prevented. A finger area image is extracted from an image captured by a camera. A fingertip area is extracted from a difference image generated between the finger area image and a shifted image. A fingertip position is detected from the fingertip area based on a center of mass. A semitransparent fingertip image is superimposed on the menu image. Manual operation buttons coinciding with fingertip positions are displayed in an emphasized manner. An actual position of a finger press is shifted to coincide with a manual operation button position and the manual operation button is considered to be pressed.

Claims

1. An input device receiving a first signal from a touch panel indicating an actual input position of a finger press and a second signal from an imaging device for capturing an image of the finger on the touch panel, the first and second signal used to reduce input errors based on visual feedback provided on a display, the input device comprising:

a finger area extraction unit for extracting a finger area image from an image captured by the imaging device;

a fingertip position detection unit for detecting a fingertip position of the finger based on the finger area image; and

an image synthesis unit for synthesizing the finger area image and superimposing the finger area image on a menu image, the finger area image and the menu image displayed such that both the finger area image and the menu image are viewable on the display,

wherein the fingertip position detection unit obtains a finger-tip only image separated from a shifted image as a difference between the finger area image and the shifted image obtained by shifting the finger area image toward the base of fingers and extracts a fingertip position relative to a fingertip area image,

wherein the fingertip position detection unit detects the fingertip position based on a center of mass of the fingertip area image,

wherein the fingertip position detection unit detects the fingertip position based on a position associated with the fingertip area image that is shifted by a predetermined distance from the center of mass toward the base of fingers.

2. The operating input device of claim 1,

wherein the fingertip position detection unit carries out a contraction computation on the fingertip area image to delete portions of the fingertip area image that do not correspond to a fingertip.

3. The operating input device of claim 1,

wherein the fingertip position detection unit smoothes the fingertip area image to delete portions thereof that do not correspond to a fingertip.

4. The operating input device of claim 1,

wherein the captured image is captured by the imaging device from a backside of the touch panel, the fingertip position detection unit establishing as a reference point for the fingertip position, coordinates of a lightest pixel in the fingertip area image.