INFORMATION PROCESSING APPARATUS, METHOD, AND STORAGE MEDIUM

• US 20120069169A1
• Filed: 08/18/2011
• Published: 03/22/2012
• Est. Priority Date: 08/31/2010
• Status: Abandoned Application

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Dejima, Tatsuya
• Application Number:
  US13/212,378
• Publication Number:
  US 20120069169A1
• Time in Patent Office: Days
• US Class Current: 348/77
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

An image capturing unit 12 captures an image of a finger 31 of a user performing a press operation within a virtual input device area associated with a predetermined input device, the virtual input device being formed on a top surface of a desk or the like, and outputs data of the captured image data. A sound input unit 13 inputs a sound generated from the virtual input device area on which a press operation is performed by a user'"'"'s finger and outputs data of the sound. A touch operation detection unit 51 detects a press operation by the user'"'"'s finger on the virtual input device area based on the captured image data outputted from the image capturing unit 12 and the sound data outputted from the sound input unit 13. An input processing unit 53 inputs predetermined information based on the detection result of the touch operation detection unit 51.

Claims

1. An information processing apparatus that regards a predetermined surface as a virtual input device area, and inputs predetermined information when a user performs a touch operation of causing a finger to touch the virtual input device area, the information processing apparatus, comprising:

an image capturing unit that captures an image of the surface where the virtual input device area is formed and outputs data of the captured image;

an identification information detection unit that detects identification information indicative of a state of contact of the finger of the user with the virtual input device area;

a touch operation detection unit that detects the touch operation on a predetermined area of the virtual input device area, based on the data of the captured image outputted from the image capturing unit, and the identification information detected by the identification information detection unit; and

an information input unit that inputs the predetermined information based on a detection result of the touch operation detection unit.

2. An information processing apparatus as set forth in claim 1, further comprising:

a specification information storing unit that stores specification information specifying a position of the virtual input device area in the captured image, wherein

the touch operation detection unit detects the predetermined area that is a target of the touch operation based on a relative position of a finger of the user in the captured image, and the specification information stored in the specification information storing unit, and

detects that the touch operation is performed on the predetermined area by detecting contact of the finger of the user with the surface based on the identification information detected by the identification information detection unit when, or before or after, the captured image is captured.

3. An information processing apparatus as set forth in claim 1, wherein

the identification information detection unit includes a unit that inputs sound generated as a result of contact of the finger of the user with the virtual input device area, and detects data of the sound as the identification information.

4. An information processing apparatus as set forth in claim 3, wherein

the touch operation detection unit detects contact of the finger of the user with the surface by detecting that a sound level of at least one frequency band is greater than or equal to a threshold, based on data of the sound detected as the identification information by the identification information detection unit.

5. An information processing apparatus as set forth in claim 2, wherein

the touch operation detection unit detects a position where the finger has stopped as the predetermined area, by detecting that the finger has stopped after moving at a speed equal to or more than a predetermined speed for a time period equal to or more than a predetermined time period, based on the data of the captured image that is continuous in time.

6. An information processing method of an information processing apparatus that regards a predetermined surface as a virtual input device area, and inputs predetermined information when a user performs a touch operation of causing a finger to touch the virtual input device area,

the information processing apparatus being provided with an image capturing unit that captures an image of the surface where the virtual input device area is formed and outputs data of the captured image, the information processing method comprising the steps of:

an identification information detection step of detecting identification information capable of identifying whether or not the finger of the user has touched the virtual input device area;

a touch operation detection step of detecting the touch operation on a predetermined area of the virtual input device area, based on the data of the captured image outputted by the image capturing unit, and the identification information detected in the identification information detection step; and

an information input step of inputting the predetermined information based on a detection result of the touch operation detection step.

7. A storage medium readable by a computer used in an information processing that regards a predetermined surface as a virtual input device area, and inputs predetermined information when a user performs a touch operation of causing a finger to touch the virtual input device area, and that has an image capturing unit that captures an image of the surface where the virtual input device area is formed and outputs data of the captured image, the storage medium having stored therein a program executable by the computer to function as:

an identification information detection unit that detects identification information indicative of a state of contact of the finger of the user with the virtual input device area;

a touch operation detection unit that detects the touch operation on a predetermined area of the virtual input device area, based on the data of the captured image outputted from the image capturing unit, and the identification information detected by the identification information detection unit; and

an information input unit that inputs the predetermined information based on a detection result of the touch operation detection unit.