Hand pattern switch device

• US 20050063564A1
• Filed: 08/11/2004
• Published: 03/24/2005
• Est. Priority Date: 08/11/2003
• Status: Abandoned Application

• Current Assignee: Mitsubishi FUSO Truck & Bus Corporation (Daimler Truck Holding AG), KEIO University
• Original Assignee: Mitsubishi FUSO Truck & Bus Corporation (Daimler Truck Holding AG), KEIO University
• Inventors: Ozawa, Shinji, Yamamoto, Keiichi, Saito, Hideo, Sato, Hiromitsu, Igarashi, Hiroya
• Application Number:
  US10/915,952
• Publication Number:
  US 20050063564A1
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60R 25/2045 by hand gestures
• CPC Class Codes: E05F 15/00 Power-operated mechanisms for wings motor-operated accessories in locks for completing closing or initiating opening of a wing E05B17/00
• CPC Class Codes: E05Y 2400/86 by hand
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A hand pattern switch device capable of easily and reliably detecting a hand pattern or a palm motion of an operator. From a picked-up image of a distal arm, an axis passing through the centroid of a hand is determined as a central axis passing through the center of arm. At least either first scanning lines perpendicular to the central axis or second scanning lines extending along the central axis are set between a fingertip and a palm center. While changing the scanning line to be examined from the fingertip side toward the palm center, a determination is made to determine how many number of scanning lines for each of which a finger width equal to or larger than a predetermined width is detected are present, thereby making a detection of whether or not the finger is extended from the palm.

Claims

1. A hand pattern switch device having image pickup means for picking up an image of a distal arm that is within a predetermined image pickup zone, and detecting a hand pattern and/or a motion of a finger of a hand from the image picked up by the image pickup means to obtain predetermined switch operation information, comprising:

first image processing means for determining a central axis passing through a center of the arm based on the picked-up image;

scanning line setting means for setting at least either a first scanning line extending perpendicular to the central axis or a second scanning line extending along the central axis; and

determination means for determining whether or not any finger of the hand is extended based on the at least either the first or second scanning line set by the scanning line setting means.

2. The hand pattern switch device according to claim 1, wherein said determination means includes function selection means for detecting projection and withdrawal of a particular finger of the hand and for cyclically selecting and specifying one of the controlled objects each time when the projection or withdrawal of the particular finger is detected, and equipment operation means for providing a control amount for the controlled object specified by said function selection means in accordance with a predetermined hand pattern and/or a motion of the hand with such hand pattern.

3. The hand pattern switch device according to claim 2, wherein said equipment operation means varies the control amount to be provided to the controlled object in accordance with an amount of hand motion from a reference position to right and left and/or a stop time at a destination of motion.

4. The hand pattern switch device according to claim 2, wherein said function selection means and said equipment operation means are caused to stop selecting and specifying the one of the controlled objects and to stop providing the control amount to the controlled object when said determination means detects that a clenched-fist pattern in which all fingers are bent into a palm is maintained for a predetermined time or more, and determines that completion of operation is instructed.

5. The hand pattern switch device according to claim 2, wherein said predetermined hand pattern includes a clenched-fist pattern in which all fingers are bent into a palm, a finger-up pattern in which only a forefinger is extended, a pattern in which only a thumb finger is extended horizontally, and an L-shaped pattern in which the forefinger and the thumb finger are extended.

6. The hand pattern switch device according to claim 2, wherein said particular finger is a thumb finger, said predetermined hand pattern is a finger-up pattern in which only a forefinger is extended, and said equipment operation means detects a left and right motion of the finger-up pattern.

7. The hand pattern switch device according to claim 1, wherein said image pickup means is a camera installed at a ceiling above a driver'"'"'s seat of a vehicle.

8. The hand pattern switch device according to claim 2, further comprising a guidance function to provide confirmation sound when one of the controlled objects is selected by said function selection means.

9. The hand pattern switch device according to claim 7, wherein said image pickup zone is located at a position to which a driver can extend his/her arm without changing a driving posture while resting the arm on an arm rest provided laterally to the driver'"'"'s seat of the vehicle and without a driver'"'"'s hand being touched to an operating section of a console provided in the vehicle.

10. The hand pattern switch device according to claim 1, wherein said image processing means includes a binarization processing means for subjecting the picked-up image to binarization processing, and centroid detecting means for determining a centroid of the picked-up image having been subject to the binarization processing, and

the central axis passing through the center of the arm in the image is determined as an axis passing through the centroid of the image.

11. The hand pattern switch device according to claim 10, wherein the first scanning line is set in plural numbers between a side of the distal arm and the centroid, and

second image processing means is provided which determines a scanning line for which a width of the distal arm having been subject to the binarization processing becomes maximum, and determines a point of intersection between the just-mentioned scanning line and the central axis as a palm center.

12. The hand pattern switch device according to claim 1, wherein said scanning line setting means sets both the first and second scanning lines, and

said determination means determines whether or not a forefinger is extended by using the first scanning line, and determines whether or not a thumb finger is extended by using the second scanning line.

13. The hand pattern switch device according to claim 12, wherein said scanning line setting means sets the second scanning line to be inclined at an angle of about 10 degrees with respect to the central axis.

14. The hand pattern switch device according to claim 13, wherein said determination means determines that a finger of the hand is extended from the palm when a number of scanning lines for each of which a finger width equal to or larger than a predetermined width is detected is equal to or larger than a predetermined number.

15. The hand pattern switch device according to claim 14, wherein said predetermined width is {fraction (1/7)} to ¼

or more of the width detected in the scanning line passing through the palm center.