Human interface system using a plurality of sensors

• US 6,583,723 B2
• Filed: 08/29/2001
• Issued: 06/24/2003
• Est. Priority Date: 02/23/2001
• Status: Expired due to Term

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Watanabe, Kazuhiro, Watanabe, Masaki, Murase, Kentaro, Noda, Takuya
• Primary Examiner(s): Wu, Daniel J.
• Assistant Examiner(s): TANG, SON M
• Application Number:
  US09/940,661
• Publication Number:
  US 20020118232A1
• Time in Patent Office: 664 Days
• Field of Search: 340/573.1, 340/517, 340/523, 340/407.1, 340/5.83, 340/5.84, 340/5.81, 345/863, 345/978, 345/328, 345/208, 345/358, 345/184, 345/522, 345/520, 345/104, 345/107, 345/156
• US Class Current: 340/573.1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

An image sensor, a voice sensor, an auxiliary sensor part (infrared sensor, etc.), a total analyzing part, and an application communicate with each other through data/control signal communication units. Each sensor provides feedback on its signal detection results and control information used by the other sensors for determining a range of a detection target and a detection sensitivity at a time of subsequent signal acquisition, to the other sensors through the communication units. The total analyzing part investigates whether or not there is inconsistency among the results detected by the respective sensors, and provide control information to each sensor. Each sensor determines a range of a signal detection target and a detection sensitivity based on the obtained information, and acquires a signal in accordance with the determination.

Claims

1. A human interface system using a plurality of sensors, comprising:

at least two kinds of sensors, each determining a range of a detection target and a detection sensitivity and acquiring a particular detection signal from the detection target at the detection sensitivity, the respective detection signals acquired by the sensors being of different types;

a total analyzing part investigating whether or not there is inconsistency among signal detection results obtained by the respective sensors, and generating control information for the respective sensors;

an application utilizing the signal detection results obtained by the respective sensors; and

communication units communicating data and control information between the respective sensors, between the respective sensors and the total analyzing part, and between the total analyzing part and the application,

wherein each of the sensors uses one of, or a combination of;

the signal detection results or control information obtained from the other sensors, and

the control information obtained from the total analyzing part,

thereby determining a range of a detection target and a detection sensitivity at a time of subsequent signal acquisition,

each of the sensors outputs its signal detection results and control information used by the other sensors to determine a range of a detection target and a detection sensitivity at a time of subsequent signal acquisition, to the other sensors through the communication units; and

the total analyzing part outputs control information used by each of the sensors to determine a range of a detection target and a detection sensitivity at a time of subsequent signal acquisition through the communication units.

2. A human interface system using a plurality of sensors according to claim 1, wherein the detection target is a human being, and the sensors include at least an image sensor and a voice sensor,

a detection signal of the image sensor is human picture recognition information,

the image sensor includes an action recognizing part interpreting an action of the detection target based on picture recognition results and recognizing a command inputted through a gesture,

a detection signal of the voice sensor is human voice recognition information, and

the voice sensor includes a voice recognizing part interpreting a voice of the detection target based on voice recognition results and recognizing a command inputted through a voice.

3. A human interface system using a plurality of sensors according to claim 1, wherein:

the detection target is a human being;

the sensors include at least an image sensor and an auxiliary sensor;

a detection signal of the image sensor is human picture recognition information,

the image sensor includes an action recognizing part interpreting an action of the detection target based on picture recognition results and recognizing a command inputted through a gesture; and

a detection signal of the auxiliary sensor is information useful for detecting human position information.

4. A human interface system using a plurality of sensors according to claim 3, wherein one of, or a combination of, an ultrasonic sensor, an infrared sensor, and a range sensor is used as the auxiliary sensor.

5. A human interface system using a plurality of sensors according to claim 1, wherein the detection target is a human being, and:

the sensors include at least a voice sensor and an auxiliary sensor;

a detection signal of the voice sensor is human voice recognition information;

the voice sensor includes a voice recognizing part for interpreting a voice of the detection target based on voice recognition results and recognizing a command inputted through a voice; and

a detection signal of the auxiliary sensor is information useful for detecting human position information.

6. A human interface system using a plurality of sensors according to claim 5, wherein either of, or a combination of, an ultrasonic sensor, an infrared sensor, and a range sensor is used as the auxiliary sensor.

7. A human interface system using a plurality of sensors according to claim 1, wherein the detection target is a human being, and:

the sensors include at least an image sensor, a voice sensor, and an auxiliary sensor,

a detection signal of the image sensor is human picture recognition information;

the image sensor includes an action recognizing part interpreting an action of the detection target based on picture recognition results and recognizing a command inputted through a gesture;

a detection signal of the voice sensor is voice recognition information;

the voice sensor includes a voice recognizing part interpreting a voice of the detection target based on voice recognition results and recognizing a command inputted through a voice; and

a detection signal of the auxiliary sensor is information useful for detecting human position information.

8. A human interface system using a plurality of sensors according to claim 7, wherein one of, or a combination of, an ultrasonic sensor, an infrared sensor, and a range sensor is used as the auxiliary sensor.