Data processing apparatus having breath detecting function and image display control method using breath detection

• US 6,064,964 A
• Filed: 03/27/1998
• Issued: 05/16/2000
• Est. Priority Date: 11/04/1997
• Status: Expired due to Term

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Yamamoto, Kenji, Ohishi, Kazuhiro
• Primary Examiner(s): Hupspeth, David R.
• Assistant Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US09/049,087
• Time in Patent Office: 781 Days
• Field of Search: 704/270, 704/276
• US Class Current: 704/270
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: G10L 25/78 Detection of presence or absence of voice signals switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10

Abstract

A data processing apparatus having breath detecting function and an image display control method using breath detection in such a data processing apparatus where in a breathing sound inputted by input means such as a microphone is detected, a feature quantity such as a voice power is transformed into another physical amount such as a temperature and a moving speed, and a display state of an image on a display screen or a driving state of a movable object such as a robot is controlled, whereby a user can feel that the user'"'"'s breath directly operates the image and robot so that a feeling of physical disorder is eliminated, and thus a difference between the user and a virtual world on the display screen or robot is eliminated.

Claims

1. A data processing apparatus, comprising:

means for inputting a speech;

means for detecting a feature quantity of an element featuring the speech inputted by said inputting means;

a dictionary which stores a speech segment comprising a breathing sound and a decision rule used for deciding whether the speech is a breathing sound based on the speech segment;

means for judging whether the speech inputted by said inputting means is a breathing sound by referring to said dictionary;

means for transforming a feature quantity of a prescribed element of the speech into information of another physical amount relevant to an object which is assumed to be changed when the object is blown by the breathing in a real world, based on the feature quantity of the element of the speech, as a result of the judgment by said judging means, when the speech inputted by said inputting means is a breathing sound; and

means for transforming the information of the physical amount into prescribed information,

whereby a breathing sound is detected from speech signals and display information relevant to the object and processed on the basis of the detection result is displayed.

2. A data processing apparatus, comprising:

means for inputting a speech;

a screen for displaying an image of an object;

means for controlling a display state of the image of the object on said screen according to a display parameter;

means for detecting a feature quantity of an element featuring the speech inputted by said inputting means;

a dictionary which stores a speech segment comprising a breathing sound and a decision rule used for deciding whether the speech is a breathing sound based on the speech segment;

means for judging whether the speech inputted by said inputting means is a breathing sound referring to said dictionary;

means for transforming a feature quantity of a prescribed element of the speech into information of another physical amount relevant to the object which is assumed to be changed when the object is blown by the breathing in a real world, based on the feature quantity of the element of the speech, as a result of the judgment by said judging means, when the speech inputted by said inputting means is a breathing sound; and

means for transforming the information of the physical amount into the display parameter,

whereby a breathing sound is detected from speech signals and display information relevant to the object and processed on the basis of the detection result is displayed.

3. A data processing apparatus, comprising:

means for inputting a speech;

a movable object;

driving means for driving said movable object;

means for controlling a driving state of said driving means according to a driving parameter;

means for detecting a feature quantity of an element featuring the speech inputted by said inputting means;

a dictionary which stores a speech segment comprising a breathing sound and a decision rule used for deciding whether the speech is a breathing sound based on the speech segment;

means for judging whether the speech inputted by said inputting means is a breathing sound referring to said dictionary;

means for transforming a feature quantity of a prescribed element of the speech into information of another physical amount relevant to the movable object which is assumed to be changed when the movable object is blown by the breathing in a real world, based on the feature quantity of the element of the speech, as a result of the judgment by said judging means, when the speech inputted by said inputting means is a breathing sound; and

means for transforming the information of the physical amount into the driving parameter.

4. A method for controlling display of an image comprising the steps of:

detecting a feature quantity of an element featuring a speech inputted by means for inputting the speech;

judging whether the inputted speech is a breathing sound referring to a dictionary which stores a speech segment comprising a breathing sound and a decision rule used for deciding whether the speech is a breathing sound based on the speech segment;

transforming a feature quantity of a prescribed element of the speech into information of another physical amount relevant to an object which is assumed to be changed when the object is blown by the breathing in a real world, based on the feature quantity of the element of the speech as a result of the judgment, when the inputted speech is a breathing sound;

transforming the information of the physical amount into a display parameter; and

controlling a display state of an image of the object on a screen according to the display parameter,

whereby a breathing sound is detected from speech signals and display information relevant to the object processed on the basis of the detection result is displayed.