Method for judgment of drinking using differential frequency energy, recording medium and device for performing the method

• US 9,907,509 B2
• Filed: 04/02/2014
• Issued: 03/06/2018
• Est. Priority Date: 03/28/2014
• Status: Active Grant

• Current Assignee: Foundation of Soongsil University-Industry Cooperation
• Original Assignee: Foundation of Soongsil University-Industry Cooperation
• Inventors: Bae, Myung Jin, Lee, Sang Gil, Bae, Seong Geon
• Primary Examiner(s): BAKER, MATTHEW H
• Application Number:
  US15/300,166
• Publication Number:
  US 20170181695A1
• Time in Patent Office: 1,434 Days
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/4845 Toxicology, e.g. by detection of alcohol, drug or toxic products A61B5/4848 takes precedence
• CPC Class Codes: A61B 5/7203 for noise prevention, reduction or removal
• CPC Class Codes: A61B 5/7257 using Fourier transforms
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: B60K 28/06 responsive to incapacity of driver
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
• CPC Class Codes: G10L 25/21 the extracted parameters being power information
• CPC Class Codes: G10L 25/30 using neural networks
• CPC Class Codes: G10L 25/66 for extracting parameters related to health condition detecting or measuring for diagnostic purposes A61B5/00

Abstract

An alcohol consumption determination method includes: detecting an effective frame of an input voice signal; detecting a difference signal of an original signal of the effective frame; performing fast Fourier conversion on the original signal and the difference signal; and determining, in the frequency domain, whether alcohol has been consumed based on a slope difference between the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal. Accordingly, it is also possible to determine whether a driver or an operator from a remote location has consumed alcohol and a degree of the consumption, thus preventing an accident caused by an individual operating a vehicle under the influence.

Claims

1. A computer implemented method for determining whether alcohol is consumed by a person by using at least one processor for executing a specific computer software to perform steps comprising:

receiving an input voice signal from said person via a microphone sensor and transmitted from a remote location;

forming a voice frame of the input voice signal from said person;

determining whether the voice frame corresponds to a voiced sound;

forming an effective frame according to a result of the voiced sound determination;

generating an original signal of the formed effective frame and a difference signal of the original signal;

performing a fast Fourier transform algorithm on the original signal and the difference signal;

determining whether alcohol is consumed by said person based on an energy difference in the frequency domain between the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal when the energy difference is greater than a threshold; and

outputting a result of a determination whether alcohol is consumed by said person who is located in a remote location.

2. The computer implemented method of claim 1, wherein the determining whether the voice frame corresponds to the voiced sound comprises:

extracting periodic characteristics of harmonics or features from the formed voice frame, and

determining whether the formed voice frame is from the voiced sound, an unvoiced sound, or background noise based on the extracted periodic characteristics of harmonics or features.

3. The computer implemented method of claim 2, wherein periodic characteristics of harmonics or features comprise root mean square energy (RMSE) or zero-crossing count (ZC) of a low-band voice signal energy area.

4. The computer implemented method of claim 2, wherein the determining whether the formed voice frame is from the voiced sound, an unvoiced sound, or background noise based on the extracted periodic characteristics of harmonics or features comprises use of neural network.

5. The computer implemented method of claim 1, wherein the generating an original signal of the formed effective frame and a difference signal of the original signal comprises:

generating an original signal S(n) of the formed effective frame;

generating a shift signal S(n−

1) by shifting the original signal S(n); and

generating a difference signal S(n)−

S(n−

1) between the original signal S(n) and the shift signal S(n−

1).

6. The computer implemented method of claim 5, wherein the difference signal S(n)−

S(n−

1) comprises a characteristic of highlighting high-frequency components.

7. The computer implemented method of claim 1, wherein the performing the fast Fourier transform algorithm on the original signal and the difference signal comprises:

performing the fast Fourier transform algorithm on the original signal; and

performing the fast Fourier transform algorithm on the difference signal.

8. The computer implemented method of claim 1, wherein the determining whether alcohol is consumed by said person based on the energy difference in the frequency domain between the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal comprises:

generating frequency slopes of the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal;

measuring a difference between the slopes to measure an energy difference between the original signal and the difference signal; and

determining that alcohol is consumed by said person when the energy difference is greater than a threshold and outputting a result of the determination.

9. The computer implemented method of claim 8, wherein each of the frequency slopes of the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal is a formant slope.

10. A non-transitory computer-readable recording medium having a computer program recorded thereon for performing the method of claim 1 of determining whether alcohol is consumed by the person.

11. A computer implemented device including at least one processor for executing a specific computer software to determine whether alcohol is consumed by a person, the computer implemented device comprising:

a microphone sensor receiving an input voice signal from said person;

a frame forming unit configured to form a voice frame of the input voice signal;

a voiced sound determination unit configured to determine whether the voice frame corresponds to a voiced sound;

an effective frame detection unit configured to detect an effective frame according to a result of the voiced sound determination;

a difference signal detection unit configured to detect a difference signal of an original signal of the effective frame;

a Fourier transform unit configured to perform a fast Fourier transform algorithm on the original signal and the difference signal; and

an alcohol consumption determination unit configured to determine whether said person consumes alcohol based on an energy difference in the frequency domain between the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal when the energy difference is greater than a threshold and output a result of a determination whether alcohol is consumed by said person who is located in a remote location.

12. The computer implemented device of claim 11, wherein the difference signal detection unit comprises:

a shift signal unit configured to generate a shift signal S(n−

1) by shifting the original signal S(n) of the effective frame; and

a difference signal output unit configured to output a difference signal S(n)−

S(n−

1) between the original signal and the shift signal.

13. The computer implemented device of claim 11, wherein the Fourier transform unit comprises:

a first Fourier transform unit configured to perform the fast Fourier transform algorithm on the original signal; and

a second Fourier transform unit configured to perform the fast Fourier transform algorithm on the difference signal.

14. The computer implemented device of claim 11, wherein the Fourier transform unit comprises:

a Fourier transform unit configured to perform the fast Fourier transform algorithm on the original signal and on the difference signal at the same time, in any order, or in sequence.

15. The computer implemented device of claim 11, wherein the alcohol consumption determination unit comprises:

a slope extraction unit configured to generate frequency slopes of the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal;

an energy comparison unit configured to measure a difference between the slopes to measure an energy difference between the original signal and the difference signal; and

a result output unit configured to determine that alcohol is consumed by said person when the energy difference is greater than a threshold and output a result of the determination.

16. The computer implemented device of claim 15, wherein each of the frequency slopes of the fast-Fourier-transformed original signal and the fast-Fourier-transformed difference signal is a formant slope.

17. The computer implemented device of claim 15, wherein the alcohol consumption determination device utilizes a formant energy comparison method.

18. A portable computer implemented device comprising the device of claim 11, for determining whether said person consumes alcohol.