Method for judgment of drinking using differential energy in time domain, recording medium and device for performing the method

• US 9,943,260 B2
• Filed: 04/02/2014
• Issued: 04/17/2018
• Est. Priority Date: 03/28/2014
• Status: Active Grant

• Current Assignee: Foundation of Soongsil University-Industry Cooperation
• Original Assignee: Foundation of Soongsil University-Industry Cooperation
• Inventors: Bae, Myung Jin, Lee, Sang Gil, Bae, Seong Geon
• Primary Examiner(s): BAKER, MATTHEW H
• Application Number:
  US15/300,217
• Publication Number:
  US 20170135620A1
• Time in Patent Office: 1,476 Days
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/4845 Toxicology, e.g. by detection of alcohol, drug or toxic products A61B5/4848 takes precedence
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: B60K 28/06 responsive to incapacity of driver
• CPC Class Codes: G10L 25/21 the extracted parameters being power information
• CPC Class Codes: G10L 25/30 using neural networks
• CPC Class Codes: G10L 25/66 for extracting parameters related to health condition detecting or measuring for diagnostic purposes A61B5/00

Abstract

An alcohol consumption determination method includes detecting a plurality of effective frames of an input voice signal; detecting a difference in signal of within the original signal of each of the effective frames; detecting average energy of the original signal and average energy of the difference signal for each of the effective frames; and determining whether alcohol has been consumed based on a difference between the average energy of the original signal and the average energy of the difference between the signals for each effective frame. Accordingly, it is also possible to determine, from a remote location, whether a driver or an operator remote has consumed alcohol and the degree of inebriation by using a difference signal energy method using a voice signal, thus preventing an accident caused by a operation vehicles and machines under the influence of alcohol.

Claims

1. A computer implemented method for determining whether alcohol is consumed by a person by using at least one processor for executing a specific computer software to perform steps comprising:

receiving an input voice signal from said person via a microphone sensor;

forming a voice frame of the input voice signal;

determining whether the formed voice frame corresponds to a voiced sound;

forming a plurality of effective frames by converting the input voice signal from said person according to a result of the voiced sound determination;

generating an original signal of each of the plurality of effective frames and a difference signal of the original signal;

computing a first average energy of the original signal and a second average energy of the difference signal for each of the plurality of effective frames;

determining whether alcohol is consumed by said person based on a difference between the first average energy and the second average energy, and

outputting a result of a determination whether alcohol is consumed by said person who is located in a remote location.

2. The computer implemented method of claim 1, wherein the determining whether the formed voice frame corresponds to the voiced sound comprises:

extracting periodic characteristics of harmonics or features from the formed voice frame, and

determining whether the formed voice frame is from the voiced sound, an unvoiced sound, or background noise based on the extracted periodic characteristics of harmonics or features.

3. The computer implemented method of claim 2, wherein periodic characteristics of harmonics or features comprise root mean square energy (RMSE) or zero-crossing count (ZC) of a low-band voice signal energy area.

4. The computer implemented method of claim 3, wherein the determining whether the formed voice frame is from the voiced sound, an unvoiced sound, or background noise based on the extracted periodic characteristics of harmonics or features comprises use of neural network.

5. The computer implemented method of claim 1, wherein the generating an original signal of each of the plurality of effective frames and a difference signal of the original signal comprises:

generating an original signal S(n) of the formed effective frame;

generating a shift signal S(n−

1) by shifting the original signal S(n); and

generating a difference signal S(n)−

S(n−

1) between the original signal S(n) and the shift signal S(n−

1).

6. The computer implemented method of claim 5, wherein the difference signal S(n)−

S(n−

1) comprises a characteristic of highlighting high-frequency components.

7. The computer implemented method of claim 1, wherein the computing the first average energy of the original signal and the second average energy of the difference signal for each of the plurality of effective frames comprises:

computing the first average energy of the original signal for each of the plurality of effective frames; and

computing the second average energy of the difference signal for each of the plurality of effective frames.

8. The computer implemented method of claim 1, wherein the determining whether alcohol is consumed by said person based on the difference between the first average energy and the second average energy comprises:

calculating a difference between the first average energy and the second average energy for each of the plurality of effective frames;

counting the number of effective frames each having the calculated difference greater than a predetermined first threshold; and

determining that alcohol is consumed by said person when the counted number is greater than a predetermined second threshold and outputting a result of the determination.

9. The computer implemented method of claim 1, wherein the determining whether alcohol is consumed by said person based on the difference between the first average energy and the second average energy comprises:

calculating the difference between the first average energy and the second average energy for each of the plurality of effective frames;

counting the number of effective frames each having the calculated difference greater than a predetermined first threshold;

computing a ratio between the counted number and the total number of effective frames; and

determining that alcohol is consumed by said person when the computed ratio is greater than a predetermined third threshold and outputting a result of the determination.

10. A non-transitory computer-readable recording medium having a computer program recorded thereon for performing the method of claim 1 of determining whether alcohol is consumed by said person.

11. A computer implemented device including at least one processor for executing a specific computer software to determine whether alcohol is consumed by a person, the computer implemented device comprising:

a microphone sensor receiving an input voice signal from said person;

a frame forming unit configured to form a voice frame of the input voice signal from said person;

a voiced sound determination unit configured to determine whether the voice frame corresponds to a voiced sound;

an effective frame detection unit configured to detect a plurality of effective frames by converting the input voice signal from said person according to a result of the voiced sound determination;

a difference signal detection unit configured to detect a difference signal of an original signal of each of the plurality of effective frames;

an energy detection unit configured to detect a first average energy of the original signal and a second average energy of the difference signal for each of the plurality of effective frames; and

an alcohol consumption determination unit configured to determine whether alcohol is consumed by said person based on a difference between the first average energy of the original signal and the second average energy and output a result of a determination whether alcohol is consumed by said person who is located in a remote location.

12. The computer implemented device of claim 11, wherein the difference signal detection unit comprises a shift signal unit configured to generate a shift signal S(n−

1) by shifting the original signal S(n) of the effective frame; and

a difference signal output unit configured to output a difference signal S(n)−

S(n−

1) between the original signal and the shift signal.

13. The computer implemented device of claim 11, wherein the energy detection unit comprises:

a first energy detection unit configured to compute the first average energy of the original signal for each of the plurality of effective frame; and

a second energy detection unit configured to compute the second average energy of the difference signal for each of the plurality of effective frame.

14. The computer implemented device of claim 11, wherein the alcohol consumption determination unit comprises:

an energy comparison unit configured to calculate the difference between the first average energy and the second average energy for each of the plurality of effective frames and outputting the calculated difference;

a counting unit configured to count the number of effective frames each having the calculated difference greater than a predetermined first threshold; and

a result output unit configured to determine that alcohol is consumed by said person when the counted number is greater than a predetermined second threshold and outputting a result of the determination.

15. The computer implemented device of claim 14, wherein the alcohol consumption determination unit further comprises a storage unit configured to prestore at least one of the first threshold and the second threshold.

16. The computer implemented device of claim 11, wherein the alcohol consumption determination unit comprises:

an energy comparison unit configured to calculate the difference between the first average energy and the second average energy for each of the plurality of effective frames and outputting the calculated difference;

a counting unit configured to count the number of effective frames each having the calculated difference greater than a predetermined first threshold;

a ratio calculation unit configured to compute a ratio between the counted number and the total number of effective frames; and

a result output unit configured to determine that alcohol is consumed by said person when the computed ratio is greater than a predetermined third threshold and outputting a result of the determination.

17. The computer implemented device of claim 16, wherein the alcohol consumption determination unit further comprises a storage unit configured to prestore at least one of the first threshold and the third threshold.

18. A portable computer implemented device comprising the computer implemented device of claim 11 for determining whether alcohol is consumed by said person.