Ultrasonic fingerprint authentication based on beam forming

• US 9,424,456 B1
• Filed: 06/24/2015
• Issued: 08/23/2016
• Est. Priority Date: 06/24/2015
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Kamath Koteshwara, Krishna, Gejji, Pushkaraksha
• Primary Examiner(s): Park, Chan
• Assistant Examiner(s): RICE, ELISA M
• Application Number:
  US14/748,480
• Time in Patent Office: 426 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06V 40/1306 non-optical, e.g. ultrasonic or capacitive sensing
• CPC Class Codes: G06V 40/1371 Matching features related to minutiae or pores
• CPC Class Codes: G06V 40/1376 Matching features related to ridge properties or fingerprint texture

Abstract

An ultrasonic finger print authentication system that generates a three-dimensional representation of a fingerprint. High frequency sound waves are used as a medium for imaging finer details of the patterns on a fingertip, including the ridge and valley formations. Multiple frequencies and beam-forming are used to quickly map the ridges. Acoustic resonance is used to determine the depths of the intervening valleys.

Claims

1. A method of generating a three-dimensional representation of a fingerprint using ultrasound, the method comprising:

scanning, by a device, a first region of a fingertip with a first directed series of ultrasonic pulses to determine a first location in a first dimension and a second dimension of a first ridge of a plurality of ridges, the ultrasonic pulses of the first directed series having a first ultrasonic frequency;

scanning, by the device, a second region of the fingertip with second directed series of ultrasonic pulses to determine a second location in the first dimension and the second dimension of a second ridge of the plurality of ridges, the ultrasonic pulses of the second directed series having a second ultrasonic frequency that is different from the first ultrasonic frequency, wherein the scanning of the first region overlaps in time with the scanning of the second region;

emitting, by the device, diffuse ultrasound at a third ultrasonic frequency having a first wavelength toward the fingertip;

determining, by the device, a third location in the first dimension and the second dimension where a first peak magnitude of first reflections occurs at a fourth ultrasonic frequency corresponding to a second wavelength, wherein the second wavelength is equal to the first wavelength or a harmonic of the first wavelength;

determining that a first depth in a third dimension of a first valley at the third location is equal to the second wavelength;

emitting, by the device, diffuse ultrasound at a fifth ultrasonic frequency having a third wavelength toward the fingertip;

determining, by the device, a fourth location in the first dimension and the second dimension where a second peak magnitude of second reflections occurs at a sixth ultrasonic frequency corresponding to a fourth wavelength, wherein the fourth wavelength is equal to the third wavelength or a harmonic of the third wavelength; and

determining that a second depth in the third dimension of a second valley at the fourth location is equal to the fourth wavelength;

combining the first location of the first ridge and the second location of the second ridge to generate a two-dimensional representation of locations of the plurality of ridges of the fingerprint; and

overlaying the two-dimensional representation of the locations of the plurality of ridges on the first depth of the first valley at the third location and the second depth of the second valley at the fourth location to generate the three-dimensional representation of the fingerprint.

2. The method of claim 1, wherein scanning the first region comprises:

forming a first pulse of the first directed series of ultrasonic pulses by controlling phases and relative amplitudes of pulsed sound waves of the first ultrasonic frequency emitted from a first group of speakers of an array of speakers, to create a first pattern of constructive and destructive interference that combines to form the first pulse, the first pulse being directed towards the first region of the fingertip at a first transmission angle;

acquiring first signal data from an array of microphones, the first signal data including third reflections of the first pulse, and fourth reflections of a second pulse of the second directed series of ultrasonic pulses;

applying spatial filtering to the first signal data to determine a third peak magnitude of the third reflections and a first reception angle at which the third reflections produce the third peak magnitude relative to the array of microphones;

determining, based on the first signal data, first coordinates in the first dimension and the second dimension where the third reflections produce the third peak magnitude relative to the array of microphones; and

determining the first location of the first ridge based on the first coordinates, the first reception angle, and a distance between the array of microphones and a surface of the device upon which the fingertip is placed for scanning.

3. The method of claim 2, further comprising:

forming a third pulse of the first directed series of ultrasonic pulses by controlling phases and relative amplitudes of pulsed sound waves of the first ultrasonic frequency emitted from a first group of speakers of an array of speakers, to create a second pattern of constructive and destructive interference that combines to form the third pulse, the third pulse being directed towards the first region of the fingertip at a second transmission angle, the second transmission angle being different than the first transmission angle;

acquiring second signal data from the array of microphones, the second signal data including fifth reflections of the third pulse, and sixth reflections of a fourth pulse of the second directed series of ultrasonic pulses;

applying spatial filtering to the second signal data to determine a fourth peak magnitude of the fifth reflections and a second reception angle at which the fifth reflections produce the second peak magnitude relative to the array of microphones;

determining, based on the second signal data, second coordinates in the first dimension and the second dimension where the third reflections the fourth peak magnitude relative to the array of microphones; and

determining a fifth location of a third ridge of the plurality of ridges based on the second coordinates, the second reception angle, and the distance between the array of microphones and the surface.

4. The method of claim 1, further comprising:

generating each pulse of the first directed series of ultrasonic pulses that scans the first region using a first group of speakers of an array of speakers;

generating each pulse of the second directed series of ultrasonic pulses that scans the second region using a second group of speakers of the array of speakers;

scanning, by the device, a third region of the fingertip with a third directed series of ultrasonic pulses to determine a fifth location in the first dimension and the second dimension of a third ridge of the plurality of ridges, after scanning the first region, scanning the third region comprising generating each pulse of the third directed series of ultrasonic pulses at the first ultrasonic frequency using a third group of speakers of the array of speakers, wherein the third group contains at least one speaker not included in the first group; and

scanning, by the device, a fourth region of the fingertip with fourth directed series of ultrasonic pulses to determine a sixth location in the first dimension and the second dimension of a fourth ridge of the plurality of ridges, after scanning the second region, scanning the fourth region comprising generating each pulse of the fourth directed series of ultrasonic pulses at the second ultrasonic frequency using a fourth group of speakers of the array of speakers, wherein the fourth group contains at least one speaker not included in the second group,

wherein the scanning of the third region overlaps in time with the scanning of the fourth region.

5. A computing device comprising:

an array of microphones arranged in a first dimension and a second dimension;

an array of speakers interspersed among microphones of the array of microphones;

a processor;

a memory including instruction operable to be executed by the processor to perform a set of actions to configure the processor to;

scan regions of a fingertip using a first directed ultrasonic pulse emitted by a first group of speakers of the array of speakers and a second directed ultrasonic pulse emitted by a second group of speakers, to determine locations of ridges of the fingertip relative to the first dimension and the second dimension;

emit, from the array of speakers, first diffuse ultrasound having a first wavelength;

receive first signal data from the array of microphones, the first signal data including first reflections of the first diffuse ultrasound from the fingertip;

determine a first resonance location in the first dimension and the second dimension where the first diffuse ultrasound produces resonance based on a first peak magnitude of the first reflections included in first signal data;

determine a first depth of a first valley of the fingertip in a third dimension orthogonal to the first and second dimensions based on the first wavelength or a harmonic of the first wavelength, the first valley coinciding with the first resonance location;

emit, from the array of speakers, second diffuse ultrasound having a second wavelength;

receive second signal data from the array of microphones, the second signal data including second reflections of the second diffuse ultrasound from the fingertip;

determine a second resonance location in the first dimension and the second dimension where the second diffuse ultrasound produces resonance based on a second peak magnitude of second reflections included in the second signal data;

determine a second depth of a second valley of the fingertip in the third dimension orthogonal to the first and second dimensions based on the second wavelength or a harmonic of the second wavelength, the second valley coinciding with the second resonance location; and

generate a three-dimensional representation of a fingerprint of the fingertip including the locations of the ridges, the first depth of the first valley, and the second depth of the second valley.

6. The computing device of claim 5, wherein

the first directed ultrasonic pulse is at a first frequency,

the second directed ultrasonic pulse is at a second frequency that is different than the first frequency,

emission of the first directed ultrasonic pulse overlaps in time with emission of the second directed ultrasonic pulse, and

the instructions to scan regions further configure the processor to:

emit, using a third group of speakers, a third directed ultrasonic at the first frequency towards a third region; and

emit, using fourth group of speakers a fourth directed ultrasonic pulse at the second frequency towards a fourth region, emission of the third directed ultrasonic pulse overlapping in time with emission of the fourth directed ultrasonic pulse.

7. The computing device of claim 5, wherein the instructions to scan regions further configure the processor to:

receive third signal data from the array of microphones, the third signal data including third reflections of the first directed ultrasonic pulse;

apply spatial filtering to the third signal data to determine a third peak magnitude and a first direction of the third reflections;

determine first coordinates in the first dimension and the second dimension where the third reflections result in the third peak magnitude relative to the array of microphones; and

determine a first location of a first ridge of the fingertip relative to the first dimension and the second dimension based on the first coordinates and the first direction.

8. The computing device of claim 7, wherein:

the first directed ultrasonic pulse is at a first frequency,

the second directed ultrasonic pulse is at a second frequency that is different than the first frequency,

the third signal data further includes fourth reflections of the second directed ultrasonic pulse, and

the instructions to scan regions further configure the processor to;

apply spatial filtering to the third signal data to determine a fourth peak magnitude and a second direction of the fourth reflections;

determine second coordinates in the first dimension and the second dimension where the fourth reflections result in the fourth peak magnitude relative to the array of microphones; and

determine a second location of a second ridge of the fingertip relative to the first dimension and the second dimension based on the second coordinates and the second direction.

9. The computing device of claim 7, wherein the instructions to scan using the first directed ultrasonic pulse emitted by the first group of speakers further configure the processor to:

control phases and relative amplitudes of sound waves emitted by the first group of speakers to create a pattern of constructive and destructive interference that forms the first directed ultrasonic pulse.

10. The computing device of claim 5, wherein the instructions to scan regions configure the processor to:

direct, from the first group of speakers of the array of speakers, the first directed ultrasonic pulse in a first direction;

receive third signal data from the array of microphones, the third signal data including third reflections of the first directed ultrasonic pulse from the fingertip;

apply spatial filtering to the third signal data to determine a third peak magnitude of the third reflections and a first reception direction at which the third reflections producing the third peak magnitude are incident on the array of microphones;

determine first coordinates in the first dimension and the second dimension where the third reflections producing the third peak magnitude are incident on the array of microphones; and

determine a first location of a first ridge of the fingertip relative to the first dimension and the second dimension based on the first coordinates and the first reception direction.

11. The computing device of claim 5, wherein:

the first directed ultrasonic pulse is at a first frequency,

the second directed ultrasonic pulse is at a second frequency,

emission of the first directed ultrasonic pulse overlaps in time with emission of the second directed ultrasonic pulse, and

the instructions to further configure the processor to;

select the first frequency and the second frequency so that the first frequency does not correspond to any harmonic of the second frequency and the second frequency does not correspond to any harmonic of the first frequency, the first frequency and the second frequency being different.

12. The computing device of claim 5, wherein the instructions further configure the processor to:

compare the three-dimensional representation of the fingerprint to a stored fingerprint template;

determine that a score representing how closely the three-dimensional representation matches the stored template exceeds a threshold value; and

authenticate access to a service in response to the score exceeding the threshold value.

13. A non-transitory computer-readable storage medium storing processor-executable instructions for controlling a computing device, comprising program code to configure the computing device to:

scan regions of a fingertip using a first directed ultrasonic pulse emitted by a first group of speakers of an array of speakers and a second directed ultrasonic pulse emitted by a second group of speakers, to determine locations of ridges of the fingertip relative to the first dimension and the second dimension;

emit, from the array of speakers, first diffuse ultrasound having a first wavelength;

receive first signal data from an array of microphones, the first signal data including first reflections of the first diffuse ultrasound from the fingertip;

determine a first resonance location in the first dimension and the second dimension where the first diffuse ultrasound produces resonance based on a first peak magnitude of the first reflections included in first signal data;

determine a first depth of a first valley of the fingertip in a third dimension orthogonal to the first and second dimensions based on the first wavelength or a harmonic of the first wavelength, the first valley coinciding with the first resonance location;

emit, from the array of speakers, second diffuse ultrasound having a second wavelength;

receive second signal data from the array of microphones, the second signal data including second reflections of the second diffuse ultrasound from the fingertip;

determine a second resonance location in the first dimension and the second dimension where the second diffuse ultrasound produces resonance based on a second peak magnitude of second reflections included in the second signal data;

determine a second depth of a second valley of the fingertip in the third dimension orthogonal to the first and second dimensions based on the second wavelength or a harmonic of the second wavelength, the second valley coinciding with the second resonance location; and

generate a three-dimensional representation of a fingerprint of the fingertip including the locations of the ridges, the first depth of the first valley, and the second depth of the second valley.

14. The non-transitory computer-readable storage medium of claim 13, wherein

the first directed ultrasonic pulse is at a first frequency,

the second directed ultrasonic pulse is at a second frequency that is different than the first frequency,

emission of the first directed ultrasonic pulse is to overlap in time with emission of the second directed ultrasonic pulse, and

the program code to scan regions is to further configure the computing device to:

emit, using a third group of speakers, a third directed ultrasonic at the first frequency towards a third region; and

emit, using fourth group of speakers a fourth directed ultrasonic pulse at the second frequency towards a fourth region, emission of the third directed ultrasonic pulse to overlap in time with emission of the fourth directed ultrasonic pulse.

15. The non-transitory computer-readable storage medium of claim 13, wherein the program code to scan regions is to further configure the computing device to:

receive third signal data from the array of microphones, the third signal data including third reflections of the first directed ultrasonic pulse;

apply spatial filtering to the third signal data to determine a third peak magnitude and a first direction of the third reflections;

determine first coordinates in the first dimension and the second dimension where the third reflections result in the third peak magnitude relative to the array of microphones; and

determine a first location of a first ridge of the fingertip relative to the first dimension and the second dimension based on the first coordinates and the first direction.

16. The non-transitory computer-readable storage medium of claim 15, wherein:

the first directed ultrasonic pulse is at a first frequency,

the second directed ultrasonic pulse is at a second frequency that is different than the first frequency,

the third signal data further includes fourth reflections of the second directed ultrasonic pulse, and

the program code to scan regions is to further configure the computing device to;

apply spatial filtering to the third signal data to determine a fourth peak magnitude and a second direction of the fourth reflections;

determine second coordinates in the first dimension and the second dimension where the fourth reflections result in the fourth peak magnitude relative to the array of microphones; and

determine a second location of a second ridge of the fingertip relative to the first dimension and the second dimension based on the second coordinates and the second direction.

17. The non-transitory computer-readable storage medium of claim 15, wherein the program code to using the first directed ultrasonic pulse emitted by the first group of speakers is to further configure the computing device to:

control phases and relative amplitudes of sound waves emitted by the first group of speakers to create a pattern of constructive and destructive interference that forms the first directed ultrasonic pulse.

18. The non-transitory computer-readable storage medium of claim 13, wherein the program code to scan regions is to further configure the computing device to:

direct, from the first group of speakers of the array of speakers, the first directed ultrasonic pulse in a first direction;

receive third signal data from the array of microphones, the third signal data including third reflections of the first directed ultrasonic pulse from the fingertip;

apply spatial filtering to the third signal data to determine a third peak magnitude of the third reflections and a first reception direction at which the third reflections producing the third peak magnitude are incident on the array of microphones;

determine first coordinates in the first dimension and the second dimension where the third reflections producing the third peak magnitude are incident on the array of microphones; and

determine a first location of a first ridge of the fingertip relative to the first dimension and the second dimension based on the first coordinates and the first reception direction.

19. The non-transitory computer-readable storage medium of claim 13, wherein:

the first directed ultrasonic pulse is at a first frequency,

the second directed ultrasonic pulse is at a second frequency,

emission of the first directed ultrasonic pulse is to overlap in time with emission of the second directed ultrasonic pulse, and

the program code is to further configure the computing device to;

select the first frequency and the second frequency so that the first frequency does not correspond to any harmonic of the second frequency and the second frequency does not correspond to any harmonic of the first frequency, the first frequency and the second frequency being different.

20. The non-transitory computer-readable storage medium of claim 13, wherein the program code is to further configure the computing device to:

compare the three-dimensional representation of the fingerprint to a stored fingerprint template;

determine that a score representing how closely the three-dimensional representation matches the stored template exceeds a threshold value; and

authenticate access to a service in response to the score exceeding the threshold value.