Hybrid user recognition systems for vehicle access and control

• US 10,745,018 B2
• Filed: 09/19/2018
• Issued: 08/18/2020
• Est. Priority Date: 09/19/2018
• Status: Active Grant

• Current Assignee: BYTON Limited
• Original Assignee: BYTON Limited
• Inventors: Abendroth, Dirk, Soltanian, Baharak
• Primary Examiner(s): Alunkal, Thomas D
• Application Number:
  US16/136,052
• Publication Number:
  US 20200086881A1
• Time in Patent Office: 699 Days
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60R 25/252 Fingerprint recognition
• CPC Class Codes: B60R 25/255 Eye recognition
• CPC Class Codes: B60R 25/257 Voice recognition
• CPC Class Codes: B60W 2040/0809 Driver authorisation; Driver identity check
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques

Abstract

Hybrid user recognition methods systems for vehicle access and control are disclosed. For one example, a hybrid user recognition system can capture at least two types of biometric data of a user. The user is recognized if at least two types of captured biometric data match with at least two types of registered biometric signatures of the user. If the user is recognized, the user is allowed access or control of at least part of the electronic or driving controls of the otherwise the user is prevented from access or control of the vehicle. Examples of user biometrics include facial, voice, iris, fingerprint and behavioral biometrics.

Claims

1. A data processing system for a vehicle comprising:

a database storing at least two types of registered biometric signatures of a user;

a plurality of user capture devices to capture at least two types of biometric data of a user; and

a processor configured to;

determine if at least two types of captured biometric data match with at least two types of registered biometric signatures of the user,

when only one of the at least two types of captured biometric data is matched, determine if an additional type of captured biometric data different from the at least two types of captured biometric data matches with an additional type of registered biometric signature of the user and

allow the user to access or control at least part of electronic or driving controls of the vehicle if there is a determined match of at least two types of captured biometric data with at least two types of registered biometric signatures or if there is a determined match of the additional type of captured biometric data, otherwise preventing the user to access or control any of the electronic or driving controls of the vehicle.

2. The data processing system of claim 1, wherein the types of biometric data include facial image, voice, iris, fingerprint or behavioral data of the user.

3. The data processing system of claim 2, wherein the types of registered biometric signatures include facial, voice, iris, fingerprint and behavioral signatures of the user.

4. The data processing system of claim 3, wherein the processor is further configured to:

obtain the biometric signatures of the user, and

register the biometric signatures in a user profile for the user.

5. The data processing system of claim 1, wherein the processor is further configured to:

determine, based at least in part on a motion sensor or an image sensor, when the user is approaching an exterior of the vehicle;

capture at least two types of biometric data while the user is located outside of the vehicle; and

allow the user entry into the vehicle if there is a determined match of at least two types of captured biometric data with at least two types of registered biometric signatures otherwise deny entry of the user.

6. A non-transitory computer-readable medium, containing instructions, which if executed by a computer cause the computer to perform an operation comprising:

capturing at least two types of biometric data of a user;

recognizing the user if at least two types of captured biometric data match with at least two types of registered biometric signatures of the user, and recognizing the user if an additional type of captured biometric data different from the at least two types of captured biometric data matches with an additional type of registered biometric signature of the user, wherein the additional type of biometric data is captured and matched when only one of the at least two types of captured biometric data can be matched; and

allowing the recognized user access or control of at least part of the electronic or driving controls of the vehicle otherwise preventing the user access or control of any of the electronic or driving controls of the vehicle.

7. The non-transitory computer-readable medium of claim 6, wherein the computer is further configured to perform an operation comprising:

capturing at least two of facial image, voice, iris, fingerprint and behavioral data of the user.

8. The non-transitory computer-readable medium of claim 7, wherein the computer is further configured to perform an operation comprising:

recognizing the user if at least two of the captured facial image, voice, iris, fingerprint and behavioral data match with at least two of facial, voice, iris, fingerprint or behavioral signatures.

9. The non-transitory computer-readable medium of claim 8, wherein the computer is further configured to perform an operation comprising:

obtaining the biometric signatures of the user; and

registering the biometric signatures in a user profile for the user.

10. The non-transitory computer-readable medium of claim 6, wherein the computer is further configured to perform an operation comprising:

allowing the recognized user entry into the vehicle otherwise preventing entry of the user into the vehicle.

11. A vehicle comprising:

a plurality of user capture devices to capture at least two types of biometric data of a user; and

a computer configured to;

recognize the user if at least two types of captured biometric data match with at least two types of registered biometric signatures of the user, recognize the user if an additional type of captured biometric data different from the at least two types of captured biometric data matches with an additional type of registered biometric signature of the user, wherein the additional type of biometric data is captured and matched when only one of the at least two types of captured biometric data can be matched, and

allow the recognized user access or control of at least part of electronic or driving controls of the vehicle otherwise preventing the user to access or control any part of the electronic or driving controls of the vehicle.

12. The vehicle of claim 11, wherein the plurality of user capture devices are located on the exterior or interior of the vehicle.

13. The vehicle of claim 12, wherein the types of biometric data include facial, voice, iris, fingerprint and behavioral data.

14. The vehicle of claim 13, wherein the types of registered biometric signatures include facial, voice, iris, fingerprint and behavioral signatures.

15. The vehicle of claim 14, wherein the registered biometric signatures are stored in a secured database or in secured cloud storage.

16. The vehicle of claim 15, wherein the registered biometric signatures are trained to provide identifiable features of the user to match with the captured biometric data to recognize the user.

17. The vehicle of claim 11, wherein the computer is further configured to allow the recognized user entry into the vehicle otherwise prevent the user entry into the vehicle.

18. A computer-implemented method for a vehicle comprising:

capturing at least two types of biometric data of a user;

recognizing the user if the at least two types of captured biometric data match with at least two types of registered biometric signatures of the user and recognizing the user if an additional type of captured biometric data different from the at least two types of captured biometric data matches with an additional type of registered biometric signature of the user, wherein the additional type of biometric data is captured and matched when only one of the at least two types of captured biometric data can be matched; and

allowing the recognized user to access or control of at least part of electronic or driving controls of the vehicle if the user is recognized otherwise preventing the user access or control any of the electronic or driving controls of the vehicle.

19. The computer-implemented method of claim 18, the types of biometric data of the user include facial image, voice, iris, fingerprint and behavioral data of the user.

20. The computer-implemented method of claim 19, wherein the types of registered biometric signatures of the user include facial, voice, iris, fingerprint and behavioral signatures of the user.

21. The computer-implemented method of claim 20, further comprising:

obtaining the biometric signatures of the user; and

registering the biometric signatures in a user profile for the user.

22. The computer-implemented method of claim 21, wherein obtaining the biometric signatures of the user includes obtaining a facial image, voice sample, iris image, fingerprint image and behavioral images of the user.

23. The computer-implemented method of claim 18, further comprising allowing the recognized user entry into the vehicle otherwise preventing entry of the user into the vehicle.

24. The computer-implemented method of claim 18, further comprising configuring settings and preferences for the electronic or driving controls of the vehicle specific to the user.

25. A computer-implemented method for a vehicle comprising:

capturing two types of biometric data of a user;

determining if the two types of captured biometric data match with two types of registered biometric signatures of the user;

capturing an additional type of biometric data of the user, different from the captured two types of biometric data, if only one of the two types of captured biometric data of the user is determined to match with one type of registered biometric signatures of the user;

determining if the additional type of biometric data of the user match with an additional type of biometric signatures of the user; and

allowing the user access or control of at least a part of electronic or driving controls of the vehicle if the two types of captured biometric data are determined to match with two types of registered biometric signatures or the additional type of biometric data is determined to match with the additional type of registered biometric signatures of the user otherwise preventing the user access or control of any of the electronic or driving controls of the vehicle.

26. The computer-implemented method of claim 25, wherein the types of biometric data include facial image, voice, iris, fingerprint and behavioral data of the user.

27. The computer-implemented method of claim 26, wherein the types of registered biometric signatures include facial, voice, iris, fingerprint and behavioral signatures of the user.

28. The computer-implemented method of claim 27, further comprising:

obtaining the biometric signatures of the user; and

registering the biometric signatures in a user profile for the user.

29. The computer-implemented method of claim 25, further comprising:

allowing the user entry into the vehicle if the two types of captured biometric data are determined to match with two types of registered biometric signatures or the additional type of biometric data is determined to match with the additional type of registered biometric signatures of the user otherwise preventing entry of the user into the vehicle.