Distributed method and system to improve collaborative services across multiple devices

• US 9,979,724 B2
• Filed: 02/08/2016
• Issued: 05/22/2018
• Est. Priority Date: 02/06/2015
• Status: Active Grant

• Current Assignee: Garmin International, Inc. (Garmin Limited)
• Original Assignee: Nxt-Id, Inc.
• Inventors: Tunnell, Andrew, Mitchell, Justin, Powers, Sean, Tunnell, David
• Primary Examiner(s): Chai, Longbit
• Application Number:
  US15/018,496
• Publication Number:
  US 20160234206A1
• Time in Patent Office: 834 Days
• Field of Search: 726 6
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/33 using wearable devices, e.g. using a smartwatch or smart-glasses
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

A distributed system and method to improve collaborative service across multiple sensors on various devices. According to one embodiment, multiple devices may be used to train and then utilize a common algorithm for purposes including but not limited to recognizing a source to perform some action, control, command, calculation, storage, retrieval, encryption, decryption, alerting, alarming, notifying or as in some embodiments, to authenticate. In one embodiment of the invention, devices with one or more sensors such as but not limited to microphones, acoustic arrays or audio sensors may contribute to one or more models by sending samples, features, recognition scores, and/or risk scores to each other to improve collaborative training, signal quality, recognition, synchronization, inter-device proximity location and/or fusion of recognition scores and/or risk scores.

Claims

1. A system for performing a task for or providing a service to a source, the system comprising:

a first device having a first sensor for receiving recognition information from the source and transmitting the received recognition information to a second device;

the first and second devices for independently processing at least different portions of the recognition information, wherein the first and second devices use a common recognition model or use a different recognition model to process the recognition information, and the first and second devices independently assigning a respective first and second recognition score to the source, wherein the second device is communicatively linked to the first device, a dynamic paring code derived from each of the independently assigned recognition scores;

one or both of the first and second devices authenticating the source responsive to the first and second recognition scores by collaboratively determining whether the source is authenticated based on the dynamic paring code; and

responsive to the source having been authenticated, the first or second device for performing the task or for providing the service to the source.

2. The system of claim 1 wherein the task or service comprises an action, control, alert, alarm, notification, command, or request.

3. The system of claim 1 wherein each of the first and second devices utilizes a different recognition model in processing the recognition information.

4. The system of claim 1 wherein after the source has been authenticated, one or both of the first and second devices stores, retrieves, encrypts or decrypts calculates, modifies, or transforms data on one or both of the first and second devices.

5. The system of claim 1 wherein one or both of the first and second recognition scores are sent to the respective second and first devices for authenticating the source.

6. The system of claim 1 wherein the source is authenticated if one or both of the recognition scores exceeds a predetermined threshold.

7. The system of claim 1 the first and second devices for analyzing the recognition information according to operating capabilities of each one of the first and second devices, the operating capabilities comprising, power, bandwidth, proximity, processing power, range, availability, memory capacity, available power, first sensor type, and first sensor quality.

8. The system of claim 1 wherein one of the first and second devices requests additional or different recognition information from the source of from another of the first and second devices for use in assigning a recognition score.

9. The system of claim 1 wherein the source comprises a human, a physical object, the first device, or the second device.

10. The system of claim 1 wherein the communicatively linked condition comprises the first and second devices authenticated to each other.

11. The system of claim 1 wherein the recognition information comprises sound samples, speech samples, sound features, speech features, voice, whistles, clicks, claps, music, behavior metrics, or biometrics.

12. The system of claim 11 wherein the recognition information received by the second device comprises all of the recognition information received by the first sensor or a portion of the recognition information received by the first sensor.

13. The system of claim 1 the first device for analyzing the recognition information using a first recognition model and the second device for analyzing the recognition information using a second recognition model, the first recognition model different than the second recognition model.

14. The system of claim 13 wherein the first and second devices exchange information related to the first and second recognition models for use in training or updating the first and second recognition models.

15. The system of claim 1 the first and second devices for independently assigning a risk score for use in authenticating the source.

16. The system of claim 15 wherein one or both of the recognition score and the risk score are used to assign the source to an authentication class indicative of the risk level of transactions to be executed with the source.

17. The system of claim 1 wherein the recognition information comprises recognition information from a sensor on one or both of the first and second devices or comprises derived recognition information derived from the recognition information.

18. The system of claim 1 further comprising the second device having a second sensor, wherein the recognition information is sensed by both the first and second sensors and a synchronization packet is exchanged between the first and second devices to synchronize sensing of the recognition information at the first and second sensors.

19. The system of claim 1 wherein one of the first and second devices facilitate a control service for controlling one or more of a door lock, a window blind, a television, a home automation device, a thermostat, a light, an irrigation system, a fan, a light switch, an alarm system, an appliance, a digital picture frame, a cooking utensil, music equipment, gaming equipment, a server, a computer, a tablet, a vehicle, a garage door opener, or a keyless lock.

20. The system of claim 1 wherein one of the first and second devices comprises a cell phone, a watch, a wallet, a necklace, a bracelet, a ring, or a wearable.

21. A system for performing a task for or providing a service to a source, the system comprising:

a first device having a first sensor for receiving first recognition information from the source;

a second device having a second sensor for receiving second recognition information from the source;

the first and second devices for independently processing at least different portions of the first and second recognition information, wherein each of the first and second devices uses a common recognition model or uses a different recognition model and each independently assigns a recognition score to the source, wherein the second device is communicatively linked to the first device, a dynamic paring code derived from each of the independently assigned recognition scores;

one or both of the first and second devices for authenticating the source responsive to the first and second recognition scores by collaboratively determining whether the source is authenticated based on the dynamic paring code; and

responsive to the source having been authenticated, one of the first and second devices for performing the task or for providing the service to the source.

22. The system of claim 21 wherein the first and second devices independently processing the respective first and second recognition information or processing different portions of the first and second recognition information is based on operating characteristics of each of the first and second devices.

23. The system of claim 22, wherein the operating characteristics of each of the first and second devices, comprise, power, bandwidth, proximity, processing power, range, availability, memory capacity, available power, first and second sensor type, and first and second sensor quality.