SYSTEM AND METHOD FOR GENERATING AND USING INFERENCE MODELS

• US 20170154269A1
• Filed: 11/29/2016
• Published: 06/01/2017
• Est. Priority Date: 11/30/2015
• Status: Abandoned Application

• Current Assignee: Allegro Artificial Intelligence Ltd.
• Original Assignee: Seematics Systems Limited
• Inventors: Guttmann, Moshe
• Application Number:
  US15/363,603
• Publication Number:
  US 20170154269A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/217 Validation; Performance evaluation; Active pattern learning techniques
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06V 10/776 Validation; Performance evaluation
• CPC Class Codes: G06V 10/94 Hardware or software architectures specially adapted for image or video understanding
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/38 for collecting sensor information
• CPC Class Codes: H04W 4/60 Subscription-based services using application servers or record carriers, e.g. SIM application toolkits

Abstract

System and method for generating inference models are provided. Scene information may be received. Inference models may be generated based on the scene information. At least one of the generated inference models may be transmitted. A result of applying input data to the transmitted inference model may be received. Input data may be received. A result of applying the received input data to at least one of the generated inference models may be generated. A notification may be provided based on the received result and the generated result.

Claims

1. A system for providing notifications, the system comprising:

at least one communication device; and

at least one processing unit configured to;

receive from an external apparatus, using the at least one communication device, scene information;

obtain a first inference model and a second inference model based, at least in part, on the scene information;

transmit to the external apparatus, using the at least one communication device, the first inference model;

receive from the external apparatus, using the at least one communication device, a first result, the first result is based, at least in part, on a result of applying input data to the first inference model;

receive from the external apparatus, using the at least one communication device, at least part of the input data;

generate a second result, the second result is based, at least in part, on a result of applying the at least part of the input data to the second inference model; and

based on the first result and the second result, transmit a notification to a device associated with the external apparatus using the at least one communication device.

2. The system of claim 1, wherein the second result is further based on the first result.

3. The system of claim 1, wherein the external apparatus comprises an image sensor;

and wherein the input data comprises image data captured from an environment of the external apparatus using the image sensor.

4. The system of claim 3, wherein the first inference model comprises at least one of a face detector model and a face recognition model;

wherein the first result comprises identifying information of at least one person appearing in the image data; and

wherein the notification comprises at least part of the identifying information.

5. The system of claim 3, wherein the first inference model comprises an object detector model;

and wherein the first result comprises information associated with an object appearing in the image data.

6. The system of claim 3, wherein the first result comprises a mapping, the mapping associates segments of the image data with values.

7. The system of claim 1, wherein the external apparatus comprises an image sensor;

and wherein the scene information is based, at least in part, on image data captured from an environment of the external apparatus using the image sensor.

8. The system of claim 7, wherein the scene information comprises at least a portion of the image data.

9. The system of claim 7, wherein the scene information comprises a background image of the environment.

10. The system of claim 7, wherein the scene information comprises an identifier of an object appearing in the image data and a position associated with the object.

11. The system of claim 7, wherein the scene information comprises identifying information of at least one person appearing regularly in the image data.

12. The system of claim 1, wherein the external apparatus comprises an audio sensor;

and wherein the input data comprises audio data captured from an environment of the external apparatus using the audio sensor.

13. The system of claim 12, wherein the first inference model comprises a speech recognition model;

wherein the first result comprises textual information extracted from the audio data using the speech recognition model; and

wherein the notification comprises at least part of the textual information.

14. The system of claim 12, wherein the first inference model comprises at least one speaker recognition model;

wherein the first result comprises identifying information of at least one person speaking in the audio data; and

wherein the notification comprises at least part of the identifying information.

15. The system of claim 1, wherein the external apparatus comprises an audio sensor;

and wherein the scene information is based, at least in part, on audio data captured from an environment of the external apparatus using the audio sensor.

16. The system of claim 15, wherein the scene information comprises a model of ambient noise.

17. The system of claim 15, wherein the scene information comprises information related to at least one person speaking in the audio data.

18. The system of claim 1, further comprising a memory unit configured to store a plurality of alternative inference models;

and wherein obtaining the first inference model and the second inference model comprises selecting at least one inference model of the plurality of alternative inference models based, at least in part, on the scene information.

19. The system of claim 1, wherein obtaining the first inference model and the second inference model comprises training one or more machine learning algorithms using one or more training examples.

20. The system of claim 1, wherein the first inference model and the second inference model comprises at least one of:

a classifier, a regression model and a detector.

21. The system of claim 1, wherein the first inference model and the second inference model is based on an output of at least one neural network.

22. The system of claim 1, wherein the first result comprises spatial information.

23. The system of claim 1, wherein the first result comprises temporal information.

24. The system of claim 1, wherein the first result comprises a mapping, the mapping associates points in time with values.

25. A method for providing notifications, the method comprising:

receiving from an external apparatus, using at least one communication device, scene information;

obtaining a first inference model and a second inference model based, at least in part, on the scene information;

transmitting to the external apparatus, using the at least one communication device, the first inference model;

receiving from the external apparatus, using the at least one communication device, a first result, the first result is based, at least in part, on a result of applying input data to the first inference model;

receiving from the external apparatus, using the at least one communication device, at least part of the input data;

generating, by a computing system comprising one or more computers, a second result, the second result is based, at least in part, on a result of applying the at least part of the input data to the second inference model; and

based on the first result and the second result, transmitting a notification to a device associated with the external apparatus using the at least one communication device.

26. The method of claim 25, wherein the second result is further based on the first result.

27. The method of claim 25, wherein the external apparatus comprises an image sensor;

and wherein the input data comprises image data captured from an environment of the external apparatus using the image sensor.

28. The method of claim 27, wherein the first inference model comprises at least one of a face detector model and a face recognition model;

wherein the first result comprises identifying information of at least one person appearing in the image data; and

wherein the notification comprises at least part of the identifying information.

29. The method of claim 27, wherein the first inference model comprises an object detector model;

and wherein the first result comprises information associated with an object appearing in the image data.

30. The method of claim 27, wherein the first result comprises a mapping, the mapping associates segments of the image data with values.

31. The method of claim 25, wherein the external apparatus comprises an image sensor;

and wherein the scene information is based, at least in part, on image data captured from an environment of the external apparatus using the image sensor.

32. The method of claim 31, wherein the scene information comprises at least a portion of the image data.

33. The method of claim 31, wherein the scene information comprises a background image of the environment.

34. The method of claim 31, wherein the scene information comprises an identifier of an object appearing in the image data and a position associated with the object.

35. The method of claim 31, wherein the scene information comprises identifying information of at least one person appearing regularly in the image data.

36. The method of claim 25, wherein the external apparatus comprises an audio sensor;

and wherein the input data comprises audio data captured from an environment of the external apparatus using the audio sensor.

37. The method of claim 36, wherein the first inference model comprises a speech recognition model;

wherein the first result comprises textual information extracted from the audio data using the speech recognition model; and

wherein the notification comprises at least part of the textual information.

38. The method of claim 36, wherein the first inference model comprises at least one speaker recognition model;

wherein the first result comprises identifying information of at least one person speaking in the audio data; and

wherein the notification comprises at least part of the identifying information.

39. The method of claim 25, wherein the external apparatus comprises an audio sensor;

and wherein the scene information is based, at least in part, on audio data captured from an environment of the external apparatus using the audio sensor.

40. The method of claim 39, wherein the scene information comprises a model of ambient noise.

41. The method of claim 39, wherein the scene information comprises information related to at least one person speaking in the audio data.

42. The method of claim 25, wherein obtaining the first inference model and the second inference model comprises selecting at least one inference model of a plurality of alternative inference models based, at least in part, on the scene information.

43. The method of claim 25, wherein obtaining the first inference model and the second inference model comprises training one or more machine learning algorithms using one or more training examples.

44. The method of claim 25, wherein the first inference model and the second inference model comprises at least one of:

a classifier, a regression model and a detector.

45. The method of claim 25, wherein the first inference model and the second inference model is based on an output of at least one neural network.

46. The method of claim 25, wherein the first result comprises spatial information.

47. The method of claim 25, wherein the first result comprises temporal information.

48. The method of claim 25, wherein the first result comprises a mapping, the mapping associates points in time with values.

49. A software product stored on a non-transitory computer readable medium and comprising data and computer implementable instructions for carrying out the method of claim 25.