Object recognition and notification

• US 9,449,488 B2
• Filed: 12/29/2011
• Issued: 09/20/2016
• Est. Priority Date: 12/29/2011
• Status: Active Grant

• Current Assignee: Tahoe Research Limited (f/k/a Learndale Limited) (Vector Capital Corporation)
• Original Assignee: Intel Corporation
• Inventors: Zafiroglu, Alexandra, Healey, Jennifer, Graumann, David L.
• Primary Examiner(s): Nguyen, Hung T
• Application Number:
  US13/977,592
• Publication Number:
  US 20150137985A1
• Time in Patent Office: 1,727 Days
• Field of Search: 340/505, 340/506, 340/539.1, 340/539.11, 340/572.1, 340/686.1, 340/10.1, 340/10.3, 340/10.4, 340/10.42
• US Class Current: 1/1
• CPC Class Codes: B60R 16/02 electric constitutive elements
• CPC Class Codes: G06K 7/0008 General problems related to the reading of electronic memory record carriers, independent of its reading method, e.g. power transfer
• CPC Class Codes: G06K 7/10297 arrangements for handling protocols designed for non-contact record carriers such as RFIDs NFCs, e.g. ISO/IEC 14443 and 18092 cryptographic protocols H04L9/00; network security protocols H04L63/00; real-time communication protocols in data switching networks H04L65/00; network protocols for data switching network services H04L67/00
• CPC Class Codes: G06K 7/10425 the interrogation device being arranged for interrogation of record carriers passing by the interrogation device
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G08B 21/24 Reminder alarms, e.g. anti-loss alarms

Abstract

Methods, systems, and apparatus are provided for determining the presence or absence of an object within a vehicle based on sensor signals and selectively providing notification to a user of the same.

Claims

1. A method comprising:

receiving, by one or more processors associated with a vehicle, an object model corresponding to an object;

receiving, by the one or more processors, a signal from at least one sensor associated with the vehicle;

determining, by the one or more processors, the signal corresponds to the object by generating a background subtracted signal by performing a background subtraction of the signal and comparing the background subtracted signal to the object model; and

providing, by the one or more processors, a notification based at least in part on the determining.

2. The method of claim 1, wherein the object model comprises at least one of:

(i) an image of the object;

(ii) a radio frequency identification;

(iii) a degraded image of the object;

(iv) a three dimensional wire mesh;

or (v) a texture descriptor.

3. The method of claim 1, wherein the object is a personal belonging.

4. The method of claim 1, wherein the at least one sensor comprises at least one of an image sensor or a radio frequency identification interrogator.

5. The method of claim 1, wherein the signal from the at least one sensor comprises at least one of an image sensor signal or a radio frequency identification signal.

6. The method of claim 5, wherein determining if the signal corresponding to the object comprises comparing the radio frequency identification signal to the object model.

7. The method of claim 1, wherein the notification is further determined using a pattern model.

8. The method of claim 7, wherein the pattern model comprises a temporal pattern model.

9. The method of claim 7, wherein the pattern model comprises a required items list.

10. The method of claim 1, wherein the notification comprises at least one of:

(i) an audible sound;

(ii) a video display;

(iii) a text message;

(iv) an email;

or (v) a visible light.

11. A vehicle comprising:

at least one sensor, the at least one sensor configured to provide a sensor signal;

an electronic memory configured to store an object model;

at least one processor configured to determine a presence of an object based at least in part on each of the sensor signals and the object model by generating a background subtracted sensor signal by performing a background subtraction of the sensor signal and comparing the background subtracted sensor signal to the object model; and

wherein the at least one processor is further configured to determine a notification based at least in part on the presence of the object.

12. The vehicle of claim 11, further comprising a user interface configured to provide a notification based in part on the determining, by the at least one processor, the notification.

13. The vehicle of claim 11, wherein the notification is further determined using a pattern model.

14. The vehicle of claim 13, wherein the pattern model comprises a temporal pattern model.

15. The vehicle of claim 13, wherein the notification comprises at least one of:

(i) an audible sound;

(ii) a video display;

(iii) a text message;

(iv) an email;

or (v) a visible light.

16. The vehicle of claim 11, wherein the at least one sensor comprises at least one of an image sensor or a radio frequency identification interrogator.

17. A system comprising:

an image sensor associated with a vehicle and configured to provide an image signal;

an electronic memory, configured to store an object model;

at least one processor configured to determine a presence of an object based at least in part on the image signal and generate a notification signal by generating a background subtracted image signal by performing a background subtraction of the image signal and comparing the background subtracted image signal to the object model; and

a user interface configured to receive the notification signal and provide a notification based on the notification signal.

18. The system of claim 17, wherein the notification is further determined using a pattern model.

19. The system of claim 17, wherein the pattern model comprises a temporal pattern model.

20. The system of claim 17, wherein the notification comprises at least one of:

(i) an audible sound;

(ii) a video display;

(iii) a text message;

(iv) an email;

or (v) a visible light.

21. At least one non-transitory computer readable medium comprising computer-executable instructions that, when executed by one or more processors, execute a method comprising:

receiving an object model corresponding to an object;

receiving a signal from at least one sensor;

determining that the signal corresponds to the object by generating a background subtracted signal by performing a background subtraction of the signal and comparing the background subtracted signal to the object model; and

providing a notification based at least in part on the determining if the signal corresponds to the object.

22. The at least one non-transitory computer readable medium of claim 21, wherein the signal from the at least one sensor comprises at least one of an image sensor signal or a radio frequency identification signal.

23. The at least one non-transitory computer readable medium of claim 22, wherein determining if the signal corresponding to the object comprises comparing the radio frequency identification signal to the object model.

24. The at least one computer readable medium of claim 21, wherein the notification is further determined using a pattern model.

25. The at least one non-transitory computer readable medium of claim 24, wherein the pattern model comprises a temporal pattern model.