Automobile video camera for the detection of children, people or pets left in a vehicle

• US 10,115,029 B1
• Filed: 10/13/2015
• Issued: 10/30/2018
• Est. Priority Date: 10/13/2015
• Status: Active Grant

• Current Assignee: Ambarella International LP (Ambarella Incorporated)
• Original Assignee: Ambarella Incorporated
• Inventors: Day, Christopher N., Fink, Alexander
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dhillon, Peet
• Application Number:
  US14/882,007
• Time in Patent Office: 1,113 Days
• Field of Search: 348 40
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

An apparatus comprising a camera sensor and a processor. The camera sensor may be configured to generate a video signal based on a targeted wide angle view of an interior of a vehicle. The processor may be configured to detect a type of object in the interior of the vehicle based on a classification of information visible in the video signal. If the vehicle is unattended by a person capable of operating one or more accessories of the vehicle, the processor may be configured to initiate one or more corrective measures based on the type of the object.

Claims

1. An apparatus comprising:

a camera sensor configured to generate a video signal based on a targeted wide angle view of an interior of a vehicle; and

a processor configured to (A) receive a status signal indicating an environmental condition of said vehicle, (B) analyze one or more video frames of said video signal received from said camera sensor to detect an object, (C) classify a type of said object in said interior of said vehicle detected using said analysis of said video frames based on information visible in said video signal and (D) determine if said classification based on said analysis of said video frame matches an expected classification consistent with said environmental condition and (E) if said classification of said object determines that said vehicle is unattended by a person capable of operating one or more accessories of said vehicle, initiate one or more corrective measures based on said type of said object.

2. The apparatus according to claim 1, wherein said processor is further configured to (i) determine areas of said video signal that correspond to an exterior of said vehicle, (ii) determine whether said objects detected in said areas are in said exterior of said vehicle, (iii) filter objects detected in said video signal that correspond to objects outside of said vehicle and (iv) said filtered objects are not processed.

3. The apparatus according to claim 1, wherein said processor is further configured to (i) examine a visibility of an outline of a window, (ii) determine if said object is blocking said outline and (iii) determine whether said object is in said interior of said vehicle based on whether said object is blocking said outline.

4. The apparatus according to claim 1, wherein said apparatus is configured to begin processing said analysis of said video frames of said video signal in response to temperature information received from a sensor external to said apparatus through a port connected to said vehicle.

5. The apparatus according to claim 4, wherein said sensor information comprises information from at least one of (a) a PIR sensor, (b) a CO2 sensor and (c) a microphone.

6. The apparatus according to claim 1, wherein (i) said apparatus is configured to interface with components of said vehicle and (ii) said components of said vehicle comprise at least one of windows, alarm systems, communication systems and temperature control.

7. The apparatus according to claim 1, wherein (i) said camera sensor is mounted on an interior ceiling of said vehicle and (ii) said targeted wide angle view in said vehicle comprises a view of at least one of (a) a back seat row, (b) a front seat row and (c) one or more middle seat rows.

8. The apparatus according to claim 1, wherein said classification of said objects comprises determining an age of a person.

9. The apparatus according to claim 1, wherein said apparatus is further configured to (i) transmit a message that prompts for a response, (ii) receive a response and (iii) implement speech-to-text audio processing on said response to determine whether said object is capable of operating said one or more accessories of said vehicle.

10. The apparatus according to claim 1, wherein (i) said processor is further configured to determine if said object is an empty vehicle seat and (ii) detect a presence of a non-moving object if said empty vehicle seat is not detected.

11. The apparatus according to claim 1, wherein said corrective measures comprise at least one of:

providing an audible warning, triggering a car alarm system, sending a message to a user device, controlling windows of said vehicle, controlling a temperature control system of said vehicle and contacting emergency services.

12. The apparatus according to claim 1, wherein (i) said apparatus further comprises a communication device, (ii) said apparatus is configured to communicate with a user device and (iii) said communication with said user device comprises at least one of a text message, an HTML-based message, audio streaming, video streaming and establishing a connection with a third party.

13. The apparatus according to claim 1, wherein said apparatus is further configured to (i) determine whether said object has entered said vehicle and (ii) if said object has entered said vehicle, initiate one or more of said corrective measures.

14. The apparatus according to claim 1, wherein said processor is further configured to generate a control signal to initiate said corrective measures.

15. The apparatus according to claim 1, wherein (i) said corrective measures comprise escalating responses comprising (a) said corrective measures corresponding to non-safety issues and (b) said corrective measures corresponding to emergency issues and (ii) said corrective measures corresponding to said emergency issues are activated in response to satisfying a condition.

16. The apparatus according to claim 1, wherein said corrective measures comprise escalating responses comprising (i) initiating a first type of said corrective measures, (ii) determining a response to said first type of said corrective measures and (iii) initiating a second type of said corrective measures.

17. The apparatus according to claim 1, wherein said types of said objects comprise at least one of an adult, a disabled person, a child, an animal and perishable items.

18. The apparatus according to claim 1, wherein said apparatus is configured as an automobile video camera for detection of at least one of children, people and pets left in said vehicle.

19. The apparatus according to claim 1, wherein said processor classifies said object by (i) storing a reference video frame and (ii) comparing a current video frame of said received video frames to said reference video frame.

20. The apparatus according to claim 1, wherein said processor is further configured to differentiate between said types of said object by processing said video frames for biometric markers of said object.