Video capture system including two independent image sensors

• US 9,538,060 B1
• Filed: 08/07/2015
• Issued: 01/03/2017
• Est. Priority Date: 07/20/2012
• Status: Active Grant

• Current Assignee: Kologik LLC
• Original Assignee: COPsync, Inc. (Thinkstream Acquisition, LLC)
• Inventors: Cilia, Andrew
• Primary Examiner(s): Selby, Gevell
• Application Number:
  US14/821,612
• Time in Patent Office: 515 Days
• US Class Current: 1/1
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/625 License plates
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An in-vehicle video system comprising a forward-looking video camera system that includes two independent image sensors and associated digital signal processors for processing imagery received from the respective independent image sensors. The in-vehicle-video system may also comprise a microphone and a transmitter; and a computing system for interfacing with the forward-looking video camera system configured to control the capture, storage and processing of video, still images and audio received from the transmitter and the forward-looking video camera system. The computing system is operable to control image capture including enabling the forward-looking video camera system in a plurality of modes, and to command the forward-looking video camera system to transition to a first mode including commanding a first independent image sensor to capture high-resolution video imagery while a second independent image sensor of the two independent image sensors is capturing still images.

Claims

1. An in-vehicle video system comprising:

a forward-looking video camera system including two independent image sensors and associated digital signal processors for processing imagery received from the respective independent image sensors including a digital signal processor that recognizes objects in captured video;

a microphone and a transmitter;

a computing system for interfacing with the forward-looking video camera system configured to control the capture, storage and processing of video, still images and audio received from the transmitter and the forward-looking video camera system;

the computing system operable to control image capture including enabling the forward-looking video camera system in a plurality of modes, the computing system operable to command the forward-looking video camera system to operate in a first mode including commanding a first independent image sensor to capture high-resolution video imagery, and the computing system including an event-based trigger system that, upon recognition of an predetermined object type, controls a transition from the first mode to a second different mode, including transitioning to capturing high-resolution video imagery on the first independent image sensor while capturing still imagery on the second of the two independent image sensors.

2. The system of claim 1 wherein the first mode is a default mode and the second mode is initiated based on a recognition of a predetermined type of object.

3. The system of claim 1 wherein the second mode is initiated based on a recognition of a specific object.

4. The system of claim 2 wherein the predetermined type of object is selected from the group comprising a face or a license plate.

5. An in-vehicle video system comprising:

a forward-looking video camera system including two independent image sensors and associated digital signal processors for processing imagery received from the respective independent image sensors;

a microphone and a transmitter;

a trigger system for detecting one or more trigger conditions, wherein at least one condition is a start-up condition and one condition is an object recognition condition that represents detecting a predetermined object in captured video and producing a trigger output; and

a computing system for interfacing with the forward-looking video camera system and the trigger system configured to control the capture, storage and processing of video, still images and audio received from the transmitter and the forward-looking video camera system, the computing system operable to control image capture of the two independent image sensors based at least in part on the trigger output including enabling the forward-looking video camera system in a plurality of modes, the computing system operable to command the forward-looking video camera system to operate in a first mode including commanding a first independent image sensor to capture high-resolution video imagery and temporarily store the captured high-resolution data in a rewritable buffer and upon recognition of a predetermined object type, the computing system further operable to control a transition from the first mode to a second different mode, including transitioning to capturing and more permanently storing the high-resolution video imagery on the first independent image sensor while capturing still imagery on the second of the two independent image sensors.

6. The in-vehicle video system of claim 5 further comprising an interface coupled between the forward-looking video camera system and the computing system for passing commands and video and captured imagery between the respective components.

7. The in-vehicle video system of claim 6 wherein the computing system receives data in the form of compressed video and still imagery from the interface and is operable to perform further processing, user presentation and storage of the received or further processed data.

8. The in-vehicle video system of claim 5 wherein the microphone further includes a wireless microphone configured for easy deployment on or in proximity to an operator of the vehicle for capturing audio data associated with events along with video and still imagery captured by the forward-looking video camera system.

9. The in-vehicle video system of claim 5 further comprising a sensor box that receives inputs from one or more vehicle sensors and provides sensor input to the computing system to enable the execution of the preprogrammed actions.

10. The in-vehicle video system of claim 9 wherein the one or more vehicle sensors are selected from the group comprising a GPS, accelerometer, temperature, or analog or digital sensors coupled to different components of the vehicle so as to enable the sensor box to sense and react to a change of state of the vehicle and initiate one or more preprogrammed actions for execution by the forward-looking video camera system.

11. The in-vehicle video system of claim 5 wherein the computing system further includes a circular buffer configured to store a predetermined amount of received data received in the first mode.

12. The in-vehicle video system of claim 11 wherein the predetermined amount is approximately 10-100 hours of video data.

13. A method for capturing event data associated with a vehicle comprising:

providing a forward-looking video camera system including two independent image sensors and associated digital signal processors for processing imagery received from the respective independent image sensors providing a microphone and transmitter;

detecting a first operating condition and, based on the detecting, controlling the forward-looking video camera system to operate in a first mode including;

using a first independent image sensor and associated digital signal processor to capture video;

analyzing captured video to detect one or more objects in a field of view associated with the captured video, recognizing at least one of the objects and

detecting one or more of

     1) a change of state of the vehicle,

     2) an event associated with the vehicle or

     3) an object based on the analyzing, and transitioning to a second mode including capturing imagery or video based on a preprogrammed action associated with a given detected change of state, event or recognized object.

14. The method of claim 13 wherein the object is a license plate and the method further includes comparing a license number in a list of wanted license numbers and providing an alert to an operator when a match is detected.

15. The method of claim 13 wherein detecting a change of state includes detecting that vehicle emergency lights or sirens are activated and detecting a rate of speed above a predetermined amount for the vehicle, and wherein the preprogrammed action includes searching for and capturing still images of faces or a target vehicle in front of the forward-looking video camera system.

16. The method of claim 15 wherein the preprogrammed action includes also capturing license plate imagery associated with the target vehicle.

17. The method of claim 13 wherein the detected state is emergency lights on and vehicle stopped, and wherein the preprogrammed action is capturing a series of images so as to be able to identify one or more of make, model, color, license plate, markings, or occupants in a target vehicle.

18. The method of claim 13 wherein the event is a fight or struggle between an operator of the vehicle and an occupant of a target vehicle, and wherein the preprogrammed action is capturing high-resolution video or imagery, and wherein the method further includes activating a warning signal upon detecting the event.

19. The method of claim 13 wherein the change of state is vehicle stopped with emergency lights on and the preprogrammed action includes evaluating a scene presented to the second independent image sensor to detect one or more predetermined scenarios.

20. The method of claim 19 wherein the scenarios are selected from the group comprising identifying a suspect, detecting a discharge of a weapon, detecting a fight or struggle, or detecting administration of a road side test by the operator of the vehicle.

21. The method of claim 19 further comprising disseminating information related to the scenarios to other entities in law enforcement depending on or more criteria associated with the detected scenario.

22. The method of claim 13 further comprising receiving a signal from an operator of the vehicle to capture a high-resolution image with the second independent image sensor or to start or stop video recording with the first independent image sensor.