Vehicle-monitoring device and method using optical flow

• US 20060140447A1
• Filed: 09/27/2005
• Published: 06/29/2006
• Est. Priority Date: 12/28/2004
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Kwang-Soo, Park, Sang-Cheol, Park, Kyong-Ha
• Application Number:
  US11/236,236
• Publication Number:
  US 20060140447A1
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

Provided is a vehicle detection/tracking device that allows vehicle detection and then tracking using a camera focusing around a camera-mounted vehicle. To this end, an optical flow is acquired from video data input through a camera mounted in a vehicle during driving of the vehicle. A background optical flow, an optical flow generated by driving the vehicle, is acquired. The acquired optical flow and the acquired background optical flow are compared, and a vehicle candidate area is detected through an optical flow for an object around the vehicle. In particular, template matching is performed on the vehicle candidate area for vehicle detection and a detected vehicle can be tracked by continuously comparing the detected optical flow and the background optical flow.

Claims

1. A vehicle-monitoring device using an optical flow, the vehicle-monitoring device comprising:

a video pre-processor for pre-processing video data input through a camera;

an optical flow detector for detecting an optical flow from the video data and separating a background optical flow area from the detected optical flow; and

a vehicle detector for matching a remaining optical flow area;

except for the background optical flow area, to templates to determine whether the remaining optical flow area is an area of a target vehicle.

2. The vehicle-monitoring device of claim 1, wherein the vehicle detector performs vehicle detection by determining a type of the target vehicle when the remaining optical flow area is the area of the target vehicle.

3. The vehicle-monitoring device of claim 1, wherein the video pre-processor comprises:

a video input unit for digitizing the video data; and

a video corrector for performing filtering to remove noise from the video data.

4. The vehicle-monitoring device of claim 1, wherein the optical flow detector comprises:

an optical flow calculator for calculating an optical flow of the video data; and

an optical flow analyzer for storing information about an area that shows a pattern different from a stationary area optical flow pattern.

5. The vehicle-monitoring device of claim 4, wherein the optical flow analyzer extracts a background optical flow from the video data by referring to an optical flow lookup table that stores background optical flows mapped to at least one of a vehicle steering wheel angle and speed information.

6. The vehicle-monitoring device of claim 1, wherein the vehicle detector comprises:

a candidate area detector for searching for a background optical flow corresponding to speed and steering wheel angle information of a source vehicle stored in an optical flow lookup table and extracting as a vehicle candidate area the area remaining after removing a background from the video data through matching; and

a template matching unit for examining correlation between the vehicle candidate area and previously stored templates for various vehicles types to determine whether the detected vehicle candidate area corresponds to an actual image of the target vehicle or a type of the target vehicle.

7. The vehicle-monitoring device of claim 1, further comprising a vehicle-tracking unit for tracking the target vehicle using information on the detected target vehicle.

8. The vehicle-monitoring device of claim 7, wherein the vehicle-tracking unit further comprises:

a vehicle storing unit for predicting a position in a next frame to which the target vehicle detected by the vehicle detector is to be moved based on information on a current image of the target vehicle and information on a previous image of the target vehicle; and

a tracking state determining unit for determining a result of tracking by comparing information on the target vehicle actually acquired from the next frame with predicted information on the target vehicle.

9. The vehicle-monitoring device of claim 8, wherein the vehicle detector continues tracking the target vehicle if an error of tracking is within a predetermined range or repeats automatic tracking if the error of tracking is outside the predetermined range.

10. A vehicle-monitoring method using an optical flow, the vehicle-monitoring method comprising the steps of:

pre-processing video data;

detecting an optical flow from the video data and separating a background optical flow from the detected optical flow;

matching a remaining optical flow area, except for the background optical flow area, to templates; and

detecting information on a target vehicle if the remaining optical flow area is an area having motion of the target vehicle; and

,

detecting the target vehicle.

11. The vehicle-monitoring method of claim 10, wherein the step of separating the background optical flow comprises the steps of:

calculating an optical flow of the video data; and

comparing the calculated optical flow with a corresponding background optical flow previously stored in an optical flow lookup table.

12. The vehicle-monitoring method of claim 11, wherein the optical flow lookup table stores background optical flows that vary with speed and steering wheel angle information of a source vehicle having a camera mounted therein.

13. The vehicle-monitoring method of claim 11, wherein the step of comparing the calculated optical flow with the background optical flow comprises:

searching for a corresponding background optical flow among previously stored background optical flows according to speed and steering wheel angle information of a source vehicle; and

extracting the corresponding background optical flow from the input image if a corresponding background optical flow is found.

14. The vehicle-monitoring method of claim 10, wherein the step of matching the remaining optical flow area, except for the background optical flow area, to templates comprises:

extracting the area remaining after removal of a background as a vehicle candidate area;

examining correlation between the vehicle candidate area and previously stored templates of various types of vehicles; and

determining whether the detected vehicle candidate area is an actual image of the target vehicle or a type of the target vehicle.

15. The vehicle-monitoring method of claim 10, further comprising the step of tracking the target vehicle using information on the target vehicle.

16. The vehicle-monitoring method of claim 15, wherein the step of tracking the target vehicle comprises:

predicting a position in a next frame to which the target vehicle is to be moved based on a current image of the target vehicle and information on a previous image of the target vehicle; and

determining a result of tracking by comparing information on the target vehicle in the next frame with predicted information on the target vehicle.

17. The vehicle-monitoring method of claim 16, wherein the step of predicting the position in the next frame comprises the step of calculating relative speed and motion information of the target vehicle.

18. The vehicle-monitoring method of claim 10, wherein the video data is input by a camera.