Lane recognition apparatus for vehicle
First Claim
1. A lane recognition apparatus for a vehicle, comprising:
- an image picking-up section picking up a road image in front of the vehicle;
a lane-marker candidate-point detecting section detecting coordinate values of a plurality of lane marker candidate points from the road image;
a steering angle detecting section detecting a steering angle of the vehicle, wherein a state equation of an extended Kalman filter uses a change of the vehicle state quantity caused by the steering angle and a vehicle speed; and
a road model parameter calculating section estimating a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity of the vehicle using the extended Kalman filter, on the basis of the coordinate values of the lane marker candidate points, the road model parameter calculating section identifying whether a yaw angle or lateral displacement of the vehicle state quantity is caused by the steering angle, wherein a state equation of the extended Kalman filter uses a change of the vehicle state quantity caused by the steering angle.
1 Assignment
0 Petitions

Accused Products

Abstract
A lane recognition apparatus for a vehicle is comprised of an image picking-up section which picks up a road image in front of the vehicle, a lane-marker candidate-point detecting section which detects coordinate values of a plurality of lane marker candidate points from the road image, and a road model parameter calculating section which estimates a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity of the vehicle using an extended Kalman filter, on the basis of the coordinate values of the lane marker candidate points.
343 Citations
Driving assist system for vehicle | ||
Patent #
US 7,873,474 B2
Filed 05/16/2007
|
Current Assignee
Mazda Motor Corporation
|
Original Assignee
Mazda Motor Corporation
|
Driver assistance system for vehicle | ||
Patent #
US 7,873,187 B2
Filed 08/16/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Imaging system for vehicle | ||
Patent #
US 7,877,175 B2
Filed 04/21/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Driver assistance system for vehicle | ||
Patent #
US 7,949,152 B2
Filed 12/28/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Automatic signaling system for vehicles | ||
Patent #
US 7,986,223 B2
Filed 01/26/2009
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Imaging system for vehicle | ||
Patent #
US 7,991,522 B2
Filed 12/28/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Object detection system for vehicle | ||
Patent #
US 7,679,498 B2
Filed 12/05/2008
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Imaging system for vehicle | ||
Patent #
US 7,792,329 B2
Filed 10/27/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
OBJECT DETECTION SYSTEM FOR VEHICLE | ||
Patent #
US 20100002081A1
Filed 09/15/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Object detection system for vehicle | ||
Patent #
US 7,720,580 B2
Filed 12/22/2005
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Automatic signaling systems for vehicles | ||
Patent #
US 7,482,916 B2
Filed 01/28/2005
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Road curvature estimation system | ||
Patent #
US 7,522,091 B2
Filed 12/24/2004
|
Current Assignee
TK Holdings Incorporated
|
Original Assignee
Automotive Systems Laboratory Incorporated
|
Imaging system for vehicle | ||
Patent #
US 7,526,103 B2
Filed 04/14/2005
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
APPARATUS AND METHOD FOR CONTROLLING TRAVEL SPEED OF VEHICLE | ||
Patent #
US 20090157273A1
Filed 11/26/2008
|
Current Assignee
Hyundai Motor Company
|
Original Assignee
Hyundai Motor Company
|
AUTOMATIC SIGNALING SYSTEM FOR VEHICLES | ||
Patent #
US 20090189756A1
Filed 01/26/2009
|
Current Assignee
Autosignal LLC
|
Original Assignee
Gerald Chan
|
Driver assistance system for vehicle | ||
Patent #
US 7,616,781 B2
Filed 04/24/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Driver scoring system with lane changing detection and warning system | ||
Patent #
US 20090284361A1
Filed 05/19/2008
|
Current Assignee
INNOSIGHT VENTURES PTE LTD
|
Original Assignee
INNOSIGHT VENTURES PTE LTD
|
Road curvature estimation system | ||
Patent #
US 7,626,533 B2
Filed 04/01/2008
|
Current Assignee
TK Holdings Incorporated
|
Original Assignee
Automotive Systems Laboratory Incorporated
|
Moving object detection using low illumination depth capable computer vision | ||
Patent #
US 7,366,325 B2
Filed 10/12/2004
|
Current Assignee
Honda Motor Company
|
Original Assignee
Honda Motor Company
|
ROAD CURVATURE ESTIMATION SYSTEM | ||
Patent #
US 20080183419A1
Filed 04/01/2008
|
Current Assignee
TK Holdings Incorporated
|
Original Assignee
Automotive Systems Laboratory Incorporated
|
Communication system, communication method, and communication device | ||
Patent #
US 20080222316A1
Filed 12/21/2007
|
Current Assignee
Ricoh Company Limited
|
Original Assignee
Ricoh Company Limited
|
System and method for preventing lane deviation of vehicle | ||
Patent #
US 7,433,769 B2
Filed 11/17/2003
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan Motor Co. Ltd.
|
Vehicle running control method for avoiding that a vehicle collides with an obstacle | ||
Patent #
US 20080281521A1
Filed 04/17/2008
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan Motor Co. Ltd.
|
Object detection system for vehicle | ||
Patent #
US 7,463,138 B2
Filed 04/21/2006
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Pedestrian detection and tracking with night vision | ||
Patent #
US 7,139,411 B2
Filed 06/13/2003
|
Current Assignee
The Ohio State University Research Foundation
|
Original Assignee
The Ohio State University Research Foundation, Honda Giken Kogyo Kabushiki Kaisha
|
Method for calculating parameters in road design of S-type clothoid, complex clothoid and egg type clothoid | ||
Patent #
US 7,010,412 B1
Filed 12/17/2004
|
Current Assignee
SAMAN ENGINEERING CONSULTANTS CO. LTD.
|
Original Assignee
SAMAN ENGINEERING CONSULTANTS CO. LTD.
|
Object detection system for vehicle | ||
Patent #
US 7,038,577 B2
Filed 04/30/2003
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
PEDESTRIAN DETECTION AND TRACKING WITH NIGHT VISION | ||
Patent #
US 20060177097A1
Filed 06/13/2003
|
Current Assignee
The Ohio State University Research Foundation
|
Original Assignee
The Ohio State University Research Foundation
|
Object detection system for vehicle | ||
Patent #
US 20060184297A1
Filed 12/22/2005
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
Moving object detection using low illumination depth capable computer vision | ||
Patent #
US 20050100192A1
Filed 10/12/2004
|
Current Assignee
Honda Motor Company
|
Original Assignee
Honda Motor Company
|
Road curvature estimation system | ||
Patent #
US 20050225477A1
Filed 12/24/2004
|
Current Assignee
TK Holdings Incorporated
|
Original Assignee
TK Holdings Incorporated
|
Process for predicting the course of a lane of a vehicle | ||
Patent #
US 20050278112A1
Filed 06/14/2005
|
Current Assignee
Daimler Chrysler Company LLC
|
Original Assignee
Daimler Chrysler Company LLC
|
Object detection system for vehicle | ||
Patent #
US 20040016870A1
Filed 04/30/2003
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
System and method for preventing lane deviation of vehicle | ||
Patent #
US 20040107035A1
Filed 11/17/2003
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan Motor Co. Ltd.
|
Driving assist system for vehicle | ||
Patent #
US 20070282532A1
Filed 05/16/2007
|
Current Assignee
Mazda Motor Corporation
|
Original Assignee
Mazda Motor Corporation
|
Imaging system for vehicle | ||
Patent #
US 8,090,153 B2
Filed 05/13/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Imaging system for vehicle | ||
Patent #
US 8,116,929 B2
Filed 07/26/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Automatic lighting system with adaptive function | ||
Patent #
US 8,070,332 B2
Filed 03/29/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic lighting system | ||
Patent #
US 8,142,059 B2
Filed 11/09/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 8,189,871 B2
Filed 01/31/2011
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Forward facing sensing system for a vehicle | ||
Patent #
US 8,217,830 B2
Filed 07/28/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 8,239,086 B2
Filed 02/10/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Object detection system for vehicle | ||
Patent #
US 8,289,142 B2
Filed 09/15/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Forward facing sensing system for vehicle | ||
Patent #
US 8,294,608 B1
Filed 07/03/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
SYSTEMS AND METHODS FOR PARAMETER DEPENDENT RICCATI EQUATION APPROACHES TO ADAPTIVE CONTROL | ||
Patent #
US 20120277888A1
Filed 04/30/2012
|
Current Assignee
Georgia Tech Research Corporation
|
Original Assignee
Georgia Tech Research Corporation
|
Imaging system for vehicle | ||
Patent #
US 8,325,986 B2
Filed 12/22/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Automatic headlamp control | ||
Patent #
US 8,376,595 B2
Filed 05/17/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic signaling system for vehicles | ||
Patent #
US 8,378,805 B2
Filed 07/26/2011
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Imaging system for vehicle | ||
Patent #
US 8,386,114 B2
Filed 08/03/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Method for calibrating a vehicular camera system | ||
Patent #
US 8,421,865 B2
Filed 05/01/2012
|
Current Assignee
Magna Electronics Europe Gmbh Co. Kg
|
Original Assignee
Magna Electronics Europe Gmbh Co. Kg
|
Vehicle running control method for avoiding that a vehicle collides with an obstacle | ||
Patent #
US 8,423,277 B2
Filed 04/17/2008
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan Motor Co. Ltd.
|
Combined RGB and IR imaging sensor | ||
Patent #
US 8,446,470 B2
Filed 10/03/2008
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 8,451,107 B2
Filed 09/11/2008
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 8,483,439 B2
Filed 05/25/2012
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
VEHICLE AUTOMATIC STEERING CONTROL APPARATUS | ||
Patent #
US 20130197758A1
Filed 01/23/2013
|
Current Assignee
Nippon Soken Inc., DENSO Corporation
|
Original Assignee
Nippon Soken Inc., DENSO Corporation
|
Selecting Visible Regions in Nighttime Images for Performing Clear Path Detection | ||
Patent #
US 20130202152A1
Filed 02/06/2012
|
Current Assignee
GM Global Technology Operations LLC
|
Original Assignee
GM Global Technology Operations LLC
|
Imaging system for vehicle | ||
Patent #
US 8,543,277 B2
Filed 02/25/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 8,593,521 B2
Filed 11/30/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 8,599,001 B2
Filed 11/19/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 8,614,640 B2
Filed 10/22/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system | ||
Patent #
US 8,629,768 B2
Filed 06/18/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Driver assistance system for vehicle | ||
Patent #
US 8,636,393 B2
Filed 05/06/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 8,637,801 B2
Filed 07/08/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera vision system for a vehicle | ||
Patent #
US 8,643,724 B2
Filed 03/13/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 8,665,079 B2
Filed 10/15/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for determining a road profile of a lane located in front of a vehicle | ||
Patent #
US 8,676,508 B2
Filed 01/18/2010
|
Current Assignee
Daimler AG
|
Original Assignee
Daimler AG
|
Vehicle yaw rate correction | ||
Patent #
US 8,694,224 B2
Filed 02/28/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 8,814,401 B2
Filed 03/22/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 8,818,042 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle automatic steering control apparatus | ||
Patent #
US 8,838,337 B2
Filed 01/23/2013
|
Current Assignee
Nippon Soken Inc., DENSO Corporation
|
Original Assignee
Nippon Soken Inc., DENSO Corporation
|
Vehicle vision system with yaw rate determination | ||
Patent #
US 8,849,495 B2
Filed 04/07/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic vehicle exterior light control | ||
Patent #
US 8,842,176 B2
Filed 01/15/2010
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Parking assist system | ||
Patent #
US 8,874,317 B2
Filed 07/27/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 8,886,401 B2
Filed 11/04/2013
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Adaptable wireless vehicle vision system based on wireless communication error | ||
Patent #
US 8,890,955 B2
Filed 02/09/2011
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
Imaging system for vehicle | ||
Patent #
US 8,908,040 B2
Filed 05/17/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 8,917,169 B2
Filed 12/02/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
METHOD AND DEVICE FOR DETECTING ROAD REGION AS WELL AS METHOD AND DEVICE FOR DETECTING ROAD LINE | ||
Patent #
US 20140379257A1
Filed 09/11/2014
|
Current Assignee
Ricoh Company Limited
|
Original Assignee
Ricoh Company Limited
|
Selecting visible regions in nighttime images for performing clear path detection | ||
Patent #
US 8,948,449 B2
Filed 02/06/2012
|
Current Assignee
GM Global Technology Operations LLC
|
Original Assignee
GM Global Technology Operations LLC
|
Rear illumination system | ||
Patent #
US 8,964,032 B2
Filed 01/26/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 8,977,008 B2
Filed 07/08/2013
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Driver assistance system for a vehicle | ||
Patent #
US 8,993,951 B2
Filed 07/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,008,369 B2
Filed 08/25/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,014,904 B2
Filed 09/23/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system with camera misalignment correction and capturing image data at different resolution levels dependent on distance to object in field of view | ||
Patent #
US 9,018,577 B2
Filed 02/25/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging and display system for vehicle | ||
Patent #
US 9,041,806 B2
Filed 08/31/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Systems and methods for parameter dependent riccati equation approaches to adaptive control | ||
Patent #
US 9,058,028 B2
Filed 04/30/2012
|
Current Assignee
Georgia Tech Research Corporation
|
Original Assignee
Georgia Tech Research Corporation
|
Rear vision system with trailer angle detection | ||
Patent #
US 9,085,261 B2
Filed 01/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Braking control system for vehicle | ||
Patent #
US 9,090,234 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 9,092,986 B2
Filed 01/31/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method for periodic lane marker identification and tracking | ||
Patent #
US 9,098,751 B2
Filed 07/27/2012
|
Current Assignee
Gentex Corporation
|
Original Assignee
Gentex Corporation
|
Vehicular rear view camera display system with lifecheck function | ||
Patent #
US 9,117,123 B2
Filed 07/05/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Alert system for vehicle | ||
Patent #
US 9,126,525 B2
Filed 02/25/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera vision system for a vehicle | ||
Patent #
US 9,131,120 B2
Filed 05/15/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,140,789 B2
Filed 12/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system with algorithm switching | ||
Patent #
US 9,146,898 B2
Filed 10/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular camera and method for periodic calibration of vehicular camera | ||
Patent #
US 9,150,155 B2
Filed 01/13/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,171,217 B2
Filed 03/03/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane keeping system and lane centering system | ||
Patent #
US 9,180,908 B2
Filed 11/17/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,187,028 B2
Filed 02/14/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 9,191,574 B2
Filed 03/13/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,191,634 B2
Filed 04/03/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,193,303 B2
Filed 04/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Step filter for estimating distance in a time-of-flight ranging system | ||
Patent #
US 9,194,943 B2
Filed 04/11/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using kinematic model of vehicle motion | ||
Patent #
US 9,205,776 B2
Filed 05/20/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system of assisting a driver of a vehicle | ||
Patent #
US 9,227,635 B1
Filed 09/25/2014
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan North America Incorporated, Nissan Motor Co. Ltd.
|
Driver assistance system for a vehicle | ||
Patent #
US 9,245,448 B2
Filed 06/17/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,244,165 B1
Filed 09/21/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic signaling system for vehicles | ||
Patent #
US 9,248,777 B2
Filed 02/19/2013
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Vehicle vision system with collision mitigation | ||
Patent #
US 9,260,095 B2
Filed 06/13/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,264,672 B2
Filed 12/21/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
Method of calibrating a vehicular camera | ||
Patent #
US 9,296,337 B2
Filed 10/05/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with lens pollution detection | ||
Patent #
US 9,319,637 B2
Filed 03/27/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular collision mitigation system | ||
Patent #
US 9,318,020 B2
Filed 07/27/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Rear collision avoidance system for vehicle | ||
Patent #
US 9,327,693 B2
Filed 04/09/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,335,411 B1
Filed 01/25/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle lane keep assist system | ||
Patent #
US 9,340,227 B2
Filed 08/12/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with yaw rate determination | ||
Patent #
US 9,346,468 B2
Filed 09/29/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for dynamically calibrating vehicular cameras | ||
Patent #
US 9,357,208 B2
Filed 01/20/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system for vehicle | ||
Patent #
US 9,376,060 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and device for detecting road region as well as method and device for detecting road line | ||
Patent #
US 9,378,424 B2
Filed 09/11/2014
|
Current Assignee
Ricoh Company Limited
|
Original Assignee
Ricoh Company Limited
|
Vision system for vehicle | ||
Patent #
US 9,428,192 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system | ||
Patent #
US 9,436,880 B2
Filed 01/13/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with dirt detection | ||
Patent #
US 9,445,057 B2
Filed 02/19/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,440,535 B2
Filed 01/27/2014
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer angle detection system | ||
Patent #
US 9,446,713 B2
Filed 09/25/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system | ||
Patent #
US 9,457,717 B2
Filed 10/27/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 9,463,744 B2
Filed 01/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,469,250 B2
Filed 02/12/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing camera synchronization | ||
Patent #
US 9,481,301 B2
Filed 12/05/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Braking control system for vehicle | ||
Patent #
US 9,481,344 B2
Filed 07/27/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with adaptive wheel angle correction | ||
Patent #
US 9,487,235 B2
Filed 04/01/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle camera alignment system | ||
Patent #
US 9,491,450 B2
Filed 07/30/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Calibration system and method for vehicular surround vision system | ||
Patent #
US 9,491,451 B2
Filed 11/14/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular camera with on-board microcontroller | ||
Patent #
US 9,495,876 B2
Filed 07/27/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle monitoring system | ||
Patent #
US 9,499,139 B2
Filed 12/05/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic control systems for vehicles | ||
Patent #
US 9,505,343 B2
Filed 01/28/2016
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Vehicular multi-camera vision system | ||
Patent #
US 9,508,014 B2
Filed 05/05/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,507,021 B2
Filed 05/09/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 9,545,921 B2
Filed 05/02/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Image processing method for detecting objects using relative motion | ||
Patent #
US 9,547,795 B2
Filed 01/20/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with trailer angle detection | ||
Patent #
US 9,558,409 B2
Filed 12/11/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,555,803 B2
Filed 05/16/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 9,563,809 B2
Filed 04/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with targetless camera calibration | ||
Patent #
US 9,563,951 B2
Filed 05/20/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
METHOD FOR LANE DETECTION | ||
Patent #
US 20170068862A1
Filed 03/27/2015
|
Current Assignee
Aptiv Technologies Limited
|
Original Assignee
Delphi Technologies Inc.
|
Vision display system for vehicle | ||
Patent #
US 9,598,014 B2
Filed 10/17/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,609,289 B2
Filed 08/29/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with image classification | ||
Patent #
US 9,619,716 B2
Filed 08/11/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Personalized driver assistance system for vehicle | ||
Patent #
US 9,623,878 B2
Filed 04/01/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,643,605 B2
Filed 10/26/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system for vehicle | ||
Patent #
US 9,656,608 B2
Filed 06/13/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle camera image quality improvement in poor visibility conditions by contrast amplification | ||
Patent #
US 9,681,062 B2
Filed 09/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Calibration system and method for multi-camera vision system | ||
Patent #
US 9,688,200 B2
Filed 03/03/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using kinematic model of vehicle motion | ||
Patent #
US 9,701,246 B2
Filed 12/07/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle camera lens dirt protection via air flow | ||
Patent #
US 9,707,896 B2
Filed 10/14/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Process for determining state of a vehicle | ||
Patent #
US 9,715,769 B2
Filed 05/23/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera image stitching calibration system | ||
Patent #
US 9,723,272 B2
Filed 10/04/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,731,653 B2
Filed 03/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,736,435 B2
Filed 03/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with enhanced display functions | ||
Patent #
US 9,743,002 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with reduced image color data processing by use of dithering | ||
Patent #
US 9,751,465 B2
Filed 04/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane keeping system and lane centering system | ||
Patent #
US 9,758,163 B2
Filed 11/09/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistant system using influence mapping for conflict avoidance path determination | ||
Patent #
US 9,761,142 B2
Filed 09/03/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with customized display | ||
Patent #
US 9,762,880 B2
Filed 12/07/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle yaw rate estimation system | ||
Patent #
US 9,764,744 B2
Filed 02/24/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular multi-camera vision system | ||
Patent #
US 9,769,381 B2
Filed 11/28/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for enhancing vehicle camera image quality | ||
Patent #
US 9,774,790 B1
Filed 06/12/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with trailer angle detection | ||
Patent #
US 9,779,313 B2
Filed 01/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging and display system for vehicle | ||
Patent #
US 9,789,821 B2
Filed 05/22/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 9,796,332 B2
Filed 05/24/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 9,802,609 B2
Filed 01/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer angle detection system calibration | ||
Patent #
US 9,802,542 B2
Filed 09/19/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 9,824,285 B2
Filed 01/26/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with collision mitigation | ||
Patent #
US 9,824,587 B2
Filed 02/12/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driving assist system for vehicle | ||
Patent #
US 9,834,142 B2
Filed 05/19/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 9,834,216 B2
Filed 01/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for dynamically calibrating vehicular cameras | ||
Patent #
US 9,834,153 B2
Filed 04/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method for periodic lane marker identification and tracking | ||
Patent #
US 9,836,657 B2
Filed 06/25/2015
|
Current Assignee
Gentex Corporation
|
Original Assignee
Gentex Corporation
|
Parking assist system | ||
Patent #
US 9,868,463 B2
Filed 09/28/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using image data transmission and power supply via a coaxial cable | ||
Patent #
US 9,900,490 B2
Filed 02/22/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method of establishing a multi-camera image using pixel remapping | ||
Patent #
US 9,900,522 B2
Filed 12/01/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver active safety control system for vehicle | ||
Patent #
US 9,911,050 B2
Filed 09/04/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing camera synchronization | ||
Patent #
US 9,912,841 B2
Filed 10/31/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Process for determining state of a vehicle | ||
Patent #
US 9,916,699 B2
Filed 07/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with calibration algorithm | ||
Patent #
US 9,916,660 B2
Filed 01/15/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system with image processing and wireless communication | ||
Patent #
US 9,919,705 B2
Filed 09/28/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle collision avoidance system with enhanced pedestrian avoidance | ||
Patent #
US 9,925,980 B2
Filed 09/15/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,940,528 B2
Filed 11/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with adaptive lane marker detection | ||
Patent #
US 9,946,940 B2
Filed 12/15/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,948,904 B2
Filed 08/14/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for controlling a vehicle in accordance with parameters preferred by an identified driver | ||
Patent #
US 9,950,707 B2
Filed 04/17/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailering assist system with trailer angle detection | ||
Patent #
US 9,950,738 B2
Filed 07/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system comprising an imaging device with a single image sensor and image processor for determining a totally blocked state or partially blocked state of the single image sensor as well as an automatic correction for misalignment of the imaging device | ||
Patent #
US 9,972,100 B2
Filed 04/23/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with targetless camera calibration | ||
Patent #
US 9,979,957 B2
Filed 01/26/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with traffic driving control | ||
Patent #
US 9,988,047 B2
Filed 12/12/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,003,755 B2
Filed 12/08/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 10,005,394 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,015,452 B1
Filed 04/16/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with lens pollution detection | ||
Patent #
US 10,021,278 B2
Filed 04/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Braking control system for vehicle | ||
Patent #
US 10,023,161 B2
Filed 10/31/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing corner detection | ||
Patent #
US 10,025,994 B2
Filed 12/02/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Spectral filtering for vehicular driver assistance systems | ||
Patent #
US 10,027,930 B2
Filed 03/28/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Image processing method for detecting objects using relative motion | ||
Patent #
US 10,043,082 B2
Filed 01/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic control systems for vehicles | ||
Patent #
US 10,046,696 B2
Filed 11/10/2016
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Control system for vehicle | ||
Patent #
US 10,046,702 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging and display system for vehicle | ||
Patent #
US 10,053,012 B2
Filed 10/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with enhanced lane tracking | ||
Patent #
US 10,055,651 B2
Filed 03/01/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular multi-camera vision system | ||
Patent #
US 10,057,489 B2
Filed 09/18/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,071,676 B2
Filed 09/12/2016
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,071,687 B2
Filed 11/27/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system with controlled illumination device and camera | ||
Patent #
US 10,075,650 B2
Filed 02/23/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle parking assist system with vision-based parking space detection | ||
Patent #
US 10,078,789 B2
Filed 07/14/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 10,086,747 B2
Filed 08/25/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer parking assist system for vehicle | ||
Patent #
US 10,086,870 B2
Filed 08/16/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with trailering assist function | ||
Patent #
US 10,089,541 B2
Filed 10/02/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with dirt detection | ||
Patent #
US 10,089,540 B2
Filed 09/12/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with front and rear camera integration | ||
Patent #
US 10,089,537 B2
Filed 05/15/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,099,614 B2
Filed 11/27/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 10,099,610 B2
Filed 10/10/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane detection system and method | ||
Patent #
US 10,102,434 B2
Filed 12/22/2015
|
Current Assignee
Omnivision Technologies Incorporated
|
Original Assignee
Omnivision Technologies Incorporated
|
Lane departure warning system and associated methods | ||
Patent #
US 10,102,435 B2
Filed 08/10/2016
|
Current Assignee
Omnivision Technologies Incorporated
|
Original Assignee
Omnivision Technologies Incorporated
|
Vehicle vision system with enhanced display functions | ||
Patent #
US 10,104,298 B2
Filed 08/21/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular camera with on-board microcontroller | ||
Patent #
US 10,106,155 B2
Filed 11/11/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 10,107,905 B2
Filed 11/28/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,110,860 B1
Filed 07/02/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistant system using influence mapping for conflict avoidance path determination | ||
Patent #
US 10,115,310 B2
Filed 09/11/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for lane detection | ||
Patent #
US 10,115,026 B2
Filed 03/27/2015
|
Current Assignee
Aptiv Technologies Limited
|
Original Assignee
Delphi Technologies Inc.
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 10,118,618 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for vehicular control | ||
Patent #
US 10,127,738 B2
Filed 03/12/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with customized display | ||
Patent #
US 10,129,518 B2
Filed 09/11/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle monitoring system | ||
Patent #
US 10,137,892 B2
Filed 11/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method, apparatus and device for detecting lane lines | ||
Patent #
US 10,140,529 B2
Filed 11/25/2016
|
Current Assignee
Neusoft Reach Automotive Technology Shanghai Co. Ltd.
|
Original Assignee
Neusoft Corporation, Technologies Inc.
|
Vision display system for vehicle | ||
Patent #
US 10,144,352 B2
Filed 08/14/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle dynamic control system for emergency handling | ||
Patent #
US 10,144,419 B2
Filed 11/22/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer backup assist system | ||
Patent #
US 10,160,382 B2
Filed 02/04/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with reverse assist | ||
Patent #
US 10,160,437 B2
Filed 02/27/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing multiple cameras and ethernet links | ||
Patent #
US 10,171,709 B2
Filed 03/05/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Road shape recognition apparatus | ||
Patent #
US 10,176,387 B2
Filed 08/24/2015
|
Current Assignee
DENSO Corporation
|
Original Assignee
DENSO Corporation
|
Multi-camera dynamic top view vision system | ||
Patent #
US 10,179,543 B2
Filed 02/27/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera vehicle vision system with image gap fill | ||
Patent #
US 10,187,590 B2
Filed 10/26/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,187,615 B1
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with adaptive wheel angle correction | ||
Patent #
US 10,202,147 B2
Filed 11/07/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for dynamically calibrating vehicular cameras | ||
Patent #
US 10,202,077 B2
Filed 05/23/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 10,207,705 B2
Filed 10/25/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system for vehicle | ||
Patent #
US 10,214,206 B2
Filed 07/11/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System for locating a parking space based on a previously parked space | ||
Patent #
US 10,222,224 B2
Filed 04/15/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Rear vision system for vehicle with dual purpose signal lines | ||
Patent #
US 10,232,797 B2
Filed 04/29/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with calibration algorithm | ||
Patent #
US 10,235,775 B2
Filed 03/07/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Adaptive lane marker detection for a vehicular vision system | ||
Patent #
US 10,255,509 B2
Filed 04/16/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for enhancing vehicle camera image quality | ||
Patent #
US 10,257,432 B2
Filed 09/25/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Calibration system and method for vehicular surround vision system | ||
Patent #
US 10,264,249 B2
Filed 11/07/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using kinematic model of vehicle motion | ||
Patent #
US 10,266,115 B2
Filed 07/10/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera image stitching calibration system | ||
Patent #
US 10,284,818 B2
Filed 07/31/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision using image data transmission and power supply via a coaxial cable | ||
Patent #
US 10,284,764 B2
Filed 02/19/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with video compression | ||
Patent #
US 10,286,855 B2
Filed 03/22/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method for estimating distance between a mobile unit and a vehicle using a TOF system | ||
Patent #
US 10,288,724 B2
Filed 11/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic control systems for vehicles | ||
Patent #
US 10,293,743 B2
Filed 08/10/2018
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Multi-sensor interior mirror device with image adjustment | ||
Patent #
US 10,300,859 B2
Filed 06/08/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer driving assist system | ||
Patent #
US 10,300,855 B2
Filed 10/25/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular display system | ||
Patent #
US 10,300,856 B2
Filed 08/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,306,190 B1
Filed 01/21/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system with enhanced display functions | ||
Patent #
US 10,321,064 B2
Filed 10/11/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with reduction of temporal noise in images | ||
Patent #
US 10,326,969 B2
Filed 08/11/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system with annotated map generation | ||
Patent #
US 10,328,932 B2
Filed 06/01/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system with rear backup video display | ||
Patent #
US 10,336,255 B2
Filed 11/29/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 10,351,135 B2
Filed 11/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Travel control apparatus | ||
Patent #
US 10,384,676 B2
Filed 02/01/2017
|
Current Assignee
Ibaraki Toyota Jidosha Kabushiki Kaisha
|
Original Assignee
Ibaraki Toyota Jidosha Kabushiki Kaisha
|
Vehicle vision system with lens pollution detection | ||
Patent #
US 10,397,451 B2
Filed 07/09/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular lane change system | ||
Patent #
US 10,406,980 B2
Filed 10/11/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system responsive to yaw rate estimation system | ||
Patent #
US 10,407,080 B2
Filed 09/18/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane keeping system and lane centering system | ||
Patent #
US 10,427,679 B2
Filed 09/11/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with reduced image color data processing by use of dithering | ||
Patent #
US 10,434,944 B2
Filed 08/30/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with road line sensing algorithm and lane departure warning | ||
Patent #
US 10,449,899 B2
Filed 05/05/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Processing method for distinguishing a three dimensional object from a two dimensional object using a vehicular system | ||
Patent #
US 10,452,931 B2
Filed 08/06/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with multi-paned view | ||
Patent #
US 10,457,209 B2
Filed 03/28/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,462,426 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system with rear backup video display | ||
Patent #
US 10,486,597 B1
Filed 07/01/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera dynamic top view vision system | ||
Patent #
US 10,486,596 B2
Filed 01/14/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle camera system with image manipulation | ||
Patent #
US 10,493,916 B2
Filed 02/22/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular trailer backup assist system | ||
Patent #
US 10,493,917 B2
Filed 12/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular collision mitigation system | ||
Patent #
US 10,497,262 B2
Filed 11/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 10,509,972 B2
Filed 04/09/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with front and rear camera integration | ||
Patent #
US 10,515,279 B2
Filed 08/30/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle data recording system | ||
Patent #
US 10,523,904 B2
Filed 04/10/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with customized display | ||
Patent #
US 10,542,244 B2
Filed 11/12/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method of synchronizing multiple vehicular cameras with an ECU | ||
Patent #
US 10,560,610 B2
Filed 12/28/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Coaxial cable with bidirectional data transmission | ||
Patent #
US 10,567,705 B2
Filed 06/06/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using image data transmission and power supply via a coaxial cable | ||
Patent #
US 10,567,633 B2
Filed 05/02/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Targetless vehicular camera calibration method | ||
Patent #
US 10,567,748 B2
Filed 05/21/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system | ||
Patent #
US 10,569,804 B2
Filed 01/15/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic control systems for vehicles | ||
Patent #
US 10,569,700 B2
Filed 05/20/2019
|
Current Assignee
Autosignal LLC
|
Original Assignee
Anita Au, Gerald Chan
|
Method for displaying video images for a vehicular vision system | ||
Patent #
US 10,574,885 B2
Filed 08/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with trailering assist function | ||
Patent #
US 10,586,119 B2
Filed 10/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular rear backup vision system with video display | ||
Patent #
US 10,589,678 B1
Filed 11/25/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with accelerated object confirmation | ||
Patent #
US 10,609,335 B2
Filed 03/22/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Video processor module for vehicle | ||
Patent #
US 10,611,306 B2
Filed 08/09/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,616,507 B2
Filed 06/18/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 10,623,704 B2
Filed 03/09/2015
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Method for dynamically calibrating vehicular cameras | ||
Patent #
US 10,640,041 B2
Filed 02/04/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,640,040 B2
Filed 09/10/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for dynamically ascertaining alignment of vehicular cameras | ||
Patent #
US 10,654,423 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward sensing system for vehicle | ||
Patent #
US 10,670,713 B2
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular driving assist system using forward-viewing camera | ||
Patent #
US 10,683,008 B2
Filed 07/15/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular driver assist system | ||
Patent #
US 10,685,243 B2
Filed 08/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with traffic driving control | ||
Patent #
US 10,688,993 B2
Filed 06/04/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with collision mitigation | ||
Patent #
US 10,692,380 B2
Filed 11/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with 3D registration for distance estimation | ||
Patent #
US 10,713,506 B2
Filed 12/15/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular parking assist system that determines a parking space based in part on previously parked spaces | ||
Patent #
US 10,718,624 B2
Filed 03/04/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system with blockage determination and misalignment correction | ||
Patent #
US 10,726,578 B2
Filed 05/14/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistant system using influence mapping for conflict avoidance path determination | ||
Patent #
US 10,733,892 B2
Filed 10/29/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with traffic lane detection | ||
Patent #
US 10,735,695 B2
Filed 10/28/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with temperature input | ||
Patent #
US 10,744,940 B2
Filed 06/25/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailering assist system for vehicle | ||
Patent #
US 10,755,110 B2
Filed 06/27/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,766,417 B2
Filed 10/23/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with reverse assist | ||
Patent #
US 10,773,707 B2
Filed 12/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for determining the course of the road for a motor vehicle | ||
Patent #
US 10,776,634 B2
Filed 03/31/2011
|
Current Assignee
Conti Temic Microelectronic GmbH
|
Original Assignee
Conti Temic Microelectronic GmbH
|
Method for stitching images captured by multiple vehicular cameras | ||
Patent #
US 10,780,827 B2
Filed 11/25/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for determining misalignment of a vehicular camera | ||
Patent #
US 10,780,826 B2
Filed 04/22/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Adaptive forward lighting system for vehicle comprising a control that adjusts the headlamp beam in response to processing of image data captured by a camera | ||
Patent #
US 10,787,116 B2
Filed 09/10/2018
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,793,067 B2
Filed 07/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer driving assist system | ||
Patent #
US 10,800,332 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular collision mitigation system | ||
Patent #
US 10,803,744 B2
Filed 12/02/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system with controlled illumination device and camera | ||
Patent #
US 10,805,550 B2
Filed 09/10/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular adaptive headlighting system | ||
Patent #
US 10,807,515 B2
Filed 10/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular rear backup vision system with video display | ||
Patent #
US 10,814,785 B2
Filed 03/16/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with incident recording function | ||
Patent #
US 10,819,943 B2
Filed 05/05/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system using image data transmission and power supply via a coaxial cable | ||
Patent #
US 10,827,108 B2
Filed 02/17/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,839,233 B2
Filed 03/05/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailering assist system with trailer angle detection | ||
Patent #
US 10,858,042 B2
Filed 04/23/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for determining alignment of vehicular cameras | ||
Patent #
US 10,868,974 B2
Filed 02/19/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with remote processor | ||
Patent #
US 10,870,427 B2
Filed 11/26/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular trailering system | ||
Patent #
US 10,870,449 B2
Filed 10/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method of synchronizing multiple vehicular cameras with an ECU | ||
Patent #
US 10,873,682 B2
Filed 02/10/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 10,875,455 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 10,875,527 B2
Filed 02/18/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 10,875,526 B2
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward sensing system for vehicle | ||
Patent #
US 10,877,147 B2
Filed 06/01/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system for emergency handling | ||
Patent #
US 10,889,293 B2
Filed 11/29/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Device for acquiring lane path indicative data | ||
Patent #
US 6,292,752 B1
Filed 11/06/1998
|
Current Assignee
21ST CENTURY GARAGE LLC
|
Original Assignee
Daimler Chrysler Company LLC
|
Trained neural network engine idle speed control system | ||
Patent #
US 6,092,018 A
Filed 02/05/1996
|
Current Assignee
Ford Global Technologies LLC
|
Original Assignee
Ford Global Technologies LLC
|
Apparatus for determining the distance of a vehicle from a roadway side marking | ||
Patent #
US 5,890,083 A
Filed 03/07/1996
|
Current Assignee
Daimler Chrysler Company LLC
|
Original Assignee
Daimler-Benz AG
|
Closed-loop four wheel steering system having dual response rate rear steering | ||
Patent #
US 4,828,061 A
Filed 06/27/1988
|
Current Assignee
General Motors Corporation
|
Original Assignee
General Motors Corporation
|
4 Claims
-
1. A lane recognition apparatus for a vehicle, comprising:
-
an image picking-up section picking up a road image in front of the vehicle;
a lane-marker candidate-point detecting section detecting coordinate values of a plurality of lane marker candidate points from the road image;
a steering angle detecting section detecting a steering angle of the vehicle, wherein a state equation of an extended Kalman filter uses a change of the vehicle state quantity caused by the steering angle and a vehicle speed; and
a road model parameter calculating section estimating a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity of the vehicle using the extended Kalman filter, on the basis of the coordinate values of the lane marker candidate points, the road model parameter calculating section identifying whether a yaw angle or lateral displacement of the vehicle state quantity is caused by the steering angle, wherein a state equation of the extended Kalman filter uses a change of the vehicle state quantity caused by the steering angle. - View Dependent Claims (2, 3)
-
-
4. A lane recognition apparatus for a vehicle, comprising:
-
a camera picking up a road image in front of the vehicle;
a steering angle sensor for detecting a steering angle of the vehicle; and
a processor coupled to the camera and the steering angle sensor, the processor being configured to, calculate coordinate values of a plurality of lane marker candidate points from the road image, identify whether a yaw angle or lateral displacement of the vehicle state quantity is caused by the steering angle from the detecting steering angle, and estimate a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity from an extended Kalman filter and the coordinate values of the lane marker candidate points, wherein a state equation of the extended Kalman filter uses a change of the vehicle state quantity caused by the steering angle when the yaw angle or lateral displacement of the vehicle state quantity is caused by the steering angle from the detecting steering angle.
-
1 Specification
The present invention relates to an apparatus for recognizing a lane on which a vehicle or other mover travels.
Various lane recognition apparatuses have been proposed in order to assist a driver to drive a vehicle along a lane or to automatically drive a vehicle. Japanese Patent Provisional Publication No. 8-5388 discloses a method for estimating a road shape using a least square method.
However, such a conventional method yet includes several problems to be improved in order to further accurately and stably estimate a road shape.
It is therefore an object of the present invention to provide an improved lane recognition apparatus which is capable of accurately estimating a road shape (a lane) while stably performing the estimation against disturbances.
An aspect of the present invention resides in a lane recognition apparatus which is for a vehicle and which comprises an image picking-up section, a lane-marker candidate-point detecting section and a road model parameter calculating section. The image picking-up section picks up a road image in front of the vehicle. The lane-marker candidate-point detecting section detects coordinate values of a plurality of lane marker candidate points from the road image. The road model parameter calculating section estimates a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity of the vehicle using an extended Kalman filter, on the basis of the coordinate values of the lane marker candidate points.
Another aspect of the present invention resides in a lane recognition apparatus which is for a vehicle and comprises a camera and a processor. The camera picks up a road image in front of the vehicle. The processor is coupled to the camera and is arranged to calculate coordinate values of a plurality of lane marker candidate points from the road image, to estimate a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity from an extended Kalman filter and the coordinate values of the lane marker candidate points.
A further another aspect of the present invention resides in a method for recognizing a lane in front of a vehicle. The method comprises a step for picking up a road image in front of the vehicle, a step for calculating coordinate values of a plurality of candidate points of a lane marker from the road image, and a step for estimating a road model parameter representative of a road shape in front of the vehicle and a vehicle state quantity from an extended Kalman filter and the coordinate values of the lane marker candidate points.
The other objects and features of this invention will become understood from the following description with reference to the accompanying drawings.
FIG. 1 is a block diagram showing a first embodiment of a lane recognition apparatus for a vehicle according to the present invention.
FIG. 2 is a flowchart showing an information processing procedure of the lane recognition apparatus of FIG. 1.
FIGS. 3A and 3B are a plan view and a side view which show a road model employed in the first embodiment.
FIG. 4 is a view showing the image picture on which the road model is developed.
FIG. 5 is an explanatory view for explaining lane marker detecting areas adapted in the present invention.
FIG. 6 is a block diagram showing a second embodiment of a lane recognition apparatus of a vehicle according to the present invention.
FIG. 7 is a view showing a coordinate of the road model according to the present invention.
FIGS. 8A and 8B are explanatory views employed for explaining a straight line detection executed by the lane recognition process.
FIG. 9 is another explanatory view employed for explaining the straight line detection.
FIGS. 10A and 10B are time charts showing the lane marker candidate point which is influenced by a steering angle.
FIG. 11 is time charts showing the lane marker candidate point influenced by noises on a road surface.
FIG. 12 is a time chart showing the lane marker candidate point influenced by noises on a road surface.
FIGS. 13A and 13B are time charts showing the lane marker candidate point influenced by the steering angle.
FIGS. 14A and 14B are time charts showing the lane marker candidate point influenced by the steering angle.
FIGS. 15A and 15B are time charts showing the lane marker candidate point influenced by the steering angle.
FIG. 16 is time charts employed for explaining a merit of a first-order lag of a continuous system of a state equation of the Kalman filter according to the present invention.
FIG. 17 is a plan view showing the road model employed in the second embodiment of the lane recognition apparatus according to the present invention.
FIG. 18 is a view showing a simulation result of the second embodiment according to the present invention.
FIG. 19 are graphs showing the simulation result of the second embodiment.
Embodiments of the invention will now be described based on the drawings.
[First Embodiment]
FIG. 1 is a block diagram showing an embodiment of a lane recognition apparatus 1 for a vehicle according to the invention. Lane recognition apparatus 1 for a vehicle according to the present embodiment comprises a CCD camera 101 for picking up an image of a scene of a road in front of the vehicle (which corresponds to the image pickup section of the invention) a pre-process section 102 for uniformly processing an entire screen of a video signal from CCD camera 101, a lane marker detecting small area setting section 103 for setting a plurality of small areas for detecting a lane marker on an input screen, a straight line detecting section 104 for detecting parts of the lane marker in the plurality of small areas, a lane marker candidate point verifying section 105 for verifying that results of straight line detection are parts of the lane marker, and a road parameter calculating section 106 for calculating road parameters for representing the shape of the road in front of the vehicle based on the result of lane marker detection.
The lane recognition apparatus 1 comprises a processor 100 which is constituted by a microcomputer and which is coupled to CCD camera 101. The microcomputer is arranged to store the sections 101 through 106 of the lane recognition apparatus in the form of software and to perform the processes of the sections 101 through 106 by executing a program control in processor 100.
Now, there will be described steps for recognizing a lane executed by lane recognition apparatus 1 according to the present invention.
FIG. 2 is a flow chart showing a flow of processes in the first embodiment according to the present invention. First, lane recognition apparatus 1 is started when a switch is operated by the driver or the vehicle is ignited at step 201, and, road parameters for recognizing the shape of a road in front of the vehicle are initialized at step 202.
The road parameters are defined according to the following procedure. As shown in FIGS. 3A and 3B, a road coordinate system is defined as an XYZ system in which the center of an image pickup lens of CCD camera 101 is the origin. The X-axis extends from the right to the left as viewed in the traveling direction of the vehicle. The Y-axis extends upward in the direction of the height of the vehicle. The Z-axis is the optical axis of the lens in the traveling direction of the vehicle. As shown in FIG. 4, a plane coordinate system of an image processing screen is defined in which the origin is at the upper left corner of the screen. The x-axis horizontally extends from the left to the right, and the y-axis vertically extends from the top to the bottom. These definition are in accordance with the direction in which a screen is scanned in television communication systems such as NTSC.
The relationship between those two coordinate systems is as shown in FIG. 7 and, for simplicity, coordinate transformation from the road coordinate system to the plane coordinate system is expressed by Equations (1) and (2) shown below where the origin of the plane coordinate system is located on the Z-axis of the road coordinate system as shown in FIG. 7.
where f represents a parameter that represents the focal length of the lens.
While a planar structure of a road is defined by straight lines, curves having constant curvatures, and clothoid curves having constant curvature change rates for connecting them, a section of the road of several tens meters in front of a vehicle can be regarded as a curved road having a constant curvature or a straight road. Then, the shape of a lane marker was formulated as shown in FIG. 3A. Similarly, a longitudinal structure of the same was formulated as shown in FIG. 3B because it can be regarded as having a constant gradient. The formulae are respectively given as Equations (3) and (4) below.
where ρ represents the curvature of the road; φ represents a yaw angle of the vehicle to the road; yc represents lateral displacement of the vehicle from a left lane marker; W represents the vehicle width; i represents the left line marker when it is 0 and represents a right lane marker when it is 1; η represents a pitch angle of the optical axis of the lens to the road surface; and h represents the height of the camera above the ground.
The shape of a lane marker projected on the plane coordinate system of the image processing screen can be formulated from Equations (1) through (4). Equations (1) through (4) can be rearranged by eliminating X, Y, and Z to obtain the following Equations (5) through (10).
where
and
The terms c0 and d0 are correction values that are required because the actual origin is located at the upper left corner of the image processing screen in spite of the fact that the origin of the plane coordinate system is on the Z-axis in the road coordinate system in FIG. 7.
It is apparent from the above that the curvature of the road, the pitch angle and yaw angle of the vehicle, and the lateral displacement of the vehicle within the lane can be estimated by identifying values of parameters a through e in Equation (5) which are satisfied by a lane marker candidate point detected through image processing. FIG. 4 shows association between an example of a two-dimensional road model and parameters a through e on a screen.
Returning to FIG. 2, at step 203, an image signal of an image as shown in FIG. 4 picked up by CCD camera 101 is inputted to pre-processing section 102 which performs a pre-process on the image signal. For example, as a pre-process for detecting a lane marker, primary space differentiation is performed with a Sobel Filter to emphasize a boundary between the lane marker and a road surface. The object of lane marker detection is such a boundary. Since a lane marker has regions which are nearly horizontal and regions which are nearly vertical depending on the curvature of the road, two edge images are created using horizontal differentiation and vertical differentiation. Other edge emphasizing filters may be used to emphasize a boundary between the lane marker and road surface.
As shown in FIG. 6, lane recognition apparatus I for a vehicle of the second embodiment according to the present invention comprises CCD camera 101 for picking up an image of a scene of a road in front of the vehicle (which corresponds to the image pickup section of the invention), pre-process section 102 for uniformly processing an entire screen of a video signal from CCD camera 101, lane marker detecting small area setting section 103 for setting a plurality of small areas for detecting a lane marker on an input screen, straight line detecting section 104 for detecting parts of the lane marker in the plurality of small areas, lane marker candidate point verifying section 105 for verifying that results of straight line detection are parts of the lane marker, road parameter calculating section 106 for calculating road parameters for representing the shape of the road in front of the vehicle based on the result of lane marker detection, a steering angle detecting section 108 for detecting a steering angle of the vehicle and transmitting the detected steering angle to road parameter calculating section 106, and a vehicle speed detecting section 107 for detecting a traveling speed of the vehicle and transmitting the detected traveling speed to road parameter calculating section 106.
At subsequent step 204, a plurality of small areas are set in order to detect a lane marker which indicates the lane in which the vehicle is traveling on the screen. As shown in FIG. 5, the detection areas are set as predetermined sections defined along the shape of the road identified from the results of the previous image processing or road parameters which have been initially set. At this time, sections 1 through 5 are set such that they become equal distances when the screen is transformed into an actual three-dimensional road coordinate system.
At step 205, straight lines are detected in the small regions set at step 204. Specifically, if a boundary between the lane marker in a certain small area and the road surface is identified as indicated by the black solid lines in FIG. 5 from the results of the previous image processing or initial setting, the position of the boundary at this time may undergo changes in the form of parallel movement as shown in FIG. 8A and changes of the inclination as shown in FIG. 8B. Then, those changes are combined to set a trapezoidal small area as shown in FIG. 9 as a detection area, and line segments extending across the top and bottom sides are to be detected. The size of the detection area is determined by the range p of the lateral behavior and the range q of the inclinational behavior, and p×q line segments are to be detected. The sum of edge strengths of pixels that make up each of the line segments on an edge image is calculated for each of the line segments, and the coordinates of the starting and end points of the line segment having the greatest sum are outputted as a result of the detection.
At subsequent step 206, it is verified whether the result of the detection at step 205 can support a judgment that a part of a lane marker has been detected. A road has many noises other than lane markers, including joints of pavement, shadows, and cars traveling ahead. In order to prevent erroneous detection of straight line segments originating from such noises, conditions as described below are taken into consideration when using a result of straight line detection as a candidate point of a lane marker.
Specifically, the range of changes in the position of a lane marker candidate point is first limited by the time required for processing the image, the vehicle speed, and the shape of the road. Since a lane marker is a white or yellow line, it has a pair of rows of positive and negative edge points. Further, the movement of a certain lane marker candidate point is correlated with the movement of other candidate points.
A result of straight line detection which satisfies such conditions is used as a lane marker candidate point for estimating parameters of a road model.
At subsequent step 207, parameters for the road model are calculated from the position of the lane marker candidate point on the screen obtained at step 206. In the present embodiment, an extended Kalman filter is used as means for estimating an equation for a two-dimensional road model based on a result of detection of a lane marker candidate point through image processing.
The following Equation (11) is derived from the above-described Equations (1) through (4). This equation is used as an output equation in configuring an extended Kalman filter, and the value of an x-coordinate at a y-coordinate value defined on a plane under image processing is calculated from the road curvature and a state quantity of the vehicle.
The estimated state quantity in the extended Kalman filter includes lateral displacement yc of the vehicle, road curvature ρ, vehicle yaw angle φ, pitch angle η, and height h of CCD camera 101. Further, the focal length f of the lens and the lane width W are treated as constant values. A state equation expressed as Equation (12) shown below is obtained if it is defined as a random walk model in a discrete system which is driven by white Gaussian noises ν on the assumption that a change of each estimated state quantity behaves stochastically.
When State Equation (12) and Output Equation (11) are simplified into Equations (13) and (14) shown below, the extended Kalman filter is configured by Equations (15) through (18).
xs(k+1)=Asxs(k)+Gsv(k) (13)
where M(k) represents covariance of states which is determined by the process; P(k) represents covariance of later states obtained from observed values; K(k) represents the gain of the Kalman filter; Q represents covariance of observation noises; R represents covariance of process noises; I represents a unit matrix; k represents a lag; and
While the state equation has configured as a random walk model in a discrete system in the above description, it may be represented as a first-order lag in a continuous system. A state equation in this case is given as Equation (19) shown below.
In Equation (19), λ is a parameter for setting a frequency band in which disturbances can be introduced, and w represents white noises having an average value of 0. In this case, each estimated state quantity X is expressed by the following equation (20).
A power spectral density Φ (ω) is obtained which is equivalent to a Poisson'"'"'s square wave having a 0-crossing frequency of N per second and an amplitude X0 where λX=2N and variance of w is 2λXX02.
Therefore, even if actual changes in the estimated state quantities are different from those in a Poisson square wave, since an average value of the changes and the behavior of the same related to variance agree with those in a Poisson square wave, λX and w can be defined from actual traveling conditions. Although a Poisson square wave is used here, any other model allowing understanding of actual traveling conditions of a vehicle may be used.
Since a straight line and a curve are connected by a clothoid curve in an actual road structure, an estimation result close to the actual road shape can be obtained as shown in FIG. 16 by estimating the change in the curvature with a first-order lag.
Returning to FIG. 2, it is judged at step 208 whether the road shape has been correctly estimated from road model parameters a through e obtained at step 207. Referring to parameter a for example, when the lateral position of the vehicle calculated from parameter a exceeds a predetermined range or when a change (in the speed in the lateral direction) from the result of the previous image processing exceeds a predetermined value, it is judged that the estimation of the road shape from road model parameters a through e is incorrect. This similarly applies to parameters b through e, and the estimation of the road shape from road model parameters a through e is judged to be incorrect when a physical quantity calculated from each of the parameters exceeds a predetermined range or when quantities of change of them exceed predetermined values. If the estimation of the road shape is judged to be correct, the process proceeds to subsequent step 209, and the process returns to step 202 to be re-executed from the initializing process when the estimation of the road shape is judged to be incorrect.
At step 209, the road parameters calculated at step 207 are preserved in a data storage area. Thereafter, the process returns to step 203 to acquire an image to perform processing of the next screen.
The processes in the present embodiment are performed according to the above procedure.
While changes in the parameters have been described as being driven by independent white Gaussian noises in the first embodiment, since such changes have some correlation with changes in the yaw angle and the lateral position, changes in the pitch angle and the camera height, and changes in the curvature and yaw angle, a state equation may be configured in consideration to those factors.
[Second Embodiment]
FIGS. 10A and 10B show time charts (time-series changes) of a coordinate system of a lane marker candidate point projected on the surface of the CCD. When the vehicle is gradually steered along the lane as in the case of automatic driving, a lane marker candidate point moves gently as shown in FIG. 10A. On the contrary, when the steering wheel is operated suddenly as shown in FIG. 10B, a lane marker candidate point moves at a high speed which does not occur during automatic driving. Even when the steering wheel is gradually operated, erroneous recognition of a lane marker can be caused by a noise on the road surface to cause an abrupt change in the coordinate of a lane marker candidate point. FIG. 11 shows erroneous recognition of a lane marker candidate point caused by a road surface that is wetted by rain.
As described above, when a state estimator is configured based on an assumption that all movements of a lane marker candidate points are stochastic changes, erroneous recognition frequently occurs in bad weather if high dynamic characteristics of candidate points are set in the estimator, although an estimated value will follow up a true value with high performance when the steering wheel is operated. On the contrary, if low dynamic characteristics are set in the estimator, a problem arises in that an estimated value will be delayed from a true value when the steering wheel is operated.
A yaw angle or lateral displacement caused by disturbances such as a transverse gradient of a road or side wind has a low frequency band, while a yaw angle or lateral displacement caused by a steering angle has a sufficiently high frequency band. Therefore, the above-described problem can be solved by identifying whether a yaw angle or lateral displacement is caused as a result of input of a steering angle.
In the present embodiment, pitching and bouncing caused by a curvature of a road or an irregular road surface are regarded as stationary stochastic processes, and motions of a vehicle caused by the input of a steering angle are treated as deterministic states based on a vehicle model. Thus, a movement of a lane marker candidate point projected on the surface of the CCD is represented as a combination of a stochastic behavior caused by a disturbance acting on the vehicle and a deterministic behavior in accordance with a steering angle. By configuring an extended Kalman filter in such a manner, it is possible to reduce erroneous recognition of a lane marker attributable to noises on a road surface while maintaining preferable properties of following up a quick behavior of the vehicle at the input of a steering angle.
As shown in FIG. 6, lane recognition apparatus 1 for a vehicle of the second embodiment according to the present invention comprises CCD camera 101 for picking up an image of a scene of a road in front of the vehicle (which corresponds to the image pickup section of the invention), pre-process section 102 for uniformly processing an entire screen of a video signal from CCD camera 101, lane marker detecting small area setting section 103 for setting a plurality of small areas for detecting a lane marker on an input screen, straight line detecting section 104 for detecting parts of the lane marker in the plurality of small areas, lane marker candidate point verifying section 105 for verifying that results of straight line detection are parts of the lane marker, road parameter calculating section 106 for calculating road parameters for representing the shape of the road in front of the vehicle based on the result of lane marker detection, a steering angle detecting section 108 for detecting a steering angle of the vehicle and transmitting the detected steering angle to road parameter calculating section 106, and a vehicle speed detecting section 107 for detecting a traveling speed of the vehicle and transmitting the detected traveling speed to road parameter calculating section 106.
Steps for recognizing a lane will now be described.
Since some of the steps for recognizing a lane in the second embodiment are the same as those in the flow chart shown in FIG. 2, the following description will be focused on differences from the first embodiment with reference to FIG. 2.
In the second embodiment, a road model is defined as indicated by the plan view in FIG. 17. It is different from FIG. 3A in that the second embodiment shown in FIG. 17 uses lateral displacement yCr of a vehicle relative to a centerline of a road unlike FIG. 3A in which lateral displacement yc of a vehicle relative to a left line marker is used as lateral displacement of the vehicle. It should be noted that yc=W/2−yCr.
While processes at steps 201 and 202 shown in FIG. 2 employed in the second embodiment are the same as those in the above described first embodiment, the shape of a lane marker shown in FIG. 17 is expressed by Equation (22) shown below from the relationship expressed by yc =W/2−Ycr. A longitudinal structure of the same is expressed by Equation (23) similarly to the above-described first embodiment.
where ρ represents the curvature of the road; φr represents a yaw angle of the vehicle to the centerline of the road; YCr represents lateral displacement of the center of gravity the vehicle from the centerline of the road; i is a lane marker number which represents a left lane marker when it is 0 and represents a right lane marker when it is 1; W represents the vehicle width; Z represents a distance in front of the vehicle from the center of the lens; X represents a distance to the left of the vehicle from the center of the lens; η represents a pitch angle of the vehicle; and h represents the height of the center of the lens above the road surface.
The shape of a lane marker projected on a plane coordinate system of an image processing screen can be formulated from Equations (1), (2), (22) and (23). Equations (1), (2), (22) and (23) can be rearranged to obtain the following Equation (24).
The present embodiment is aimed at estimating the shape of a road and a state quantity of a vehicle from a combination of (x, y) and a steering angle, and a vehicle is expressed by the following State Equation (25) based on a common two-wheeled model.
Constants a11, a12, a13, a31, a32, a33, b11, and b31 in Equation (25) are constants determined by the vehicle specifications shown below.
where lf(lr) represents the distance between the center of gravity and the front (or rear) wheel; Cf(Cr) represents the full cornering power of the front (rear) wheels for two wheels; m represents the vehicle weight; I represents a yawing moment of inertia of the vehicle; θ represents a steering angle; N represents a steering gear ratio; V represents the vehicle speed; and φ represents a yaw rate.
The same processes as those in the above-described first embodiment are performed at steps 203 through 206.
At subsequent step 207, parameters of a road model are calculated from the position of a lane marker candidate point on a screen obtained at step 206. An extended Kalman filter is used also in the present embodiment as means for estimating an equation for a two-dimensional road model based on the result of detection of a lane marker candidate point through image processing.
A behavior of a stochastic state variable ξ for the curvature ρ, pitch angle η, the quantity of a bounce h, and various disturbances is approximated as a first-order system driven by white noises as indicated by the following Equation (26).
where λ is used for setting a frequency band in which disturbances can be introduced; q corresponds to a standard deviation of process noises; ν represents a normalized white Gaussian noise. A state equation of the vehicle is expressed by the following Equation (27) in which M and F represent a yaw moment and a lateral force originating from disturbances acting on the vehicle; and [νρνηνh νM νF]T are put on an assumption of the presence of white Gaussian noises. qρ, qη, qh, qM, and qF represent standard deviations of disturbances that drive the respective state variables. The yaw moment and lateral force of disturbances are treated as state variables here to improve lane follow-up properties by providing feedback of those state quantities and to absorb any shift of the steering wheel from a neutral position during a straight drive due to a stationary transverse gradient of a road or a side wind or any shift of the steering wheel from the neutral position at the time of shipment.
Equation (27) is simplified into the following Equation (28) in a discrete form with the state variables maintained.
A state variable vector is accompanied by a suffix “S” as represented by “XS” in order to prevent it from mistaken as the x of the coordinates of the CCD surface. An output x is the x-coordinate value of a pixel of the CCD surface. The output equation is a non-linear function of the state variables as indicated by Equation (24). Specifically, (x, y) coordinate values are the coordinates of lane marker candidate points, ten points being selected in total for left and right line markers, the y-coordinate system being a fixed value. The output equation for a j-th (j ranges from 1 to 10) x-coordinate is as expressed by the following Equation (29).
Equation (29) is simplified into the following Equation (30). g(Xs, y) represents a non-linear function of Xs and y.
The extended Kalman filter is expressed by the following Equations (31) through (34).
where M(k) represents covariance of states which is determined by the process; P(k) represents covariance of states after an observation value is obtained; and K(k) represents the gain of the Kalman filter; and
The parameters for the road model are obtained using the extended Kalman filter, and it is judged at subsequent step 208 whether the road shape has been correctly estimated from road model parameters a through e obtained at step 207 just as in the first embodiment described above. If the estimation of the road shape is judged to be correct, the process proceeds to subsequent step 209, and the process returns to step 202 to be re-executed from the initializing process when the estimation of the road shape is judged to be incorrect.
At step 209, the road parameters calculated at step 207 are preserved in a data storage area. Thereafter, the process returns to step 203 to acquire an image to perform processing of the next screen.
Evaluation and comparison of performance was conducted between an extended Kalman filter utilizing a cause-effect relationship between state quantities of a vehicle caused by a steering angle and an extended Kalman filter for which no steering angle information was considered, with reference to a yaw rate which was actually measured with a gyroscope loaded on the vehicle. Referring to conditions for the evaluation, they were evaluated under two conditions, i.e., (1) a steering angle was abruptly inputted, and (2) erroneous recognition of a lane marker was caused by noises on a road surface. Since a lane marker candidate point is detected through edge processing as a basic process, contrast caused by noises such as rain on the road is erroneously recognized under the condition (2). This results in a discontinuous behavior as shown in FIG. 12.
First, FIGS. 13A and 13B show results of estimation by the extended Kalman filter for which no steering angle information was considered and in which high dynamic characteristics were set. FIG. 13A shows a result of estimation under the condition (1), and FIG. 13B shows a result of estimation under the condition (2). As shown in FIG. 13A, the estimated value follows up the true value with high response when a steering angle is quickly inputted per the condition (1) described above. However, as apparent from FIG. 13B, estimation errors having great amplitudes occur in this state when there are many noises on the road surface as experienced under the condition (2).
FIGS. 14A and 14B show results of estimation by the extended Kalman filter for which no steering angle information was considered and in which low dynamic characteristics were set. FIG. 14A shows a result of estimation under the condition (1), and FIG. 14B shows a result of estimation under the condition (2). In this case, while estimation errors at the time of erroneous recognition have amplitudes smaller than those in the example shown in FIGS. 13A and 13B, it is apparent that the dynamic characteristics of the estimator are too low to obtain correct estimation values.
Thus, the extended Kalman filter for which no steering angle information is considered has tradeoff between the property of following up a true value (speed of estimation) and estimation errors at the time of erroneous recognition (anti-noise performance).
On the contrary, FIGS. 15A and 15B show results of estimation according to the present invention. The results of the estimation were obtained using the extended Kalman filter for which steering angle information was considered. FIG. 15A shows a result of estimation under the condition (1), and FIG. 15B shows a result of estimation under the condition (2). The dynamic characteristics of the extended Kalman filter of this example were kept constant regardless of the conditions. The results show that the extended Kalman filter for which steering angle information is considered can overcome the tradeoff that is a problem in the extended Kalman filters shown in FIGS. 13A, 13B, 14A and 14B because the vehicle behavior caused by a steering angle is modeled.
In general, conventional lane tracking systems are constituted by an image processing system for estimating lateral displacement of a point for forward observation by detecting a lane marker and a steering control system operating based on information from the image processing system. However, a control system utilizing estimated values of intermediate variables such as lateral displacement of a point for forward observation is useless for optimal control of a steering system. It is more rational and efficient to estimate and use state variables of a vehicle required for optical steering control system directly with an image processing system. That is, in the present embodiment, state quantities of a vehicle are directly estimated from coordinate values on the image pickup surface of a CCD to perform optimal control.
H2 control can be easily configured by extending the above-described Equation (27) as it is into a generalized plant. However, since the output equation is non-linear as apparent from Equation (24), the extended Kalman filter represented by Equations (31) through (34) is used for estimating state quantities, and a feedback gain obtained to allow observation of all states is used for a regulator (state feedback section). This makes it possible to minimize H2 norm from disturbance w to control quantity z on an approximated basis while it is a non-linear system.
In Equations (35), a generalized plant equivalent to an optimal regulator is configured, and Q is a weight for lateral displacement. Frequency shaping may be adopted instead of such a scalar weight. The feedback gain is given by K=−B2TH where H is a positive definite solution to Riccati'"'"'s Equation (36).
FIG. 18 shows examples of lane markers used in a simulation (of a travel around a corner bent to the left). The shapes and positions of lane markers projected on a screen change with the vehicle depending on the curvature and a state quantity of the vehicle. By way of example, FIG. 19 shows comparison between values estimated with a Kalman filter and true state quantities during the simulation when the vehicle enters a curved section having no transition curve on an automatic steering basis. FIG. 19 shows that an actual state and an estimated value preferably match even when a steering angle is quickly inputted.
This application is based on a prior Japanese Patent Application No. 2000-302709. The entire contents of a Japanese Patent Application No. 2000-302709 with a filing date of Oct. 2, 2000 are hereby incorporated by reference.
Although the invention has been described above by reference to certain embodiments of the invention, the invention is not limited to the embodiments described above. Modifications and variations of the embodiments described above will occur to those skilled in the art in light of the above teachings. The scope of the invention is defined with reference to the following claims.