System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion
CAFCFirst Claim
1. An ego-motion determination system for generating an estimate as to the ego-motion of a vehicle moving along a roadway comprising:
- A. an image receiver configured to receive image information relating to a series of at least two images recorded as the vehicle moves along a roadway; and
B. a processor configured to process the image information received by the image receiver to generate an ego-motion estimate of the vehicle relative to the roadway.
4 Assignments
Litigations
1 Petition

Accused Products

Abstract
An ego-motion determination system is disclosed for generating an estimate as to the ego-motion of a vehicle moving along a roadway. The ego-motion determination system includes an image information receiver and a processor. The image information receiver is configured to receive image information relating to a series of at least two images recorded as the vehicle moves along a roadway. The processor is configured to process the image information received by the image receiver to generate an ego-motion estimate of the vehicle, including the translation of the vehicle in the forward direction and the rotation of the vehicle around a vertical axis as between, for example, successive images.
358 Citations
Driver assistance system for vehicle | ||
Patent #
US 7,873,187 B2
Filed 08/16/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
VISION SYSTEM FOR VEHICLE | ||
Patent #
US 20110122249A1
Filed 01/31/2011
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Driver assistance system for vehicle | ||
Patent #
US 7,949,152 B2
Filed 12/28/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
DRIVER ASSISTANCE SYSTEM FOR VEHICLE | ||
Patent #
US 20110093179A1
Filed 12/28/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
IMAGING AND DISPLAY SYSTEM FOR VEHICLE | ||
Patent #
US 20110193961A1
Filed 02/09/2011
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
IMAGING SYSTEM FOR VEHICLE | ||
Patent #
US 20110216198A1
Filed 05/13/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Detecting and recognizing traffic signs | ||
Patent #
US 8,064,643 B2
Filed 12/06/2007
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Imaging System for Vehicle | ||
Patent #
US 20100265048A1
Filed 09/11/2008
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
IMAGE RECORDING METHODS AND SYSTEMS FOR RECORDING A SCENE-CAPTURING IMAGE WHICH CAPTURES ROAD SCENES AROUND A CAR, AND MACHINE READABLE MEDIUM THEREOF | ||
Patent #
US 20100103265A1
Filed 10/02/2009
|
Current Assignee
Winstron Corporation
|
Original Assignee
Wistron Corporation
|
MULTIOBJECT FUSION MODULE FOR COLLISION PREPARATION SYSTEM | ||
Patent #
US 20100191391A1
Filed 01/19/2010
|
Current Assignee
GM Global Technology Operations LLC
|
Original Assignee
GM Global Technology Operations Incorporated
|
BUNDLING OF DRIVER ASSISTANCE SYSTEMS | ||
Patent #
US 20100172542A1
Filed 10/05/2009
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Imaging system for vehicle | ||
Patent #
US 7,792,329 B2
Filed 10/27/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
IMAGING SYSTEM FOR VEHICLE | ||
Patent #
US 20100045797A1
Filed 10/27/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Cameras to determine vehicle heading | ||
Patent #
US 7,774,113 B2
Filed 10/07/2004
|
Current Assignee
TRW Limited
|
Original Assignee
TRW Limited
|
Environment recognition device | ||
Patent #
US 7,804,980 B2
Filed 08/10/2006
|
Current Assignee
DENSO Corporation
|
Original Assignee
DENSO Corporation
|
MARK-ERASABLE PEN CAP | ||
Patent #
US 20100266326A1
Filed 04/21/2009
|
Current Assignee
Cheng-Hua Chuang
|
Original Assignee
Cheng-Hua Chuang
|
SYSTEMS AND METHODS FOR EXTRACTING PLANAR FEATURES, MATCHING THE PLANAR FEATURES, AND ESTIMATING MOTION FROM THE PLANAR FEATURES | ||
Patent #
US 20100284572A1
Filed 05/06/2009
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell International Inc.
|
FRAME BY FRAME, PIXEL BY PIXEL MATCHING OF MODEL-GENERATED GRAPHICS IMAGES TO CAMERA FRAMES FOR COMPUTER VISION | ||
Patent #
US 20100283778A1
Filed 09/12/2006
|
Current Assignee
Centerus Inc.
|
Original Assignee
Centerus Inc.
|
DRIVER ASSISTANCE SYSTEM FOR VEHICLE | ||
Patent #
US 20100312446A1
Filed 08/16/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Imaging system for vehicle | ||
Patent #
US 7,526,103 B2
Filed 04/14/2005
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Collision Warning System | ||
Patent #
US 20090143986A1
Filed 01/19/2005
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Headlight, taillight and streetlight detection | ||
Patent #
US 7,566,851 B2
Filed 03/22/2007
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
IMAGING SYSTEM FOR VEHICLE | ||
Patent #
US 20090208058A1
Filed 04/24/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Driver assistance system for vehicle | ||
Patent #
US 7,616,781 B2
Filed 04/24/2009
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
METHOD AND APPARATUS FOR VISION BASED MOTION DETERMINATION | ||
Patent #
US 20090279741A1
Filed 08/28/2008
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell BV
|
System and method for on-road detection of a vehicle using knowledge fusion | ||
Patent #
US 7,639,841 B2
Filed 12/19/2005
|
Current Assignee
Siemens Corp.
|
Original Assignee
Continental Automotive GmbH, Siemens Corp.
|
Moving obstacle detecting device | ||
Patent #
US 7,346,191 B2
Filed 07/13/2005
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan Motor Co. Ltd.
|
Method and Device for Determining the Speed of a Vehicle | ||
Patent #
US 20080091315A1
Filed 11/16/2005
|
Current Assignee
Conti Temic Microelectronic GmbH
|
Original Assignee
Conti Temic Microelectronic GmbH
|
DETECTING AND RECOGNIZING TRAFFIC SIGNS | ||
Patent #
US 20080137908A1
Filed 12/06/2007
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Object detection apparatus, object detection method and object detection program | ||
Patent #
US 20080278576A1
Filed 05/10/2007
|
Current Assignee
Honda Motor Company
|
Original Assignee
Honda Motor Company
|
Real-time obstacle detection with a calibrated camera and known ego-motion | ||
Patent #
US 7,446,798 B2
Filed 02/02/2004
|
Current Assignee
Siemens Corp.
|
Original Assignee
Siemens Corporate Research Incorporated
|
Environment recognition device | ||
Patent #
US 20070047809A1
Filed 08/10/2006
|
Current Assignee
DENSO Corporation
|
Original Assignee
DENSO Corporation
|
Headlight, Taillight And Streetlight Detection | ||
Patent #
US 20070221822A1
Filed 03/22/2007
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Moving obstacle detecting device | ||
Patent #
US 20060013480A1
Filed 07/13/2005
|
Current Assignee
Nissan Motor Co. Ltd.
|
Original Assignee
Nissan Motor Co. Ltd.
|
Automatic taxi manager | ||
Patent #
US 7,050,909 B2
Filed 01/29/2004
|
Current Assignee
Northrop Grumman Systems Corp.
|
Original Assignee
Northrop Grumman Corporation
|
System and method for on-road detection of a vehicle using knowledge fusion | ||
Patent #
US 20060177099A1
Filed 12/19/2005
|
Current Assignee
Siemens Corp.
|
Original Assignee
Siemens Corp.
|
Moving vehicle in cuboidal panorama | ||
Patent #
US 7,117,090 B2
Filed 08/30/2004
|
Current Assignee
Siemens AG
|
Original Assignee
Siemens AG
|
Moving vehicle in cuboidal panorama | ||
Patent #
US 20050049788A1
Filed 08/30/2004
|
Current Assignee
Siemens AG
|
Original Assignee
Siemens AG
|
Cameras | ||
Patent #
US 20050113995A1
Filed 10/07/2004
|
Current Assignee
TRW Limited
|
Original Assignee
TRW Limited
|
Automatic taxi manager | ||
Patent #
US 20050171654A1
Filed 01/29/2004
|
Current Assignee
Northrop Grumman Systems Corp.
|
Original Assignee
Northrop Grumman Corporation
|
Imaging system for vehicle | ||
Patent #
US 6,946,978 B2
Filed 04/24/2003
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Imaging system for vehicle | ||
Patent #
US 20050232469A1
Filed 04/14/2005
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
Real-time obstacle detection with a calibrated camera and known ego-motion | ||
Patent #
US 20040183905A1
Filed 02/02/2004
|
Current Assignee
Siemens Corp.
|
Original Assignee
Siemens Corporate Research Incorporated
|
Imaging system for vehicle | ||
Patent #
US 20030236622A1
Filed 04/24/2003
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
MOVING OBJECT DETECTION APPARATUS AND MOVING OBJECT DETECTION METHOD | ||
Patent #
US 20110298988A1
Filed 04/26/2011
|
Current Assignee
Toshiba Corporation
|
Original Assignee
Toshiba Corporation
|
Imaging system for vehicle | ||
Patent #
US 8,090,153 B2
Filed 05/13/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Frame by frame, pixel by pixel matching of model-generated graphics images to camera frames for computer vision | ||
Patent #
US 8,102,390 B2
Filed 09/12/2006
|
Current Assignee
Centerus Inc.
|
Original Assignee
Centerus Inc.
|
Automatic lighting system with adaptive function | ||
Patent #
US 8,070,332 B2
Filed 03/29/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision warning system | ||
Patent #
US 8,082,101 B2
Filed 01/19/2005
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Method and device for determining the speed of a vehicle | ||
Patent #
US 8,140,214 B2
Filed 11/16/2005
|
Current Assignee
Conti Temic Microelectronic GmbH
|
Original Assignee
Conti Temic Microelectronic GmbH
|
Automatic lighting system | ||
Patent #
US 8,142,059 B2
Filed 11/09/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Camera system for vehicles | ||
Patent #
US 8,164,627 B1
Filed 10/12/2000
|
Current Assignee
BMW AG
|
Original Assignee
BMW AG
|
Vision system for vehicle | ||
Patent #
US 8,189,871 B2
Filed 01/31/2011
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
System and method for extraction of features from a 3-D point cloud | ||
Patent #
US 8,199,977 B2
Filed 05/07/2010
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell International Inc.
|
Forward facing sensing system for a vehicle | ||
Patent #
US 8,217,830 B2
Filed 07/28/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and apparatus for vision based motion determination | ||
Patent #
US 8,238,612 B2
Filed 08/28/2008
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell International Inc.
|
Bundling of driver assistance systems | ||
Patent #
US 8,254,635 B2
Filed 10/05/2009
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Forward facing sensing system for vehicle | ||
Patent #
US 8,294,608 B1
Filed 07/03/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Object detection apparatus, object detection method and object detection program | ||
Patent #
US 8,300,887 B2
Filed 05/10/2007
|
Current Assignee
Honda Motor Company
|
Original Assignee
Honda Motor Company
|
Imaging system for vehicle | ||
Patent #
US 8,325,986 B2
Filed 12/22/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
VOTING STRATEGY FOR VISUAL EGO-MOTION FROM STEREO | ||
Patent #
US 20120308114A1
Filed 05/31/2011
|
Current Assignee
Ibaraki Toyota Jidosha Kabushiki Kaisha
|
Original Assignee
Czech Technical University In Prague, Toyota Motor Europe SA
|
Systems and methods for extracting planar features, matching the planar features, and estimating motion from the planar features | ||
Patent #
US 8,340,400 B2
Filed 05/06/2009
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell International Inc.
|
Automatic headlamp control | ||
Patent #
US 8,376,595 B2
Filed 05/17/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
EGOMOTION ESTIMATION SYSTEM AND METHOD | ||
Patent #
US 20130070962A1
Filed 09/16/2011
|
Current Assignee
Harman International China Holdings Co. Ltd.
|
Original Assignee
Harman International Industries Incorporated
|
Combined RGB and IR imaging sensor | ||
Patent #
US 8,446,470 B2
Filed 10/03/2008
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 8,451,107 B2
Filed 09/11/2008
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 8,483,439 B2
Filed 05/25/2012
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Generic surface feature extraction from a set of range data | ||
Patent #
US 8,521,418 B2
Filed 09/26/2011
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell International Inc.
|
Imaging system for vehicle | ||
Patent #
US 8,593,521 B2
Filed 11/30/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 8,599,001 B2
Filed 11/19/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
METHOD AND SYSTEM FOR DETERMINING AN EGO-MOTION OF A VEHICLE | ||
Patent #
US 20130335553A1
Filed 12/06/2011
|
Current Assignee
Robert Bosch GmbH
|
Original Assignee
Michael Helmle, Stephan Simon, Thomas Heger
|
Forward facing sensing system for vehicle | ||
Patent #
US 8,614,640 B2
Filed 10/22/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system | ||
Patent #
US 8,629,768 B2
Filed 06/18/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Donnelly Corporation
|
Driver assistance system for vehicle | ||
Patent #
US 8,636,393 B2
Filed 05/06/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 8,637,801 B2
Filed 07/08/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera vision system for a vehicle | ||
Patent #
US 8,643,724 B2
Filed 03/13/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 8,665,079 B2
Filed 10/15/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle yaw rate correction | ||
Patent #
US 8,694,224 B2
Filed 02/28/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Voting strategy for visual ego-motion from stereo | ||
Patent #
US 8,744,169 B2
Filed 05/31/2011
|
Current Assignee
Ibaraki Toyota Jidosha Kabushiki Kaisha
|
Original Assignee
Czech Technical University In Prague, Toyota Motor Europe SA
|
Multiobject fusion module for collision preparation system | ||
Patent #
US 8,812,226 B2
Filed 01/19/2010
|
Current Assignee
GM Global Technology Operations LLC
|
Original Assignee
GM Global Technology Operations LLC
|
Vehicular vision system | ||
Patent #
US 8,814,401 B2
Filed 03/22/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 8,818,042 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
BIRDS EYE VIEW VIRTUAL IMAGING FOR REAL TIME COMPOSITED WIDE FIELD OF VIEW | ||
Patent #
US 20140285516A1
Filed 06/10/2014
|
Current Assignee
Doubleshot Inc.
|
Original Assignee
Doubleshot Inc.
|
Vehicle vision system with yaw rate determination | ||
Patent #
US 8,849,495 B2
Filed 04/07/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic vehicle exterior light control | ||
Patent #
US 8,842,176 B2
Filed 01/15/2010
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Intelligent navigation system | ||
Patent #
US 8,855,847 B2
Filed 01/20/2012
|
Current Assignee
Ibaraki Toyota Jidosha Kabushiki Kaisha
|
Original Assignee
Toyota Motor Engineering Manufacturing North America Incorporated
|
Collison warning system | ||
Patent #
US 8,861,792 B2
Filed 11/26/2013
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mobileye Technologies Limited
|
Parking assist system | ||
Patent #
US 8,874,317 B2
Filed 07/27/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision warning system | ||
Patent #
US 8,879,795 B2
Filed 11/26/2013
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Driver assistance system for a vehicle | ||
Patent #
US 8,886,401 B2
Filed 11/04/2013
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Adaptable wireless vehicle vision system based on wireless communication error | ||
Patent #
US 8,890,955 B2
Filed 02/09/2011
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
Egomotion estimation system and method | ||
Patent #
US 8,903,127 B2
Filed 09/16/2011
|
Current Assignee
Harman International China Holdings Co. Ltd.
|
Original Assignee
Harman International China Holdings Co. Ltd.
|
Imaging system for vehicle | ||
Patent #
US 8,908,040 B2
Filed 05/17/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 8,917,169 B2
Filed 12/02/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 8,977,008 B2
Filed 07/08/2013
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Detecting and recognizing traffic signs | ||
Patent #
US 8,995,723 B2
Filed 09/19/2011
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Driver assistance system for a vehicle | ||
Patent #
US 8,993,951 B2
Filed 07/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,008,369 B2
Filed 08/25/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,014,904 B2
Filed 09/23/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system with camera misalignment correction and capturing image data at different resolution levels dependent on distance to object in field of view | ||
Patent #
US 9,018,577 B2
Filed 02/25/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging and display system for vehicle | ||
Patent #
US 9,041,806 B2
Filed 08/31/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Rear vision system with trailer angle detection | ||
Patent #
US 9,085,261 B2
Filed 01/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Braking control system for vehicle | ||
Patent #
US 9,090,234 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 9,092,986 B2
Filed 01/31/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision warning system | ||
Patent #
US 9,096,167 B2
Filed 04/24/2014
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicular rear view camera display system with lifecheck function | ||
Patent #
US 9,117,123 B2
Filed 07/05/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Alert system for vehicle | ||
Patent #
US 9,126,525 B2
Filed 02/25/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera vision system for a vehicle | ||
Patent #
US 9,131,120 B2
Filed 05/15/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,140,789 B2
Filed 12/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system with algorithm switching | ||
Patent #
US 9,146,898 B2
Filed 10/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Systems and methods for 3D data based navigation using descriptor vectors | ||
Patent #
US 9,153,067 B2
Filed 01/21/2013
|
Current Assignee
Honeywell International Inc.
|
Original Assignee
Honeywell International Inc.
|
Collision Warning System | ||
Patent #
US 9,168,868 B2
Filed 04/30/2013
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vision system for vehicle | ||
Patent #
US 9,171,217 B2
Filed 03/03/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane keeping system and lane centering system | ||
Patent #
US 9,180,908 B2
Filed 11/17/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,187,028 B2
Filed 02/14/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 9,191,574 B2
Filed 03/13/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,191,634 B2
Filed 04/03/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,193,303 B2
Filed 04/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Step filter for estimating distance in a time-of-flight ranging system | ||
Patent #
US 9,194,943 B2
Filed 04/11/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using kinematic model of vehicle motion | ||
Patent #
US 9,205,776 B2
Filed 05/20/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Pedestrian collision warning system | ||
Patent #
US 9,233,659 B2
Filed 04/25/2012
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Driver assistance system for a vehicle | ||
Patent #
US 9,245,448 B2
Filed 06/17/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,244,165 B1
Filed 09/21/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward collision warning trap and pedestrian advanced warning system | ||
Patent #
US 9,251,708 B2
Filed 12/07/2011
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicle vision system with collision mitigation | ||
Patent #
US 9,260,095 B2
Filed 06/13/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,264,672 B2
Filed 12/21/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Mirrors of America Incorporated
|
PATIENT TRANSPORT SYSTEM | ||
Patent #
US 20160066869A1
Filed 09/10/2015
|
Current Assignee
Siemens Healthcare GMBH
|
Original Assignee
Siemens AG
|
Vehicle vision system with lens pollution detection | ||
Patent #
US 9,319,637 B2
Filed 03/27/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular collision mitigation system | ||
Patent #
US 9,318,020 B2
Filed 07/27/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Rear collision avoidance system for vehicle | ||
Patent #
US 9,327,693 B2
Filed 04/09/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,335,411 B1
Filed 01/25/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle lane keep assist system | ||
Patent #
US 9,340,227 B2
Filed 08/12/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with yaw rate determination | ||
Patent #
US 9,346,468 B2
Filed 09/29/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for dynamically calibrating vehicular cameras | ||
Patent #
US 9,357,208 B2
Filed 01/20/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system for vehicle | ||
Patent #
US 9,376,060 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,428,192 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system | ||
Patent #
US 9,436,880 B2
Filed 01/13/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with dirt detection | ||
Patent #
US 9,445,057 B2
Filed 02/19/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,440,535 B2
Filed 01/27/2014
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer angle detection system | ||
Patent #
US 9,446,713 B2
Filed 09/25/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system | ||
Patent #
US 9,457,717 B2
Filed 10/27/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 9,463,744 B2
Filed 01/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,469,250 B2
Filed 02/12/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing camera synchronization | ||
Patent #
US 9,481,301 B2
Filed 12/05/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Braking control system for vehicle | ||
Patent #
US 9,481,344 B2
Filed 07/27/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with adaptive wheel angle correction | ||
Patent #
US 9,487,235 B2
Filed 04/01/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle camera alignment system | ||
Patent #
US 9,491,450 B2
Filed 07/30/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Calibration system and method for vehicular surround vision system | ||
Patent #
US 9,491,451 B2
Filed 11/14/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular camera with on-board microcontroller | ||
Patent #
US 9,495,876 B2
Filed 07/27/2010
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle monitoring system | ||
Patent #
US 9,499,139 B2
Filed 12/05/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular multi-camera vision system | ||
Patent #
US 9,508,014 B2
Filed 05/05/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 9,507,021 B2
Filed 05/09/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 9,545,921 B2
Filed 05/02/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Image processing method for detecting objects using relative motion | ||
Patent #
US 9,547,795 B2
Filed 01/20/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with trailer angle detection | ||
Patent #
US 9,558,409 B2
Filed 12/11/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,555,803 B2
Filed 05/16/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 9,563,809 B2
Filed 04/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with targetless camera calibration | ||
Patent #
US 9,563,951 B2
Filed 05/20/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,598,014 B2
Filed 10/17/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,609,289 B2
Filed 08/29/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with image classification | ||
Patent #
US 9,619,716 B2
Filed 08/11/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Personalized driver assistance system for vehicle | ||
Patent #
US 9,623,878 B2
Filed 04/01/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,643,605 B2
Filed 10/26/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system for vehicle | ||
Patent #
US 9,656,608 B2
Filed 06/13/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision warning system | ||
Patent #
US 9,656,607 B2
Filed 06/29/2015
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicle camera image quality improvement in poor visibility conditions by contrast amplification | ||
Patent #
US 9,681,062 B2
Filed 09/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Calibration system and method for multi-camera vision system | ||
Patent #
US 9,688,200 B2
Filed 03/03/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using kinematic model of vehicle motion | ||
Patent #
US 9,701,246 B2
Filed 12/07/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Process for determining state of a vehicle | ||
Patent #
US 9,715,769 B2
Filed 05/23/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera image stitching calibration system | ||
Patent #
US 9,723,272 B2
Filed 10/04/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 9,731,653 B2
Filed 03/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,736,435 B2
Filed 03/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with enhanced display functions | ||
Patent #
US 9,743,002 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with reduced image color data processing by use of dithering | ||
Patent #
US 9,751,465 B2
Filed 04/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
VEHICLE VISION SYSTEM WITH AUTOMATIC PARKING FUNCTION | ||
Patent #
US 20170253237A1
Filed 03/01/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane keeping system and lane centering system | ||
Patent #
US 9,758,163 B2
Filed 11/09/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistant system using influence mapping for conflict avoidance path determination | ||
Patent #
US 9,761,142 B2
Filed 09/03/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with customized display | ||
Patent #
US 9,762,880 B2
Filed 12/07/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle yaw rate estimation system | ||
Patent #
US 9,764,744 B2
Filed 02/24/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular multi-camera vision system | ||
Patent #
US 9,769,381 B2
Filed 11/28/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for enhancing vehicle camera image quality | ||
Patent #
US 9,774,790 B1
Filed 06/12/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with trailer angle detection | ||
Patent #
US 9,779,313 B2
Filed 01/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for determining an ego-motion of a vehicle | ||
Patent #
US 9,789,816 B2
Filed 12/06/2011
|
Current Assignee
Robert Bosch GmbH
|
Original Assignee
Robert Bosch GmbH
|
Imaging and display system for vehicle | ||
Patent #
US 9,789,821 B2
Filed 05/22/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 9,796,332 B2
Filed 05/24/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Bundling night vision and other driver assistance systems (DAS) using near infra-red (NIR) illumination and a rolling shutter | ||
Patent #
US 9,800,779 B2
Filed 10/12/2015
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Collision avoidance system for vehicle | ||
Patent #
US 9,802,609 B2
Filed 01/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer angle detection system calibration | ||
Patent #
US 9,802,542 B2
Filed 09/19/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 9,824,285 B2
Filed 01/26/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with collision mitigation | ||
Patent #
US 9,824,587 B2
Filed 02/12/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driving assist system for vehicle | ||
Patent #
US 9,834,142 B2
Filed 05/19/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 9,834,216 B2
Filed 01/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for dynamically calibrating vehicular cameras | ||
Patent #
US 9,834,153 B2
Filed 04/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system | ||
Patent #
US 9,868,463 B2
Filed 09/28/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using image data transmission and power supply via a coaxial cable | ||
Patent #
US 9,900,490 B2
Filed 02/22/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method of establishing a multi-camera image using pixel remapping | ||
Patent #
US 9,900,522 B2
Filed 12/01/2011
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver active safety control system for vehicle | ||
Patent #
US 9,911,050 B2
Filed 09/04/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing camera synchronization | ||
Patent #
US 9,912,841 B2
Filed 10/31/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision warning system | ||
Patent #
US 9,916,510 B2
Filed 05/08/2017
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Process for determining state of a vehicle | ||
Patent #
US 9,916,699 B2
Filed 07/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with calibration algorithm | ||
Patent #
US 9,916,660 B2
Filed 01/15/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assist system with image processing and wireless communication | ||
Patent #
US 9,919,705 B2
Filed 09/28/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Pedestrian collision warning system | ||
Patent #
US 9,925,939 B2
Filed 12/29/2015
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicle collision avoidance system with enhanced pedestrian avoidance | ||
Patent #
US 9,925,980 B2
Filed 09/15/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 9,940,528 B2
Filed 11/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,948,904 B2
Filed 08/14/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for controlling a vehicle in accordance with parameters preferred by an identified driver | ||
Patent #
US 9,950,707 B2
Filed 04/17/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailering assist system with trailer angle detection | ||
Patent #
US 9,950,738 B2
Filed 07/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Dense structure from motion | ||
Patent #
US 9,959,595 B2
Filed 02/18/2014
|
Current Assignee
Mobileye Technologies Limited
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicular imaging system comprising an imaging device with a single image sensor and image processor for determining a totally blocked state or partially blocked state of the single image sensor as well as an automatic correction for misalignment of the imaging device | ||
Patent #
US 9,972,100 B2
Filed 04/23/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with targetless camera calibration | ||
Patent #
US 9,979,957 B2
Filed 01/26/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with traffic driving control | ||
Patent #
US 9,988,047 B2
Filed 12/12/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,003,755 B2
Filed 12/08/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 10,005,394 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,015,452 B1
Filed 04/16/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with lens pollution detection | ||
Patent #
US 10,021,278 B2
Filed 04/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Braking control system for vehicle | ||
Patent #
US 10,023,161 B2
Filed 10/31/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing corner detection | ||
Patent #
US 10,025,994 B2
Filed 12/02/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Spectral filtering for vehicular driver assistance systems | ||
Patent #
US 10,027,930 B2
Filed 03/28/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Image processing method for detecting objects using relative motion | ||
Patent #
US 10,043,082 B2
Filed 01/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Control system for vehicle | ||
Patent #
US 10,046,702 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging and display system for vehicle | ||
Patent #
US 10,053,012 B2
Filed 10/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with enhanced lane tracking | ||
Patent #
US 10,055,651 B2
Filed 03/01/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular multi-camera vision system | ||
Patent #
US 10,057,489 B2
Filed 09/18/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,071,676 B2
Filed 09/12/2016
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,071,687 B2
Filed 11/27/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle parking assist system with vision-based parking space detection | ||
Patent #
US 10,078,789 B2
Filed 07/14/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Barrier and guardrail detection using a single camera | ||
Patent #
US 10,078,788 B2
Filed 02/01/2016
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Driver assistance system for vehicle | ||
Patent #
US 10,086,747 B2
Filed 08/25/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer parking assist system for vehicle | ||
Patent #
US 10,086,870 B2
Filed 08/16/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with trailering assist function | ||
Patent #
US 10,089,541 B2
Filed 10/02/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with dirt detection | ||
Patent #
US 10,089,540 B2
Filed 09/12/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with front and rear camera integration | ||
Patent #
US 10,089,537 B2
Filed 05/15/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,099,614 B2
Filed 11/27/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for a vehicle | ||
Patent #
US 10,099,610 B2
Filed 10/10/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with enhanced display functions | ||
Patent #
US 10,104,298 B2
Filed 08/21/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular camera with on-board microcontroller | ||
Patent #
US 10,106,155 B2
Filed 11/11/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward facing sensing system for vehicle | ||
Patent #
US 10,107,905 B2
Filed 11/28/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,110,860 B1
Filed 07/02/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistant system using influence mapping for conflict avoidance path determination | ||
Patent #
US 10,115,310 B2
Filed 09/11/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Barrier and guardrail detection using a single camera | ||
Patent #
US 10,115,027 B2
Filed 03/06/2017
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
Mibileye Vision Technologies Ltd.
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 10,118,618 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for vehicular control | ||
Patent #
US 10,127,738 B2
Filed 03/12/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with customized display | ||
Patent #
US 10,129,518 B2
Filed 09/11/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Building night vision and other driver assistance systems (DAS) using near infra-red (NIR) illumination and a rolling shutter | ||
Patent #
US 10,129,465 B2
Filed 10/18/2017
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicle monitoring system | ||
Patent #
US 10,137,892 B2
Filed 11/18/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision display system for vehicle | ||
Patent #
US 10,144,352 B2
Filed 08/14/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle dynamic control system for emergency handling | ||
Patent #
US 10,144,419 B2
Filed 11/22/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer backup assist system | ||
Patent #
US 10,160,382 B2
Filed 02/04/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with reverse assist | ||
Patent #
US 10,160,437 B2
Filed 02/27/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system utilizing multiple cameras and ethernet links | ||
Patent #
US 10,171,709 B2
Filed 03/05/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera dynamic top view vision system | ||
Patent #
US 10,179,543 B2
Filed 02/27/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera vehicle vision system with image gap fill | ||
Patent #
US 10,187,590 B2
Filed 10/26/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,187,615 B1
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with adaptive wheel angle correction | ||
Patent #
US 10,202,147 B2
Filed 11/07/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for dynamically calibrating vehicular cameras | ||
Patent #
US 10,202,077 B2
Filed 05/23/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 10,207,705 B2
Filed 10/25/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system for vehicle | ||
Patent #
US 10,214,206 B2
Filed 07/11/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System for locating a parking space based on a previously parked space | ||
Patent #
US 10,222,224 B2
Filed 04/15/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Rear vision system for vehicle with dual purpose signal lines | ||
Patent #
US 10,232,797 B2
Filed 04/29/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with calibration algorithm | ||
Patent #
US 10,235,775 B2
Filed 03/07/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for enhancing vehicle camera image quality | ||
Patent #
US 10,257,432 B2
Filed 09/25/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Calibration system and method for vehicular surround vision system | ||
Patent #
US 10,264,249 B2
Filed 11/07/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using kinematic model of vehicle motion | ||
Patent #
US 10,266,115 B2
Filed 07/10/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera image stitching calibration system | ||
Patent #
US 10,284,818 B2
Filed 07/31/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision using image data transmission and power supply via a coaxial cable | ||
Patent #
US 10,284,764 B2
Filed 02/19/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with video compression | ||
Patent #
US 10,286,855 B2
Filed 03/22/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method for estimating distance between a mobile unit and a vehicle using a TOF system | ||
Patent #
US 10,288,724 B2
Filed 11/20/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-sensor interior mirror device with image adjustment | ||
Patent #
US 10,300,859 B2
Filed 06/08/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer driving assist system | ||
Patent #
US 10,300,855 B2
Filed 10/25/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Pedestrian collision warning system | ||
Patent #
US 10,300,875 B2
Filed 03/23/2018
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicular display system | ||
Patent #
US 10,300,856 B2
Filed 08/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,306,190 B1
Filed 01/21/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system with enhanced display functions | ||
Patent #
US 10,321,064 B2
Filed 10/11/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with reduction of temporal noise in images | ||
Patent #
US 10,326,969 B2
Filed 08/11/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system with annotated map generation | ||
Patent #
US 10,328,932 B2
Filed 06/01/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system with rear backup video display | ||
Patent #
US 10,336,255 B2
Filed 11/29/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 10,351,135 B2
Filed 11/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with lens pollution detection | ||
Patent #
US 10,397,451 B2
Filed 07/09/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular lane change system | ||
Patent #
US 10,406,980 B2
Filed 10/11/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system responsive to yaw rate estimation system | ||
Patent #
US 10,407,080 B2
Filed 09/18/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Lane keeping system and lane centering system | ||
Patent #
US 10,427,679 B2
Filed 09/11/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with reduced image color data processing by use of dithering | ||
Patent #
US 10,434,944 B2
Filed 08/30/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Barrier and guardrail detection using a single camera | ||
Patent #
US 10,445,595 B2
Filed 08/23/2018
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicle vision system with adjustable computation and data compression | ||
Patent #
US 10,452,076 B2
Filed 12/19/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Processing method for distinguishing a three dimensional object from a two dimensional object using a vehicular system | ||
Patent #
US 10,452,931 B2
Filed 08/06/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with multi-paned view | ||
Patent #
US 10,457,209 B2
Filed 03/28/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,462,426 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system with rear backup video display | ||
Patent #
US 10,486,597 B1
Filed 07/01/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Multi-camera dynamic top view vision system | ||
Patent #
US 10,486,596 B2
Filed 01/14/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Adaptive headlights for the trajectory of a vehicle | ||
Patent #
US 10,493,900 B2
Filed 05/04/2018
|
Current Assignee
University College Dublin
|
Original Assignee
International Business Machines Corporation
|
Vehicle camera system with image manipulation | ||
Patent #
US 10,493,916 B2
Filed 02/22/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular trailer backup assist system | ||
Patent #
US 10,493,917 B2
Filed 12/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular collision mitigation system | ||
Patent #
US 10,497,262 B2
Filed 11/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 10,509,972 B2
Filed 04/09/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with front and rear camera integration | ||
Patent #
US 10,515,279 B2
Filed 08/30/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle data recording system | ||
Patent #
US 10,523,904 B2
Filed 04/10/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with customized display | ||
Patent #
US 10,542,244 B2
Filed 11/12/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method of synchronizing multiple vehicular cameras with an ECU | ||
Patent #
US 10,560,610 B2
Filed 12/28/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Coaxial cable with bidirectional data transmission | ||
Patent #
US 10,567,705 B2
Filed 06/06/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system using image data transmission and power supply via a coaxial cable | ||
Patent #
US 10,567,633 B2
Filed 05/02/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Targetless vehicular camera calibration method | ||
Patent #
US 10,567,748 B2
Filed 05/21/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Parking assist system | ||
Patent #
US 10,569,804 B2
Filed 01/15/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for displaying video images for a vehicular vision system | ||
Patent #
US 10,574,885 B2
Filed 08/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision warning system | ||
Patent #
US 10,579,885 B2
Filed 02/07/2018
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicular control system with trailering assist function | ||
Patent #
US 10,586,119 B2
Filed 10/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular rear backup vision system with video display | ||
Patent #
US 10,589,678 B1
Filed 11/25/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with traffic sign recognition | ||
Patent #
US 10,607,094 B2
Filed 02/05/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with accelerated object confirmation | ||
Patent #
US 10,609,335 B2
Filed 03/22/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Video processor module for vehicle | ||
Patent #
US 10,611,306 B2
Filed 08/09/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,616,507 B2
Filed 06/18/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 10,623,704 B2
Filed 03/09/2015
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Method for dynamically calibrating vehicular cameras | ||
Patent #
US 10,640,041 B2
Filed 02/04/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 10,640,040 B2
Filed 09/10/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method and system for dynamically ascertaining alignment of vehicular cameras | ||
Patent #
US 10,654,423 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Patient transport system | ||
Patent #
US 10,660,583 B2
Filed 09/10/2015
|
Current Assignee
Siemens Healthcare GMBH
|
Original Assignee
Siemens AG
|
Forward sensing system for vehicle | ||
Patent #
US 10,670,713 B2
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular driving assist system using forward-viewing camera | ||
Patent #
US 10,683,008 B2
Filed 07/15/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular driver assist system | ||
Patent #
US 10,685,243 B2
Filed 08/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Dense structure from motion | ||
Patent #
US 10,685,424 B2
Filed 04/19/2018
|
Current Assignee
Mobileye Technologies Limited
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicle control system with traffic driving control | ||
Patent #
US 10,688,993 B2
Filed 06/04/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with collision mitigation | ||
Patent #
US 10,692,380 B2
Filed 11/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular parking assist system that determines a parking space based in part on previously parked spaces | ||
Patent #
US 10,718,624 B2
Filed 03/04/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular imaging system with blockage determination and misalignment correction | ||
Patent #
US 10,726,578 B2
Filed 05/14/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistant system using influence mapping for conflict avoidance path determination | ||
Patent #
US 10,733,892 B2
Filed 10/29/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with traffic lane detection | ||
Patent #
US 10,735,695 B2
Filed 10/28/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with temperature input | ||
Patent #
US 10,744,940 B2
Filed 06/25/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle camera LVDS repeater | ||
Patent #
US 10,750,119 B2
Filed 10/16/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailering assist system for vehicle | ||
Patent #
US 10,755,110 B2
Filed 06/27/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Imaging system for vehicle | ||
Patent #
US 10,766,417 B2
Filed 10/23/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle control system with reverse assist | ||
Patent #
US 10,773,707 B2
Filed 12/20/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for stitching images captured by multiple vehicular cameras | ||
Patent #
US 10,780,827 B2
Filed 11/25/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for determining misalignment of a vehicular camera | ||
Patent #
US 10,780,826 B2
Filed 04/22/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Adaptive forward lighting system for vehicle comprising a control that adjusts the headlamp beam in response to processing of image data captured by a camera | ||
Patent #
US 10,787,116 B2
Filed 09/10/2018
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Systems and methods for determining a vehicle position | ||
Patent #
US 10,788,830 B2
Filed 07/28/2017
|
Current Assignee
Qualcomm Inc.
|
Original Assignee
Qualcomm Inc.
|
Imaging system for vehicle | ||
Patent #
US 10,793,067 B2
Filed 07/25/2012
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailer driving assist system | ||
Patent #
US 10,800,332 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular collision mitigation system | ||
Patent #
US 10,803,744 B2
Filed 12/02/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular adaptive headlighting system | ||
Patent #
US 10,807,515 B2
Filed 10/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular rear backup vision system with video display | ||
Patent #
US 10,814,785 B2
Filed 03/16/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system with incident recording function | ||
Patent #
US 10,819,943 B2
Filed 05/05/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system using image data transmission and power supply via a coaxial cable | ||
Patent #
US 10,827,108 B2
Filed 02/17/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Detection and classification of light sources using a diffraction grating | ||
Patent #
US 10,830,642 B2
Filed 10/05/2015
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicular control system | ||
Patent #
US 10,839,233 B2
Filed 03/05/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Trailering assist system with trailer angle detection | ||
Patent #
US 10,858,042 B2
Filed 04/23/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method for determining alignment of vehicular cameras | ||
Patent #
US 10,868,974 B2
Filed 02/19/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with remote processor | ||
Patent #
US 10,870,427 B2
Filed 11/26/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular trailering system | ||
Patent #
US 10,870,449 B2
Filed 10/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Method of synchronizing multiple vehicular cameras with an ECU | ||
Patent #
US 10,873,682 B2
Filed 02/10/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 10,875,455 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Collision avoidance system for vehicle | ||
Patent #
US 10,875,527 B2
Filed 02/18/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular vision system | ||
Patent #
US 10,875,526 B2
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Forward sensing system for vehicle | ||
Patent #
US 10,877,147 B2
Filed 06/01/2020
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Building night vision and other driver assistance systems (DAS) using near infra-red (NIR) illumination and rolling shutter | ||
Patent #
US 10,880,471 B2
Filed 11/12/2018
|
Current Assignee
MobilEye Vision Technologies Ltd.
|
Original Assignee
MobilEye Vision Technologies Ltd.
|
Vehicular control system for emergency handling | ||
Patent #
US 10,889,293 B2
Filed 11/29/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle steering force correction system | ||
Patent #
US 5,913,375 A
Filed 08/29/1996
|
Current Assignee
Honda Giken Kogyo Kabushiki Kaisha
|
Original Assignee
Honda Giken Kogyo Kabushiki Kaisha
|
Method for measuring visibility from a moving vehicle | ||
Patent #
US 5,987,152 A
Filed 11/18/1997
|
Current Assignee
Volkswagen AG
|
Original Assignee
Volkswagen AG
|
Vehicle monitoring system | ||
Patent #
US 5,809,161 A
Filed 03/22/1993
|
Current Assignee
Commonwealth Scientific Industrial Research Organisation
|
Original Assignee
Telstra Corporation Limited, Commonwealth Scientific Industrial Research Organisation
|
36 Claims
-
1. An ego-motion determination system for generating an estimate as to the ego-motion of a vehicle moving along a roadway comprising:
-
A. an image receiver configured to receive image information relating to a series of at least two images recorded as the vehicle moves along a roadway; and
B. a processor configured to process the image information received by the image receiver to generate an ego-motion estimate of the vehicle relative to the roadway. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
A. a patch generator configured to divide respective images Ψ
′ and
Ψ
into a plurality of respective patches Wi′ and
Wi;
B. a confidence value generator configured to generate for respective patches Wi′ and
Wi at least one confidence value representative of the confidence that the respective patch represents a projection of the roadway;
C. a search generator configured to perform a search operation to identify the motion {circumflex over (m)} that has a selected relationship in connection with a probability density function in relation to motions for the respective patches and the at least one confidence value.
-
-
5. An ego-motion determination system as defined in claim 4 in which the search generator is configured to perform the search operation to determine the motion {circumflex over (m)} that maximizes the probability density function in relation to the respective patches.
-
6. An ego-motion determination system as defined in claim 5 in which the search generator is configured to perform the search operation to determine the motion {circumflex over (m)} that maximizes the probability density function defined by
-
( m ^ | Ψ , Ψ ′ ) = c ∑ i P ( m ^ | W i , W i ′ ) λ i α i β i ∑ i λ i , where represents a probability density function relating the respective “
i-th”
patches Wi and Wi′
, where S({circumflex over (m)}) represents the sum of squared difference between the patch Wi and the corresponding patch Wi′
warped according to the motion {circumflex over (m)}, and σ
is a function of noise in the respective images, and “
c”
is a normalization factor;(ii) λ
.i and α
i are weighting functions whose values reflect the confidence that the respective “
i-th”
patch is a projection of the roadway; and
(iii) β
i is a gradient strength function whose value reflects the degree to which the image in the respective “
i-th”
patch contains a texture.
-
-
7. An ego-motion determination system as defined in claim 6 in which the search generator is configured to generate the sum of squared difference S({circumflex over (m)}) for the respective “
- i-th”
patches in accordance withwhere “
R”
represents the region associated with the respective “
i-th”
patch, and {circumflex over (Ψ
)}′
represents the region of the respective image Ψ
′
warped in accordance with the motion {circumflex over (m)}.
- i-th”
-
8. An ego-motion determination system as defined in claim 6 in which the search generator is configured to generate at least one value for the weighting function λ
-
i in accordance with
where for all {circumflex over (m)}ε
{circumflex over (M)} is the value for the best fit in a local search region, andfor all {circumflex over (m)}ε
L is the value for the best fit over all possible image motions.
-
i in accordance with
-
9. An ego-motion determination system as defined in claim 6 in which the search generator is configured to generate at least one value for the weighting function α
-
i to reflect the degree to which projections of a line in the respective patch Wi, Wi′
is horizontal and parallel to the direction of the roadway or horizontal and perpendicular to the direction of the roadway, and not vertical.
-
i to reflect the degree to which projections of a line in the respective patch Wi, Wi′
-
10. An ego-motion determination system as defined in claim 9 in which the search generator is configured to generate at least one value for the weighting function α
-
i in relation to a gradient in luminance at respective points in the respective patch Wi, Wi′
.
-
i in relation to a gradient in luminance at respective points in the respective patch Wi, Wi′
-
11. An ego-motion determination system as defined in claim 6 in which the search generator is configured to generate at least one value for the gradient strength function β
-
i in accordance with
where S({circumflex over (m)}) represents the sum of squared difference between the patch Wi and the corresponding patch Wi′
warped according to the motion {circumflex over (m)}, and σ
is a function of noise in the respective images.
-
i in accordance with
-
12. An ego-motion determination system as defined in claim 11 in which the search generator is configured to generate the sum of squared difference S({circumflex over (m)}) for the respective “
- i-th”
patches in accordance withwhere “
R”
represents the region associated with the respective “
i-th”
patch, and {circumflex over (Ψ
)}′
represents the region of the respective image Ψ
′
warped in accordance with the motion {circumflex over (m)}.
- i-th”
-
13. An ego-motion determination method for generating an estimate as to the ego-motion of a vehicle moving along a roadway comprising the steps of:
-
A. an image information receiving step comprising the step of receiving image information relating to a series of at least two images recorded as the vehicle moves along a roadway; and
B. an image information processing step comprising the step of processing the image information received by the image receiver to generate an ego-motion estimate of the vehicle relative to the roadway. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34)
A. a patch generation step of dividing respective images Ψ
′ and
Ψ
into a plurality of respective patches Wi′ and
Wi;
B. a confidence value generation step of generating for respective patches Wi′ and
Wi at least one confidence value representative of the confidence that the respective patch represents a projection of the roadway;
C. a search generation step of performing a search operation to identify the motion {circumflex over (m)} that has a selected relationship in connection with a probability density function in relation to motions for the respective patches and the at least one confidence value.
-
-
17. An ego-motion determination method as defined in claim 16 in which the search generation step includes the step of performing the search operation to determine the motion {circumflex over (m)} that maximizes the probability density function in relation to the respective patches.
-
18. An ego-motion determination method as defined in claim 17 in which the search generation step includes the step of performing the search operation to determine the motion {circumflex over (m)} that maximizes the probability density function defined by
-
( m ^ | Ψ , Ψ ′ ) = c ∑ i P ( m ^ | W i , W i ′ ) λ i α i β i ∑ i λ i , where represents a probability density function relating the respective “
i-th”
patches Wi and Wi′
, where S({circumflex over (m)}) represents the sum of squared difference between the patch Wi and the corresponding patch Wi′
warped according to the motion {circumflex over (m)}, and σ
is a function of noise in the respective images, and “
c”
is a normalization factor;(ii) λ
.i and α
i are weighting functions whose values reflect the confidence that the respective “
i-th”
patch is a projection of the roadway; and
(iii) β
i is a gradient strength function whose value reflects the degree to which the image in the respective “
i-th”
patch contains a texture.
-
-
19. An ego-motion determination method as defined in claim 18 in which the search generation step includes the step of generating the sum of squared difference S({circumflex over (m)}) for the respective “
- i-th”
patches in accordance withwhere “
R”
represents the region associated with the respective “
i-th”
patch, and {circumflex over (Ψ
)}′
represents the region of the respective image Ψ
′
warped in accordance with the motion {circumflex over (m)}.
- i-th”
-
20. An ego-motion determination method as defined in claim 18 in which the search generation step includes the step of generating at least one value for the weighting function λ
-
i in accordance with
where for all {circumflex over (m)}ε
{circumflex over (M)} is the value for the best fit in a local search region, andfor all {circumflex over (m)}ε
L is the value for the best fit over all possible image motions.
-
i in accordance with
-
21. An ego-motion determination method as defined in claim 18 in which the search generation step includes the step of generating at least one value for the weighting function α
-
i to reflect the degree to which projections of a line in the respective patch Wi, Wi′
is horizontal and parallel to the direction of the roadway or horizontal and perpendicular to the direction of the roadway, and not vertical.
-
i to reflect the degree to which projections of a line in the respective patch Wi, Wi′
-
22. An ego-motion determination method as defined in claim 21 in which the search generation step includes the step of generating at least one value for the weighting function α
-
i in relation to a gradient in luminance at respective points in the respective patch Wi, Wi′
.
-
i in relation to a gradient in luminance at respective points in the respective patch Wi, Wi′
-
23. An ego-motion determination method as defined in claim 18 in which the search generation step includes the step of generating generate at least one value for the gradient strength function β
-
i in accordance with
where S({circumflex over (m)}) represents the sum of squared difference between the patch Wi and the corresponding patch Wi′
warped according to the motion {circumflex over (m)}, and σ
is a function of noise in the respective images.
-
i in accordance with
-
24. An ego-motion determination method as defined in claim 23 in which the search generation step includes the step of generating the sum of squared difference S({circumflex over (m)}) for the respective “
- i-th”
patches in accordance withwhere “
R”
represents the region associated with the respective “
i-th”
patch, and {circumflex over (Ψ
)}′
represents the region of the respective image Ψ
′
warped in accordance with the motion {circumflex over (m)}.
- i-th”
-
25. A computer program product as defined in claim 24 in which the processor module is configured to enable the computer to generate the ego-motion estimate in relation to portions of the respective images Ψ
- ′ and
Ψ
that are likely to represent projections of the roadway.
- ′ and
-
26. A computer program product as defined in claim 25 in which the processor module comprises:
-
A. a patch generator module configured to enable the computer to divide respective images Ψ
′ and
Ψ
into a plurality of respective patches Wi′ and
Wi;
B. a confidence value generator module configured to enable the computer to generate for respective patches Wi′ and
Wi at least one confidence value representative of the confidence that the respective patch represents a projection of the roadway;
C. a search generator module configured to enable the computer to perform a search operation to identify the motion {circumflex over (m)} that has a selected relationship in connection with a probability density function in relation to motions for the respective patches and the at least one confidence value.
-
-
27. A computer program product as defined in claim 26 in which the search generator module is configured to enable the computer to perform the search operation to determine the motion {circumflex over (m)} that maximizes the probability density function in relation to the respective patches.
-
28. A computer program product as defined in claim 27 in which the search generator module is configured to enable the computer to perform the search operation to determine the motion {circumflex over (m)} that maximizes the probability density function defined by
-
( m ^ | Ψ , Ψ ′ ) = c ∑ i P ( m ^ | W i , W i ′ ) λ i α i β i ∑ i λ i , where represents a probability density function relating the respective “
i-th”
patches Wi and Wi′
, where S({circumflex over (m)}) represents the sum of squared difference between the patch Wi and the corresponding patch Wi′
warped according to the motion {circumflex over (m)}, and σ
is a function of noise in the respective images, and “
c”
is a normalization factor;(ii) λ
.i and α
i are weighting functions whose values reflect the confidence that the respective “
i-th”
patch is a projection of the roadway; and
(iii) β
i is a gradient strength function whose value reflects the degree to which the image in the respective “
i-th”
patch contains a texture.
-
-
29. A computer program product as defined in claim 28 in which the search generator module is configured to enable the computer to generate the sum of squared difference S({circumflex over (m)}) for the respective “
- i-th”
patches in accordance withwhere “
R”
represents the region associated with the respective “
i-th”
patch, and {circumflex over (Ψ
)}′
represents the region of the respective image Ψ
′
warped in accordance with the motion {circumflex over (m)}.
- i-th”
-
30. A computer program product as defined in claim 28 in which the search generator module is configured to generate at least one value for the weighting function λ
-
i in accordance with
where for all {circumflex over (m)}ε
{circumflex over (M)} is the value for the best fit in a local search region, andfor all {circumflex over (m)}ε
L is the value for the best fit over all possible image motions.
-
i in accordance with
-
31. A computer program product as defined in claim 28 in which the search generator module is configured to enable the computer to generate at least one value for the weighting function α
-
i to reflect the degree to which projections of a line in the respective patch Wi, Wi′
is horizontal and parallel to the direction of the roadway or horizontal and perpendicular to the direction of the roadway, and not vertical.
-
i to reflect the degree to which projections of a line in the respective patch Wi, Wi′
-
32. A computer program product as defined in claim 31 in which the search generator module is configured to enable the computer to generate at least one value for the weighting function α
-
i in relation to a gradient in luminance at respective points in the respective patch Wi, Wi′
.
-
i in relation to a gradient in luminance at respective points in the respective patch Wi, Wi′
-
33. A computer program product as defined in claim 28 in which the search generator module is configured to enable the computer to generate at least one value for the gradient strength function β
-
i in accordance with
where S({circumflex over (m)}) represents the sum of squared difference between the patch Wi and the corresponding patch W1′
warped according to the motion {circumflex over (m)}, and σ
is a function of noise in the respective images.
-
i in accordance with
-
34. A computer program product as defined in claim 33 in which the search generator module is configured to enable the computer to generate the sum of squared difference S({circumflex over (m)}) for the respective “
- i-th”
patches in accordance withwhere “
R”
represents the region associated with the respective “
i-th”
patch, and {circumflex over (Ψ
)}′
represents the region of the respective image Ψ
′
warped in accordance with the motion {circumflex over (m)}.
- i-th”
-
35. A computer program product for use in connection with a computer to provide an ego-motion determination system for generating an estimate as to the ego-motion of a vehicle moving along a roadway, the computer program product comprising a computer readable medium having encoded thereon:
-
A. an image receiver module configured to enable the computer to receive image information relating to a series of at least two images recorded as the vehicle moves along a roadway; and
B. a processor module configured to enable the computer to process the image information received by the image receiver module to generate an ego-motion estimate of the vehicle relative to the roadway. - View Dependent Claims (36)
-
1 Specification
This application is a continuation in part of U.S. Provisional Patent Application Ser. No. 60/167,587, filed Nov. 26, 1999 and U.S. Provisional Patent Application Ser. No. 06/230,166, filed Sep. 1, 2000.
The invention relates generally to the field of systems and methods for estimating ego-motion (that is, “self-motion) of a moving vehicle, and more specifically to systems and methods that estimate ego-motion using successively-recorded images recorded along the vehicle'"'"'s path of motion.
Accurate estimation of the ego- (“self-”) motion of a vehicle relative to a roadway is an important component in autonomous driving and computer vision-based driving assistance. Using computer vision techniques to provide assistance while driving, instead of mechanical sensors, allows for the use of the information that is recorded for use in estimating vehicle movement to also be used in detecting obstacles, identifying lanes and the like, without the need for calibration between sensors as would be necessary with mechanical sensors. This reduces cost and maintenance.
There are several problems in estimating ego-motion of a vehicle. Typically, roads have few feature points, if any. The most obvious features in a road, such as lane markings, have a generally linear structure, whereas background image structures, such as those associated with other vehicles, buildings, trees, and the like, will typically have many feature points. This will make image- or optical-flow-based estimation difficult in practice. In addition, typically images that are recorded for ego-motion estimation will contain a large amount of “outlier” information that is either not useful in estimating ego-motion, or that may result in poor estimation. For example, in estimating of ego-motion relative to a fixed structure such as a road, images of objects that are moving relative to the road, such as other moving vehicles and even moving wipers, will contribute false information for the ego-motion estimation. In addition, conditions that degrade image quality, such as raindrops and glare, will also make accurate ego-motion estimation difficult.
The invention provides a new and improved system and method for estimating ego-motion using successively-recorded images recorded along the vehicle'"'"'s path of motion.
In brief summary, the invention provides an ego-motion determination system for generating an estimate as to the ego-motion of a vehicle moving along a roadway. The ego-motion determination system includes an image information receiver and a processor. The image information receiver is configured to receive image information relating to a series of at least two images recorded as the vehicle moves along a roadway. The processor is configured to process the image information received by the image receiver to generate an ego-motion estimate of the vehicle, including the translation of the vehicle in the forward direction and the rotation of the vehicle around a vertical axis as between, for example, successive images.
Several methodologies are disclosed for generating the ego-motion estimate of the vehicle.
This invention is pointed out with particularity in the appended claims. The above and further advantages of this invention may be better understood by referring to the following description taken in conjunction with the accompanying drawings, in which:
FIG. 1 schematically depicts a vehicle moving on a roadway and including an ego-motion estimation system constructed in accordance with the invention;
FIGS. 2-2A are charts depicting operations performed by the ego-motion estimation system in determining ego-motion of the vehicle in accordance with one methodology; and
FIG. 3 is a flow chart depicting operations performed by the ego-motion estimation system in determining ego-motion of the vehicle in accordance with a second methodology.
FIG. 1 schematically depicts a vehicle 10 moving on a roadway 11 and including an ego-motion estimation system 12 constructed in accordance with the invention. The vehicle 10 may be any kind of vehicle 10 that may move on the roadway 11, including, but not limited to automobiles, trucks, buses and the like. The ego-motion estimation system 12 includes a camera 13 and a ego-motion estimation system processor 14. The camera 13 is mounted on the vehicle 10 and is preferably pointed in a forward direction, that is, in the direction in which the vehicle would normally move, to record successive images as the vehicle moves over the roadway. Preferably as the camera 13 records each image, it will provide the image to the ego-motion estimation system processor 14. The ego-motion estimation system processor 14, in turn, will process information that it obtains from the successive images, possibly along with other information, such as information from the vehicle'"'"'s speedometer (not separately shown) to determine the ego-motion (that is, the self-motion) of the vehicle relative to the roadway 11. The ego-motion estimation system processor 14 may also be mounted in or on the vehicle 11 and may form part thereof. The ego-motion estimates generated by the ego-motion estimation system processor 14 may be used for a number of things, including, but not limited to obstacle and lane detection, autonomous driving by the vehicle, perhaps also using positioning information from, for example, the global positioning system (“GPS”) and roadway mapping information from a number of sources known to those skilled in the art, and the like. Operations performed by the ego-motion estimation system processor 14 in determining ego-motion of the vehicle 10 will be described in connection with the flow charts depicted in FIGS. 2 and 3.
Before proceeding further, it would be helpful to provide background of the operations performed by the ego-motion estimation system processor 14 depicted in FIG. 1. Generally, as between two images Ψ and Ψ′ the ego-motion estimation system processor 14 attempts to determine the translation T=(tX,tY,tZ)T and rotation w=(wX,wY,wZ)T (where “T” refers to the transpose operation, ti refers to translation along the respective “X,” “Y” and “Z” axes, and wi refers to rotation around the respective axis) of the camera 13 affixed to the vehicle 10. Since the camera 13 is affixed to the vehicle 10, the translation and rotation of the camera 13 will also conform to the translation and rotation of the vehicle 10. In that case, for a point p=(x,y)T (where “x” and “y” are coordinates of a point or feature in the image) that is a projection of a point P=(X,Y,Z)T (where “X,” “Y” and “Z” are coordinates of the point in three-dimensional space), the flow vector for the point, that is, the vector indicating the motion of the same point in three dimensional space from is position in the image Ψ to the image Ψ′, has components (u,v)
where “X” in equations (1) refers to the matrix cross-product and
where “f” is the focal length of the camera 13, which is presumed to be known. The roadway on which the vehicle 10 is traveling is modeled as a plane. The equation for points on a plane is
where the “X” and “Y” axes correspond to horizontal “x” and vertical “y” axes of the image plane, and the “Z” axis is perpendicular to the image plane. The camera 13 may be tilted slightly downwardly to increase the amount of the image that corresponds to the road, and reduce the amount of the image that corresponds to other features, such as other traffic, buildings, trees and the like, and in that case, the images Ψ and Ψ′ will be rectified so that the images z axis will be parallel to the plane of the roadway, as will be described below.
Dividing equation (3) by “Z” provides
where a=A/f, b=B/f and c=C. Substituting equation (4) into equations (1) results in
Expanding equations (5) results in
Equations (6) and (7) are a special case (the “calibrated camera 13” case) of an eight parameter model for a camera 13 moving relative to a plane:
v=a4x+a5y+a6+a7xy+a8y2 (9)
Given the flow vector (u,v), one can recover the parameters αi, i=1, . . . ,8, from which one can recover the motion parameters t and w.
One problem arises in connection with the methodology described above in connection with equations (1) through (9), namely, given the large number of parameters αi whose values need to be determined, it is difficult to devise a satisfactory method that will reject outliers. This follows from the fact that a relatively large number of optical flow vectors (u,v) will need to be used in determining the values of the parameters, which, in turn, requires a corresponding number of points in both images. In addition, it is difficult to differentiate between optical flow due to rotation around the X and Y axes and translation along the X and Z axes, respectively.
Accordingly, it is desirable to reduce the number of motion parameters to a minimum. The motion of a vehicle 10 along a roadway can be modeled as being constrained to be a translation along the Z axis, as the vehicle 10 moves forward or in reverse, and a rotation around the X and Y axes, as the vehicle 10'"'"'s path deviates from a straight-line course. In that case, equation (5) reduces to
If the images are rectified to ensure that the plane of the roadway is parallel to the camera 13'"'"'s XZ plane, that is, so that the images would be as if the camera 13'"'"'s optical axis is parallel to the plane of the road, then, in equations (10) a=0 and c=0, in which case
In order to rectify the images, the camera 13 will need to be calibrated. A methodology for calibrating the camera 13 and rectifying the images will be described below.
In equations (11) there are three motion parameters, tZ (translation along the Z axis), wX (rotation around the X axis) and wY (rotation around the Y axis) to be determined from the flow vectors (u,v) associated with points in at least some portions of the images Ψ and Ψ′. Finding corresponding points in the images Ψ and Ψ′, that is, points that are projections of the same point in three-dimensional space in the respective images is based on a “photometric constraint”
which essentially states that the irradiance, or luminance, of the point p=(x,y)T in the image Ψ and and the point p=(x+uδt,y+vδt) in the image Ψ′, which are projections of the same point in three-dimensional space into the respective images, are the same. In practice, equation (12) will not hold exactly because of noise. If, for every point, the noise is modeled as zero mean Gaussian noise, equation 12 reduces to
and a maximum likelihood can be sought.
Equation (13) can be computationally intensive, and, instead of using that equation, the motion parameters tZ, wX and wY can be determined directly from the images by combining the geometric constraints embodied in equation (11) with the photometric constraints embodied in equation (12). In that operation, given two consecutive images Ψ and Ψ′, the goal is to determine the probability
of that the motion of the vehicle 10 is {circumflex over (m)}=(tz,wx,wy) given the two images. The motion {circumflex over (m)} that maximizes (14) is the estimate of the camera 13 motion between the two images Ψ and Ψ′, and, thus, the estimate of vehicle 10 motion between the two images.
According to Bayes'"'"' rule,
where P(Ψ′|Ψ,{circumflex over (m)}) is the probability that, given image Ψ, motion {circumflex over (m)} will result in image Ψ′, P({circumflex over (m)}) is the a priori probability that the motion is {circumflex over (m)}, and P(Ψ′) is the a priori probability that the image is Ψ′. It will be assumed that P({circumflex over (m)}), the probability that the motion is {circumflex over (m)}, is uniform in a small region {circumflex over (M)} around the previous motion estimate, that is, the motion estimate generated as between the “i-1st” and “i-th” images; it will be appreciated that, if the time period between the times at which images Ψ and Ψ′ are recorded is sufficiently small, this assumption will hold. It will further be appreciated that, in equation (15), the denominator P(Ψ′) does not depend on the motion {circumflex over (m)}, and so it does not affect the search for a maximum.
The probability that, given image Ψ, motion {circumflex over (m)} will result in image Ψ, P(Ψ′|Ψ,{circumflex over (m)}), can be determined by warping the image Ψ′ according to the motion {circumflex over (m)}, thereby to generate a warped image Ψ′ and determining the sum squared difference (“SSD”)
between corresponding patches, or regions, R in the images that are believed to be a projection of the roadway in the two images. In equation 16, “N” is the number of points in the region R. It will be appreciated that, if the images Ψ and Ψ′ are recorded at times “t” and “t+δt, respectively, the warped image {circumflex over (Ψ)}′ will represent the image that is assumed would be recorded at time “t” if the motion is {circumflex over (m)}. Using the SSD criteria (equation 16), P(Ψ′|Ψ,{circumflex over (m)}), the probability that image Ψ′ would result from image Ψ and a motion {circumflex over (m)} is given by the probability density function
where “c” is a normalization factor and “σ” is the variance of the noise, which is modeled as a zero mean Gaussian function. Since it is assumed that P({circumflex over (m)}), the probability that the motion is {circumflex over (m)}, is uniform in a small region {circumflex over (M)} around a previous motion estimate, the problem of finding the maximum likelihood motion {circumflex over (m)} for a patch of image Ψ reduces to finding the maximum of the probability density function
for motion {circumflex over (m)}ε{circumflex over (M)}.
Since the motion for which the ego-motion estimation system processor 14 is to generate an estimate is the translational and rotational motion of the vehicle 10 relative to the road, it is desirable for the ego-motion estimation system processor 14 to consider only regions of the images T and T′ that comprise projections of the road, and ignore other regions of the images. However, it should be noted that the set R of regions, or patches, of the images that projections of the roadway in the two images Ψ and Ψ′, is not known. To accommodate that, instead of attempting to maximize the function defined in equation (18), the image can be tessellated into a set of patches Wi, and a probability density P({circumflex over (m)}|Wi,Wi′) generated for each patch using equations (16) and (18) for the respective patches. The probability density over the entire pair of images Ψ and Ψ′ will be
where λi and αi are weighting functions whose values generally reflect the confidence that the “i-th” patch is a projection of the road. The value of the gradient strength βi for a patch reflects the degree to which the patch the contains a texture, and thus will more likely to contain useful information for use in determining ego motion of the vehicle. The motion {circumflex over (m)}ε{circumflex over (M)} for which equation (19) is the maximum will be deemed to correspond to the actual translational and rotational motion of the vehicle 10 as between the locations at which images Ψ and Ψ′ were recorded.
The weighting function λi for the respective “i-th” patch is generated using patches Wi and w′i from respective images Ψ and Ψ′. In determining the values for the weighting functions λi, for patches Wi, W′i that are not of the road, the motion model reflected in equation (11) is not a good fit; instead, a better fit can be obtained using some other motion of the patch. In addition, for planar image artifacts moving on the roadway surface, such as moving shadows, the maximum of equation (18) will occur far away from the initial guess. Accordingly, the value of the weighting function λi for the “i-th” patch Wi, Wi′ will correspond to the ratio between the best fit using the motion model in a local region ({circumflex over (M)}) near the initial guess and the best fit using any motion model over large search region “L.” Accordingly, if
for all {circumflex over (m)}ε{circumflex over (M)} is the value for the best fit in a local search region, where Si( ) denotes the SSD over all points in the “i-th” patch, and
for all {circumflex over (m)}εL the value for the best fit over all possible image motions, then
Generally, generating the value for P2 (equation 21) can be computationally intensive. To avoid generating P2 according to equation (21), the value for P2 for each patch can be estimated by using the SSD as between a patch in the image Ψ and the correspondingly-positioned patch in the image Ψ′, as well as the SSD'"'"'s as between the patch in the image Ψ and patches translated horizontally and vertically around the correspondingly-positioned patch in the image Ψ′, for a selected number of points. That is, if the patch in image Ψ consists of points p(x,y) centered on p(a,b) (that is, points p(a−α, b−β) through p(a+α,b+β) (α and β being integers), with the patch being of dimensions 2α+1 by 2β+1), P2 is generated by using the SSD as between the patch of the same size in image Ψ′ consisting of points p(x,y) centered on p(a,b), as well as SSD'"'"'s as between the patch in image Ψ and patches of the same size in image Ψ′ that are centered on points p(a−δ, b−δ) through p(a+δ, b+δ), a total of (2δ+1)2 patches in image Ψ′. Each patch in image Ψ′ can be considered as one of the possible image motions. In one embodiment, δ is selected to be seven, in which case there will be two hundred and twenty five patches in Ψ′ for which the SSD will be generated in generating the value for P2.
Unlike weighting function λi, weighting function αi for the respective “i-th” patch is generated using only patch Wi and W′i from image Ψ′. Generally, it should be appreciated that, in three-dimensional space, there are three dominant directions for lines, namely, (i) vertical, for buildings, automobiles, and other objects that extend above the roadway surface, (ii) horizontal lines that are generally parallel to the direction of the roadway, and (iii) horizontal lines that are generally perpendicular to the direction of the roadway. In an image Ψ′, vertical lines (that is, lines of type (i)) and horizontal lines that are generally perpendicular to the direction of the roadway (that is, lines of type (iii)) will project in to image Ψ′ as vertical and horizontal lines, respectively. On the other hand, horizontal lines that are generally parallel to the direction of the roadway (that is, lines of type (ii)) will appear in image Ψ′ as lines that pass through a common point, that is, a vanishing point. It will be appreciated that patches W′i in image Ψ′ that are projections of the roadway will predominately contain lines of type (ii) and (iii). On the other hand, patches W′ that are projections of obstacles, such as automobiles will predominately contain lines of type (i) and (iii), while patches W′ that are projections of, for example, buildings, fences, and the like, will contain lines of type (i) and (ii).
Accordingly, the value for weighting function αi for patch Wi will reflect the degree to which it is deemed to contain projections of lines of type (ii) and (iii), and not projections of lines of types (i) and (iii) or types (i) and (ii). Generally, the directions of lines, if any, passing though a patch can be determined in relation to the gradients of the luminance at the various points in the patch Wi. Each point in the patch W′i whose gradient (Ix,Iy) is above a selected threshold is considered to lie at or near a line, with the direction of the line being perpendicular to the direction of the gradient. Thus, for those points, the direction of the line associated therewith can be determined, as can whether the line is of type (i), (ii) or (iii). Thus, for each patch W′i in the image Ψ′, three sums Sni (n=i, ii or iii) are generated each corresponding to the sum of the magnitudes of the gradients of the points in the patch that are associated with lines of the respective type, the magnitude corresponding to G=(Ix2+Iy2)0.5. A patch W′i in image Ψ′ is deemed to be:
(a) a projection of the roadway if the sums Siii and Siiii are both large and significantly larger than sum Sii, since the sums indicate that the patch is associated with a line or lines that are horizontal and in the direction of the roadway and/or perpendicular thereto, but not a line or lines that are vertical;
(b) be a projection of an obstacle, that is, an object generally in the path of the vehicle, if sums Sii and Siiii are both large and significantly larger than sum Siii, since the sums indicate that the patch is associated with a line or lines that are vertical and/or horizontal and perpendicular to the direction of the roadway, but not a line or lines that are horizontal and in the direction of the roadway; and
(c) a projection of an object to the side of the path of the vehicle if sums Sii and Siii are both large and significantly larger than sum Siiii, since the sums indicate that the patch is associated with a line or lines that are vertical and/or horizontal and in the direction of the roadway.
The value of the weighting function ai is assigned to the patch based on the degree to which the patch Wi is deemed to be a projection of the roadway (case (a) above).
It will be appreciated that, if, for a patch W′i, the sum Siii is relatively large, indicating that the patch is associated with a line that is horizontal and in the direction of the roadway, but sums Sii and Siiii are relatively small, indicating that the patch is not associated with a line that is vertical or horizontal and perpendicular to the direction of the roadway, it generally cannot be determined from the set of sums generated for the patch whether the patch is a projection of the roadway (case (a) above) or a projection of an object to the side of the path of the vehicle (case (c) above). However, since the patch is not associated with a line that is vertical, it will generally not be deemed to be a projection of an obstacle (case (b) above). In that case, an assessment as to whether the patch is a projection of the roadway (case (a) above) or a projection of an object to the side of the path of the vehicle (case (c) above) by referring to patches adjacent thereto.
As noted above, the value of the gradient strength βi for a patch reflects the degree to which the patch the contains a texture, and thus will more likely to contain useful information for use in determining ego motion of the vehicle. The gradient strength βi corresponds to
For relatively uniform patches, the value of the SSD Si({circumflex over (m)}) will be relatively low for all motions, in which case the value of βi will be relatively low. On the other hand, for patches with texture, the value of the SSD will be relatively high for most motions, in which case the value of βi− will be relatively high.
With this background, operations performed by the ego-motion estimation system processor 14 will be describe in connection with the flow chart depicted in FIG. 2. In connection with FIG. 2, it is assumed that the ego-motion estimation system processor 14 already has image Ψ, which it may have used in connection with determining the translational and rotational motion up to the location at which image Ψ was recorded. With reference to FIG. 2, after the ego-motion estimation system processor 14 has received image Ψ′ (step 100), it will rectify the image according to information provided during the camera 13 calibration operation (described below) to provide that the optical axis is parallel to the plane defined by the roadway (step 101). In addition, the ego-motion estimation system processor 14 will generate an initial guess as to the translational and rotational motion, using the previous motion estimate and, perhaps information from other sensors if available (step 102). For example, the ego-motion estimation system processor 14 may make use of information from the vehicle 10'"'"'s speedometer, as well as information as to the time period between the time at which image Ψ was recorded and the time at which image Ψ′ was recorded, in generating the initial guess. Generally, it will be appreciated that the time period will be fixed, and will preferably the same for each successive pair of images Ψ and Ψ′. After the ego-motion estimation system processor 14 has generated the initial guess, it will use the initial guess to warp image Ψ′ toward image Ψ, thereby to generate a warped image {circumflex over (Ψ)}′ (step 103).
After the ego-motion estimation system processor 14 has generated the warped image (step 103), it will divide the image Ψ and the warped image {circumflex over (Ψ)}′ into patches and, for each pair of corresponding patches in the two images Ψ and {circumflex over (Ψ)}′, generate the weighting value λi. In that operation, the ego-motion estimation system processor 14 will select a patch in the image Ψ (step 104) and generate values for P2 (step 105), P1 (equation 20) (step 106) and λi (equation 22) (step 107) as described above. In addition, the ego-motion estimation system processor 14 can generate the value for βi (equation 23) and αi (step 108). After the ego-motion estimation system processor 14 has generated performed steps 105 through 108 for the selected patch, it will determine whether all of the patches in image T have been processed (step 109) and if not, return to step 104 to select another patch and perform steps 105 through 109 in connection therewith.
The ego-motion estimation system processor 14 will perform steps 104 through 109 in connection with each patch in the image Ψ. After the ego-motion estimation system processor 14 has performed steps 104 through 109 in connection with all of the patches in the image Ψ, it will sequence from step 109 to step 110 to search for the motion m that maximizes the value provided by equation (19) (step 110). That motion {circumflex over (m)} will comprise values for translation tZ and rotation wX, wY parameters that will constitute the estimate of the motion of the vehicle 10 as between the point in time at which image Ψ was recorded and the point in time at which image Ψ′ is recorded. The ego-motion estimation system processor 14 can perform operations described above in connection with each successive pair of images Ψ and Ψ′ to estimate the motion of the vehicle 10.
In performing steps 106 (to generate the values for Pi) and 110 (to determine the motion {circumflex over (m)} that maximizes the value provided by equation (19)), the ego-motion estimation system processor 14 can perform a gradient descent that is limited to a selected cube-shaped region around the initial guess.
In determining the initial guess (step 102) for each new image Ψ′, the ego-motion estimation system processor 14 can use the estimate of the motion generated for the previously-received image.
In addition, the size of the region {circumflex over (M)} can be adjusted adaptively.
A second methodology for determining the ego-motion of a vehicle 10 will be described in connection with FIG. 3. As with the methodology described above in connection with FIG. 2, it is assumed that the images have been rectified so that the image planes are perpendicular to the plane represented by the roadway on which the vehicle 10 is traveling, and their horizontal (“x”) axes are parallel to the plane represented by the roadway. By way of background, in that case, the equation of a plane
(reference equation (3)) reduces to
in which case
is the height of the optical axis of the camera 13 (or, more specifically, the Z axis) above the road. Since, for a point p(x,y) in an image that is a projection of a point P(X,Y,Z) in three-dimensional space,
equation (25) becomes
The brightness constraint is
for each point, where, at each point (x,y) in the image, Ix and Iy are the horizontal and vertical components of the spatial gradient of the luminance and It is the time gradient of the luminance. In addition, the equations for the components (u,v) of the flow vector (reference equation (1)) can be written
where [w]x is a skew-symmetric matrix, in which case
where
For motion constrained to a plane, equation (29) reduces to
Since the images are rectified, equation (26) will hold. In addition, since rotational motion is constrained so as to occur only around the vertical (“Y”) axis, wX=wZ=0. Accordingly, equation (31) will correspond to
Expanding equation 32, and using equation (30),
Generally, the portion uwY of the vertical component of the flow vector that arises due to rotation (wY) of the vehicle 10 will be larger than the portion utX that arises due to translation (tX) along the “X” axis, and the portions will have a very different form. The portion tX that arises due to translation along the “X” axis will depend on the distance that the vehicle 10 moves between the times the images are recorded, and will be larger for points towards the bottom of the image than for points further up. In that case, expressions for uwY and utX are
Since, for small rotations around the vertical “Y,” axis, the angle of rotation wY is approximately
It will be appreciated that values for tY, the component of the translation t in the vertical direction, and wX and wZ, the X and Z components of rotation w, will be zero. Accordingly, after the ego-motion estimation system processor 14 receives a new image Ψ′, it will determine the values for t1 and t3, the components of the translation t in the forward (along the Z axis) and side (along the X axis) directions, and wY, the component of rotation around the vertical (Y) axis. In that operation, the ego-motion estimation system processor 14 will generate an initial estimate as to the motion (step 150, FIG. 3) and use that initial estimate to generate a warped image {circumflex over (Ψ)}′ (step 151). The ego-motion estimation system processor 14 can use information from a number of sources in connection with generating the initial estimate (step 150), including information from, for example, the vehicle 10'"'"'s speedometer. Thereafter, the ego-motion estimation system processor 14 divides the image Ψ and {circumflex over (Ψ)}′ into patches (step 152) and determines which patches are likely to comprise images of the roadway (step 153). In determining which patches are likely to comprise images of the roadway (reference step 153), the ego-motion estimation system processor 14 can generate an SSD (equation 16) for corresponding patches in the images Ψ and {circumflex over (Ψ)}′ and determine that patches in the warped image {circumflex over (Ψ)}′ that comprise images of the roadway will be those patches with a relatively high SSD value. The ego-motion estimation system processor 14 then uses the patches identified in step 153 to minimize a cost function of the form
where W1 and W2 are weighting matrices that essentially describe confidence in the priors or smoothness values (step 154). Equation (38) can be formalized in the form of a Kalman filter, and the value of “p” can be selected to be one or two depending on whether the L1 or L2 norm is to be used.
As noted above, for methodologies described above in connection with both FIGS. 2 and 3, the ego-motion estimation system processor 14 will initially rectify the images as received from the camera 13. In the above description, the images I and I′ are images as rectified by the ego-motion estimation system processor 14. To rectify the images as received from the camera 13, the camera 13 will need to be calibrated during a calibration operation prior to use in connection with recording images for use in estimating vehicle 10 motion as described above. Before describing operations to be performed during calibration, it would be helpful to consider the effects of incorrect calibration. If, for example, a vehicle is driving along a straight road, and if the optical axis of the camera is aligned with the direction of motion, the flow field of successively recorded images will be an expansion field with the focus of expansion located at the center of the respective images, that is, at the origin (x,y)=(0,0) of the image'"'"'s rectilinear coordinate system. On the other hand, if the camera is mounted on the vehicle with a small rotation around the vertical (“Y”) axis in three-dimensional space, then the focus of expansion will be displaced along the image'"'"'s horizontal (“x”) axis. In that case, the motion model defined by equation (11) will not account for the flow field, but will be well approximated by a forward translation and a rotational velocity wy around the vertical (“Y”) axis.
Accordingly, errors in the orientation of the camera around the vertical (“Y”) axis in three dimensional space will create a bias in the rotation estimate, in which case a curved path would be estimated instead of a straight path. Similarly, errors in the camera'"'"'s orientation around the horizontal (“X”) axis in three dimensional space will cause a bias in the pitch estimate. Based on these observations, a calibration operation can be performed by having the camera record a sequence of images while the vehicle is being driven down a straight roadway. The vehicle'"'"'s ego-motion is estimated as described above in connection with FIG. 2 or 3, and calibration parameters are estimated that would cause the ego-motion to integrate into a straight path.
The invention provides a number of advantages. In particular, the invention provides an arrangement for determining ego-motion of a vehicle 10 on a roadway from a series of images recorded by a camera 13 mounted on the vehicle 10, at least a portion of the images comprising projections of the roadway, and without requiring mechanical sensors which are normally not provided with a vehicle 10 and that would, if provided, increase the cost and maintenance expenses thereof.
It will be appreciated that a system in accordance with the invention can be constructed in whole or in part from special purpose hardware or a general purpose computer system, or any combination thereof, any portion of which may be controlled by a suitable program. Any program may in whole or in part comprise part of or be stored on the system in a conventional manner, or it may in whole or in part be provided in to the system over a network or other mechanism for transferring information in a conventional manner. In addition, it will be appreciated that the system may be operated and/or otherwise controlled by means of information provided by an operator using operator input elements (not shown) which may be connected directly to the system or which may transfer the information to the system over a network or other mechanism for transferring information in a conventional manner.
The foregoing description has been limited to a specific embodiment of this invention. It will be apparent, however, that various variations and modifications may be made to the invention, with the attainment of some or all of the advantages of the invention. It is the object of the appended claims to cover these and such other variations and modifications as come within the true spirit and scope of the invention.