Method and an apparatus for monitoring the environment around a vehicle and an operation support system using the same
First Claim
1. A vehicle operation support system, comprising:
- a picture pickup device attached to a vehicle for picking up a picture of a road surface in front of the vehicle so that the lane position of the vehicle is arranged almost at the center of the picked up picture;
a control unit, including a picture processing unit, for processing picture data picked up by said picture pickup device, a vehicle running state judgment unit for judging states of said vehicle and an actuator drive unit; and
an alarm unit for generating alarms;
whereby said picture processing unit generates display data representing a trapezoidal personal area enclosed by right and left white lines of a lane of said vehicle and two preset horizontal lines to represent a picture of the road surface in front of the vehicle, and wherein said actuator drive unit is operated and an alarm for urging an operator to initiate a steering operation is generated from said alarm unit, when a difference between lengths between said right and said left line type marks of said trapezoidal personal area exceeds a predetermined first threshold value.
1 Assignment
0 Petitions

Accused Products

Abstract
Safety of the distance between vehicles is judged by monitoring whether or not an object other than a front road surface, namely, a preceding vehicle, exists in a predetermined area of the front road surface which is recognized by a picture processing unit used as a sensor for recognizing traffic states of the front road, without recognizing an image of a preceding vehicle having a complicated shape and a plurality of colors of the preceding vehicle by means of picture processing.
135 Citations
Vision-based operating method and system | ||
Patent #
US 7,945,076 B2
Filed 05/02/2008
|
Current Assignee
Morphotrust USA Incorporated
|
Original Assignee
Identix Inc.
|
Image Recordation Device with a Plurality of Lenses | ||
Patent #
US 20100271533A1
Filed 04/07/2010
|
Current Assignee
Crispin Porter Bogusky LLC
|
Original Assignee
Crispin Porter Bogusky LLC
|
System and method for taking risk out of driving | ||
Patent #
US 7,659,827 B2
Filed 05/08/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and method for selective review of event data | ||
Patent #
US 7,804,426 B2
Filed 12/04/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
VISION-BASED OPERATING METHOD AND SYSTEM | ||
Patent #
US 20090097713A1
Filed 05/02/2008
|
Current Assignee
Morphotrust USA Incorporated
|
Original Assignee
Identix Inc.
|
System and method for wireless delivery of event data | ||
Patent #
US 7,536,457 B2
Filed 12/04/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
Vehicle Event Recorder Systems | ||
Patent #
US 20090157255A1
Filed 12/08/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
Smart Drive Systems Inc.
|
Object detection system | ||
Patent #
US 7,554,484 B2
Filed 02/22/2001
|
Current Assignee
Robert Bosch GmbH
|
Original Assignee
Robert Bosch GmbH
|
Method and Driver Assistance System for Sensor-Based Drive-Off Control of a Motor Vehicle | ||
Patent #
US 20090192686A1
Filed 08/11/2006
|
Current Assignee
Robert Bosch GmbH
|
Original Assignee
Robert Bosch GmbH
|
System and method for on-road detection of a vehicle using knowledge fusion | ||
Patent #
US 7,639,841 B2
Filed 12/19/2005
|
Current Assignee
Siemens Corp.
|
Original Assignee
Continental Automotive GmbH, Siemens Corp.
|
Data Transfer System and Method | ||
Patent #
US 20080043736A1
Filed 08/18/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
SYSTEM FOR MONITORING AN AREA ADJACENT A VEHICLE | ||
Patent #
US 20080030311A1
Filed 09/13/2007
|
Current Assignee
Winplus North America Inc.
|
Original Assignee
Old World Industries LLC
|
Docking assistant | ||
Patent #
US 7,336,805 B2
Filed 06/16/2005
|
Current Assignee
Chemtron Research LLC
|
Original Assignee
Daimler Chrysler Company LLC
|
Vision-based operating method and system | ||
Patent #
US 7,369,685 B2
Filed 04/05/2002
|
Current Assignee
Morphotrust USA Incorporated
|
Original Assignee
Identix Incorporated
|
Vehicle exception event management systems | ||
Patent #
US 20080111666A1
Filed 11/09/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Object Detection System | ||
Patent #
US 20070205938A1
Filed 02/22/2001
|
Current Assignee
Robert Bosch GmbH
|
Original Assignee
Robert Bosch GmbH
|
Vehicle event recorders with integrated web server | ||
Patent #
US 20070219685A1
Filed 03/16/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
System and Method for Wireless Delivery of Event Data | ||
Patent #
US 20070260363A1
Filed 12/04/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and Method for Selective Review of Event Data | ||
Patent #
US 20070260361A1
Filed 12/04/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and Method for Reducing Driving Risk With Foresight | ||
Patent #
US 20070257804A1
Filed 05/08/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
SYSTEM AND METHOD FOR TAKING RISK OUT OF DRIVING | ||
Patent #
US 20070257815A1
Filed 05/08/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and Method for Multi-Event Capture | ||
Patent #
US 20070257782A1
Filed 12/04/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and Method for Reducing Driving Risk With Hindsignt | ||
Patent #
US 20070271105A1
Filed 05/09/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and Method for Reducing Driving Risk With Insight | ||
Patent #
US 20070268158A1
Filed 05/09/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and Method for Identifying Non-Event Profiles | ||
Patent #
US 20070257781A1
Filed 08/28/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
Perceptual similarity image retrieval | ||
Patent #
US 7,031,555 B2
Filed 02/28/2003
|
Current Assignee
Intellectual Ventures Holding 81 LLC
|
Original Assignee
Pixlogic LLC
|
System and method for on-road detection of a vehicle using knowledge fusion | ||
Patent #
US 20060177099A1
Filed 12/19/2005
|
Current Assignee
Siemens Corp.
|
Original Assignee
Siemens Corp.
|
Road monitoring method for a vehicle and a system thereof | ||
Patent #
US 6,842,189 B2
Filed 12/28/2001
|
Current Assignee
Hyundai Motor Company
|
Original Assignee
Hyundai Motor Company
|
Docking assistant | ||
Patent #
US 20050281436A1
Filed 06/16/2005
|
Current Assignee
Chemtron Research LLC
|
Original Assignee
Daimler Chrysler Company LLC
|
Method and apparatus for probabilistic image analysis | ||
Patent #
US 20040052418A1
Filed 04/09/2003
|
Current Assignee
Identix Inc.
|
Original Assignee
Identix Inc.
|
Road monitoring method for a vehicle and a system thereof | ||
Patent #
US 20030043269A1
Filed 12/28/2001
|
Current Assignee
Hyundai Motor Company
|
Original Assignee
Hyundai Motor Company
|
Vision-based operating method and system | ||
Patent #
US 20030190076A1
Filed 04/05/2002
|
Current Assignee
Morphotrust USA Incorporated
|
Original Assignee
Identix Inc.
|
Rear monitoring system | ||
Patent #
US 6,360,170 B1
Filed 02/23/2000
|
Current Assignee
Yazaki Corporation
|
Original Assignee
Yazaki Corporation
|
Parking assistance system | ||
Patent #
US 6,483,429 B1
Filed 10/20/2000
|
Current Assignee
Matsushita Electric Industrial Company Limited
|
Original Assignee
Matsushita Electric Industrial Company Limited
|
Assistant apparatus and method for a vehicle in reverse motion | ||
Patent #
US 6,476,730 B2
Filed 02/28/2001
|
Current Assignee
Aisin Seiki Co. Ltd.
|
Original Assignee
Aisin Seiki Co. Ltd.
|
Method for integrated representation of the parameters of a distance control device | ||
Patent #
US 6,497,297 B1
Filed 04/13/2001
|
Current Assignee
Volkswagen AG
|
Original Assignee
Volkswagen AG
|
Three-dimensional scope system with a single camera for vehicles | ||
Patent #
US 6,172,601 B1
Filed 11/15/1999
|
Current Assignee
Matsushita Electric Industrial Company Limited
|
Original Assignee
Matsushita Electric Industrial Company Limited
|
Run environment recognizing apparatus | ||
Patent #
US 6,191,704 B1
Filed 12/19/1997
|
Current Assignee
Hitachi America Limited
|
Original Assignee
Hitachi Ltd.
|
Rear monitoring system for vehicle | ||
Patent #
US 6,259,359 B1
Filed 04/06/2000
|
Current Assignee
Yazaki Corporation
|
Original Assignee
Yazaki Corporation
|
Object observing method and device | ||
Patent #
US 5,910,817 A
Filed 05/17/1996
|
Current Assignee
Omron Corporation
|
Original Assignee
Omron Corporation
|
System for controlling distance to a vehicle traveling ahead based on an adjustable probability distribution | ||
Patent #
US 5,710,565 A
Filed 04/05/1996
|
Current Assignee
Nippondenso Co. Ltd.
|
Original Assignee
Nippondenso Co. Ltd.
|
Method and apparatus for cruise control | ||
Patent #
US 5,761,629 A
Filed 12/11/1995
|
Current Assignee
Lucas Industries Limited
|
Original Assignee
Lucas Industries Limited
|
Method for determining the gradient of a roadway | ||
Patent #
US 5,797,109 A
Filed 12/07/1995
|
Current Assignee
Wabco GmbH
|
Original Assignee
Mercedes-Benz Bank AG
|
Drive assist system for a vehicle and the method thereof | ||
Patent #
US 5,808,561 A
Filed 03/17/1997
|
Current Assignee
Fuji Heavy Industries Limited
|
Original Assignee
Fuji Heavy Industries Limited
|
Lane marker position sensor and alarm | ||
Patent #
US 5,835,028 A
Filed 05/05/1997
|
Current Assignee
Wood J. Rodger, Lee Bender
|
Original Assignee
Wood J. Rodger, Lee Bender
|
System for monitoring an area adjacent a vehicle | ||
Patent #
US 8,194,132 B2
Filed 09/13/2007
|
Current Assignee
Winplus North America Inc.
|
Original Assignee
Old World Industries LLC
|
Advanced Driver Assistance System Having a Sensor Arrangement for Detecting the Distance of the Own Vehicle from a Foreign Object | ||
Patent #
US 20120154135A1
Filed 04/06/2011
|
Current Assignee
BMW AG
|
Original Assignee
BMW AG
|
System and method for reducing driving risk with foresight | ||
Patent #
US 8,314,708 B2
Filed 05/08/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and method for identifying non-event profiles | ||
Patent #
US 8,373,567 B2
Filed 08/28/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
Driving support device, driving support method, and program | ||
Patent #
US 8,559,675 B2
Filed 04/15/2010
|
Current Assignee
Panasonic Corporation
|
Original Assignee
Panasonic Corporation
|
Passenger service unit with gesture control | ||
Patent #
US 20140003659A1
Filed 06/28/2013
|
Current Assignee
Zodiac Aerotechnics
|
Original Assignee
Intertechnique
|
Advanced driver assistance system having a sensor arrangement for detecting the distance of the own vehicle from a foreign object | ||
Patent #
US 8,717,156 B2
Filed 04/06/2011
|
Current Assignee
BMW AG
|
Original Assignee
BMW AG
|
Driver assistance system for vehicle | ||
Patent #
US 8,818,042 B2
Filed 11/18/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Automatic vehicle exterior light control | ||
Patent #
US 8,842,176 B2
Filed 01/15/2010
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Vehicle exception event management systems | ||
Patent #
US 8,868,288 B2
Filed 11/09/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Memory management in event recording systems | ||
Patent #
US 8,880,279 B2
Filed 01/04/2013
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
System and method to detect execution of driving maneuvers | ||
Patent #
US 8,892,310 B1
Filed 02/21/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicular vision system | ||
Patent #
US 8,917,169 B2
Filed 12/02/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Driver assistance system for vehicle | ||
Patent #
US 8,977,008 B2
Filed 07/08/2013
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Vehicle operator performance history recording, scoring and reporting systems | ||
Patent #
US 8,989,959 B2
Filed 11/07/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorders with integrated web server | ||
Patent #
US 8,996,240 B2
Filed 03/16/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Driver assistance system for a vehicle | ||
Patent #
US 8,993,951 B2
Filed 07/16/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,008,369 B2
Filed 08/25/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vision system for vehicle | ||
Patent #
US 9,171,217 B2
Filed 03/03/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Distributed vehicle event recorder systems having a portable memory data transfer system | ||
Patent #
US 9,183,679 B2
Filed 09/25/2013
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vision system for vehicle | ||
Patent #
US 9,191,634 B2
Filed 04/03/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
VEHICLE SPEED CONTROL APPARATUS AND METHOD USING AN IMAGE | ||
Patent #
US 20150329114A1
Filed 08/20/2014
|
Current Assignee
Hyundai Motor Company
|
Original Assignee
Hyundai Motor Company
|
Traffic analysis system utilizing position based awareness | ||
Patent #
US 9,200,904 B2
Filed 03/15/2013
|
Current Assignee
Caterpillar Incorporated
|
Original Assignee
Caterpillar Incorporated
|
Vehicle event recorder systems and networks having integrated cellular wireless communications systems | ||
Patent #
US 9,201,842 B2
Filed 03/16/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorder systems and networks having integrated cellular wireless communications systems | ||
Patent #
US 9,208,129 B2
Filed 08/02/2013
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Memory management in event recording systems | ||
Patent #
US 9,226,004 B1
Filed 11/03/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle speed control apparatus and method using an image | ||
Patent #
US 9,358,978 B2
Filed 08/20/2014
|
Current Assignee
Hyundai Motor Company
|
Original Assignee
Hyundai Motor Company
|
Vehicle event recorders with integrated web server | ||
Patent #
US 9,402,060 B2
Filed 02/27/2015
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vision system for vehicle | ||
Patent #
US 9,428,192 B2
Filed 11/16/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle vision system | ||
Patent #
US 9,436,880 B2
Filed 01/13/2014
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle event recorder systems and networks having integrated cellular wireless communications systems | ||
Patent #
US 9,472,029 B2
Filed 11/17/2015
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event playback apparatus and methods | ||
Patent #
US 9,501,878 B2
Filed 10/16/2013
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorder systems and networks having integrated cellular wireless communications systems | ||
Patent #
US 9,545,881 B2
Filed 07/13/2015
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Power management systems for automotive video event recorders | ||
Patent #
US 9,554,080 B2
Filed 02/10/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Driver assistance system for vehicle | ||
Patent #
US 9,555,803 B2
Filed 05/16/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle event recorder systems and networks having integrated cellular wireless communications systems | ||
Patent #
US 9,566,910 B2
Filed 10/30/2015
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
System and method to detect execution of driving maneuvers | ||
Patent #
US 9,594,371 B1
Filed 09/15/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vision system for vehicle | ||
Patent #
US 9,609,289 B2
Filed 08/29/2016
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle fuel consumption monitor and feedback systems | ||
Patent #
US 9,610,955 B2
Filed 11/11/2013
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorder systems | ||
Patent #
US 9,633,318 B2
Filed 12/08/2006
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
System for monitoring an area adjacent a vehicle | ||
Patent #
US 9,637,051 B2
Filed 05/29/2015
|
Current Assignee
Winplus North America Inc.
|
Original Assignee
Winplus North America Inc.
|
Vision system for vehicle | ||
Patent #
US 9,643,605 B2
Filed 10/26/2015
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Rail vehicle event detection and recording system | ||
Patent #
US 9,663,127 B2
Filed 10/28/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Distributed vehicle event recorder systems having a portable memory data transfer system | ||
Patent #
US 9,679,424 B2
Filed 11/06/2015
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorder systems and networks having integrated cellular wireless communications systems | ||
Patent #
US 9,691,195 B2
Filed 10/17/2016
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event playback apparatus and methods | ||
Patent #
US 9,728,228 B2
Filed 08/10/2012
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vision system for vehicle | ||
Patent #
US 9,736,435 B2
Filed 03/20/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle exception event management systems | ||
Patent #
US 9,738,156 B2
Filed 10/17/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle operator performance history recording, scoring and reporting systems | ||
Patent #
US 9,761,067 B2
Filed 10/30/2014
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 9,834,216 B2
Filed 01/24/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method for reducing driving risk with hindsight | ||
Patent #
US 9,836,716 B2
Filed 05/09/2006
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
Memory management in event recording systems | ||
Patent #
US 9,911,253 B2
Filed 12/28/2015
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorders with integrated web server | ||
Patent #
US 9,942,526 B2
Filed 07/01/2016
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vision system for vehicle | ||
Patent #
US 9,948,904 B2
Filed 08/14/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method to detect execution of driving maneuvers | ||
Patent #
US 9,953,470 B1
Filed 02/23/2017
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicular control system | ||
Patent #
US 10,015,452 B1
Filed 04/16/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle event playback apparatus and methods | ||
Patent #
US 10,019,858 B2
Filed 11/21/2016
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Power management systems for automotive video event recorders | ||
Patent #
US 10,053,032 B2
Filed 12/06/2016
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicular display control device | ||
Patent #
US 10,065,503 B2
Filed 03/30/2015
|
Current Assignee
DENSO Corporation
|
Original Assignee
DENSO Corporation
|
Vision system for vehicle | ||
Patent #
US 10,071,676 B2
Filed 09/12/2016
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,110,860 B1
Filed 07/02/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 10,118,618 B2
Filed 12/04/2017
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,187,615 B1
Filed 10/22/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
System and method for reducing driving risk with hindsight | ||
Patent #
US 10,235,655 B2
Filed 11/01/2017
|
Current Assignee
Lytx Inc.
|
Original Assignee
Lytx Inc.
|
System and method to detect execution of driving maneuvers | ||
Patent #
US 10,249,105 B2
Filed 01/25/2018
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Driving assistance method, and driving assistance device, driving control device, vehicle, driving assistance program, and recording medium using said method | ||
Patent #
US 10,252,726 B2
Filed 04/15/2016
|
Current Assignee
Panasonic Intellectual Property Management Co. Ltd.
|
Original Assignee
Panasonic Intellectual Property Management Co. Ltd.
|
Vehicular control system | ||
Patent #
US 10,306,190 B1
Filed 01/21/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle operator performance history recording, scoring and reporting systems | ||
Patent #
US 10,339,732 B2
Filed 07/24/2017
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicular control system using cameras and radar sensor | ||
Patent #
US 10,351,135 B2
Filed 11/01/2018
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle event recorders with integrated web server | ||
Patent #
US 10,404,951 B2
Filed 01/26/2018
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle vision system with multi-paned view | ||
Patent #
US 10,457,209 B2
Filed 03/28/2013
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system | ||
Patent #
US 10,462,426 B2
Filed 05/16/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicle exception event management systems | ||
Patent #
US 10,471,828 B2
Filed 08/11/2017
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
System and method to detect execution of driving maneuvers | ||
Patent #
US 10,497,187 B2
Filed 02/20/2019
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Driver assistance system for vehicle | ||
Patent #
US 10,623,704 B2
Filed 03/09/2015
|
Current Assignee
Donnelly Corporation
|
Original Assignee
Donnelly Corporation
|
Power management systems for automotive video event recorders | ||
Patent #
US 10,682,969 B2
Filed 07/12/2018
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicular driving assist system using forward-viewing camera | ||
Patent #
US 10,683,008 B2
Filed 07/15/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular control system with traffic lane detection | ||
Patent #
US 10,735,695 B2
Filed 10/28/2019
|
Current Assignee
Magna Electronics Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Adaptive forward lighting system for vehicle comprising a control that adjusts the headlamp beam in response to processing of image data captured by a camera | ||
Patent #
US 10,787,116 B2
Filed 09/10/2018
|
Current Assignee
Magna Mirrors of America Incorporated
|
Original Assignee
Magna Electronics Incorporated
|
Vehicular display control device | ||
Patent #
US 10,800,258 B2
Filed 07/26/2018
|
Current Assignee
DENSO Corporation
|
Original Assignee
DENSO Corporation
|
Vehicle event playback apparatus and methods | ||
Patent #
US 10,818,112 B2
Filed 05/02/2018
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Vehicle event recorder systems | ||
Patent #
US 10,878,646 B2
Filed 12/08/2005
|
Current Assignee
SmartDrive Systems Inc.
|
Original Assignee
SmartDrive Systems Inc.
|
Apparatus and method of processing image | ||
Patent #
US 5,523,958 A
Filed 06/10/1993
|
Current Assignee
Seiko Epson Corporation
|
Original Assignee
Seiko Epson Corporation
|
System for monitoring condition outside vehicle using imaged picture by a plurality of television cameras | ||
Patent #
US 5,410,346 A
Filed 03/15/1993
|
Current Assignee
Fuji Heavy Industries Limited
|
Original Assignee
Fuji Heavy Industries Limited
|
Automatic brake control system | ||
Patent #
US 5,420,792 A
Filed 03/26/1993
|
Current Assignee
Mazda Motor Corporation
|
Original Assignee
Mazda Motor Corporation
|
Obstacle detection device for vehicle | ||
Patent #
US 5,461,357 A
Filed 01/27/1993
|
Current Assignee
Mazda Motor Corporation
|
Original Assignee
Mazda Motor Corporation
|
Vehicle cruise control system | ||
Patent #
US 5,230,400 A
Filed 12/02/1991
|
Current Assignee
Aisin Seiki Co. Ltd.
|
Original Assignee
Aisin Seiki Co. Ltd.
|
Distance detector mounted on vehicle | ||
Patent #
US 4,931,937 A
Filed 09/01/1988
|
Current Assignee
Aisin Seiki Co. Ltd.
|
Original Assignee
Aisin Seiki Co. Ltd.
|
System for measuring position and/or velocity | ||
Patent #
US 4,195,425 A
Filed 01/04/1978
|
Current Assignee
Ernst Leitz Wetzlar GmbH
|
Original Assignee
Ernst Leitz Wetzlar GmbH
|
DISTANCE MEASURING DEVICE | ||
Patent #
US 3,603,929 A
Filed 09/17/1969
|
Current Assignee
Thomas T. Drysdale
|
Original Assignee
Thomas T. Drysdale
|
5 Claims
-
1. A vehicle operation support system, comprising:
-
a picture pickup device attached to a vehicle for picking up a picture of a road surface in front of the vehicle so that the lane position of the vehicle is arranged almost at the center of the picked up picture; a control unit, including a picture processing unit, for processing picture data picked up by said picture pickup device, a vehicle running state judgment unit for judging states of said vehicle and an actuator drive unit; and an alarm unit for generating alarms; whereby said picture processing unit generates display data representing a trapezoidal personal area enclosed by right and left white lines of a lane of said vehicle and two preset horizontal lines to represent a picture of the road surface in front of the vehicle, and wherein said actuator drive unit is operated and an alarm for urging an operator to initiate a steering operation is generated from said alarm unit, when a difference between lengths between said right and said left line type marks of said trapezoidal personal area exceeds a predetermined first threshold value. - View Dependent Claims (2, 3, 4, 5)
-
1 Specification
The present invention relates to a method and an apparatus for monitoring traffic states around a vehicle by using picture information picked up by a picture pickup device, and further to an operation support system using the method and the apparatus.
Methods or apparatuses for maintaining a constant distance between a subject vehicle and a preceding vehicle or for operating the subject vehicle to follow a preceding vehicle by means of a picture processing technique using pictures of a front scene in the running direction, picked up by a picture pickup device, are described in Japanese Patent Applications Laid-Open No. 313200/1992, No. 172799/1983 and No. 291100/1990.
Since the above-mentioned techniques are based upon recognition of a preceding vehicle by using picture information, the techniques require processing of a large amount of picture information, and therefore, the implementation of such techniques requires a large capacity memory and an information processing device (computer) capable of superhigh speed calculation.
Further, the techniques have a problem in that they need more information processing time if a road is curved since it is necessary under such circumstances to process more picture information for following the preceding vehicle.
The present invention has been achieved in consideration of the above-described problems, and has the aim of providing a method and an apparatus for monitoring the traffic states of a vehicle, and of providing an operation support system using the method and the apparatus and which is capable of largely reducing the amount of information to be processed and the information processing time, while downsizing the information processing device.
An object of the present invention is to generate signals or execute predetermined controls over a subject vehicle on detecting the appearance of a part, which can not be determined as a road, or the image of an object which is determined as a thing other than a road surface, in the predetermined front area of the front road surface area in the running direction of the subject vehicle, which are recognized by using picture information picked up by a picture pickup device.
And, by providing the above-mentioned functions, the present invention can generate or execute controls over the subject vehicle on detecting the indication of a vehicle in the predetermined front area in the running direction of the subject vehicle, which is displayed on a display device.
Further, a function to judge the curving of a road by applying a simple picture processing technique to road surface information obtained from picture information is also provided by the present invention.
By the present invention, the required memory capacity and the amount of processed information can be decreased by judging a safe distance between vehicles based not on recognition of a preceding vehicle itself having a complicated shape and plural colors and sizes, but on a determination as to whether an object other than a road surface (for example, a preceding vehicle) exists or not, or whether a part not recognized as a road surface exists or not in the predetermined area (the predetermined area in the running direction of the present vehicle) of the recognized front road surface.
FIG. 1 is a schematic block diagram which shows the main constitution of an apparatus and an operation support system forming an embodiment of a present invention.
FIG. 2 is a block diagram which shows the constitution of a control unit of the apparatus and the operation support system of the present invention.
FIG. 3 diagrammatically shows an example of a display on a window which is processed by a picture processing unit of the present invention.
FIG. 4 is a flow chart which shows a control flow of running operations of the control unit of the present invention in the case of a traffic snarl.
FIG. 5 diagrammatically shows a picture displaying the situation in which preceding vehicle exists in a first personal area as produced by the picture processing unit of the present invention.
FIG. 6 diagrammatically shows a display on the window in the case of processing a curved road by the picture processing unit of the present invention.
FIG. 7 diagrammatically shows a picture displaying the situation in which a preceding vehicle exists in a second personal area as produced by the picture processing unit of the present invention.
FIG. 8 is a flow chart which shows a control flow of stopping operations of the control unit of the present invention in the case of a traffic snarl.
FIG. 9 is a diagram showing the personal area making up process performed by the picture processing unit of the present invention.
FIG. 10 is a block diagram which shows the main constitution of an apparatus and an operation support system of the present invention.
FIG. 11 is a diagram which shows the relation between Y coordinates of the personal areas and the gradient of a road used in the present invention.
FIG. 12 is a flow chart which shows a control flow of running operations in a traffic snarl performed by the control unit of the present invention.
FIG. 13(a) is a diagram showing the relation between the position of a preceding vehicle existing outside the personal area and the position of the subject vehicle.
FIG. 13(b) is a diagram showing the relation between the position of a preceding vehicle existing inside the personal area and the position of the subject vehicle.
FIG. 14 is a block diagram which shows the constitution of a control unit in accordance with the present invention.
FIG. 15 is a diagram showing the relation between Y coordinates of the personal areas and the acceleration of the subject car in accordance with the present invention.
Hereinafter, details of the present invention will be explained based on embodiments illustrated in the drawings. In FIG. 1, the main constitution of an apparatus and an operation support system for monitoring traffic states around a vehicle according to an embodiment of the present invention is shown. A picture pickup device 3 such as a CCD camera for picking up a preceding vehicle 1 and a front road 2, etc. is connected to a control unit 5 via an A/D converter 4. A wheel rotation speed sensor 6, a monitor of a stop lamp signal 7 and a steering angle sensor 8 are connected to the input side of the control unit 5, and a brake actuator 9 and an alarm device 10 are connected to the output side of the control unit 5.
As shown in FIG. 2, the control unit 5 is composed of a picture processing unit 501 for processing picture information, a memory 502 for storing predetermined parameters (yW, yS, yo, c1, c2 ), an actuator drive unit 504, a vehicle running state judgment unit 503 for judging running states of a vehicle and several kinds of memories which are not shown in the figure. Picture signals 101 converted to digital signals by the A/D converter 4 are input into the picture processing unit 501, and a wheel rotation speed sensor signal 102, a stop lamp signal 103 and a steering angle sensor signal 104 are supplied to the vehicle running state judgment unit 503. Then, an alarm generating signal 105 and a brake drive signal 106 are output from the actuator drive unit 504.
FIG. 3 shows the situation in which the processed information concerning the front road 2 picked up by the picture pickup device 3 is displayed on a two dimensional window 11 when a preceding vehicle does not exist. A personal area 202 of trapezoid shape formed by four points PW1, PW2, PS1, PS2 and a smaller personal area 203 of trapezoidal shape formed by four points PS1, PS2, Po1, Po2 are located in a lane 201 of the subject vehicle. The points PW1, PS1, Po1 and the points PW2, PS2, Po2 are contiguous internally with the right and the left white lines, respectively, the coordinates of which are represented by (xW1,, yW), (xS1, yS), (xo1, yo), (xW2, yW), (xS1, yS) and (xo2, yo).
The values of yW, yS and yo are predetermined and stored in the memory 502 of the control unit 5 in advance corresponding to the monitoring position and angle of the picture pickup device 3. The values of yW and yS are set so that the distance between the preceding vehicle and the subject vehicle is a safe one for a vehicle running in a traffic snarl, if the preceding vehicle exists in the upper area above the yW, and the position distance between the vehicles is a dangerous one which may cause a vehicle collision, if the preceding vehicle exists in the lower area below the position yS. The position yo is set to the lowest position in the window 11.
The difference DL between the right and the left white line segments cut by the two horizontal lines represented by the coordinates yW and yS is expressed by Eq.1. ##EQU1##
DL is calculated and compared with a predetermined first threshold value c1 and a predetermined second threshold value c2 larger than the c1.
In the following, operations of the embodiment are described.
Firstly, FIG. 4 shows a control flow of the subject vehicle in the running state, the running state being determined using the wheel rotation speed sensor signal 102. After a road is recognized by the picture pickup device 3 at the step 1001, the first personal area Aw (202) and the second personal area As (203) are established in the picture processing unit 502 at the step 1002. At the step 1003, it is judged whether or not an object, namely, a preceding vehicle, exists in the first personal area Aw. Then, if a preceding vehicle does not exist in the area Aw, as shown in FIG. 3, the process goes to the step 1004 of judging the difference between the right and the left white line segments. If the difference is smaller than the threshold value c1, the road is judged as a straight road, as shown in FIG. 3, and the process goes back to the first step 1001.
On the other hand, if the judgment at the step 1003 is "NO", it is judged that a preceding vehicle 1 comes into the first personal area Aw (202) as shown in FIG. 5, that is, it has slowed down or stopped, and the alarm unit 10 sends the first alarm for urging the operator to initiate to a braking operation in response to an alarm generating signal 105 if it is judged from the state of the stop lamp signal 103 that the braking operation of the subject vehicle is not already being carried out at the step 1005. And, if the judgment at the step 1004 is "NO", it is judged that the road is curved, as shown in FIG. 6, and the alarm unit 10 sends out a first alarm for urging the operator to initiate a steering operation in response to an alarm generating signal 105, if it is judged from the state of the steering angle signal 104 at the step 1007 that the steering operation of the present vehicle is not being carried out.
Furthermore, if, at the step 1008, it is judged that the operator has not initiated a braking or steering operation in spite of the first alarm and the preceding vehicle comes into the second personal area As (203), as shown in FIG. 7, or if, at the step 1009, it is judged that the difference between the right and the left white line segment exceeds the second threshold c2, the second alarm is sent to the operator, since a vehicle collision or a wheel falling off may possibly occur. At the same time, the brake actuator 9 is driven by the brake drive signal 106 and the subject vehicle is automatically stopped at the step 1011.
FIG. 8 shows a control flow of the subject vehicle in the stopping state on a snarled road, in which the stopping state is determined by using the wheel rotation speed sensor signal 102.
After the presence of a road is picked up by the picture pickup device 3 at the step 2001, the first personal area Aw (202) is established in the picture processing unit 501 at the step 2002. At the step 2003, it is judged whether or not an object, namely, a preceding vehicle exists in the first personal area Aw. Then, if a preceding vehicle exists in the area Aw, as shown in FIG. 5, it is judged that the preceding vehicle is also stopping and the distance between the vehicles is too short for starting of the subject vehicle, and the process goes back to the first step 2001.
On the other hand, if, at the step 2003, the judgment is "NO", it is judged that the preceding vehicle has started and enough distance between the vehicles is ensured, and so on alarm for urging the operator release the braking is sent by the alarm generating signal 105 at the step 2005, if, at the step 2004, it is judged from the state of the stop lamp signal 103 that braking of the subject vehicle is maintained.
As mentioned above, in accordance with the present invention, picture information input to the picture processing unit 501 can be decreased, since only one picture pickup device is needed as a sensor for detecting the situation of a road in front of the subject vehicle, and information to be dealt with in the picture processing is greatly reduced compared with conventional methods since the preceding vehicle is dealt with as only an object, other than a part of a road surface (a personal area). By the above-mentioned features, downsizing of the control unit can be realized, which can present a small size, light and cheap system.
Furthermore, the fatigue and stress of an operator can be mitigated by enjoying a meal or reading in a traffic snarl, since the alarm for urging the operator'"'"'s stopping or starting with adequate timing is given on stopping or starting of the preceding vehicle and on departing of the preceding vehicle from the lane of the subject vehicle.
Furthermore, an operator can avoid an accident due to his carelessness in a traffic snarl, since the brake is automatically operated and the subject vehicle is stopped if the danger of a vehicle collision or a wheel falling off is predicted when the operator does not become aware of the generated alarm.
In the following, a method of making up the personal areas on the two dimensional window will be explained by referring to FIG. 9. Supposing that a road surface is always picked up at the center of the bottom part (y coordinate is y0) in the horizontal direction, a small area 204a is set at the center. Then, the area is extended by the predetermined picture elements in the upper, right and left direction (204b). The extending operation is repeated as far as the same color and brightness is kept in the extended area. In the process of area extension, a part having another color is determined as a white line and extension of the area in the horizontal direction is stopped at that part (Q part of 204c) if another color appears in the extended area. In the upper direction (y direction), the extension is terminated when the extended area reaches a predetermined height yW and the personal area 204 is finally established.
By the embodiment, the computation load for picture processing can be reduced by efficiently making up the personal areas, that is, by always starting the area extension from a predetermined point of the window, without searching for a vehicle by scanning the picked up picture in the x and y directions.
In some cases, depending on the mounting position and angle of the picture pickup device, the hood of the vehicle is picked up at the center of the bottom part of the window. In such a case, the same effect of computation load reduction can be realized by setting the initial area 204a near the central upper part contacting the top of the hood and making up the personal area using same procedure as mentioned above.
In the following, an embodiment wherein a road gradient sensor 12 is provided will be explained with reference to FIG. 1 and FIG. 10. The picture pickup device 3 for picking up a preceding vehicle 1 and the front road 2 is connected to the control unit 5 via the A/D converter 4. The wheel rotation speed sensor 6, the stop lamp monitor 7 and the road gradient sensor 12 are connected to the input side of the control unit 5, and the brake actuator 9 and the alarm unit 10 to the output side of the control unit 5.
As shown in FIG. 10, the control unit 5 is composed of the memory 502 for storing predetermined parameters (yW, yS, yo, c1, c2), a personal area parameter setting unit 506 for correcting and setting the y coordinates yW and yS of the personal area corresponding to a road gradient sensor signal 107, an actuator drive unit 504, a vehicle running state judgment unit 503 for judging running states of a vehicle and several kinds of memories which are not shown in the figure.
Picture signals 101 converted to digital signals by the A/D converter 4 are input into a picture processing unit 501, the road gradient sensor signal 107 is input into the personal area parameter setting unit 506, and a wheel rotation speed sensor signal 102, a stop lamp signal 103 and a steering angle sensor signal 104 are input into the vehicle running state judgment unit 503. Then, a alarm generating signal 105 and a brake drive signal 106 are output from the actuator drive unit 504.
FIG. 3 shows the situation in which information concerning the front road 2 picked up by the picture pickup device 3 is displayed on the two dimensional window 11 when a preceding vehicle does not exist. The personal area AW (202) of trapezoidal shape formed by four points PW1, PW2, PS1, PS2,and the smaller personal area AS (203) of trapezoidal shape formed by four points PS1, PS2, Po1, Po2 are disposed in a lane 201 of the subject vehicle. The points PW1, PS1, Po1 and the points PW2, PS2, Po2 are contiguous internally to the right and the left white lines, respectively, each coordinate of which is represented by (xW1, yW), (xS1, yW), (xo1, yo), (xW2, yw), (xS1, yW) and (xo2, yo). The coordinates yW and yS are changed in accordance with the road gradient as shown in FIG. 11. For example, in the case of a road gradient increase at a descendant road, the values of yW and yS are corrected and set by the personal area parameter setting unit 506 so that the values of yW and yS increase corresponding to the gradient increase. Further, it is also possible to directly set the values of yW and yS as a function of the road gradient and to set the value of Yo as the y coordinate of the bottom of the window 11.
In the following, operations of the embodiment are described.
Firstly, FIG. 12 shows a control flow of the subject vehicle in the running state of the present vehicle, the running state being determined by using the wheel rotation speed sensor signal 102. After the situation of the road is recognized by the picture pickup device 3 at the step 3001, the values of yW and yS are set by the personal area parameter setting unit 506 in accordance with the road gradient obtained from the road gradient sensor signal 107 at the step 3002 and the first personal area Aw (202) and the second personal area As (203) are established in the picture processing unit 502 at the step 3003. At the step 3004, it is judged whether an object, namely, a preceding vehicle exists or not in the first personal area Aw. Then, if a preceding vehicle does not exist in the area Aw, as shown in FIG. 3, the process goes back to the first step 3001.
On the other hand, if the judgment at the step 3004 is "NO", it is judged that a preceding vehicle 1 is present in the first personal area Aw (202) as shown in FIG. 5, that is, it has slowed down or stopped, and the alarm unit 10 sends a first alarm for urging the operator to initiate a braking operation in response to the alarm generating signal 105 at the step 3006, if it is judged from the state of the stop lamp signal 103 that the braking operation of the subject vehicle has not been initiated at the step 3005.
Furthermore, if, at the step 3007, it is judged that the operator does not initiate a braking or steering operation in spite of the first alarm and the preceding vehicle comes into the second personal area As (203), a second alarm is sent to the operator, since a vehicle collision may possibly occur at the step 3008, and then, at the same time, the brake actuator 9 is driven by the brake drive signal 106 and the vehicle is automatically stopped at the step 3009.
FIGS. 13(a) and 13(b) show a comparison of processing states displayed on the window of the picture processing unit 501 for the case of a flat road and the case of a large descendant gradient road, wherein the position of the preceding vehicle has the same y coordinate yV, that is, the distance between the vehicles is the same in the both cases. In the case of a flat as shown by FIG. 13(a), the alarm is not generated since the y coordinate yW of the first personal area is below the y coordinate yV of the preceding vehicle. On the other hand, in the case of a large descendant gradient road as shown by FIG. 13(b), the alarm is generated since the yW is above the position yV. Since the personal area is enlarged in accordance with the gradient in a descendant road, the alarm is generated earlier and safer braking can be realized.
In the following, another embodiment is explained with reference to FIGS. 1, 14, and 15.
FIG. 1 shows the constitution of this embodiment, while details of the embodiment are shown by FIG. 14, wherein the wheel rotation speed 102 is input into both the vehicle running state judgement unit 503 and the personal area parameter setting unit 506. Furthermore, the acceleration of the vehicle is obtained, for example, by differentiating the wheel rotation speed sensor signal. Then, the degree of the road surface gradient is estimated, and the process from setting the personal areas to generating the alarm or driving the brake is executed according to the same process flow as the flow described in the above-mentioned embodiment (as shown by FIG. 12). In the embodiment, as shown in FIG. 15, it is judged that the road is descendant if the acceleration is positive, that is, the wheel rotation speed increases, and the y coordinate yW of the first personal area and the y coordinate yS of the second personal area are increased corresponding to the increase of the acceleration.
By this embodiment, the same effects as the above-mentioned embodiment can be attained and further cost reduction of the apparatus is possible, since the road surface gradient sensor becomes dispensable.
As explained above, by the present invention, the judgment as to a safe distance between vehicles is obtained based on only the determination as to whether or not an object other than a road, namely, a preceding vehicle exists in a predetermined area on a road surface. By the feature of the present invention, it is possible to considerably reduce the memory capacity and the amount of processed information and to offer a downsized, light and cheap operation support system.