CONSTRAINT AUGMENTATION IN A NAVIGATIONAL SYSTEM

• US 20190286157A1
• Filed: 06/07/2019
• Published: 09/19/2019
• Est. Priority Date: 01/05/2016
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: Shalev-Shwartz, Shai, Shammah, Shaked, Shashua, Amnon, Taieb, Yoav, Stein, Gideon
• Granted Patent: US 10,514,705 B2
• Time in Patent Office: Days
• CPC Class Codes: B60W 2050/0088 Adaptive recalibration
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2520/16 Pitch
• CPC Class Codes: B60W 2520/18 Roll
• CPC Class Codes: B60W 2552/15 Road slope, i.e. the inclination of a road segment in the longitudinal direction
• CPC Class Codes: B60W 2552/30 Road curve radius
• CPC Class Codes: B60W 2552/53 Road markings, e.g. lane marker or crosswalk
• CPC Class Codes: B60W 2554/00 Input parameters relating to objects
• CPC Class Codes: B60W 2554/20 Static objects
• CPC Class Codes: B60W 2554/4029 Pedestrians
• CPC Class Codes: B60W 2554/4046 Behavior, e.g. aggressive or erratic
• CPC Class Codes: B60W 2554/802 Longitudinal distance
• CPC Class Codes: B60W 2554/804 Relative longitudinal speed
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B60W 30/0953 the prediction being responsive to vehicle dynamic parameters
• CPC Class Codes: B60W 30/0956 the prediction being responsive to traffic or environmental parameters
• CPC Class Codes: B60W 30/18163 Lane change; Overtaking manoeuvres
• CPC Class Codes: B60W 50/0097 Predicting future conditions
• CPC Class Codes: B60W 50/045 Monitoring control system parameters
• CPC Class Codes: B60W 60/0011 involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles
• CPC Class Codes: B60W 60/00276 : for two or more other traffic participants
• CPC Class Codes: G01C 21/34 : Route searching; Route guidance
• CPC Class Codes: G01C 21/3453 : Special cost functions, i.e. other than distance or default speed limit of road segments
• CPC Class Codes: G01C 21/3602 : Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G05D 1/0055 : with safety arrangements
• CPC Class Codes: G05D 1/0231 : using optical position detecting means position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16
• CPC Class Codes: G05D 1/0246 : using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0253 : extracting relative motion information from a plurality of images taken successively, e.g. visual odometry, optical flow determining position or orientation from images G06T7/70
• CPC Class Codes: G06N 20/00 : Machine learning
• CPC Class Codes: G06N 3/00 : Computing arrangements based on biological models
• CPC Class Codes: G06N 3/006 : based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06N 3/044 : Recurrent networks, e.g. Hopfield networks
• CPC Class Codes: G06N 3/08 : Learning methods
• CPC Class Codes: G06N 5/046 : Forward inferencing; Production systems
• CPC Class Codes: G06N 7/01 : Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 : of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A navigation system for a host vehicle is provided. The system may comprise at least one processing device programmed to receive, from a camera, a plurality of images representative of an environment of the host vehicle; analyze the plurality of images to identify a navigational state associated with the host vehicle; determine a first predefined navigational constraint implicated by at least one aspect of the navigational state; identify, based on analysis of the plurality of images, a presence of at least one navigational constraint augmentation factor; determine a second navigational constraint based on identification of the at least one navigational constraint augmentation factor; determine, based on the identified navigational state, a navigational action for the host vehicle satisfying the second navigational constraint; and cause at least one adjustment of a navigational actuator of the host vehicle in response to the determined navigational action.

Claims

1-75. -75. (canceled)

76. A navigation system for a host vehicle, the system comprising:

at least one processing device programmed to;

receive, from a camera, a plurality of images representative of an environment of the host vehicle;

analyze the plurality of images to identify a navigational state associated with the host vehicle;

determine a first predefined navigational constraint implicated by at least one aspect of the navigational state;

identify, based on analysis of the plurality of images, a presence of at least one navigational constraint augmentation factor;

determine a second navigational constraint based on identification of the at least one navigational constraint augmentation factor, wherein the second navigational constraint is different from the first navigational constraint and includes at least one characteristic augmented with respect to the first navigational constraint;

determine, based on the identified navigational state, a navigational action for the host vehicle satisfying the second navigational constraint; and

cause at least one adjustment of a navigational actuator of the host vehicle in response to the determined navigational action.

77. The navigation system of claim 76, wherein determination of the navigational action for the host vehicle satisfying the second navigational constraint occurs in a trained navigational system.

78. The navigation system of claim 76, wherein the first predefined navigational constraint includes a first buffer zone associated with a detected object, wherein at least a portion of the first buffer zone extends a first distance from the detected object, and wherein the second navigational constraint includes a second buffer zone associated with the detected object, wherein at least a portion of the second buffer zone extends a second distance from the detected object greater than the first distance.

79. The navigation system of claim 76, wherein the at least one navigational constraint augmentation factor includes a detected presence of snow or water on a road surface.

80. The navigation system of claim 76, wherein the at least one navigational constraint augmentation factor includes a detected decrease in image quality of the plurality of images.

81. The navigation system of claim 76, wherein the at least one navigational constraint augmentation factor includes detected particulates on an outer surface of a windshield of the host vehicle.

82. The navigation system of claim 76, wherein the at least one navigational constraint augmentation factor includes a detected failure of a least one sensor associated with the host vehicle.

83. The navigation system of claim 76, wherein the navigational actuator includes at least one of a steering mechanism, a brake, or an accelerator.

84. The navigation system of claim 76, wherein that least one augmented characteristic includes an increased distance of at least a portion of a buffer zone associated with at least one of a pedestrian, a target vehicle, a detected object, or a roadside barrier.

85. The navigation system of claim 76, wherein the at least one augmented characteristic includes a decrease in speed associated with at least one predefined navigational constraint.

86. The navigation system of claim 76, wherein the at least one augmented characteristic includes a decrease in maximum allowable deceleration associated with at least one predefined navigational constraint.

87. An autonomous vehicle, the autonomous vehicle comprising:

a frame;

a body attached to the frame;

a camera; and

at least one processing device programmed to;

receive, from the camera, a plurality of images representative of an environment of the autonomous vehicle;

analyze the plurality of images to identify a navigational state associated with the autonomous vehicle;

determine a first predefined navigational constraint implicated by at least one aspect of the navigational state;

identify, based on analysis of the plurality of images, a presence of at least one navigational constraint augmentation factor;

determine a second navigational constraint based on identification of the at least one navigational constraint augmentation factor, wherein the second navigational constraint is different from the first navigational constraint and includes at least one characteristic augmented with respect to the first navigational constraint;

determine, based on the identified navigational state, a navigational action for the autonomous vehicle satisfying the second navigational constraint; and

cause at least one adjustment of a navigational actuator of the autonomous vehicle in response to the determined navigational action.

88. The autonomous vehicle of claim 87, wherein determination of the navigational action for the autonomous vehicle satisfying the second navigational constraint occurs in a trained navigational system.

89. The autonomous vehicle of claim 87, wherein the first predefined navigational constraint includes a first buffer zone associated with a detected object, wherein at least a portion of the first buffer zone extends a first distance from the detected object, and wherein the second navigational constraint includes a second buffer zone associated with the detected object, wherein at least a portion of the second buffer zone extends a second distance from the detected object greater than the first distance.

90. The autonomous vehicle of claim 87, wherein the at least one navigational constraint augmentation factor includes a detected presence of snow or water on a road surface.

91. The autonomous vehicle of claim 87, wherein the at least one navigational constraint augmentation factor includes a detected decrease in image quality of the plurality of images.

92. The autonomous vehicle of claim 87, wherein the at least one navigational constraint augmentation factor includes detected particulates on an outer surface of a windshield of the autonomous vehicle.

93. The autonomous vehicle of claim 87, wherein the at least one navigational constraint augmentation factor includes a detected failure of a least one sensor associated with the autonomous vehicle.

94. The autonomous vehicle of claim 87, wherein the navigational actuator includes at least one of a steering mechanism, a brake, or an accelerator.

95. The autonomous vehicle of claim 87, wherein that least one augmented characteristic includes an increased distance of at least a portion of a buffer zone associated with at least one of a pedestrian, a target vehicle, a detected object, or a roadside barrier.

96. The autonomous vehicle of claim 87, wherein the at least one augmented characteristic includes a decrease in speed associated with at least one predefined navigational constraint.

97. The autonomous vehicle of claim 87, wherein the at least one augmented characteristic includes a decrease in maximum allowable deceleration associated with at least one predefined navigational constraint.

98. A method of navigating an autonomous vehicle, the method comprising:

receiving, from a camera, a plurality of images representative of an environment of the autonomous vehicle;

analyzing the plurality of images to identify a navigational state associated with the autonomous vehicle;

determining a first predefined navigational constraint implicated by at least one aspect of the navigational state;

identifying, based on analysis of the plurality of images, a presence of at least one navigational constraint augmentation factor;

determining a second navigational constraint based on identification of the at least one navigational constraint augmentation factor, wherein the second navigational constraint is different from the first navigational constraint and includes at least one characteristic augmented with respect to the first navigational constraint;

determining, based on the identified navigational state, a navigational action for the autonomous vehicle satisfying the second navigational constraint; and

causing at least one adjustment of a navigational actuator of the autonomous vehicle in response to the determined navigational action.

99-135. -135. (canceled)