Multi-level navigation monitoring and control

• US 10,215,583 B2
• Filed: 09/17/2015
• Issued: 02/26/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Ng-Thow-Hing, Victor, Tran, Cuong, Bark, Karlin
• Primary Examiner(s): Collins, Darryl J
• Assistant Examiner(s): Sumlar, Journey
• Application Number:
  US14/856,596
• Publication Number:
  US 20160003636A1
• Time in Patent Office: 1,258 Days
• Field of Search: 701 23
• CPC Class Codes: G01C 21/3632 Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G01C 21/3658 Lane guidance
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/3697 Output of additional, non-guidance related information, e.g. low fuel level G01C21/3679 takes precedence
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

Multi-level navigation monitoring and control is provided. A system includes a lane marking manager determining a first boundary line, a second boundary line, and a centerline of a current lane of travel. The system also includes a confidence level determiner assigning a first confidence level to the first boundary line, a second confidence level to the second boundary line, and a third confidence level to the centerline. Further, the system includes a user interface outputting representations of the first boundary line, the second boundary line, and the centerline based, at least in part, on the first confidence level, the second confidence level, and the third confidence level.

Claims

1. A system for multi-level navigation monitoring and control, comprising:

a memory; and

a processor that executes the following computer executable components stored in the memory;

a navigation manager generating a route between a first location and a second location;

a map displayer outputting a map that includes the route and is indicative of distances of one or more surfaces, objects, obstructions, or geometries in an area around a vehicle,

wherein the map displayer outputs the route to indicate a path travelled and a future path expected to be travelled, each graphically distinguishable from one another, wherein the map displayer outputs the map on a windshield of the vehicle, wherein the map is transparent and does not obstruct a view of real world objects in a vehicle environment;

a modification controller altering at least a portion of the route based on an indication of a change received at a user interface or a sensor;

a lane marking manager determining one or more lane boundaries and a center steering trajectory of a lane of traffic; and

a confidence level determiner assigning respective confidence levels to the lane boundaries and the center steering trajectory based on a prior system knowledge of conditions of a road being traversed, respective confidence levels indicative of confidence that the lane boundaries are correct,

wherein the navigation manager regenerates the route between the first location and the second location as a function of the indication of the change and the map displayer outputs a revised map based on the regenerated route.

2. The system of claim 1, wherein the indication of the change is based on a gesture detected by the user interface or the sensor.

3. The system of claim 1, wherein the indication of the change is based on a verbal command detected by the user interface or the sensor.

4. The system of claim 1, wherein the confidence level determiner is configured to output outputting a notification based on a determination that at least one confidence level of the respective confidence levels is below a threshold level.

5. The system of claim 4, wherein the notification is a multimodal alarm.

6. The system of claim 4, wherein the notification is represented as a visual indicator that is rendered to appear as overlaying real world portions of the lane of traffic.

7. The system of claim 1, wherein the indication of the change is received from a passenger in the vehicle.

8. A method for multi-level navigation monitoring and control, comprising:

generating a route between a first location and a second location based on a determination of a current location of a vehicle and a received destination location;

outputting a map on a windshield of the vehicle, the map comprises segments of the route and are transparent, wherein a view of real world objects through the windshield are not obstructed by the segments, wherein the outputting the route includes indicating a path travelled and a future path expected to be travelled, each graphically distinguishable from one another;

altering at least one segment of the route based on an indication of a change to the at least one segment, the altering comprising overriding an autonomous steering instruction of the vehicle;

determining one or more lane boundaries and a center steering trajectory of a lane of traffic;

overlaying the lane boundaries and the center steering trajectory on a real world view of the lane of traffic;

assigning respective confidence levels to the lane boundaries and the center steering trajectory based on a prior system knowledge of conditions of a road being traversed, respective confidence levels indicative of confidence that the lane boundaries are correct; and

altering an output of the overlaid lane boundaries and the center steering trajectory based on the assigned confidence levels.

9. The method of claim 8, wherein the altering at least one segment of the route comprises:

detecting a gesture performed by a vehicle occupant; and

interpreting the gesture as a command to change a driving instruction related to the at least one segment.

10. The method of claim 8, further comprising:

determining at least one confidence level of the respective confidence levels is below a threshold amount; and

outputting a multimodal alarm based on the determining.

11. A system for navigation monitoring and control of a vehicle, comprising:

a memory; and

a processor that executes the following computer executable components stored in the memory;

a lane marking manager determining a first boundary line, a second boundary line, and a centerline of a current lane of travel;

a confidence level determiner assigning a first confidence level to the first boundary line, a second confidence level to the second boundary line, and a third confidence level to the centerline based on a prior system knowledge of conditions of a road being traversed, respective confidence levels indicative of confidence that the lane boundaries are correct; and

a user interface outputting representations of the first boundary line, the second boundary line, and the centerline based on the first confidence level, the second confidence level, and the third confidence level.

12. The system of claim 11, wherein the user interface is configured to output outputting the representations in a first format based on the respective confidence levels conforming to a predetermined threshold value, and outputting output the representations in a second format based on the respective confidence levels being below the predetermined threshold value.

13. The system of claim 11, wherein the user interface outputting is configured to output an audible alarm based on a determination that at least one of the first confidence level, the second confidence level, and the third confidence level are below a threshold amount.

14. The system of claim 11, further comprising at least one sensor receiving a modification to at least one of the first boundary line, the second boundary line, or the centerline, the confidence level determiner assigning another confidence level based on the modification, and the user interface changing the respective representation based on the modification and the other confidence level.

15. The system of claim 11, wherein the user interface is configured to output outputting the representations on a windshield, wherein the representations are rendered to overlay associated real world portions of the current lane of travel.