System and method for visual communication of an operational status

• US 10,053,001 B1
• Filed: 09/15/2016
• Issued: 08/21/2018
• Est. Priority Date: 09/24/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Nabbe, Bartholomeus C., Han, Byron B.
• Primary Examiner(s): Wu, Zhen Y
• Application Number:
  US15/266,357
• Time in Patent Office: 705 Days
• Field of Search: 340464
• CPC Class Codes: B60Q 1/346 with automatic actuation
• CPC Class Codes: B60Q 1/5037 the display content changing automatically, e.g. depending on traffic situation
• CPC Class Codes: B60Q 1/507 specific to autonomous vehicles
• CPC Class Codes: B60Q 1/543 for indicating other states or conditions of the vehicle indicating taxis' state of hire or fare G07B13/045
• CPC Class Codes: B60Q 1/547 for issuing requests to other traffic participants; for confirming to other traffic participants they can proceed, e.g. they can overtake
• CPC Class Codes: B60Q 2400/50 Projected symbol or information, e.g. onto the road or car body

Abstract

Aspects of the present disclosure involve systems, methods, computer program products, and the like, for displaying an operational status of a system. In one particular implementation, the operational status of an autonomous vehicle is displayed. The operational status of the vehicle may indicate an operational state of the vehicle, such as whether the vehicle is in manual control mode or autonomous control mode. In addition to displaying the operational state, the vehicle may also display an intended or future maneuver by the vehicle. For example, the vehicle may determine a route for the autonomous vehicle that includes various operations or steps and may display one or more of the operations or steps of the route. This information may be displayed such that an external observer to the vehicle may determine the near-future operation autonomous vehicle is about to perform. Other information concerning the operation of the vehicle may also be displayed.

Claims

1. A method for operating an autonomous vehicle, the method comprising:

determining, utilizing a computing device, a route for the autonomous vehicle from a starting location to a destination location, the route comprising at least one operation control to automatically maneuver the autonomous vehicle corresponding to a next step in the calculated route;

calculating, utilizing the computing device, an estimated time to the next step in the calculated route;

projecting through a display system an indicator of the next step in the calculated route on an external surface, the indicator of the next step comprising a shape corresponding to the next step selected from a plurality of indicator shapes and a countdown to an estimated time to the next step in the calculated route; and

automatically executing the at least one operation control of the autonomous vehicle to maneuver the autonomous vehicle corresponding to the next step in the calculated route.

2. The method of claim 1 further comprising:

displaying the estimated time to the next step in the calculated route on the external surface.

3. The method of claim 2 further comprising:

adjusting, through the display system, the displayed estimated time to the next step on the external surface based on a current speed and geographical position of the autonomous vehicle.

4. The method of claim 1 wherein the external surface is a display device oriented on the autonomous vehicle toward a rear portion of the autonomous vehicle.

5. The method of claim 1 wherein the external surface is a road surface adjacent to the autonomous vehicle.

6. The method of claim 5 wherein displaying the indicator of the next step in the calculated route on the road surface adjacent to the autonomous vehicle comprises projecting the indicator on the road surface utilizing a projection system.

7. The method of claim 1 wherein the indicator is an arrow indicator of the direction the at least one operation control of the autonomous vehicle orients the autonomous vehicle.

8. The method of claim 1 further comprising:

calculating an estimated distance to the next step in the calculated route; and

displaying the estimated distance to the next step in the calculated route on the external surface.

9. The method of claim 1 wherein the next step in the calculated route is a lane change operation from a first lane of travel to a second lane of travel and the indicator is displayed on a road surface of the second lane of travel.

10. The method of claim 9 wherein the projected indicator is a box-shaped object that indicates the location of the autonomous vehicle in the second lane of travel after the lane change operation is complete.

11. A system for operating an autonomous vehicle, the system comprising:

a non-transitory database storing one or more geographic maps of a region;

a processing device in communication with the non-transitory database for calculating a route for the autonomous vehicle from a starting location to a destination location utilizing at least one geographic map of the region, the route comprising at least one operation control to automatically maneuver the autonomous vehicle corresponding to a next step in the calculated route;

a geographic position system (GPS) locator in communication with the processing device, the processing device further utilizing the GPS locator to calculate an estimated time to the next step in the calculated route based at least on a current geographic location of the GPS locator; and

a display system projecting an indicator of the next step in the calculated route on an external surface prior to executing the at least one operation control of the autonomous vehicle, the display system comprising an external display screen integrated with the autonomous vehicle and the indicator comprises at least a countdown to an estimated time to the next step in the calculated route.

12. The system of claim 11 wherein the display screen is oriented on the autonomous vehicle toward a rear portion of the autonomous vehicle.

13. The system of claim 11 wherein the external surface is a road surface adjacent to the autonomous vehicle.

14. The system of claim 13 wherein the display system further comprises a projection system for displaying the indicator of the next step in the calculated route on the road surface adjacent to the autonomous vehicle.

15. The system of claim 11 wherein the processing device provides one or more instructions to the display device to adjust the displayed countdown to the estimated time to the next step on the external surface based on a current speed and current geographical location of the GPS locator.

16. The system of claim 11 wherein the indicator is an arrow indicator of the direction the at least one operation control of the autonomous vehicle orients the autonomous vehicle.

17. The system of claim 11 wherein the processing device further calculates an estimated distance to the next step in the calculated route and instructs the display device to display the estimated distance to the next step in the calculated route on the external surface.

18. The system of claim 11 wherein the next step in the calculated route is a lane change operation from a first lane of travel to a second lane of travel and the indicator is displayed on a road surface of the second lane of travel.

19. The system of claim 18 wherein the indicator displayed on the road surface of the second lane of travel is a box-shaped object.