System and method for providing situational awareness in a vehicle

• US 9,469,248 B2
• Filed: 03/09/2015
• Issued: 10/18/2016
• Est. Priority Date: 10/10/2014
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Ng-Thow-Hing, Victor, Bark, Karlin, Tran, Cuong
• Primary Examiner(s): Lau, Hoi
• Application Number:
  US14/641,493
• Publication Number:
  US 20160264045A1
• Time in Patent Office: 589 Days
• Field of Search: 340/435, 340/438, 340/905, 340/903, 348/148, 348/48, 345/7, 701/532, 701/117, 701/301, 342/59, 342/174, 342/107
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/166 Navigation
• CPC Class Codes: B60K 2360/178 Warnings
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: G01S 13/53 performing filtering on a single spectral line and associated with one or more range gates with a phase detector or a frequency mixer to extract the Doppler information, e.g. pulse Doppler radar G01S13/5244 takes precedence
• CPC Class Codes: G01S 13/86 Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 7/20 Stereoscopic displays; Three-dimensional displays; Pseudo-three-dimensional displays
• CPC Class Codes: G01S 7/22 Producing cursor lines and indicia by electronic means
• CPC Class Codes: G01S 7/24 the display being orientated or displaced in accordance with movement of object carrying the transmitting and receiving apparatus, e.g. true-motion radar

Abstract

A method and system for providing situational awareness in a vehicle. The method and system include receiving environmental sensor data and vehicle performance sensor data. The method and system also include compiling the environmental sensor data and the vehicle performance data. The method and system additionally include determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data. The method and system further include generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle.

Claims

1. A computer-implemented method for providing situational awareness in a vehicle comprising:

receiving environmental sensor data and vehicle performance data;

compiling the environmental sensor data and the vehicle performance data;

determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data; and

generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing situational awareness assessment data and generating a virtual rear fan object (rear fan) that includes a virtual floor zone of interest (floor zone) and a virtual Doppler zone of interest (Doppler zone), wherein the floor zone and the Doppler zone includes the one or more projected graphical objects that represent at least one of;

one or more objects determined within the surrounding environment of the vehicle, determined characteristics of the surrounding environment of the vehicle, and determined situational risks that are posed to the vehicle.

2. The computer-implemented method of claim 1, wherein compiling the environmental sensor data and the vehicle performance data includes compiling a plurality of inputs that are simultaneously provided from one or more vehicle environment sensors, one or more vehicle performance sensors, and one or more external sources into situational awareness sensing data.

3. The computer-implemented method of claim 2, wherein determining one or more situational risks that are posed to the vehicle includes analyzing the situational awareness sensing data and determining characteristics of at least one of:

the one or more objects determined within the surrounding environment of the vehicle, and inherent driving attributes of the vehicle.

4. The computer-implemented method of claim 2, wherein determining one or more situational risks that are posed to the vehicle includes assigning an environment classification to the surrounding environment of the vehicle and a severity score to one or more determined situational risks that are posed to the vehicle, wherein the environment classification includes a classification of the surrounding environment of the vehicle and the severity score includes a score that is assigned to each determined situational risk that is posed to the vehicle.

5. The computer-implemented method of claim 1, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing the situational awareness assessment data and generating one or more formats of the floor zone and the Doppler zone, wherein generating one or more formats includes at least one of:

generating the floor zone to be in an extended format, generating the floor zone of the Doppler zone to be in the extended format, generating the floor zone to be in a reduced format, generating the Doppler zone to be in a reduced format, generating the outline of the floor zone to be modified, generating the floor zone to represent one more environments in which the vehicle is being driven.

6. The computer-implemented method of claim 5, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing the situational awareness assessment data and generating a plurality of formats of the one or more projected graphical objects, wherein generating different formats of the one or more projected graphical objects include modifying at least one of:

size, color, shape, appearance, arrangement, and scale of the one or more projected graphical objects.

7. The computer-implemented method of claim 5, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing the situational awareness assessment data and generating a plurality of formats of one or more tilt orientations of the rear fan, wherein generating the one or more tilt orientations of the rear fan includes at least one of:

generating the one or more projected graphical objects within the Doppler zone in a two dimensional format, generating the one or more projected graphical objects within the Doppler zone in a volumetric three dimensional format, generating the floor zone in one or more horizontal angles, and generating the floor zone in one or more vertical angles, generating the floor zone in an inverted format.

8. A system for providing situational awareness in a vehicle, comprising:

a situational awareness subsystem that provides situational awareness of a surrounding environment of the vehicle;

a sensor data compiling module of the situational awareness subsystem that receives environmental sensor data and vehicle performance data, wherein the sensor data compiling module compiles the environmental sensor data and the vehicle performance data;

a situational awareness assessment module of the situational awareness subsystem that determines one or more situational risks that are posed to the vehicle that occur within the surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data; and

a situational awareness presentation module that generates one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle, wherein the situational awareness presentation module analyzes situational awareness assessment data received from the situational awareness assessment module and generates a virtual rear fan object (rear fan) that includes a virtual floor zone of interest object (floor zone) and a virtual Doppler zone of interest object (Doppler zone), wherein the floor zone and the Doppler zone include the one or more projected graphical objects that represent determined situational risks that are posed to the vehicle.

9. The system of claim 8, wherein the sensor data compiling module compiles a plurality of inputs that are simultaneously provided from one or more vehicle environment sensors, one or more vehicle performance sensors, and one or more external sources into situational awareness sensing data.

10. The system of claim 9, wherein the situational awareness assessment module analyzes the situational awareness sensing data and determines characteristics of at least one of:

the surrounding environment of the vehicle, objects within the surrounding environment of the vehicle, and inherent driving attributes of the vehicle.

11. The system of claim 9, wherein the situational awareness assessment module assigns an environment classification to the surrounding environment of the vehicle and a severity score to one or more determined situational risks that are posed to the vehicle, wherein the environment classification includes a classification of the surrounding environment of the vehicle and the severity score includes a score that is assigned to each determined situational risk that is posed to the vehicle.

12. The system of claim 9, wherein the situational awareness presentation module analyzes the situational awareness assessment data received from the situational awareness assessment module and generates one or more formats of the floor zone and the Doppler zone, wherein generating one or more formats includes at least one of:

generating the floor zone to be in an extended format, generating the floor zone of the Doppler zone to be in the extended format, generating the floor zone to be in a reduced format, generating the Doppler zone to be in a reduced format, generating the outline of the floor zone to be modified, generating the floor zone to represent one more environments in which the vehicle is being driven.

13. The system of claim 9, wherein the situational awareness presentation module analyzes the situational awareness assessment data received from the situational awareness assessment module and generates a plurality of formats of the one or more projected graphical objects, wherein generating different formats of the one or more projected graphical objects include modifying at least one of:

size, color, shape, appearance, arrangement, and scale of the one or more projected graphical objects.

14. The system of claim 12, wherein the situational awareness presentation module analyzes the situational awareness assessment data received from the situational awareness assessment module and generates plurality of formats of one or more tilt orientations of the rear fan, wherein generating the one or more tilt orientations of the rear fan includes at least one of:

generating the one or more projected graphical objects within the Doppler zone in a two dimensional format, generating the one or more projected graphical objects within the Doppler zone in a volumetric three dimensional format, generating the floor zone in one or more horizontal angles, and generating the floor zone in one or more vertical angles, generating the floor zone in an inverted format.

15. A non-transitory computer readable-storage medium storing instructions that when executed by a processor perform actions, comprising:

receiving environmental sensor data and vehicle performance data;

compiling the environmental sensor data and the vehicle performance data;

determining one or more situational risks that are posed to a vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data; and

generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing situational awareness assessment data and generating a virtual rear fan object (rear fan) that includes a virtual floor zone of interest object (floor zone) and a virtual Doppler zone of interest object (Doppler zone), wherein the floor zone and the Doppler zone include the one or more projected graphical objects that represent determined situational risks that are posed to the vehicle.

16. The non-transitory computer readable-storage medium of claim 15, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing the situational awareness assessment data and generating one or more formats of the floor zone and the Doppler zone, wherein generating one or more formats includes at least one of:

generating the floor zone to be in an extended format, generating the floor zone of the Doppler zone to be in the extended format, generating the floor zone to be in a reduced format, generating the Doppler zone to be in a reduced format, generating the outline of the floor zone to be modified, generating the floor zone to represent one more environments in which the vehicle is being driven.

17. The non-transitory computer readable-storage medium of claim 15, wherein generating the one or more projected graphical objects that represent the one or more situational risks includes analyzing the situational awareness assessment data and generating a plurality of formats of the one or more projected graphical objects, wherein generating different formats of the projected graphical objects include modifying at least one of:

size, color, shape, appearance, arrangement, and scale of the one or more projected graphical objects.