EFFICIENT SITUATIONAL AWARENESS FROM PERCEPTION STREAMS IN AUTONOMOUS DRIVING SYSTEMS

• US 20180217603A1
• Filed: 01/31/2017
• Published: 08/02/2018
• Est. Priority Date: 01/31/2017
• Status: Abandoned Application

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: KWON, HYUKSEONG, CHO, YOUNGKWAN, BHATTACHARYYA, RAJAN
• Application Number:
  US15/420,524
• Publication Number:
  US 20180217603A1
• Time in Patent Office: Days
• CPC Class Codes: G01C 21/3407 specially adapted for specific applications
• CPC Class Codes: G01C 21/3807 characterised by the type of data
• CPC Class Codes: G01C 21/3833 characterised by the source of data
• CPC Class Codes: G05D 1/0214 in accordance with safety or protection criteria, e.g. avoiding hazardous areas monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13
• CPC Class Codes: G05D 1/0274 using mapping information stored in a memory device navigation using map-matching G01C21/30
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/029 Location-based management or tracking services
• CPC Class Codes: H04W 64/006 with additional information processing, e.g. for direction or speed determination
• CPC Class Codes: H04W 84/005 Moving wireless networks
• CPC Class Codes: H04W 84/042 Public Land Mobile systems, e.g. cellular systems
• CPC Class Codes: H04W 84/12 WLAN [Wireless Local Area Networks]

Abstract

A system and method is taught for data processing where an environment around the self-vehicle is encoded into ego centric and geocentric overlapping coordinate systems. The overlapping coordinate systems are then divided into adaptively sized grid cells according to characteristics of environments and the self-vehicle status. Each grid cell is defined with one of representative event patterns and risk values to the self-vehicle. The autonomous driving system is then operative to provide a real time assessment of the surrounding environment in response to the grid cell data. And temporal sequences of the grid cell data are stored in the episodic memory and recalled from it during driving.

Claims

1. A method comprising:

generating a combined coordinate system in response to a first coordinate system centered on a moving object and a second coordinate system centered on a fixed location;

segmenting the combined coordinate system into a first cell and a second cell, wherein the first cell is associated with an object located within the cell;

assigning a first risk level to the first cell in response to the first object and a second risk level to the second cell; and

generating a control signal in response to the first risk level.

2. The method of claim 1 further comprising a determination that no object is present within a geographical location associated with second cell.

3. The method of claim 1 wherein the control signal is used to guide an autonomous vehicle.

4. The method of claim 1 wherein data associated with the first coordinate system is received via a mobile sensor system.

5. The method of claim 1 wherein data associated with the second coordinate system is received via a network connection

6. The method of claim 1 wherein the first risk level is determined in response to a geographical location of the first object and a trajectory of the first object.

7. The method of claim 1 wherein the first risk level is determined in response to a geographical location of the first object and a trajectory of the first object and a geographical location of a second object.

8. An apparatus comprising:

a sensor for receiving perception data around a moving object and wherein the perception data is organized according to a first coordinate system;

a network interface for receiving information associated with a fixed geographical location and wherein the information is organized according to a second coordinate system;

a processor for combining the information organized to according to the second coordinate system and the and the perception data organized according to the first coordinate system to generate a combined coordinate system, wherein the processor is further operative to segment the combined coordinate system into a first cell and a second cell, wherein the first cell is associated with an object located within the cell, to assign a first risk level to the first cell in response to the first object and a second risk level to the second cell and to generate generating a control signal in response to the first risk level; and

a controller for controlling the moving object in response to the first risk level.

9. The apparatus of claim 8 wherein the controller is further operative to control the moving object in response to a geographical location associated with the first cell.

10. The apparatus of claim 8 wherein the processor is further operative to determine that no object is present within a geographical location associated with second cell.

11. The apparatus of claim 8 wherein the moving object is an autonomous vehicle.

12. The apparatus of claim 8 wherein the first risk level is determined in response to a geographical location of the first object and a trajectory of the first object.

13. The apparatus of claim 8 wherein the first risk level is determined in response to a geographical location of the first object and a trajectory of the first object and a geographical location of a second object.

14. A method of controlling a vehicle comprising:

receiving a first plurality of data indicative of a first plurality of objects, wherein the first plurality of data is perceived via a vehicular sensor, and wherein a first plurality of locations associated with the first plurality of objects is organized according to a first coordinate system;

receiving a second plurality of data indicative of a second plurality of objects, wherein the second plurality of data is received via a network interface, and wherein a second plurality of locations associated with the second plurality of objects is organized according to a second coordinate system;

combining the first plurality of data and the second plurality of data into a third plurality of data associated with a combined coordinate system.

segmenting the combined coordinate system into a first cell and a second cell, wherein the first cell is associated with at least one of the first plurality of objects and at least one of the second plurality of objects;

assigning a first risk level to the first cell in response to the at least one of the first plurality of objects and at least one of the second plurality of objects; and

generating a control signal in response to the first risk level.

15. The method of claim 14 further comprising assigning a second risk level to second first cell in response to the at least one of the first plurality of objects and at least one of the second plurality of objects.

16. The method of claim 15 further comprising altering a trajectory of the moving object in response to the first risk level and the second risk level.

17. The method of claim 14 wherein the combined coordinate system is segmented into a plurality of cells wherein each of the cells is associated with a geographical location at a first instance of time and wherein each of the plurality of cells are assigned a risk level in response to the first plurality of objects associated with the geographical location and the second plurality of objects associated with the geographical location.

18. The method of claim 14 wherein a size of the first cell and the second cell are determined in response to a velocity of the moving object.

19. The method of claim 14 wherein a size of the first cell and the size of the second cell are determined in response to a trajectory of the moving object.

20. The method of claim 14 wherein a size of the first cell and a size of the second cell are the same.