METHOD AND SYSTEM FOR GENERATING AND USING A PERCEPTION SCENE GRAPH IN MOTOR VEHICLE APPLICATIONS
First Claim
1. A method of generating a perception scene graph (PSG) for use in a motor vehicle, comprising the steps of:
- collecting sensor information, by at least one external sensor having an effective sensor range, about an adjacent surrounding of the motor vehicle;
processing the sensor information, by a perception controller, to generate the PSG comprising a virtual model of the adjacent surrounding of the motor vehicle;
subscribing, by a state decision logic (SDL) controller, to the PSG; and
extracting information from the PSG, by the SDL controller, for use in execution of a vehicle application routine.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system is provided for generating a perception scene graph (PSG) for use in a motor vehicle. External sensor information and vehicle-to-everything (V2X) information are collected on a volume of space surrounding the vehicle. The sensor information and V2X information are fused to increase the fidelity of the information. The fused information is analyzed to detect, classify, and locate objects present in the volume of space surrounding the vehicle. A perception controller generates and publishes the PSG, which includes a virtual 3-D model of the volume of space containing the classified and located objects. At least one vehicle controller subscribes to the PSG and extracts information from the PSG for use as an input for a software application to generate instructions for use in execution of a vehicle application routine. The vehicle controller may also publish a real time copy of the PSG.
-
Citations
20 Claims
-
1. A method of generating a perception scene graph (PSG) for use in a motor vehicle, comprising the steps of:
-
collecting sensor information, by at least one external sensor having an effective sensor range, about an adjacent surrounding of the motor vehicle; processing the sensor information, by a perception controller, to generate the PSG comprising a virtual model of the adjacent surrounding of the motor vehicle; subscribing, by a state decision logic (SDL) controller, to the PSG; and extracting information from the PSG, by the SDL controller, for use in execution of a vehicle application routine. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method of generating a perception scene graph (PSG), comprising the steps of:
-
collecting sensor information, by a plurality of external sensors, on a volume of space surrounding a motor vehicle; receiving vehicle-to-everything (V2X) information, by a V2X receiver, augmenting the sensor information on the volume of space surrounding the motor vehicle; fusing the sensor information and V2X information, by a perception controller, to increase the fidelity of the volume of space surrounding the motor vehicle; analyzing the fused information, by the perception controller, to detect, classify, and locate objects present in the volume of space surrounding the motor vehicle; and generating the PSG comprising a virtual 3-dimensional (3-D) model of the volume of space surrounding the motor vehicle containing the classified and located objects. - View Dependent Claims (13, 14)
-
-
15. A system for generating and using a perception scene graph (PSG) in a motor vehicle, comprising a:
-
at least one external sensor having an effective sensor range configured to gather information on a surrounding of the motor vehicle; at least one perception controller in communication with the at least one external sensor, wherein the at least one perception controller is configured to generate the PSG comprising a virtual model of the surroundings of the motor vehicle based on the gathered information from the external sensor; and at least one state decision logic (SDL) controller in communication with at least one vehicle control system, where the SDL controller is configured to extract information from the PSG to execute a vehicle application for the vehicle control system. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification