Method and system for merging ambient sensor data with communication data, and use of the system

• US 10,055,517 B2
• Filed: 10/25/2013
• Issued: 08/21/2018
• Est. Priority Date: 10/26/2012
• Status: Active Grant

• Current Assignee: Continental Teves AG & Co. OHG (Continental AG)
• Original Assignee: Continental Teves AG & Co. OHG (Continental AG)
• Inventors: Stahlin, Ulrich, Scherping, Richard, Grotendorst, Thomas
• Primary Examiner(s): Fernandez Rivas, Omar F
• Assistant Examiner(s): Luu, Cuong V
• Application Number:
  US14/438,271
• Publication Number:
  US 20150286754A1
• Time in Patent Office: 1,761 Days
• Field of Search: None
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06F 30/20 Design optimisation, verification or simulation optimisation, verification or simulation of circuit designs G06F30/30
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A method for merging environment sensor data with communication data, wherein the environment sensor data is detected by at least one environment sensor and wherein the communication data is contained in vehicle-to-X messages which are received by vehicle-to-X communication. The communication data selected by pre-processing is fed directly to the sensor data merging process, wherein the sensor data merging process merges the selected communication data with environment sensor data to form an environment model. A corresponding system and a usage of the system are also disclosed.

Claims

1. A method for merging, by a controller of a vehicle sensor system, ambient sensor data with communication data, the method comprising:

capturing, by at least one ambient sensor in the vehicle, ambient sensor data;

receiving, by a vehicle-to-X communication means in the vehicle, communication data;

selecting, by the controller of the vehicle sensor system, during a preprocessing process;

a first portion of the communication data, and supplying the first portion of the communication data directly to a sensor data merging process that merges the first portion of the communication data with ambient sensor data to produce an environment model, and

a second portion of the communication data, and supplying the second portion of the communication data to a data management process; and

wherein the selected communication data including at least one of the first portion or the second portion are provided with a data marking by the preprocessing process,

wherein heterogeneous application processes that receive information forwarded both by the sensor data merging process and by a data management process identify redundantly forwarded information by the data marking, and

controlling, by the controller of the vehicle sensor system, a safety system of the vehicle by controlling an application of the safety system based on the environment model and/or data output from the data management process.

2. The method as claimed in claim 1, wherein at least one component of the communication data is supplied both to the sensor data merging process and to a data management process by the preprocessing process.

3. The method as claimed in claim 1, wherein different data formats of received vehicle-to-X messages are standardized in a data arrival process.

4. The method as claimed in claim 3, wherein the communication data are combined to produce a joint data stream by means of the data arrival process and/or the preprocessing process.

5. The method as claimed in claim 3, wherein at least one preprocessing stage , which is affiliated to the data arrival process and an ambient data capture process, is used to effect first filtering of the ambient sensor data and the communication data.

6. The method as claimed in claim 5, wherein the preprocessing process is used to effect second filtering of the communication data.

7. The method as claimed in claim 1, wherein the communication data selected by the preprocessing process are selected on the basis of their header data elements.

8. The method as claimed in claim 5, wherein the preprocessing process and the at least one preprocessing stage are used to categorize the ambient sensor data and the communication data into one of the categories critical, relevant and irrelevant.

9. The method as claimed in claim 8, wherein ambient sensor data and communication data categorized as critical are edited and/or forwarded preferentially.

10. The method as claimed in claim 8, wherein ambient sensor data and communication data categorized as irrelevant are rejected.

11. The method as claimed in claim 1, wherein the vehicle-to-X communication means exchange the vehicle-to-X messages using at least one of the following connection types:

a WLAN connection, based on IEEE 802.11p,

a WiFi Direct,

an ISM (Industrial, Scientific, Medical band) connection, using a closing apparatus with radio connection capability,

a Bluetooth connection

a ZigBee connection

a UWB (Ultra Wide Band) connection,

a WiMax (Worldwide Interoperability for Microwave Access),

a remote keyless entry connection,

a closing apparatus with radio connection capability,

a mobile radio connection, utilizing GSM, GPRS, EDGE, UMTS and/or LTE connections, and

an infrared connection.

12. The method as claimed in claim 1, wherein, the ambient sensors are one or more elements selected from the group consisting of:

a radar sensor,

an optical camera sensor,

a lidar sensor,

a laser sensor,

an ultrasonic sensor

an ESP sensor,

an ABS sensor and

an inclination sensor.

13. A vehicle sensor system for merging ambient sensor data with communication data, the vehicle sensor system comprising:

ambient sensors in the vehicle for capturing the ambient sensor data;

a vehicle-to-X communication means in the vehicle for receiving the communication data; and

a controller, which during a preprocessing process selects;

a first portion of the communication data and supplies the first portion of the communication data directly to a sensor data merging process that merges the selected communication data with the ambient sensor data to produce an environment model, and

a second portion of the communication data, and supplies the second portion of the communication data to a data management process,

wherein the selected communication data including at least one of the first portion or the second portion are provided with a data marking by the preprocessing process,

wherein heterogeneous application processes that receive information forwarded both by the sensor data merging process and by a data management process identify redundantly forwarded information by the data marking, and

controlling, by the controller of the vehicle sensor system, a safety system of the vehicle by controlling an application of the safety system based on the environment model and/or data output from the data management process.

14. The use of the system as claimed in claim 13 in a motor vehicle.