SELF-ADAPTIVE MULTIRESOLUTION DIGITAL-PLATE FOR MULTIMODAL ENHANCED SAFETY OF VEHICLES

• US 20200130570A1
• Filed: 12/24/2019
• Published: 04/30/2020
• Est. Priority Date: 12/24/2019
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Elli, Maria Soledad, Alvarez, Ignacio J., Felip Leon, Javier, Gonzalez Aguirre, David I., Turek, Javier
• Granted Patent: US 11,192,495 B2
• Time in Patent Office: Days
• CPC Class Codes: B60Q 1/5037 the display content changing automatically, e.g. depending on traffic situation
• CPC Class Codes: B60Q 1/507 specific to autonomous vehicles
• CPC Class Codes: B60Q 1/545 for indicating other traffic conditions, e.g. fog, heavy traffic
• CPC Class Codes: B60R 13/10 Registration, licensing, or like devices
• CPC Class Codes: B60R 13/105 Licence- or registration plates, provided with mounting means, e.g. frames, holders, retainers, brackets
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: H04L 12/40 Bus networks
• CPC Class Codes: H04L 12/40156 by using dedicated slots associated with a priority level
• CPC Class Codes: H04L 2012/40215 Controller Area Network CAN
• CPC Class Codes: H04L 2012/40273 the transportation system being a vehicle

Abstract

Techniques are disclosed to realize a self-adaptive multiresolution digital plate (SAMDP) system that facilitates sharing of vehicle state information via a dynamically generated binary two-dimensional multispectral pattern. The binary 2D multispectral pattern adjusts its resolution to adapt to the visual perception process while communicating vehicle state information without relying on wireless communications (i.e. V2V, V2X, etc.). The techniques as described herein leverage the use of a multichannel spectral means that helps lower the error present in sensing and representation models used by automated driving systems.

Claims

1. A self-adaptive multiresolution digital plate (SAMDP) encoder associated with a vehicle, the SAMDP encoder comprising:

a controller area network (CAN) bus reader configured to receive vehicle data regarding an operational state of the vehicle via the CAN bus; and

a binary two-dimensional (2D) code encoder configured to calculate one or more parameters using the vehicle data and to encode at least one of the one or more parameters as part of a set of messages represented by respective 2D binary-encoded patterns,

wherein each one of the set of 2D binary-encoded patterns represents a separately encoded message including one or more of the one or more parameters, and

wherein the binary 2D code encoder is further configured to encode each one of the set of 2D binary-encoded patterns in accordance with a different visible wavelength such to form a single composite multispectral 2D binary-encoded pattern when the set of 2D binary-encoded patterns is concurrently displayed.

2. The SAMDP encoder of claim 1, wherein the binary 2D code encoder is further configured to classify a current environmental condition based upon sensor data, and

wherein the binary 2D code encoder is further configured to encode the set of messages based upon the classified current environmental condition.

3. The SAMDP encoder of claim 2, wherein the binary 2D code encoder is further configured to encode each separately encoded message based upon a different predetermined distance between the vehicle and surrounding agents attempting to read the single composite multispectral 2D binary-encoded pattern.

4. The SAMDP encoder of claim 3, wherein the binary 2D code encoder is further configured to encode each separate encoded message to have a different message size based upon a combination of the classified current environmental condition and the different predetermined distances to the surrounding agents.

5. The SAMDP encoder of claim 1, wherein each one of the set of 2D binary-encoded patterns is associated with a different resolution.

6. The SAMDP encoder of claim 1, wherein the one or more of the one or more parameters are safety driving model parameters that include one or more of an estimated friction coefficient μ

, a combined braking efficiency and friction uncertainty factor α

, and a velocity ν

of the vehicle.

7. The SAMDP encoder of claim 1, wherein the binary 2D code encoder is further configured to encode each separate encoded message according to a different data frame structure.

8. The SAMDP encoder of claim 1, wherein the binary 2D code encoder is further configured to classify a current environmental condition based upon sensor data and to encode each separate encoded message based upon the classified current environmental condition,

wherein a size of messages encoded for better classified environmental conditions are larger than messages encoded for worse classified environmental conditions.

9. A self-adaptive multiresolution digital plate (SAMDP) decoder associated with a vehicle, the SAMDP decoder comprising:

a binary two-dimensional (2D) code reader configured to detect a composite multispectral 2D binary-encoded pattern that includes a set of concurrently-displayed 2D binary-encoded patterns, each of the set of concurrently-displayed 2D patterns being encoded in accordance with a different visible wavelength; and

a binary 2D code decoder configured to attempt to decode an encoded message associated with each respective one of the set of the concurrently-displayed 2D binary-encoded patterns to obtain respective sets of one or more data units for each successfully decoded message,

wherein the one or more data units are based upon vehicle data regarding an operational state of another vehicle, and

wherein the binary 2D code decoder is further configured to transmit, to one or more electronic components associated with the vehicle, the one or more data units associated with one of the successfully decoded messages having a longest message length.

10. The SAMDP decoder of claim 9, wherein the concurrently-displayed 2D binary-encoded patterns include a first 2D binary-encoded pattern that is encoded in accordance with a blue wavelength band, a second 2D binary-encoded pattern that is encoded in accordance with a red wavelength band, and a third 2D binary-encoded pattern is encoded in accordance with a green wavelength band.

11. The SAMDP decoder of claim 9, wherein each one of the concurrently-displayed 2D patterns has a different resolution.

12. The SAMDP decoder of claim 10, wherein the first 2D binary-encoded pattern has a higher resolution than the second 2D binary-encoded pattern, which has a higher resolution than the third 2D binary-encoded pattern.

13. The SAMDP decoder of claim 10, wherein the first 2D binary-encoded pattern represents a first encoded message having a message length that is longer than that of a second encoded message represented by the second 2D binary-encoded pattern, which has a message length that is longer than that of a third encoded message represented by the third 2D binary-encoded pattern.

14. The SAMDP decoder of claim 9, wherein the one or more of the one or more data units are safety driving model parameters that include one or more of an estimated friction coefficient μ

, a combined braking efficiency and friction uncertainty factor α

, and a velocity ν

of the other vehicle.

15. The SAMDP decoder of claim 9, wherein each encoded message associated with each respective one of the set of the concurrently-displayed 2D binary-encoded patterns has a different data frame structure.

16. A non-transitory computer-readable media associated with a self-adaptive multiresolution digital plate (SAMDP) encoder having instructions stored thereon that, when executed by one or more processors, cause the SAMDP encoder to execute an adaptive communication protocol by:

receiving vehicle data regarding an operational state of the vehicle via one or more electronic components associated with the vehicle;

calculating one or more data units using the vehicle data; and

encoding the one or more data units as part of a set of messages represented by respective 2D binary-encoded patterns, with each one of the set of 2D binary-encoded patterns representing a separately encoded message including at least one of the one or more data units,

wherein each one of the set of 2D binary-encoded patterns is encoded in accordance with a different visible wavelength to form a single composite multispectral 2D binary-encoded pattern when the set of 2D binary-encoded patterns is concurrently displayed.

17. The non-transitory computer-readable media of claim 16, further including instructions stored thereon that, when executed by one or more processors, cause the SAMDP encoder to execute an adaptive communication protocol by:

classifying a current environmental condition based upon sensor data, the classified environmental condition representing a numeric value,

wherein the act of encoding the one or more data units as part of a set of messages represented by respective 2D binary-encoded patterns includes encoding each of the one or more data units as a separate one of the set of messages based upon the numeric value representing the classified current environmental condition.

18. The non-transitory computer-readable media of claim 17, wherein the instructions to encode the one or more data units as part of a set of messages represented by respective 2D binary-encoded patterns includes instructions that, when executed by one or more processors, cause the SAMDP encoder to encode each encoded message based upon a different predetermined distance between the vehicle and surrounding agents attempting to read the single composite multispectral 2D binary-encoded pattern.

19. The non-transitory computer-readable media of claim 18, wherein the instructions to encode the one or more data units as part of a set of messages represented by respective 2D binary-encoded patterns includes instructions that, when executed by one or more processors, cause the SAMDP encoder to encode the one or more parameters as part of a set of messages represented by respective 2D binary-encoded patterns by encoding each separate encoded message to have a different message size based upon a combination of the numeric value representing the classified current environmental condition and the different predetermined distances.

20. The non-transitory computer-readable media of claim 16, wherein the one or more data units are safety driving model parameters that include one or more of an estimated friction coefficient μ

, a combined braking efficiency and friction uncertainty factor α

, and a velocity ν

of the vehicle.

21. A control system configured to provide assisted driving features for a vehicle, the control system comprising:

a binary two-dimensional (2D) code reader configured to detect a composite multispectral 2D binary-encoded pattern that includes a set of concurrently-displayed 2D binary-encoded patterns, each of the set of concurrently-displayed 2D patterns being encoded in accordance with a different visible wavelength; and

a binary 2D code decoder configured to attempt to decode an encoded message associated with each respective one of the set of the concurrently-displayed 2D binary-encoded patterns to obtain respective sets of one or more data units for each successfully decoded message,

wherein the one or more data units are based upon vehicle data regarding an operational state of another vehicle, and

wherein the binary 2D code decoder is further configured to transmit, to one or more electronic components associated with the vehicle, the one or more data units associated with one of the successfully decoded messages having a longest message length.

22. The control system of claim 21, wherein the concurrently-displayed 2D binary-encoded patterns include a first 2D binary-encoded pattern that is encoded in accordance with a blue wavelength band, a second 2D binary-encoded pattern that is encoded in accordance with a red wavelength band, and a third 2D binary-encoded pattern is encoded in accordance with a green wavelength band,

wherein the first 2D binary-encoded pattern has a higher resolution than the second 2D binary-encoded pattern, which has a higher resolution than the third 2D binary-encoded pattern, and

wherein the first 2D binary-encoded pattern represents a first encoded message having a message length that is longer than that of a second encoded message represented by the second 2D binary-encoded pattern, which has a message length that is longer than that of a third encoded message represented by the third 2D binary-encoded pattern.

23. The control system of claim 21, wherein each one of the concurrently-displayed 2D patterns has a different resolution, and

wherein each encoded message associated with each respective one of the set of the concurrently-displayed 2D binary-encoded patterns has a different data frame structure.

24. The control system of claim 21, wherein the one or more of the one or more data units are safety driving model parameters that include one or more of an estimated friction coefficient μ

, a combined braking efficiency and friction uncertainty factor α

, and a velocity ν

of the other vehicle.