Vehicle communications using visible light communications

• US 10,461,858 B2
• Filed: 02/08/2018
• Issued: 10/29/2019
• Est. Priority Date: 06/12/2017
• Status: Active Grant

• Current Assignee: STMicroelectronics Limited (STMicroelectronics NV)
• Original Assignee: STMicroelectronics Limited (STMicroelectronics NV)
• Inventors: Raynor, Jeffrey M., Hall, Duncan
• Primary Examiner(s): Tran, Dzung D
• Application Number:
  US15/892,035
• Publication Number:
  US 20180359031A1
• Time in Patent Office: 628 Days
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G08G 1/162 event-triggered
• CPC Class Codes: H04B 10/116 Visible light communication
• CPC Class Codes: H04W 4/46 for vehicle-to-vehicle communication [V2V]

Abstract

An apparatus has a pixel array arrangement having a number of photosensitive detectors. Processing circuitry is configured to process data captured by at least one pixel of the array to provide image information and detect data on an encoded pulsed light signal. In a specific embodiment, data is captured at a vehicle. Information for the vehicle is determined based on the encoded pulsed light signal.

Claims

1. An apparatus comprising:

a pixel array having a plurality of photosensitive detectors, a first subset of the plurality of photosensitive detectors configured to capture an image of a light source, a second subset of the plurality of photosensitive detectors configured to capture data from an encoded pulsed light signal of the light source; and

processing circuitry configured to process data captured by pixels of the pixel array to provide image information and to detect data on an encoded pulsed light signal, processing circuitry configured to process data by;

sampling the light source at a first ratio corresponding to a sampling rate of the image to a sampling rate of the encoded pulsed light signal; and

detecting a data source in the light source, and based thereon, sampling the light source at a second ratio, the sampling rate of the encoded pulsed light signal in accordance with the second ratio being greater than the sampling rate of the encoded pulsed light signal in accordance with the first ratio.

2. The apparatus as claimed in claim 1, wherein the pixel array comprises a first part that is configured to provide image data to the processing circuitry and a second part that is configured to detect data on the encoded pulsed light signal.

3. The apparatus as claimed in claim 2, wherein the apparatus is configured to capture the image data for n frames and the encoded pulsed light signal for m frames, where n and m are integers.

4. The apparatus as claimed in claim 3 wherein when the processing circuitry is configured to determine when a pulsed encoded light signal is present and to determine when the pulsed encoded light signal is present to cause the value of m to be increased.

5. The apparatus as claimed in claim 1, wherein the pixel array is configured to capture the data providing the image information at different times to the data on the encoded pulsed light signal.

6. The apparatus as claimed in claim 1, wherein the processing circuitry is configured to use the image information to locate a position of a source of the encoded pulsed light signal.

7. The apparatus as claimed in claim 1, wherein a timing, associated with a respective pixel in the pixel array, controls if the respective pixel is configured to detect image data or data on the encoded pulsed light signal.

8. The apparatus as claimed in claim 1, wherein the processing circuitry is configured to provide an output to an automotive driving system.

9. The apparatus as claimed in claim 1, wherein each value of data on the encoded pulsed light signal is represented by a plurality of bit values.

10. The apparatus as claimed in claim 9, wherein the data is encoded on the encoded pulsed light signal using Manchester encoding.

11. The apparatus as claimed in claim 9, wherein each pixel further comprises a plurality of photodetectors, one photodetector dedicated for each of the plurality of bit values.

12. The apparatus as claimed in claim 9, wherein each pixel comprises a single photodetector controlled to detect each of the plurality of bit values.

13. The apparatus as claimed in claim 1, wherein the encoded pulsed light signal is at a frequency such that a pulsing of the encoded pulsed light signal is not detected by the human eye.

14. A method comprising:

sampling a light source at a first ratio, the first ratio corresponding to a sampling rate of an image of the light source to a sampling rate of an encoded pulsed light signal of the light source;

detecting a data source in the light source, and based thereon, sampling the light source at a second ratio, the sampling rate of the encoded pulsed light signal in accordance with the second ratio being greater than the sampling rate of the encoded pulsed light signal in accordance with the first ratio; and

processing data captured by a pixel array having a plurality of photosensitive detectors to provide image information and detect data on an encoded pulsed light signal, based on the sampling.

15. A method comprising:

capturing, by a vehicle, information from a light source using a pixel array having a plurality of photosensitive detectors, a first subset of the plurality of photosensitive detectors configured to capture an image of a light source, a second subset of the plurality of photosensitive detectors configured to capture an encoded pulsed light signal of the light source;

sampling the light source at a first ratio corresponding to a sampling rate of the image to a sampling rate of the encoded pulsed light signal;

detecting a data source in the light source, and based thereon, sampling the light source at a second ratio, the sampling rate of the encoded pulsed light signal in accordance with the second ratio being greater than the sampling rate of the encoded pulsed light signal in accordance with the first ratio;

determining image data from the image of the light source;

extracting an encoded pulsed light signal from the encoded pulsed light signal of the light source; and

determining information for the vehicle based on the encoded pulsed light signal.

16. The method as claimed in claim 15, wherein the encoded pulsed light signal is at a frequency such that a pulsing of the encoded pulsed light signal is not detected by the human eye.

17. The method as claimed in claim 16, wherein the information from the light source is received at the pixel array from an illuminated sign.

18. The method as claimed in claim 15, wherein the information from the light source is received from a matrix of illumination sources.

19. The method as claimed in claim 15, further comprising optically transmitting information from the vehicle.

20. The method as claimed in claim 19, wherein the transmitted information comprises an actual speed of the vehicle, information related to acceleration/deceleration, information related to lane movement, a destination of the vehicle, whether the vehicle is in self-driving mode, whether the vehicle is in assisted mode or whether the vehicle is in fully manual mode.

21. The method as claimed in claim 15, wherein capturing data comprises capturing image data and the encoded pulsed light signal, wherein the image data is captured for n frames and the encoded pulsed light signal is captured for m frames, where n and m are integers.

22. The method as claimed in claim 15, wherein capturing data comprises capturing the image data at different times than capturing the encoded pulsed light signal.

23. The method as claimed in claim 15, further comprising using the image data to locate a position of a source of the encoded pulsed light signal.

24. The method as claimed in claim 15, wherein a timing, associated with a respective pixel in the pixel array, controls whether the respective pixel is configured to detect image data or data on the encoded pulsed light signal.

25. The method as claimed in claim 15, wherein each value of data on the encoded pulsed light signal is represented by a plurality of bit values.

26. The method as claimed in claim 25, wherein data is encoded on the encoded pulsed light signal using Manchester encoding.