Integrated fault-tolerant augmented area viewing system

• US 10,395,541 B2
• Filed: 10/02/2015
• Issued: 08/27/2019
• Est. Priority Date: 01/16/2015
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Bergsagel, Jonathan Elliot, Nadampalli, Sunita, Shelburne, Thomas Ray, Dubey, Aishwarya, Byers, Ian Carl
• Primary Examiner(s): Perungavoor, Sathyanaraya V
• Assistant Examiner(s): Dang, Philip P.
• Application Number:
  US14/874,112
• Publication Number:
  US 20160210861A1
• Time in Patent Office: 1,425 Days
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 2300/404 triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

An integrated fault-tolerant augmented area viewing system includes, for example, a subsystem processor for receiving a safety signal for blind spot monitoring from a blind spot sensor and for generating a subsystem processor video output signal in response to the received safety signal. Selector circuitry selects the subsystem processor video output signal or a master controller video output signal received from a master controller and generates a selected video output signal in response. The selector circuitry performs the selection of the video output signal selection in response to receiving a safety request signal generated in response to a user action. A buffer outputs the selected video output signal for displaying on a display for viewing by the user.

Claims

1. A circuit, comprising:

a processor having a processor input and a processor output, the processor input adapted to be coupled to a blind spot sensor, the processor configured to;

receive a safety signal from the blind spot sensor; and

generate at the processor output a blind spot camera video output signal in response to the safety signal;

an input hash generator having an input hash generator input and an input hash generator output, the input hash generator input coupled to the processor output, and the input hash generator configured to generate at the input hash generator output a first hash of the blind spot camera video output signal;

selector circuitry coupled to the processor and adapted to be coupled to a controller, the selector circuitry configured to select a video output signal, the selected video output signal being either;

the blind spot camera video output signal, if the safety signal is responsive to an action by a user;

or otherwise a controller video output signal from the controller;

a buffer having a buffer input and a buffer output, the buffer input coupled to the selector circuitry and adapted to be coupled to a display, the buffer configured to output at the buffer output the selected video output signal to the display for viewing by the user;

an output hash generator having an output hash generator input and an output hash generator output, the output hash generator input coupled to the buffer, and the output hash generator configured to generate at the output hash generator output a second hash of the selected video output signal; and

a bad frame detector having a detector input, the detector input coupled to the input hash generator output and to the output hash generator output, the bad frame detector configured to compare the first and second hashes to detect a video fault.

2. The circuit of claim 1, wherein the blind spot sensor includes a video camera configured to generate a video input signal, the video input signal including video frames.

3. The circuit of claim 2, wherein the safety signal is asserted in response to the user actuating a control of a vehicle to which the video camera is affixed.

4. The circuit of claim 1, wherein the controller is formed upon a substrate upon which the processor is formed, and the controller is configured to configure a boot configuration of the processor.

5. The circuit of claim 1, wherein the bad frame detector is adapted to be coupled to the display, and the bad frame detector is configured to:

receive successive video frames from the display; and

detect bad frames by comparing digital signatures respectively associated with the successive video frames.

6. The circuit of claim 5, wherein the bad frame detector is configured to provide an indication of the video fault in response to at least one of:

the video input signal, the blind spot camera video output signal, or the successive video frames received from the display.

7. The circuit of claim 5, wherein the bad frame detector is configured to provide an indication of whether the video fault occurs off-substrate or on-substrate.

8. The circuit of claim 1, further comprising a warning frame generator coupled to the bad frame detector, the warning frame generator configured to generate a warning video output signal as a portion of the blind spot camera video output signal, in response to the bad frame detector detecting a bad frame in a video signal derived from the blind spot sensor.

9. The circuit of claim 8, wherein the selector circuitry is configured to output the blind spot camera video output signal independently of an operating state of the controller.

18. The circuit of claim 1, further comprising an output multiplexer configured to suppress the blind spot camera video output signal and to present an alternate warning video signal when the first hash and the second hash do not match.

10. A system, comprising:

a processor formed on a substrate, the processor having a processor input and a processor output, the processor input adapted to be coupled to a blind spot sensor, and the processor configured to;

receive a safety signal from the blind spot sensor; and

generate at the processor output a blind spot camera video output signal in response to the safety signal;

a controller, formed on the substrate, the controller configured to configure the processor;

an input hash generator having an input hash generator input and an input hash generator output, the input hash generator input coupled to the processor output, and the input hash generator configured to generate at the input hash generator output a first hash of the blind spot camera video output signal;

selector circuitry coupled to the processor and to the controller, the selector circuitry configured to select a video output signal, the selected video output signal being either;

the blind spot camera video output signal, if the safety signal is responsive to an action by a user;

or otherwise a controller video output signal from the controller;

a buffer having a buffer input and a buffer output, the buffer input coupled to the selector circuitry and adapted to be coupled to a display, the buffer configured to output at the buffer output the selected video output signal to the display for viewing by the user;

an output hash generator having an output hash generator input and an output hash generator output, the output hash generator input coupled to the buffer, and the output hash generator configured to generate at the output hash generator output a second hash of the selected video output signal; and

a bad frame detector having a detector input, the detector input coupled to the input hash generator output and to the output hash generator output, the bad frame detector configured to compare the first and second hashes to detect a video fault.

11. The system of claim 10, wherein the controller is configured to load a boot image for the processor.

12. The system of claim 11, wherein the selector circuitry is configured to output the blind spot camera video output signal independently of an operating state of the controller.

13. The system of claim 12, wherein the bad frame detector is configured to detect bad frames in a video input signal independently of the operating state of the controller.

19. The system of claim 10, further comprising an output multiplexer configured to suppress the blind spot camera video output signal and to present an alternate warning video signal when the first hash and the second hash do not match.

14. A method, comprising:

receiving, by executing instructions with a processor formed on a substrate, a safety signal from a blind spot sensor;

generating, by executing instructions with the processor, a blind spot camera video output signal in response to the safety signal;

generating, by executing instructions with the processor, a first hash of the blind spot camera video output signal;

selecting, by executing instructions with the processor, a video output signal, the selected video output signal being either;

the blind spot camera video output signal, if the safety signal is responsive to an action by a user;

or otherwise a controller video output signal from a controller;

outputting, by executing instructions with the processor, the selected video output signal to a display for viewing by the user;

generating a second hash of the selected video output signal; and

comparing, by executing instructions with the processor, the first and second hashes to detect a video failure.

15. The method of claim 14, further comprising booting a high-level operating system (HLOS) on the controller in parallel with booting the processor for generating the blind spot camera video output signal.

16. The method of claim 15, further comprising generating a warning video output signal as a portion of the blind spot camera video output signal in response to a detection of a bad frame in a video signal derived from the blind spot sensor.

17. The method of claim 16, further comprising determining whether bad frames are detected in one of a first or a second writeback path of a video signal derived from the blind spot sensor, wherein the second writeback path is different from the first writeback path and includes a return portion to receive frame information of selected video output signal frames displayed on the display.

20. The method of claim 14, further comprising:

suppressing the blind spot camera video output signal; and

presenting an alternate warning video signal when the first hash and the second hash do not match.