Multi-Level Video Processing Within A Vehicular Communication Network

• US 20120105637A1
• Filed: 06/29/2011
• Published: 05/03/2012
• Est. Priority Date: 11/03/2010
• Status: Abandoned Application

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Broadcom Corporation (Broadcom, Inc.)
• Inventors: Yousefi, Nariman, Kim, Yongbum, Walley, John, Chen, Sherman (Xuemin), Diab, Wael W., Ilyadis, Nicholas
• Application Number:
  US13/171,629
• Publication Number:
  US 20120105637A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60L 50/00 Electric propulsion with power supplied within the vehicle with power supply from force of nature, e.g. sun or wind, B60L8/00; for monorail vehicles, suspension vehicles or rack railways B60L13/00
• CPC Class Codes: B60R 16/023 for transmission of signals between vehicle parts or subsystems
• CPC Class Codes: B60R 16/03 for supply of electrical power to vehicle subsystems or for circuit arrangements for charging batteries H02J7/00
• CPC Class Codes: B60R 16/0315 using multiplexing techniques multiplexing for transmission of signals G08C15/00; multiplexing for electrical communication in general H04J
• CPC Class Codes: B60R 19/03 characterised by material, e.g. composite B60R19/18 takes precedence
• CPC Class Codes: G06F 1/26 Power supply means, e.g. regulation thereof for memories G11C
• CPC Class Codes: G06F 1/266 Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
• CPC Class Codes: G06F 13/4022 using switching circuits, e.g. switching matrix, connection or expansion network G06F13/4009 takes precedence
• CPC Class Codes: G06F 7/76 Arrangements for rearranging, permuting or selecting data according to predetermined rules, independently of the content of the data
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/085 using electronic data carriers
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: H04B 1/3822 specially adapted for use in vehicles H04B1/3827 takes precedence
• CPC Class Codes: H04L 12/10 Current supply arrangements
• CPC Class Codes: H04L 12/46 Interconnection of networks
• CPC Class Codes: H04L 12/4625 Single bridge functionality, e.g. connection of two networks over a single bridge
• CPC Class Codes: H04L 12/56 Packet switching systems
• CPC Class Codes: H04L 45/74 Address processing for routing
• CPC Class Codes: H04L 47/2433 Allocation of priorities to traffic types
• CPC Class Codes: H04L 47/6275 : based on priority
• CPC Class Codes: H04L 47/76 : using dynamic resource allocation, e.g. in-call renegotiation requested by the user or requested by the network in response to changing network conditions
• CPC Class Codes: H04L 47/821 : Prioritising resource allocation or reservation requests
• CPC Class Codes: H04L 49/25 : Routing or path finding in a switch fabric
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 69/08 : Protocols for interworking; Protocol conversion
• CPC Class Codes: H04L 69/22 : Parsing or analysis of headers
• CPC Class Codes: H04N 19/102 : characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04W 24/08 : Testing, supervising or monitoring using real traffic
• CPC Class Codes: H04W 28/08 : Load balancing or load distribution transferring a connection for handling the traffic H04W36/22; wireless traffic scheduling H04W72/12
• CPC Class Codes: H04W 4/40 : for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H04W 4/44 : for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
• CPC Class Codes: H04W 4/46 : for vehicle-to-vehicle communication [V2V]
• CPC Class Codes: H04W 72/02 : Selection of wireless resources by user or terminal
• CPC Class Codes: H04W 72/541 : using the level of interference
• CPC Class Codes: H04W 72/56 : based on priority criteria
• CPC Class Codes: H04W 88/02 : Terminal devices
• CPC Class Codes: Y02D 30/70 : in wireless communication networks
• CPC Class Codes: Y04S 40/18 : Network protocols supporting networked applications, e.g. including control of end-device applications over a network

Abstract

A system for performing multi-level video processing within a vehicle includes a pre-processing module for determining an encoding mode and enabling one or more levels of encoding based on the encoding mode. The pre-processing module further receives a video stream from a camera attached to the vehicle via a vehicular communication network and encodes the video stream based on the encoding mode to produce a packet stream output. The system further includes a video decoder for receiving the packet stream output and decoding the packet stream output in accordance with the encoding mode to produce a decoded video output.

Claims

1. A system for performing multi-level video processing within a vehicle, comprising:

a pre-processing module for determining an encoding mode and enabling one or more levels of encoding based on the encoding mode, the pre-processing module further for receiving a video stream from a camera attached to the vehicle via a vehicular communication network and encoding the video stream based on the encoding mode to produce a packet stream output; and

a video decoder for receiving the packet stream output and decoding the packet stream output in accordance with the encoding mode to produce a decoded video output.

2. The system of claim 1, wherein the pre-processing module comprises:

a first level encoding module for performing a base layer encoding of the video stream to produce a first level encoded video stream with low latency;

a second level encoding module for performing spatial scaling encoding on the video stream based on the base layer encoding of the first level encoding module to produce a second level encoded video stream;

a third level encoding module for performing quality scaling encoding on the video stream based on the base layer encoding of the first level encoding module and the spatial scaling encoding of the second level encoding module to produce a third level encoded video stream; and

a packetizing module for receiving and packetizing the first level encoded video stream, the second level encoded video stream and the third level encoded video stream to produce a packet stream output;

wherein at least one of the first level encoding module, the second level encoding module and the third level encoding module is enabled based on the encoding mode.

3. The system of claim 2, wherein the pre-processing module further comprises:

at least one of;

a first low latency sub-sampling module for sampling the video stream at a first rate to produce a sub-sampled video stream provided to the first level encoding module; and

a second low latency sub-sampling module for sampling the video stream at a second rate higher than the first rate to produce a second sub-sampled video stream provided to the second level encoding module.

4. The system of claim 2, further comprising:

a processing module for generating a control signal that indicates the encoding mode to the pre-processing module.

5. The system of claim 4, wherein the control signal further adjusts characteristics of one or more of the first level encoding module, the second level encoding module, the third level encoding module and the packetizing module.

6. The system of claim 4, wherein the processing module generates the control signal based on at least one of a mode of operation, packet content, a vehicle status and an availability of network resources of the vehicular communication network.

7. The system of claim 2, wherein the packetizing module prioritizes output of packets from the first level encoded video stream into the packet stream output.

8. The system of claim 7, wherein the packetizing module output packets from the first level encoded video stream, second level encoded video stream and third level encoded video stream in a serial manner with the packets from the first level encoded video stream having priority over the packets from the second level encoded video stream and the third level encoded video stream to produce the packet stream output.

9. The system of claim 2, wherein the video decoder further comprises:

a de-packetizing module for receiving the packet stream output and separating the packet stream output into first level encoded packets, second level encoded packets and third level encoded packets;

a first level decoding module for receiving the first level encoded packets and decoding the first level encoded packets to produce a first level decoded video signal;

a second level decoding module for receiving the second level encoded packets and decoding the second level encoded packets to produce a second level decoded video signal;

a third level decoding module for receiving the third level encoded packets and decoding the third level encoded packets to produce a third level decoded video signal; and

a video output module for receiving and outputting at least one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal based on the encoding mode to produce the decoded video output.

10. The system of claim 9, further comprising:

a processing module for generating a control signal that indicates the encoding mode to the video decoder.

11. The system of claim 10, wherein the control signal further indicates a particular one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal to output as the decoded video output.

12. The system of claim 10, wherein the control signal instructs the video output module to output the first level decoded video signal as the decoded video output, and further comprising:

a video safety monitoring module for receiving the output video signal and processing the decoded video output to determine whether criteria for detecting a safety issue are met, and if so, generating a safety command.

13. The system of claim 10, wherein the control signal instructs the video output module to output at least one of the second level decoded video signal and the third level decoded video signal as the decoded video output, and further comprising:

a user display for receiving the decoded video output and displaying the decoded video output thereon.

14. A pre-processing module for performing multi-level video processing within a vehicle, comprising:

a first level encoding module for performing a base layer encoding of a video stream received from a camera attached to the vehicle via a vehicular communication network to produce a first level encoded video stream with low latency;

a second level encoding module for performing spatial scaling encoding on the video stream based on the base layer encoding of the first level encoding module to produce a second level encoded video stream;

a third level encoding module for performing quality scaling encoding on the video stream based on the base layer encoding of the first level encoding module and the spatial scaling encoding of the second level encoding module to produce a third level encoded video stream; and

a packetizing module for receiving and packetizing the first level encoded video stream, the second level encoded video stream and the third level encoded video stream to produce a packet stream output;

wherein at least one of the first level encoding module, the second level encoding module and the third level encoding module is enabled based on an encoding mode.

15. The pre-processing module of claim 14, further comprising:

at least one of;

a first low latency sub-sampling module for sampling the video stream at a first rate to produce a sub-sampled video stream provided to the first level encoding module; and

a second low latency sub-sampling module for sampling the video stream at a second rate higher than the first rate to produce a second sub-sampled video stream provided to the second level encoding module.

16. The pre-processing module of claim 14, wherein the packetizing module prioritizes output of packets from the first level encoded video stream into the packet stream output.

17. The pre-processing module of claim 16, wherein the packetizing module outputs packets from the first level encoded video stream, the second level encoded video stream and the third level encoded video stream in a serial manner with the packets from the first level encoded video stream having priority over the packets from the second level encoded video stream and the third level encoded video stream to produce the packet stream output.

18. A video decoder for performing multi-level video processing within a vehicle, comprising:

a de-packetizing module for receiving a packet stream output representing a video stream captured by a camera attached to the vehicle via a vehicular communication network, the de-packetizing module further for separating the packet stream output into first level encoded packets, second level encoded packets and third level encoded packets;

a first level decoding module for receiving the first level encoded packets and decoding the first level encoded packets to produce a first level decoded video signal;

a second level decoding module for receiving the second level encoded packets and decoding the second level encoded packets to produce a second level decoded video signal;

a third level decoding module for receiving the third level encoded packets and decoding the third level encoded packets to produce a third level decoded video signal; and

a video output module for receiving and outputting at least one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal based on a control signal to produce a decoded video output.

19. The video decoder of claim 18, wherein the control signal further indicates a particular one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal to output as the decoded video output.

20. The video decoder of claim 19, wherein the control signal is generated based on at least one of a mode of operation, packet content, a vehicle status and an availability of network resources of the vehicular communication network.