System and method for video processing software

• US 9,860,483 B1
• Filed: 05/17/2012
• Issued: 01/02/2018
• Est. Priority Date: 05/17/2012
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Williams, Kevin C., Sullivan, Michael J., Wilder, III, Louis
• Primary Examiner(s): Philippe, Gims
• Assistant Examiner(s): Gadomski, Stefan
• Application Number:
  US13/473,823
• Time in Patent Office: 2,056 Days
• Field of Search: None
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 7/01 Conversion of standards , e.g. involving analogue television standards or digital television standards processed at pixel level

Abstract

System and method for processing video information are disclosed and may include receiving, at a processing device, packetized digital video from a sensor. The packetized digital video may be decoded within the processing device, into source video formatted frames. The decoding may use at least one shared library function call. The source video formatted frames may be converted within the processing device into destination video formatted frames. The destination video formatted frames may be transferred to a video processing system. The destination video formatted frames may be stored, prior to the transferring, in shared memory within the processing device. The storing of the destination video formatted frames may include allocating at least one memory block of the shared memory, and associating the allocated at least one memory block with a memory pointer.

Claims

1. A method for processing video information, the method comprising:

reading a configuration file associated with a first video processing system using at least one shared library function call, the configuration file comprising data used to configure the first video processing system;

determining the configuration file comprises a valid source location for a video stream, the source location comprising a uniform resource locator (“

URL”

) of a network;

receiving, at the first video processing system, packetized digital video from the source location specified in the configuration file in response to determining the configuration file comprises a valid source location for a video stream, the packetized digital video being generated by a first video sensor, the first video processing system configured to process digital video generated by a second video sensor while not being configured to process digital video generated by the first video sensor, the second video sensor having different output characteristics than the first video sensor;

providing a list of a plurality of shared library function calls used to emulate functionality of a second video processing system configured to process digital video generated using the second video sensor on the first video processing system, the first video processing system comprising one or more of logic, circuitry, interfaces, and code for emulating functionality of the second video processing system, wherein the plurality of shared library function calls comprises one or more pass-through function calls that are performed by the first video processing system and stub function calls that return an indication of successful execution;

decoding the packetized digital video received from the first video sensor into source video formatted frames using at least one shared library function call of the plurality of shared library function calls, wherein the at least one shared library function call for decoding the packetized digital video into source video formatted frames is called for each frame of the packetized digital video, the at least one shared library function call comprising a draw shared library function call, wherein availability of the video stream is verified for each call of the draw shared library function call by maintaining a counter indicating a number of seconds since a source video formatted frame is received from the video stream, and wherein the video stream is reset in response to the number of seconds since the source video formatted frame is received from the video stream exceeding a threshold time;

converting the source video formatted frames into destination video formatted frames using at least one shared library function call of the plurality of shared library function calls, the destination video formatted frames having output characteristics such that the destination video formatted frames are displayable by the first video processing system; and

making available the destination video formatted frames for display by the first video processing system.

2. The method according to claim 1, wherein the at least one shared library function call comprises one or more of a dynamically linked library (DLL) function call and a statically linked library function call.

3. The method according to claim 1, wherein the source video formatted frames comprise RGB formatted digital video frames, and the destination video formatted frames comprise device independent bitmap (DIB) formatted video frames.

4. The method according to claim 1, comprising:

generating the destination video formatted digital video frames by decoding, within the processing device, the packetized digital video into the destination video formatted digital video frames, using the at least one shared library function call, wherein said generating takes place without said converting.

5. The method according to claim 1, comprising storing the destination video formatted frames in shared memory within the processing device.

6. The method according to claim 5, wherein said storing of the destination video formatted frames comprises:

allocating at least one memory block of the shared memory; and

associating said allocated at least one memory block with a memory pointer, wherein said memory pointer is provided by the first video processing system.

7. The method according to claim 6, wherein the destination video formatted frames are transferred from said allocated at least one memory block.

8. The method according to claim 7, further comprising:

post-processing said transferred destination video formatted frames by the first video processing system; and

displaying said post-processed transferred destination video formatted frames by the first video processing system.

9. The method according to claim 1, wherein said converting comprises converting the source video formatted frames into a video format compatible with the first video processing system.

10. A non-transitory machine-readable storage medium having stored thereon, a computer program having at least one code section for processing video information, the at least one code section being executable by a machine for causing the machine to perform steps comprising:

reading a configuration file associated with a first video processing system using at least one shared library function call, the configuration file comprising data used to configure the first video processing system;

determining the configuration file comprises a valid source location for a video stream, the source location comprising a uniform resource locator (“

URL”

) of a network;

receiving, at the first video processing system, packetized digital video from the source location specified in the configuration file in response to determining the configuration file comprises a valid source location for a video stream, the packetized digital video being generated by a first video sensor, the first video processing system configured to process digital video generated by a second video sensor while not being configured to process digital video generated by the first video sensor, the second video sensor having different output characteristics than the first video sensor;

providing a list of a plurality of shared library function calls used to emulate functionality of a second video processing system configured to process digital video generated using the second video sensor on the first video processing system, the first video processing system comprising one or more of logic, circuitry, interfaces, and code for emulating functionality of the second video processing system, wherein the plurality of shared library function calls comprises one or more pass-through function calls that are performed by the first video processing system and stub function calls that return an indication of successful execution;

decoding the packetized digital video received from the first video sensor into source video formatted frames using at least one shared library function call of the plurality of shared library function calls, wherein the at least one shared library function call for decoding the packetized digital video into source video formatted frames is called for each frame of the packetized digital video, the at least one shared library function call comprising a draw shared library function call, wherein availability of the video stream is verified for each call of the draw shared library function call by maintaining a counter indicating a number of seconds since a source video formatted frame is received from the video stream, and wherein the video stream is reset in response to the number of seconds since the source video formatted frame is received from the video stream exceeding a threshold time;

converting the source video formatted frames into destination video formatted frames using at least one shared library function call of the plurality of shared library function calls, the destination video formatted frames having output characteristics such that the destination video formatted frames are displayable by the first video processing system; and

making available the destination video formatted frames for display by the first video processing system.

11. The non-transitory machine-readable storage medium according to claim 10, wherein the at least one shared library function call comprises one or more of a dynamically linked library (DLL) function call and a statically linked library function call.

12. The non-transitory machine-readable storage medium according to claim 10, wherein the at least one code section comprises code for generating the destination video formatted digital video frames by decoding, within the processing device, the packetized digital video into the destination video formatted digital video frames, using the at least one shared library function call, wherein said generating takes place without said converting.

13. The non-transitory machine-readable storage medium according to claim 10, wherein the at least one shared library function call comprises an Initialization function call.

14. A system for processing video information, the system comprising:

at least one processor within a first video processing system;

a memory comprising code executable by the at least one processor to;

read a configuration file associated with the first video processing system using at least one shared library function call, the configuration file comprising data used to configure the first video processing system;

determine the configuration file comprises a valid source location for a video stream, the source location comprising a uniform resource locator (“

URL”

) of a network;

receive, at the first video processing system, packetized digital video from the source location specified in the configuration file in response to determining the configuration file comprises a valid source location for a video stream, the packetized digital video being generated by a first video sensor, the first video processing system configured to process digital video generated by a second video sensor while not being configured to process digital video generated by the first video sensor, the second video sensor having different output characteristics than the first video sensor;

provide a list of a plurality of shared library function calls used to emulate functionality of a second video processing system configured to process digital video generated using the second video sensor on the first video processing system, the first video processing system comprising one or more of logic, circuitry, interfaces, and code for emulating functionality of the second video processing system, wherein the plurality of shared library function calls comprises one or more pass-through function calls that are performed by the first video processing system and stub function calls that return an indication of successful execution;

decode the packetized digital video received from the first video sensor into source video formatted frames using at least one shared library function call of the plurality of shared library function calls, wherein the at least one shared library function call for decoding the packetized digital video into source video formatted frames is called for each frame of the packetized digital video, the at least one shared library function call comprising a draw shared library function call, wherein availability of the video stream is verified for each call of the draw shared library function call by maintaining a counter indicating a number of seconds since a source video formatted frame is received from the video stream, and wherein the video stream is reset in response to the number of seconds since the source video formatted frame is received from the video stream exceeding a threshold time;

convert the source video formatted frames into destination video formatted frames using at least one shared library function call of the plurality of shared library function calls, the destination video formatted frames having output characteristics such that the destination video formatted frames are displayable by the first video processing system; and

make available the destination video formatted frames for display by the first video processing system.

15. The system according to claim 14, wherein the source video formatted frames comprise RGB formatted digital video frames, and the destination video formatted frames comprise device independent bitmap (DIB) formatted video frames.

16. The system according to claim 14, wherein the code is further executable by the processor to generate the destination video formatted digital video frames by decoding, within the processing device, the packetized digital video into the destination video formatted digital video frames, using the at least one shared library function call, wherein said generating takes place without said converting.

17. The system according to claim 14, wherein the code is further executable by the processor to:

store the destination video formatted frames in shared memory within the processing device;

allocate at least one memory block of the shared memory; and

associate said allocated at least one memory block with a memory pointer, wherein said memory pointer is provided by the first video processing system.

18. The system according to claim 14, wherein during said converting, the code is further executable by the processor to convert the source video formatted frames into a video format compatible with the first video processing system.

19. The system according to claim 14, wherein said processing device is within an aircraft, and further comprises:

a communication bus; and

at least one sensor within the aircraft, the at least one sensor operable to provide video sensor data via the communication bus and wherein said processor within said processing device is operable to receive the video sensor data from the at least one sensor via the communication bus.