Modular device for high-speed video vibration analysis

• US 10,127,678 B2
• Filed: 12/09/2016
• Issued: 11/13/2018
• Est. Priority Date: 12/10/2015
• Status: Active Grant

• Current Assignee: Airbus Defence and Space GmbH
• Original Assignee: Airbus Defence and Space GmbH
• Inventors: Perez Acal, Antonio, Marsiglia, Gianluca, Nadalutti, Daniele
• Primary Examiner(s): STREGE, JOHN B
• Application Number:
  US15/374,592
• Publication Number:
  US 20170169575A1
• Time in Patent Office: 704 Days
• CPC Class Codes: G01B 11/16 for measuring the deformation in a solid, e.g. optical strain gauge
• CPC Class Codes: G01H 9/00 Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves by using radiation-sensitive means, e.g. optical means
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/20016 Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
• CPC Class Codes: G06T 7/262 using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 13/214 using spectral multiplexing
• CPC Class Codes: H04N 13/246 Calibration of cameras
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0085 Motion estimation from stereoscopic image signals

Abstract

A technique for modular high-speed video vibration analysis of a structure. An embodiment of a device for high-speed video vibration analysis comprises a camera arrangement configured to generate at least two high-speed video streams of the structure and a data analyzer unit, connected to the camera arrangement. The data analyzer unit comprises a processing unit configured to extract vibrational data of at least a portion of the captured structure by considering estimated deformations of at least a portion of the captured structure along a first plane and determined depth information of at least a portion of the captured structure along a second plane different from the first plane or along an axis included in the second plane.

Claims

1. A device for high-speed video vibration analysis, the device comprising:

a camera arrangement configured to generate at least two high-speed video streams of the structure;

a data analyzer unit, connected to the camera arrangement, the data analyzer unit comprising

a processing unit configured to;

estimate, from at least one of the at least two high-speed video streams, deformations of at least a portion of the captured structure along a first plane,

determine, from the at least two high-speed video streams, depth information of at least a portion of the captured structure being one of along a second plane, different from the first plane, or along an axis included in the second plane,

detect vibration modes associated with the estimated deformations of at least the portion of the captured structure along the first plane, and

extract vibrational data of at least a portion of the captured structure by combining the estimated deformations of at least the portion of the captured structure along the first plane, the detected vibration modes associated with the estimated deformations of at least the portion of the captured structure along the first plane and the determined depth information of at least the portion of the captured structure along the second plane.

2. The device of claim 1, wherein the data analyzer unit comprises an acquisition unit configured to at least one of control the camera arrangement or synchronize the at least two high-speed video streams.

3. The device of claim 1, wherein the processing unit is configured to rectify the at least two high-speed video streams onto the first plane.

4. The device of claim 1, wherein the camera arrangement comprises at least two high-speed cameras, wherein each camera is arranged and configured to capture the structure and generate a high-speed video stream of the at least two high-speed video streams.

5. The device of claim 1, wherein the second plane is perpendicular to the first plane.

6. The device of claim 1, further comprising:

a display unit configured to display at least one of

a user input,

a user setting,

one or more of the at least two high-speed video streams,

the extracted vibrational data of at least the portion of the captured structure, and a synthetic or model-based representation of the estimated deformations, or

the computed depth information.

7. The device of claim 1, further comprising:

a graphical user interface configured to import and display model-based results and align the model-based results with the extracted vibrational data by dedicated controls and windows of the graphical user interface.

8. A device for high-speed video vibration analysis, the device comprising:

a camera arrangement configured to generate at least two high-speed video streams of the structure;

a data analyzer unit, connected to the camera arrangement, the data analyzer unit comprising

a processing unit configured to;

estimate, from at least one of the at least two high-speed video streams, deformations of at least a portion of the captured structure along a first plane,

determine, from the at least two high-speed video streams, depth information of at least a portion of the captured structure being one of along a second plane, different from the first plane, or along an axis included in the second plane,

extract vibrational data of at least a portion of the captured structure by considering the estimated deformations and the determined depth information, wherein the camera arrangement comprises a high-speed video camera that is configured to operate in a visible spectrum and a high-speed video camera that is configured to operate in a non-visible spectrum.

9. A device for high-speed video vibration analysis, the device comprising:

a camera arrangement configured to generate at least two high-speed video streams of the structure;

a data analyzer unit, connected to the camera arrangement, the data analyzer unit comprising

a processing unit configured to;

estimate, from at least one of the at least two high-speed video streams, deformations of at least a portion of the captured structure along a first plane,

determine, from the at least two high-speed video streams, depth information of at least a portion of the captured structure being one of along a second plane, different from the first plane, or along an axis included in the second plane, and

extract vibrational data of at least a portion of the captured structure by considering the estimated deformations and the determined depth information; and

a moveable platform on which the camera arrangement is arranged the moveable platform comprising at least one of accelerometers, gyro sensors, or motion sensors configured to detect self-vibrations of at least one of the moveable platform or the camera arrangement, and further configured to provide the resulting self-vibration data to the data analyzer unit, wherein the processing unit is further configured to correct the vibrational data of the structure parts being monitored, based on the detected self-vibrations, the moveable platform comprising at least one of accelerometers, gyro sensors, or motion sensors configured to detect self-vibrations of at least one of the moveable platform or the camera arrangement, and further configured to provide the resulting self-vibration data to the data analyzer unit, wherein the processing unit is further configured to correct the vibrational data of the structure parts being monitored, based on the detected self-vibrations.

10. A method for high-speed video vibration analysis of a structure, utilizing a camera arrangement and a processing unit of a data analyzer unit, the method comprising:

generating, by the camera arrangement, at least two high-speed video streams of the structure;

estimating, by the processing unit of the data analyzer unit, from at least one of the at least two high-speed video streams, deformations of at least a portion of the structure along a first plane;

determining, by the processing unit, from the at least two high-speed video streams, depth information of at least a portion of the structure along a second plane, different from the first plane, or along an axis included in the second plane;

detecting, by the processing unit, vibration modes associated with the estimated deformations of at least the portion of the captured structure along the first plane; and

extracting, by the processing unit, vibrational data of at least a portion of the captured structure by combining the estimated deformations of at least the portion of the captured structure along the first plane, the detected vibration modes associated with the estimated deformations of at least the portion of the captured structure along the first plane and the determined depth information of at least the portion of the captured structure along the second plane.

11. The method of claim 10, wherein the portion of the captured structure is at least one of a user-selected point or region of the structure.

12. The method of claim 10, wherein the steps of estimating, determining and extracting are performed in a user-selected order.