Machine-learning to see defects: a hybrid attention-ConvLSTM-based convolutional neural network deep learning architecture for structural damage detection

Mehrdad Shafiei Dizaji; Zhu Mao

doi:10.1117/12.2615542

18 April 2022 Machine-learning to see defects: a hybrid attention-ConvLSTM-based convolutional neural network deep learning architecture for structural damage detection

Mehrdad Shafiei Dizaji, Zhu Mao

Author Affiliations +

Proceedings Volume 12046, Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2022; 120460L (2022) https://doi.org/10.1117/12.2615542
Event: SPIE Smart Structures + Nondestructive Evaluation, 2022, Long Beach, California, United States

Abstract

Vibration measurement serves as the basis for structural damage detection. To detect damage, vibration measurement and frequency estimation through image sequence analysis continue to receive increasing attention. In this work, we demonstrate that structural damage prediction can be achieved using a deep learning neural network architecture. In this paper, we seek to learn and see the structural damage directly from videos using deep convolutional neural networks (CNN). The key idea is to use each pixel of an image taken from a digital camera, extracting the spatiotemporal information, like a sensor to capture the modal frequencies of a vibrating structure. We develop attention-based architecture to detect subtle signals from a specific source to visualize high resolution of dynamic properties of the structures to infer existing structural damage. We first extract the high discriminative features of video frames using the CNN. Then we leverage conv-long short-term memory (ConvLSTM) with the extracted features as inputs to capture the temporal dynamics in videos. The attention mechanisms are embedded in the network to ensure the model learns to focus selectively on the dynamic frames across the video clips. Our computer vision-based deep learning model takes the video of a vibrating structure as input and outputs about the health of the structure. We demonstrate, using reliable empirical results, the proposed model is efficient, autonomous, and accurate. The proposed method is verified using a few laboratory experiments. Our experimental results demonstrate that the proposed method can achieve acceptable prediction accuracy even.

Conference Presentation

Citation Download Citation

Mehrdad Shafiei Dizaji and Zhu Mao "Machine-learning to see defects: a hybrid attention-ConvLSTM-based convolutional neural network deep learning architecture for structural damage detection", Proc. SPIE 12046, Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2022, 120460L (18 April 2022); https://doi.org/10.1117/12.2615542

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available