Abstract

This project aims to create a framework of training engineers and policy makers on robotic operation and image analysis for the inspection and preservation of transportation infrastructure. Specifically, it develops the method for collecting camera-based bridge inspection data and the algorithms for data processing and pattern recognitions; and it creates tools for assisting users on visually analyzing the processed image data and recognized patterns for inspection and preservation decision-making.

The project first developed a Siamese Neural Network to support bridge engineers in analyzing big video data. The network was initially trained by one-shot learning and is fine-tuned iteratively with human in the loop. Bridge engineers define the region of interest initially, then the algorithm retrieves all related regions in the video, which facilitates the engineers to inspect the bridge rather than exhaustively check every frame of the video. Our neural network was evaluated on three bridge inspection videos with promising performances.

Then, the project developed an assistive intelligence system to facilitate inspectors efficiently and accurately detect and segment multiclass bridge elements from inspection videos. A Mask Region-based Convolutional Neural Network was transferred in the studied problem with a small initial training dataset labeled by the inspector. Then, the temporal coherence analysis was used to recover false negative detections of the transferred network. Finally, self-training with a guidance from experienced inspectors was used to iteratively refine the network. Results from a case study have demonstrated that the proposed method uses just a small amount of time and guidance from experienced inspectors to successfully build the assistive intelligence system with an excellent performance.

Department(s)

Civil, Architectural and Environmental Engineering

Second Department

Engineering Management and Systems Engineering

Third Department

Computer Science

Research Center/Lab(s)

INSPIRE - University Transportation Center

Grant Number

USDOT #69A3551747126

Comments

Principal Investigator: Ruwen Qin
Co-Principal Investigators: Genda Chen, Suzanna Long, Zhaozheng Yin, Sushil Louis

Grant Period: 30 Nov 2016 - 30 Sep 2022

Project Period: 01 Jan 2018 - 30 Sep 2021

The investigation was conducted in cooperation with the U. S. Department of Transportation.

Report Number

INSPIRE-001

Document Type

Technical Report

Document Version

Final Version

File Type

text

Language(s)

English

Rights

© 2020 Missouri University of Science and Technology, All rights reserved.

Publication Date

31 Jul 2020

Download

Share

 
COinS