A Dnn-Ensemble Method for Error Reduction and Training Data Selection in Dnn based Modeling

Author

Ling Zhang
Da Li
Jiayi He
Bhyrav Mutnury
Bo Pu
Xiao Ding Cai
Chulsoon Hwang, Missouri University of Science and TechnologyFollow
Jun Fan, Missouri University of Science and TechnologyFollow
James L. Drewniak, Missouri University of Science and TechnologyFollow
Er Ping Li

Abstract

Deep neural networks (DNNs) have been widely adopted in modeling electromagnetic compatibility (EMC) problems, but the training data acquisition is usually time-consuming through various simulators. This paper presents a powerful approach using an ensemble of DNN s to effectively reduce the training data size in DNN-based modeling problems. A batch of training data with the largest uncertainties is selected using active learning through the variance among the ensemble of DNNs. Subsequently, a greedy sampling algorithm is applied to select a data subset using diversity. Thus, the proposed method can achieve both uncertainty and diversity in data selection. By averaging the outputs of the DNN ensemble, the prediction error can be further reduced. Simple mathematical functions are used to validate the proposed method, and a high-dimensional strip line modeling problem also demonstrates the effectiveness of this DNN-ensemble approach. The proposed method is task agnostic and can be used in other surrogate modeling problems with DNN s.

Recommended Citation

L. Zhang and D. Li and J. He and B. Mutnury and B. Pu and X. D. Cai and C. Hwang and J. Fan and J. L. Drewniak and E. P. Li, "A Dnn-Ensemble Method for Error Reduction and Training Data Selection in Dnn based Modeling," 2022 IEEE International Symposium on Electromagnetic Compatibility and Signal/Power Integrity, EMCSI 2022, pp. 175 - 180, Institute of Electrical and Electronics Engineers, Jan 2022.

The definitive version is available at https://doi.org/10.1109/EMCSI39492.2022.9889587

Department(s)

Electrical and Computer Engineering

Comments

National Natural Science Foundation of China, Grant 62027805

Keywords and Phrases

Active learning; deep neural network; ensemble-based; greedy sampling; machine learning; stripline modeling

International Standard Book Number (ISBN)

978-166540929-2

Document Type

Article - Conference proceedings

Document Version

Final Version

File Type

text

Language(s)

English

Rights

© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.

Publication Date

01 Jan 2022