Deep neural networks (DNNs) have been widely adopted in modeling electromagnetic compatibility (EMC) problems, but the training data acquisition is usually time-consuming through various simulators. This paper presents a powerful approach using an ensemble of DNN s to effectively reduce the training data size in DNN-based modeling problems. A batch of training data with the largest uncertainties is selected using active learning through the variance among the ensemble of DNNs. Subsequently, a greedy sampling algorithm is applied to select a data subset using diversity. Thus, the proposed method can achieve both uncertainty and diversity in data selection. By averaging the outputs of the DNN ensemble, the prediction error can be further reduced. Simple mathematical functions are used to validate the proposed method, and a high-dimensional strip line modeling problem also demonstrates the effectiveness of this DNN-ensemble approach. The proposed method is task agnostic and can be used in other surrogate modeling problems with DNN s.
L. Zhang and D. Li and J. He and B. Mutnury and B. Pu and X. D. Cai and C. Hwang and J. Fan and J. L. Drewniak and E. P. Li, "A Dnn-Ensemble Method for Error Reduction and Training Data Selection in Dnn based Modeling," 2022 IEEE International Symposium on Electromagnetic Compatibility and Signal/Power Integrity, EMCSI 2022, pp. 175 - 180, Institute of Electrical and Electronics Engineers, Jan 2022.
The definitive version is available at https://doi.org/10.1109/EMCSI39492.2022.9889587
Electrical and Computer Engineering
Keywords and Phrases
Active learning; deep neural network; ensemble-based; greedy sampling; machine learning; stripline modeling
International Standard Book Number (ISBN)
Article - Conference proceedings
© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.
01 Jan 2022
National Natural Science Foundation of China, Grant 62027805