Abstract
Federated Learning (FL) presents a robust paradigm for privacy-preserving, decentralized machine learning. However, a significant gap persists between the theoretical design of FL algorithms and their practical performance, largely because existing evaluation tools often fail to model realistic operational conditions. Many testbeds oversimplify the critical dynamics among algorithmic efficiency, client-level heterogeneity, and continuously evolving network infrastructure. To address this challenge, we introduce the Federated Learning Emulation and Evaluation Testbed (FLEET). This comprehensive platform provides a scalable and configurable environment by integrating a versatile, framework-agnostic learning component with a high-fidelity network emulator. FLEET supports diverse machine learning frameworks, customizable real-world network topologies, and dynamic background traffic generation. The testbed collects holistic metrics that correlate algorithmic outcomes with detailed network statistics. By unifying the entire experiment configuration, FLEET enables researchers to systematically investigate how network constraints, such as limited bandwidth, high latency, and packet loss, affect the convergence and efficiency of FL algorithms. This work provides the research community with a robust tool to bridge the gap between algorithmic theory and real-world network conditions, promoting the holistic and reproducible evaluation of federated learning systems.
Recommended Citation
O. A. Hamdan et al., "FLEET: A Federated Learning Emulation and Evaluation Testbed for Holistic Research," Proceedings IEEE Consumer Communications and Networking Conference Ccnc, Institute of Electrical and Electronics Engineers, Jan 2026.
The definitive version is available at https://doi.org/10.1109/CCNC65079.2026.11366595
Department(s)
Computer Science
Keywords and Phrases
Federated Learning; Network Emulation; Testbed
International Standard Serial Number (ISSN)
2331-9860
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2026 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
01 Jan 2026

Comments
National Science Foundation, Grant 2427408