Fault Tolerant One-Sided Matrix Decompositions on Heterogeneous Systems with GPUs


Current algorithm-based fault tolerance (ABFT) approach for one-sided matrix decomposition on heterogeneous systems with GPUs have following limitations: (1) they do not provide sufficient protection as most of them only maintain checksum in one dimension; (2) their checking scheme is not efficient due to redundant checksum verifications; (3) they fail to protect PCIe communication; and (4) the checksum calculation based on a special type of matrix multiplication is far from efficient. By overcoming the above limitations, we design an efficient ABFT approach providing stronger protection for one-sided matrix decomposition methods on heterogeneous systems. First, we provide full matrix protection by using checksums in two dimensions. Second, our checking scheme is more efficient by prioritizing the checksum verification according to the sensitivity of matrix operations to soft errors. Third, we protect PCIe communication by reordering checksum verifications and decomposition steps. Fourth, we accelerate the checksum calculation by 1.7x via better utilizing GPUs.

Meeting Name

30th ACM/IEEE International Conference for High Performance Computing, Networking, Storage, and Analysis, SC '18 (2018: Nov. 11-16, Dallas, TX)


Computer Science

Keywords and Phrases

Algorithm-Based Fault Tolerance; GPU; Heterogeneous System; Linear Algebra; Matrix Decomposition

International Standard Book Number (ISBN)


Document Type

Article - Conference proceedings

Document Version


File Type





© 2019 Association for Computing Machinery (ACM), All rights reserved.

Publication Date

11 Mar 2019