A survey of fault tolerance mechanisms and checkpoint/restart implementations for high performance computing systems
TLDR
The failure rates of HPC systems are reviewed, rollback-recovery techniques which are most often used for long-running applications on HPC clusters are discussed, and a taxonomy is developed for over twenty popular checkpoint/restart solutions.Abstract:
In recent years, High Performance Computing (HPC) systems have been shifting from expensive massively parallel architectures to clusters of commodity PCs to take advantage of cost and performance benefits. Fault tolerance in such systems is a growing concern for long-running applications. In this paper, we briefly review the failure rates of HPC systems and also survey the fault tolerance approaches for HPC systems and issues with these approaches. Rollback-recovery techniques which are most often used for long-running applications on HPC clusters are discussed because they are widely used for long-running applications on HPC systems. Specifically, the feature requirements of rollback-recovery are discussed and a taxonomy is developed for over twenty popular checkpoint/restart solutions. The intent of this paper is to aid researchers in the domain as well as to facilitate development of new checkpointing solutions.read more
Citations
More filters
Journal ArticleDOI
A Lightweight and Flexible Tool for Distinguishing Between Hardware Malfunctions and Program Bugs in Debugging Large-Scale Programs
TL;DR: A new technique to distinguish the reason for program failure between hardware malfunctions and program bugs is proposed, which mitigates the impact of shorter mean time between failures to the debugging process on the future exa-scale supercomputers and improves the productivity of debugging large-scale parallel programs.
Journal ArticleDOI
Improving fault-tolerance capability of on-chip binary CDMA bus
TL;DR: Simulation results show that the proposed encoding scheme significantly improves the post-decoding bit error rate performance of the binary CDMA bus under a binary symmetric channel model.
Journal ArticleDOI
Minimizing Energy and Computation in Long-Running Software
Erol Gelenbe,Miltiadis Siavvas +1 more
TL;DR: This work studies how checkpoint intervals need to be selected so as to minimize a cost function that includes the execution time and the energy of the program, in terms of the classical “Lambert function”.
User-Space Process Virtualization in the Context of Checkpoint-Restart and Virtual Machines
TL;DR: This dissertation presents user-space process virtualization to decouple application processes from the external subsystems and an adaptive plugin based approach is used to implement the virtualization layers that allow the checkpoint-restart system to grow organically.
Book ChapterDOI
A Comparative Cost Study of Fault-Tolerant Techniques for Availability on the Cloud
TL;DR: Two state-of-the-art fault-tolerance techniques are compared in terms of availability of services to consumers, and energy costs to Cloud providers and the results have shown that proactive fault-Tolerance technique outperforms traditional redundancy in Terms of cost to Cloud users, while providing available compute environments and Services to consumers.
References
More filters
Book ChapterDOI
Time, clocks, and the ordering of events in a distributed system
TL;DR: In this paper, the concept of one event happening before another in a distributed system is examined, and a distributed algorithm is given for synchronizing a system of logical clocks which can be used to totally order the events.
Journal ArticleDOI
Time, clocks, and the ordering of events in a distributed system
TL;DR: In this article, the concept of one event happening before another in a distributed system is examined, and a distributed algorithm is given for synchronizing a system of logical clocks which can be used to totally order the events.
Proceedings ArticleDOI
Live migration of virtual machines
Christopher Clark,Keir Fraser,Steven Hand,Jacob Gorm Hansen,Eric Jul,Christian Limpach,Ian Pratt,Andrew Warfield +7 more
TL;DR: The design options for migrating OSes running services with liveness constraints are considered, the concept of writable working set is introduced, and the design, implementation and evaluation of high-performance OS migration built on top of the Xen VMM are presented.
MPI: A Message-Passing Interface Standard
TL;DR: This document contains all the technical features proposed for the interface and the goal of the Message Passing Interface, simply stated, is to develop a widely used standard for writing message-passing programs.
Journal ArticleDOI
Distributed snapshots: determining global states of distributed systems
K. Mani Chandy,Leslie Lamport +1 more
TL;DR: An algorithm by which a process in a distributed system determines a global state of the system during a computation, which helps to solve an important class of problems: stable property detection.