Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival - IMT - Institut Mines-Télécom Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival

Résumé

Speculative execution can significantly improve the performance of Big Data applications by launching other copies of stragglers (slow tasks). Stragglers detection plays an important role in the effectiveness of speculative execution. The methods employed to detect stragglers use the information extracted from the last received heartbeats which may be outdated when triggering detection. This, in turn, can mislead Big Data analytic systems to make wrong detection with high inaccuracy. To shed the light on this issue, we carry out extensive simulations to identify how heartbeat arrival, task starting times, and detection methods impact the accuracy of stragglers detection in Big Data analytic systems. We reveal that the asynchrony in heartbeat arrivals not only lead to marking normal tasks as stragglers (false positives) but can also result in overlooking real stragglers (false negatives).

Domaines

Informatique
Fichier principal
Vignette du fichier
CCGrid'22-CR.pdf (395.95 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03777656 , version 1 (08-12-2022)

Licence

Paternité

Identifiants

Citer

Thomas Lambert, Shadi Ibrahim, Twinkle Jain, David Guyon. Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival. CCGrid 2022 - 22nd International Symposium on Cluster, Cloud and Internet Computing, May 2022, Taormina, Italy. pp.747-751, ⟨10.1109/CCGrid54584.2022.00084⟩. ⟨hal-03777656⟩
116 Consultations
68 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More