Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival - Archive ouverte HAL Access content directly
Conference Papers Year :

Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival

(1) , (2) , (3) , (4)
1
2
3
4

Abstract

Speculative execution can significantly improve the performance of Big Data applications by launching other copies of stragglers (slow tasks). Stragglers detection plays an important role in the effectiveness of speculative execution. The methods employed to detect stragglers use the information extracted from the last received heartbeats which may be outdated when triggering detection. This, in turn, can mislead Big Data analytic systems to make wrong detection with high inaccuracy. To shed the light on this issue, we carry out extensive simulations to identify how heartbeat arrival, task starting times, and detection methods impact the accuracy of stragglers detection in Big Data analytic systems. We reveal that the asynchrony in heartbeat arrivals not only lead to marking normal tasks as stragglers (false positives) but can also result in overlooking real stragglers (false negatives).
Fichier principal
Vignette du fichier
CCGrid'22-CR.pdf (395.95 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03777656 , version 1 (08-12-2022)

Identifiers

Cite

Thomas Lambert, Shadi Ibrahim, Twinkle Jain, David Guyon. Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival. CCGrid 2022 - 22nd International Symposium on Cluster, Cloud and Internet Computing, May 2022, Taormina, Italy. pp.747-751, ⟨10.1109/CCGrid54584.2022.00084⟩. ⟨hal-03777656⟩
27 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More