Skip to Main content Skip to Navigation
Journal articles

Automatic benchmark profiling through advanced workflow-based trace analysis

Alexis Martin 1 Vania Marangozova-Martin 2, 3
1 POLARIS [2016-2019] - Performance analysis and optimization of LARge Infrastructures and Systems [2016-2019]
Inria Grenoble - Rhône-Alpes, LIG [2016-2019] - Laboratoire d'Informatique de Grenoble [2016-2019]
2 ERODS [2016-2019] - Efficient and Robust Distributed Systems [2016-2019]
LIG [2016-2019] - Laboratoire d'Informatique de Grenoble [2016-2019]
Abstract : Benchmarking has proven to be crucial for the investigation of the behavior and performances of a system. However, the choice of relevant benchmarks still remains a challenge. To help the process of comparing and choosing among benchmarks, we propose a solution for automatic benchmark profiling. It computes unified benchmark profiles reflecting benchmarks' duration, function repartition, stability, CPU efficiency, parallelization, and memory usage. Our approach identifies the needed system information for profile computation and collects it from execution traces captured without benchmark code modifications. It structures profile computation as a reproducible workflow for automatic trace analysis, which efficiently manages important trace volumes. In this paper, we report on the design and the implementation of our approach, which involves the collection and analysis of about 500 GB of trace data coming from 2 different platforms (an x86 desktop machine and the Juno SoC board). The computed benchmark profiles provide valuable insights about the benchmarks' behavior and help compare different benchmarks on the same platform as well as the behavior of the same benchmark on different platforms.
Document type :
Journal articles
Complete list of metadatas

Cited literature [59 references]  Display  Hide  Download

https://hal.inria.fr/hal-02047273
Contributor : Vania Marangozova-Martin <>
Submitted on : Wednesday, March 6, 2019 - 5:37:34 PM
Last modification on : Thursday, August 6, 2020 - 3:03:55 AM
Document(s) archivé(s) le : Friday, June 7, 2019 - 5:59:30 PM

File

spedoc.pdf
Files produced by the author(s)

Identifiers

Citation

Alexis Martin, Vania Marangozova-Martin. Automatic benchmark profiling through advanced workflow-based trace analysis. Software: Practice and Experience, Wiley, 2018, 48 (6), pp.1195-1217. ⟨10.1002/spe.2570⟩. ⟨hal-02047273⟩

Share

Metrics

Record views

161

Files downloads

509