Time-Independent Experiment Reproducibility: Turning the WalT Platform into a Time Machine
Résumé
This paper concerns the problem of testing wireless networks in a way that guarantees repeatability and reproducibility of experiments. To contribute to this research objective, we have developed WalT, a reproducible platform for running reproducible experiments~\cite{walt2016}. WalT nodes are single-board computers on which users can deploy their OS (filesystem, kernel) packaged as a docker image for easy customization and sharing. With low-cost small-sized standard components and free software, researchers can easily reproduce their own WalT platforms to validate results in real-world conditions. They can set up WalT nodes on a desk to make the debugging process and the use of low level measurement tools like oscilloscopes much easier. WalT can also support mobile demos that you can bring to a demo room in your backpack. The total control of WalT nodes allows setting up diverse experiment scenarios ranging, for instance, from Wi-Fi handover measurements to evaluating routing protocols in wireless sensor networks
In this paper, we have addressed the issue of providing support for reproducibility and repeatability of experiments over time. Our experience with WalT shows that investigators often need to reproduce experiments done earlier in a specific configuration, which is difficult if the experimental platform has evolved. Based on the current developments of WalT, we propose several mechanisms for keeping track of modifications and being able to roll back to a given version in the past.