Accurate Synthetic Tasks for Scientific Workflow Benchmarks
| Author: | Wies, T., Kharma, S., Meuser, T., & Scheuermann, B. |
| Published in: | Proceedings of the 26th IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid ‘26) |
| Year: | 2026 |
| Type: | Academic articles |
| DOI: | 10.1109/CCGridW69005.2026.00014 |
Scientific workflows are fundamental for automating complex data processing tasks. Research on workflow scheduling and execution strategies often relies on real-world workflows for testing and validation. The setup of such workflows is time-consuming and error-prone due to their dependence on large datasets, specialized software, or specific hardware requirements. Synthetic workflows have been proposed as a solution, offering realistic benchmarking scenarios. Existing workload generators, however, primarily model tasks based on aggregated resource consumption metrics, such as total CPU time or peak memory usage, which do not capture the dynamic resource usage patterns exhibited by real-world tasks. This limits the expressiveness of experiments performed on synthetic workflows. In this work, we introduce a novel approach for generating synthetic workflow tasks that capture dynamic resource usage patterns. In addition, we derive realistic task models by monitoring real workflow task executions and applying segmented linear regression to the measurement data. These models serve as the basis for generating synthetic tasks. Our method allows researchers to create synthetic workflows that more accurately reflect the behavior of real-world scientific workflows, while still being efficient and without requiring external datasets.
| Visit publication |

HIIG Forscher*in
Björn Scheuermann, Prof. Dr.
- Peer Reviewed
Die HIIG DNA
Forschung und Dialog
Wir stellen an unsere Forschungspraxis den Anspruch, wissenschaftliche Erkenntnis und gesellschaftlichen Dialog zu verschränken.
