Skip to content

Accurate Synthetic Tasks for Scientific Workflow Benchmarks

Author: Wies, T., Kharma, S., Meuser, T., & Scheuermann, B.
Published in: Proceedings of the 26th IEEE International Symposium on Cluster, Cloud and Internet Computing (CCGrid ‘26)
Year: 2026
Type: Academic articles
DOI: 10.1109/CCGridW69005.2026.00014

Scientific workflows are fundamental for automating complex data processing tasks. Research on workflow scheduling and execution strategies often relies on real-world workflows for testing and validation. The setup of such workflows is time-consuming and error-prone due to their dependence on large datasets, specialized software, or specific hardware requirements. Synthetic workflows have been proposed as a solution, offering realistic benchmarking scenarios. Existing workload generators, however, primarily model tasks based on aggregated resource consumption metrics, such as total CPU time or peak memory usage, which do not capture the dynamic resource usage patterns exhibited by real-world tasks. This limits the expressiveness of experiments performed on synthetic workflows. In this work, we introduce a novel approach for generating synthetic workflow tasks that capture dynamic resource usage patterns. In addition, we derive realistic task models by monitoring real workflow task executions and applying segmented linear regression to the measurement data. These models serve as the basis for generating synthetic tasks. Our method allows researchers to create synthetic workflows that more accurately reflect the behavior of real-world scientific workflows, while still being efficient and without requiring external datasets.

Visit publication

Publication

Connected HIIG researchers

Björn Scheuermann, Prof. Dr.

Associated Research Director


  • Peer Reviewed

The HIIG DNA

Research and dialogue

In our research practice, scientific insight and societal dialogue are deliberately intertwined.