Extra-P – Empirical Performance Modeling Made Easy

Alexandru Calotoiu¹Marcin Copik¹Fabian Czappa²Alexander Geiss²Gustavo Morais²Marcus Ritter³Sergei Shudler⁴Torsten Hoefler¹Felix Wolf^2*

• ¹Eidgenossische Technische Hochschule Zurich Departement Informatik, Zürich, Switzerland
• ²Technische Universitat Darmstadt, Darmstadt, Germany
• ³ABB AG, Mannheim, Germany
• ⁴e.solutions GmbH, Erlangen, Germany

High-performance computing (HPC) applications face challenges in achieving scalability, with bottlenecks often discovered only late in the development cycle. Performance modeling offers a means to predict and understand scalability, but analytical approaches require deep expertise and are often impractical for large, complex codes. To address this, the Extra-P project provides a user-friendly tool for empirical performance modeling, enabling automated model generation from a small number of carefully selected experiments. This paper presents an overview of Extra-P, its underlying methodology—the Performance Model Normal Form (PMNF)—and its evolution into a mature tool for detecting and analyzing scalability issues. We discuss strategies to reduce experiment costs through parameter selection, sparse modeling, and Gaussian process regression, as well as techniques for mitigating the impact of noise using iterative refinement and deep learning. Furthermore, we highlight novel use cases, including segmented modeling and validation of user expectations, and of course demonstrate how Extra-P can uncover hidden bottlenecks in real-world applications such as HOMME or MPI libraries. Finally, we outline the software's architecture and future directions, emphasizing the potential for integration with AI-driven methods and adaptation to increasingly heterogeneous hardware.