Skip to main navigation Skip to search Skip to main content

HPC ODA Commons: Community-Governed Contracts and Toolkit for Reproducible Operational Data Analytics

  • Lawrence Berkeley National Laboratory
  • Barcelona Supercomputing Center

Research output: Contribution to conference › Paper

Abstract

High-Performance Computing (HPC) facilities generate vast quantities of operational data, yet turning this data into actionable insight remains hindered by fragmented, site-specific analytics pipelines. Results from one site cannot easily be compared with another, and promising methods stay siloed because there is no shared language for describing the data, the experiments, or the outcomes. We present HPC ODA Commons, an open-source, CLI-first toolkit that establishes community-governed contracts in the form of versioned schemas, canonical artifacts, and benchmark recipes for HPC Operational Data Analytics (ODA). The toolkit ingests heterogeneous site-specific data into a standardized format, evaluates predictive models through reproducible recipe-driven benchmarks, and can aggregate results into leaderboards for cross-site comparison, all without requiring data to leave the local cluster. Version 0.1 targets job runtime prediction, shipping three models: a mean-prediction baseline, an XGBoost model with rolling-window evaluation, and a TF-IDF + kNN text-similarity model. We describe the architecture, demonstrate results on two supercomputer datasets totaling 13 million jobs, and show how the toolkit's structured, declarative design makes it well-suited to operation by AI coding agents. HPC ODA Commons is available as open-source software under a BSD-3-Clause license.
Original languageAmerican English
Number of pages6
DOIs
StatePublished - 2026
EventPEARC '26: Practice and Experience in Advanced Research Computing - Minneapolis, Minnesota
Duration: 26 Jul 2026 → 30 Jul 2026

Conference

ConferencePEARC '26: Practice and Experience in Advanced Research Computing
CityMinneapolis, Minnesota
Period26/07/26 → 30/07/26

NLR Publication Number

  • NLR/CP-2C00-102297

Keywords

  • benchmarking
  • community standards
  • HPC
  • operational data analytics
  • reproducibility
  • runtime prediction

Fingerprint

Dive into the research topics of 'HPC ODA Commons: Community-Governed Contracts and Toolkit for Reproducible Operational Data Analytics'. Together they form a unique fingerprint.

Cite this