Skip to content

Conversation

@rfhaque
Copy link
Collaborator

@rfhaque rfhaque commented Jul 21, 2025

Description

This PR fixes the babelstream benchmark. Supersedes #639. Closes #615.
Tested on tuolumne (openmp, rocm modes) and matrix (cuda mode)

Currently the application uses a source repo that implements caliper. The following steps must be completed before this PR can be merged

Adding/modifying a benchmark (docs: Adding a Benchmark)

  • If package.py upstreamed to Spack is insufficient, add/modify repo/benchmark_name/package.py plus: create, self-assign, and link here a follow up issue with a link to the PR in the Spack repo.
  • Add/modify an experiments/benchmark_name/experiment.py to define a single node and multi-node experiments
  • Add/modify a dry run unit test in .github/workflows/run.yml

@rfhaque rfhaque requested a review from pearce8 July 21, 2025 02:53
@github-actions github-actions bot added experiment New or modified experiment ci CI, unit tests, GitHub actions application labels Jul 21, 2025
@codecov-commenter
Copy link

codecov-commenter commented Jul 21, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 40.82%. Comparing base (143e691) to head (9a48c56).

Additional details and impacted files
@@           Coverage Diff            @@
##           develop     #910   +/-   ##
========================================
  Coverage    40.82%   40.82%           
========================================
  Files           22       22           
  Lines         1536     1536           
  Branches       219      219           
========================================
  Hits           627      627           
  Misses         864      864           
  Partials        45       45           
Flag Coverage Δ
unittests 40.82% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pearce8 pearce8 marked this pull request as ready for review September 5, 2025 12:52
Copy link
Collaborator

@scheibelp scheibelp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one compatibility issue w/ #953

import re # To get the variant name after (+)

from spack.package import *
from spack.pkg.builtin.babelstream import Babelstream as BuiltinBabel
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

referring to builtin changed w/ #953 - see https://github.com/LLNL/benchpark/blob/develop/repo/blt/package.py for example of how to import from builtin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

application ci CI, unit tests, GitHub actions experiment New or modified experiment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Babelstream: update package

6 participants