Skip to content

Make benchmark report indicators configurable - #1910

Merged
jprendes merged 1 commit into
hyperlight-dev:mainfrom
jprendes:update-criterion-markdown-emojis
Oct 8, 2026
Merged

jprendes merged 1 commit into
hyperlight-dev:mainfrom
jprendes:update-criterion-markdown-emojis

Conversation

@jprendes

@jprendes jprendes commented Oct 8, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Update criterion-markdown to 0.3.0.
  • Group report ratios under [thresholds] and indicators under [thresholds.emojis].
  • Configure distinct regression, stable, improvement, and strong improvement icons.

Testing

  • just fmt-apply
  • cargo test --locked -p hyperlight-ci
  • just clippy
  • Remaining just test subrecipes

The full unit stage passed 483 tests and reached the known host dependent kvm_does_not_expose_cet_to_guest failure.

Update criterion-markdown to 0.3.0 and read grouped threshold and emoji settings from bench_report.toml. Preserve command-line threshold precedence and renderer defaults.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: Jorge Prendes <jorge.prendes@gmail.com>
Copilot AI balanced review requested due to automatic review settings October 8, 2026 21:02
@jprendes jprendes added C-deps For PRs that update dependencies or related components A-deps Concerns dependencies or related components A-infra Concerns infrastructure rather than core functionality S-needs-review PR is ready for (re-)review labels Oct 8, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The breaking configuration migration needs a changelog entry.

1 open finding
What changed in this PR

Makes benchmark report thresholds and indicators configurable through the report configuration.

Changes:

  • Upgrades criterion-markdown to 0.3.0.
  • Groups ratios under [thresholds].
  • Adds configurable classification icons under [thresholds.emojis].
File Description
src/​hyperlight_ci/​src/​config.rs Adds nested threshold and indicator configuration.
src/​hyperlight_ci/​src/​bench_report.rs Applies configured thresholds and icons.
src/​hyperlight_ci/​Cargo.toml Upgrades criterion-markdown.
Cargo.lock Locks version 0.3.0.
bench_report.toml Configures report ratios and icons.

🧠 Review effort: Balanced


💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread bench_report.toml Resolved
@jprendes
jprendes merged commit a57d07e into hyperlight-dev:main Oct 8, 2026
67 of 68 checks passed
@github-actions github-actions Bot removed the S-needs-review PR is ready for (re-)review label Oct 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-deps Concerns dependencies or related components A-infra Concerns infrastructure rather than core functionality C-deps For PRs that update dependencies or related components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants