Scrape metrics and draw the standard plots in post-run analysis - #391
Conversation
Post-run analysis covered delivery and latency only, so the resource and mesh-health half of a regression report was hand-written per campaign: six scrape-and-plot scripts across the v2.2.0 runs, none of them in the repo. Bandwidth, memory, connections and mesh degree now come out of the run itself, off its own stable window.
479def0 to
989aecf
Compare
PlotSpec held name, metrics, ylabel, scale and fig_size, which PlotConfig already has, and plot_run_metrics copied field by field into one. The standard set is now PlotConfig templates the run copies and fills in with groups and the output path. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
AlbertoSoutullo
left a comment
AlbertoSoutullo
left a comment
There was a problem hiding this comment.
_has_any() uses any(...), but MetricsPlotter processes every metric in template.metrics for every selected group. If a dump contains libp2p-in but not libp2p-out, it is included for the bandwidth plot and then fails when the missing metric produces an empty dataframe.
We shoudl make sure that all metrics exist for the plot, becuase if something is missing, it means that something weird happened.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Thanks, fixed and added a test |
2 participants
The resource and mesh health figures now come out of the run.
Includes #384, which it needs to read a scrape dump; review that one first.
Related to #158