Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 7 additions & 5 deletions .github/workflows/model-evaluation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -87,18 +87,20 @@ jobs:
- name: Download all results
uses: actions/download-artifact@v8
with:
# Download all artifacts instead of using pattern matching.
# When pattern matches a single artifact, download-artifact extracts
# it directly into the path without creating a subdirectory, breaking
# the expected path structure. Downloading all artifacts always creates
# per-artifact subdirectories.
pattern: eval-results-*
path: eval-results

- name: Update model evaluation docs
run: |
MODELS="${{ inputs.models || 'gpt-5-mini' }}"
for MODEL in $(echo "$MODELS" | tr ',' ' '); do
# download-artifact@v8 creates per-artifact subdirectories only when
# multiple artifacts are downloaded. With a single artifact it extracts
# directly into the target path. Check both locations.
RESULTS_FILE="eval-results/eval-results-${MODEL}/mcpchecker-stackrox-mcp-e2e-out.json"
if [ ! -f "$RESULTS_FILE" ]; then
RESULTS_FILE="eval-results/mcpchecker-stackrox-mcp-e2e-out.json"
fi
if [ -f "$RESULTS_FILE" ]; then
echo "Updating docs for model: ${MODEL}"
./scripts/update-model-evaluation.sh \
Expand Down
Loading