Repository navigation
feat(ingest): per-run ingest report and PR callback / ingest：按运行统计的报告与 PR 回调 - #1495
Merged
Merged
Conversation
Count what each ingest-ci-run invocation wrote per category (benchmark, eval, trace, power) and outcome (new, duplicate, skipped, unmapped, failed). Write it to INGEST_REPORT_OUTPUT and the job summary on success and failure, retain it as an artifact, and send ingest-results-completed to BENCHMARK_REPO for dispatched merge ingests so the merged PR gets a comment. 中文：新增按运行统计的 ingest 报告与 InferenceX 回调。按类别（benchmark、eval、trace、power）和结果（new、duplicate、skipped、unmapped、failed）统计每次 ingest-ci-run 写入的数据，成功与失败时都写入 INGEST_REPORT_OUTPUT 和 job summary 并保留为 artifact；对通过 dispatch 触发的合并 ingest，向 BENCHMARK_REPO 发送 ingest-results-completed，以便在已合并的 PR 上评论。
Bugbot is paused — your team has an unpaid invoiceBugbot is paused because your team has an unpaid invoice. Pay it from the billing page in the Cursor dashboard and Bugbot resumes automatically. (requestId: a6c14848-0d30-4a68-b78c-28b63a8f19d7) |
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This comment has been minimized.
This comment has been minimized.
…omment / 移除 ingest-report 工件上传，保留作业摘要与 PR 评论
Bugbot is paused — your team has an unpaid invoiceBugbot is paused because your team has an unpaid invoice. Pay it from the billing page in the Cursor dashboard and Bugbot resumes automatically. (requestId: 4971ec1f-7060-4acd-9837-cd4cf18f8a15) |
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The ingest log prints per-file lines like
benchmark rows: +1 new, 0 dup, 1 id(s), anddb:verifyprints whole-database totals, so confirming what one run actually wrote means grepping logs. Nobody on the InferenceX PR hears whether its ingest landed.Change
New
packages/db/src/etl/ingest-run-report.ts:ingest-ci-runcounts what this run wrote, by category and outcome:plus detail (files, raw rows, run stats, eval samples, gpu samples, PowerX points, changelog entries) and unmapped names.
The report is written in the existing
finally, so it exists on failure too: JSON atINGEST_REPORT_OUTPUT, Markdown table appended to$GITHUB_STEP_SUMMARY. Status becomesfailedon an exception or recorded DB write errors.ingest-results.ymlfor dispatched merge ingests only (ingest-results/ingest-agentic-results), sendsingest-results-completedtoBENCHMARK_REPOwithsecrets.PAT, mirroringstage-results-completed. The step runs onalways()and iscontinue-on-error, so a callback problem never fails an ingest.Companion: feat(ingest): comment app ingest reports on the merged PR / ingest：在已合并的 PR 上评论 app 的 ingest 报告 InferenceX#4503 resolves the merged PR from the Merge Ingest run and comments the counts (one marker comment per merge run, updated in place).
Maintainer action:
PATalready sends the staging dispatches to InferenceX; no new secret. It must be readable by this workflow'srepository_dispatchruns (it is a repo secret, so it is). Merge the InferenceX PR first or the dispatches land with no listener (harmless).No database ingest was run while preparing this PR.
AI model disclosure
Prepared with Claude Opus 5.5 (
claude-opus-5-5), which wrote the code, tests and description. No delegated agents.中文
目前 ingest 日志只按文件打印
benchmark rows: +1 new, 0 dup之类的行，db:verify只输出整个数据库的总数，要确认某次运行实际写入了什么只能 grep 日志；InferenceX PR 上也没有人收到 ingest 成功或失败的通知。本 PR 新增
ingest-run-report.ts，由ingest-ci-run按类别（benchmark、eval、trace、power）和结果（new、duplicate、skipped、unmapped、failed）统计本次运行写入的数据。报告在已有的finally中写出，因此失败时也会生成：JSON 写入INGEST_REPORT_OUTPUT，Markdown 表格追加到$GITHUB_STEP_SUMMARY。对于通过 dispatch 触发的合并 ingest，workflow 使用secrets.PAT向BENCHMARK_REPO发送ingest-results-completed（与stage-results-completed相同的模式），由配套的 InferenceX PR 在已合并的 PR 上发布或原地更新评论。该步骤continue-on-error，回调失败不会导致 ingest 失败。无需新增 secret。