Evaluation: rewrite Postman docs for Evaluation/STT/TTS#821
Evaluation: rewrite Postman docs for Evaluation/STT/TTS#821AkhileshNegi wants to merge 1 commit intomainfrom
Conversation
Bring the Evaluation, STT Evaluation, and TTS Evaluation folders of the Postman collection to a quality bar where a non-technical NGO operator can run the full lifecycle using only API calls. - Track Kaapi API'S.postman_collection.json under git for the first time. - Fix 5 collection bugs: 2 URL path errors (Get/Delete Dataset), 2 unusable Start STT/TTS bodies (`"models": ["string"]`), and 1 wrong form-data field type on Upload audio file. - Rewrite every endpoint description in the 3 eval folders with schemas, examples, errors, prerequisites, status enums, and polling guidance. - Add 3 Getting Started walkthroughs (one per domain) and a single top-level Errors & Troubleshooting reference. - Surface silent invariants (1 MB CSV cap, 200 MB audio cap, 5000-char TTS sample cap, 1-hour signed URL TTL, single supported model per provider, TTS feedback only on status==SUCCESS). - Surface capability gaps (no cancel/retry/export/bulk-feedback, no STT/TTS dataset DELETE, poll-only completion). Model Evaluation folder is intentionally untouched. Companion file: docs/postman-evaluation-changelog.md. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
Important Review skippedAuto reviews are limited based on label configuration. 🏷️ Required labels (at least one) (1)
Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Tip 💬 Introducing Slack Agent: The best way for teams to turn conversations into code.Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.
Built for teams:
One agent for your entire SDLC. Right inside Slack. Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
Summary
Target issue is #PLEASE_TYPE_ISSUE_NUMBER
Bring the Evaluation, STT Evaluation, and TTS Evaluation folders of the Postman collection to a quality bar where a non-technical NGO operator can run the full evaluation lifecycle using only API calls.
This PR also tracks
Kaapi API'S.postman_collection.jsonunder git for the first time, so future updates can flow through reviewable diffs.What changed
Evaluation→Get Dataset/Delete Dataset(/datasets/dataset_id={dataset_id}→/datasets/:dataset_id)"models": ["string"]with the actual supported model valuesUpload audio filechanged fromtype: "text"totype: "file"so multipart upload actually worksErrors & Troubleshootingreference with the global error matrix, common traps, capability gaps, and auth notestatus == SUCCESS"Out of scope
The
Model Evaluationfolder is intentionally untouched in this PR.Companion document
docs/postman-evaluation-changelog.mdlists the per-endpoint deltas alongside the import-into-fork instructions, so reviewers can scan changes without scrolling the 6500-line JSON.Checklist
Before submitting a pull request, please ensure that you mark these task.
fastapi run --reload app/main.pyordocker compose upin the repository root and test. — N/A: docs-only change to the Postman JSON; no backend code touched.jq empty+ structural assertions (folder counts, residual bug-pattern grep).Notes
docs/postman-evaluation-changelog.mdfirst, then spot-check 2–3 endpoint descriptions inside the JSON.Kaapi API'S.postman_collection.jsoninto the Postman fork ("Import → Replace" scoped to the fork) and open a Postman PR from the fork to the parent collection.🤖 Generated with Claude Code