Skip to content

test(studio): an edit accuracy benchmark for manual editing #4760

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
miguel-heygen merged 14 commits into from
Sep 30, 2026
+1,961 −0
Merged

test(studio): an edit accuracy benchmark for manual editing #4760

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
fb7a639
test(studio): start an edit accuracy benchmark for manual editing (wo…
miguel-heygen Sep 30, 2026
ff6d3cb
test(studio): an edit accuracy benchmark for manual editing
miguel-heygen Sep 30, 2026
acba134
test(studio): move render drift out of the first benchmark PR
miguel-heygen Sep 30, 2026
ea12047
test(studio): keep the edit accuracy bench clean under fallow
miguel-heygen Sep 30, 2026
27c03ac
test(studio): report edit accuracy with the Studio and bench commits …
miguel-heygen Sep 30, 2026
79041f0
test(studio): bank the edit accuracy baseline measured on main
miguel-heygen Sep 30, 2026
85ed581
test(studio): state the edit accuracy build prerequisite in the runne…
miguel-heygen Sep 30, 2026
f277639
test(studio): keep the edit accuracy baseline one line per case under…
miguel-heygen Sep 30, 2026
610ccc8
test(studio): store edit accuracy baseline values rounded up
miguel-heygen Sep 30, 2026
7bc98a2
test(studio): score edit smoothness on dropped frames and main-thread…
miguel-heygen Sep 30, 2026
9d11257
test(studio): measure edit accuracy on a still preview and score pres…
miguel-heygen Sep 30, 2026
f1797b5
test(studio): stamp the edit accuracy build with the Studio bundle as…
miguel-heygen Sep 30, 2026
23e0109
test(studio): regenerate the edit accuracy baseline on main after the…
miguel-heygen Sep 30, 2026
283476f
test(studio): wait for each edit accuracy undo write before sending redo
miguel-heygen Sep 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .prettierignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,9 @@ packages/gcp-cloud-run/terraform/workflow.yaml
# toMatchFileSnapshot golden files — vitest writes these; oxfmt must not reformat them.
packages/**/__goldens__/

# Edit accuracy baseline, written by the bench one line per case so a diff reads case by case.
packages/studio/tests/e2e/edit-accuracy/baseline.json

# vendored third-party bundles inside skills — never reformat
skills/**/assets/vendor/
skills/**/*.min.js
Expand Down
1 change: 1 addition & 0 deletions packages/studio/package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,6 +75,7 @@
"build": "vite build && tsup",
"typecheck": "tsc --noEmit",
"test": "vitest run",
"test:edit-accuracy": "bun tests/e2e/edit-accuracy/run.mjs",
"test:webmcp-edit-loop": "node tests/e2e/webmcp-edit-loop.mjs",
"test:timeline-virtualization": "TIMELINE_ROW_VIRTUALIZATION=on TIMELINE_ELEMENT_COUNT=50000 node tests/e2e/timeline-virtualization.mjs",
"test:watch": "vitest",
Expand Down
668 changes: 668 additions & 0 deletions packages/studio/tests/e2e/edit-accuracy/baseline.json
View file
Open in desktop

Large diffs are not rendered by default.

Loading
Loading