Repository navigation
[executorch][native] Judge engine outputs against golden and precise samples - #24359
digantdesai wants to merge 3 commits into
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24359
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New FailureAs of commit c9bffde with merge base 0f8e096 ( NEW FAILURE - The following job has failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
SS-JIA
left a comment
There was a problem hiding this comment.
Review automatically exported from Phabricator review in Meta.
Stack from ghstack (oldest at bottom):
A fixed tolerance either hides engine bugs or fails legitimate numerics, so an engine is judged by its distance from
preciserelative to eager's.OutputCheckbounds RMSE and max error by multiples of eager's plusrtol, and the fitted absolute and relative bias likewise, plussigmasstandard errors. Non-finite values must equal golden. CMake builds it and its test too.Authored with Claude Code.
@bypass-github-export-checks
@bypass-github-pytorch-ci-checks
@bypass-github-executorch-ci-checks
@exported-using-ghexport
Differential Revision: D128254878
Differential Revision: D128254878