E58: on a 7-joint arm (Pusher), the curves miss most faults, the step ledger catches every one, and no fault the curves miss leaves a worse policy - #126
Merged
Conversation
…usher, a 7-joint arm, do E54-E57's findings hold? E54's 21 client faults and 2 log faults at doses one, 0.01 and 1.0 on Pusher-v5, 409,600 steps; seeds 0-2 traced, ledgered and evaluated on a clean environment, seeds 10-19 fault-free; 226 runs. Status rule: last tenth of the log beats the first by 36 (half the budget pilot's gain). P1 covers the final-obs faults: every Pusher episode ends at the time limit. verdicts.py is committed here, before any registered run.
…iss most faults, the step ledger catches and locates every one, and no fault the curves miss leaves a worse policy 226 of 226 runs; V1-V2 and P1-P9 hold. Status rule 0/3/21 of 63 client-fault runs at doses one/0.01/1.0; byte identity 189/189 (final-obs included); ledger 189/189 with no false alarm in 27; ledger or record 207/207. Clean evaluation: 0 of 155 runs silent on both curve checks harmed; all 30 harmed runs were caught by a curve check.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
E54's 21 client faults and 2 log faults on Pusher-v5 at doses one, 0.01 and 1.0, 409,600 steps, seeds 0-2 traced, ledgered and evaluated on a clean environment, seeds 10-19 fault-free; 226 runs, every check and prediction holds (results/verdicts.txt).
The protocol and verdicts.py were committed (67db23d) before the registered runs.