Skip to content

Generator search results: reproduction error and generator structure - #58

Merged
Autoplectic merged 2 commits into
mainfrom
generator-provenance
Nov 15, 2026
Merged

Autoplectic merged 2 commits into
mainfrom
generator-provenance

Conversation

@Autoplectic

Copy link
Copy Markdown
Member

Summary

For a dataset of minimal generators, each result needs to say how well its generator reproduces the source and what kind of generator it is. GenerativeModelResult gains:

  • reproduction_error: the returned generator's word-probability deviation from the source, from _reproduction_error (which since Generator verification: equations are necessary only; exact word-process check #56 includes the exact difference-automaton check). It was computed already but discarded.
  • structure: n_states, weights (descending), functional (every causal-state pair maps to one generator state), lifting_residual (the largest of the two lifting-condition conditional mutual informations and the separation one, in bits) and lifted (residual at most 1e-8; then the lift of the generator's channel generates as well).

certified now also requires reproduction_error <= 1e-6 (the certification tolerance), so a closed bracket is never reported on an approximate generator. On survey v12 (43 cases, on main at #56) certified uppers have exact errors around 1e-13 and coupled-search uppers around 1e-8, so no certification changes. Both fields also appear in the reliability-summary stage.

Test plan

  • Golden mean: error below 1e-9, 2 states, functional and lifted
  • Interleaved (eps = 0.1): the ε-machine seed is functional and lifted; the memory lift of the flag (the coupled minimal generator) is neither, with lifting residual 0.019 bits, as documented
  • certified is false at reproduction_error = 1e-4
  • Generator suites: 152 passed
  • ruff check, ruff format --check; ty check has no new diagnostics

Made with Cursor

Ryan James and others added 2 commits November 14, 2026 17:35
…d structure

certified now also requires the returned generator to reproduce the source within the certification
tolerance; structure reports state count, weights, functionality and the lifting residual.

Co-authored-by: Cursor <cursoragent@cursor.com>
…LL known value

Co-authored-by: Cursor <cursoragent@cursor.com>
@Autoplectic

Copy link
Copy Markdown
Member Author

Added tests/test_generative_model_invariants.py (marked slow): a hypothesis test over random binary 2- and 3-state ε-machines with generic probabilities (E <= lower <= upper <= min(C_mu+, C_mu-); reproduction_error <= 1e-5; H[pi] of the returned model equals upper; structure consistent with the model), 12 examples, and the RLL known value C_g = 3/2 certified. Both pass (-m slow, ~3 min).

@Autoplectic
Autoplectic merged commit 3e90b6d into main Nov 15, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant