Repository navigation
Expand file tree
/
Copy pathdata.js
More file actions
134 lines (134 loc) · 10.8 KB
/
Copy pathdata.js
File metadata and controls
134 lines (134 loc) · 10.8 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
window.PROJECTS = [
{
repo: "auto-sci-harness",
lead: "I built",
rest: "a system where an AI agent can write the code and make the claim, but cannot sign the certificate.",
standout: "Agents explore freely in a Lab, then a Court re-runs their frozen code on data held back from them, and ten mechanical checks decide whether the claim holds. No model can grant a pass.",
detail: "Each Court version must first get 11 planted claims right, including leaks, p-hacking and sabotaged baselines, before it can register a minted or sealed case. An attack museum records 65 findings against the checker: 51 fixed, 13 accepted as stated limits, 1 open.",
outcomeLabel: "Where it stands",
outcome: "Experimental, not production-grade. It has been used locally for research runs, and the first certified result is the next milestone.",
tags: ["research agents", "verification", "systems"],
hue: 190
},
{
repo: "stress-testing-weight-space-programming",
lead: "I replicated",
rest: "a headline claim about AI editing neural network weights, then found a far simpler rival.",
standout: "Turning thinking off, with no edit, reached about 76% of the edit's gain at about one-seventh of the tokens. The edit still won, 61.0% to 48.8%.",
detail: "I rebuilt the edit from its authors' published logs, tested it against simple alternatives, and ran related experiments on circuits, backdoors and sycophancy. The full run took 87 minutes on four rented RTX 5090s.",
outcomeLabel: "What it showed",
outcome: "The scores replicate: 54.0% on MATH-500 against the paper's 48.1%, and 68.0% on GSM8K against 67.1%. Thinking off used different settings, so that comparison is not matched. The LLM experiments did not run, and this is exploratory, not peer reviewed.",
tags: ["replication", "weight edits", "interpretability"],
hue: 62
},
{
repo: "flow-policy-noise-carry",
lead: "I tried",
rest: "to break a robot-policy idea on a real vision-language-action model, and found a far larger effect.",
standout: "Replanning more often gained 22.5 points on all 10 tasks when clean, then reversed to −14.0 under a 0.2 s delay. The noise-carry idea itself showed no improvement (+1.0).",
detail: "1,600 paired episodes with SmolVLA on LIBERO on four RTX 5090s, with 0 start-state mismatches, decision rules written first, and a screen that predicted the negative result in under 20 minutes.",
outcomeLabel: "What it showed",
outcome: "The delay reversal was not the planned test, so it is a strong lead to confirm on fresh tasks. This is one checkpoint in simulation and says nothing about real hardware.",
tags: ["robotics", "flow matching", "benchmarking"],
hue: 214
},
{
repo: "how-networks-forget",
lead: "I caught",
rest: "a plain memory probe reporting memory that controlled tests could not find.",
standout: "After 5 later tasks, the probe still read 0.49 retained while scoring 0.317 on the trained task and 0.321 on tasks the network never saw. Measured at 2 labelled images per class.",
detail: "Six hypotheses on whether forgetting is overwriting or lost access, each committed before its data. The two main experiments took their verdicts from 20 fresh seeds per setting, with constants set blind on separate seeds.",
outcomeLabel: "What it showed",
outcome: "The gap was 0.41 [0.35, 0.47] on ResNet-18 and Split CIFAR-100. That raises a question about published probe readings without refuting them, and real memory does survive: stronger keys reached 0.39 and 0.54. No biology-to-AI mapping was supported.",
tags: ["forgetting", "memory", "preregistered"],
hue: 172
},
{
repo: "world-model-adaptation-vs-retention",
lead: "I reproduced",
rest: "and extended JEPA-TTT, then tested what the paper never reported: what adapting forgets.",
standout: "At x16 updates, AUC passed the paper's on grid (0.773 vs 0.725) and wave (0.767 vs 0.728), on different checkpoints. A frozen-plus-calibrated model nearly matched that on wave (0.757) and scored 0.807 right after the world switched back.",
detail: "I found no official code, so I implemented the method from the paper on the Two-Room task, using the public LeWorldModel checkpoint, then added a switch-back test and five further ideas with pass or fail rules set in advance.",
outcomeLabel: "What it showed",
outcome: "On wave, fine-tuning forgets the old world (0.320 right after switching back) while a small action translator barely does (0.753, against 0.812 frozen). At the paper's own update rate I scored below it, the paper partly reproduced, and the combined model's pass is partly by construction. 3 seeds, one task.",
tags: ["reproduction", "world models", "retention"],
hue: 118
},
{
repo: "physics",
lead: "I asked",
rest: "171 questions that climb from why glass doors push one way to what a falling notebook falls into.",
standout: "One line of questioning became a closed antimatter engine, and my own energy account correctly shows why it can't deliver net work.",
detail: "The questions keep their original wording. They run through friction, entropy, relativity, black holes, time loops, Boltzmann brains and whether a thought can be made of atoms. Seven sections and 59 verification scripts back the answers.",
outcomeLabel: "Where it stands",
outcome: "Every answer carries a label for its support, from Derived and Code to Open and Speculative. Where no proof is possible, the answer says so. It has not been peer reviewed.",
tags: ["physics", "black holes", "thought experiments"],
hue: 140
},
{
repo: "world-model-adaptation",
lead: "I put",
rest: "test-time world-model adaptation up against kill criteria written before the results existed.",
standout: "A result that held from state broke from pixels. Of 14 scored hypotheses, 9 were killed by their own criteria.",
detail: "Latent tuning against closed-form weight writes on simulated pendulum, puck and drone, with 20 training seeds, 674 passing tests and 105 pixel comparisons recomputed from raw records with no disagreement.",
outcomeLabel: "What it showed",
outcome: "From state, each method won its own regime; from pixels, the latent won both. The method with the lowest prediction error had the lowest control success, though the gaps to RLS were below my effect rule. Pixel verdicts cover pendulum only, in small simulators.",
tags: ["world models", "adaptation", "control"],
hue: 322
},
{
repo: "falsifiable-dl-math",
lead: "I traced",
rest: "a transformer's collapse past its training length from suspected bug to measured mechanism.",
standout: "Loss jumps from 1.48 to about 5 bits per byte, and removing the far tokens from attention brings it back to 1.49. ALiBi stayed flat to 8x training length. Toy run, 2 seeds.",
detail: "Eight hypotheses on the math of deep learning, with derivations, numeric checks and kill criteria set before the runs (one closed-form check is the exception), including exact identities for Adam's epsilon. My mistakes stay on the record.",
outcomeLabel: "What it showed",
outcome: "No new method of mine has beaten a tuned baseline so far. What I have is verified mathematics, clear negative results and a diagnosis. The full long-context run is still pending.",
tags: ["attention", "optimizers", "long context"],
hue: 38
},
{
repo: "continual-learning-experiments",
lead: "I ran",
rest: "five linked projects on how a learner can keep improving without losing what it knows.",
standout: "Forgetting here was mostly lost access: refitting only the last layer gave 70.6%, against 41.5% as trained and 73.5% for joint training. Toy scale.",
detail: "A record spanning continual learning, memory, world models and robot learning, failures included. A fresh re-implementation flipped two of my conclusions, and an outside audit caught another error.",
outcomeLabel: "What it showed",
outcome: "Most ideas tested lost, and the strongest results explain why. Everything is small: toys, Split-MNIST and Split CIFAR. Nothing has run on a robot.",
tags: ["continual learning", "memory", "world models"],
hue: 268
},
{
repo: "transfer",
lead: "I built",
rest: "the first stage of a robot arm world model that keeps learning during deployment. Execution unfinished.",
standout: "Baseline B1 is coded: LoRA and token-residual adapters, replay, a promotion gate with rollback, six-joint planning and a shadow-mode online loop, tested on CPU against the real predictor code.",
detail: "A full mathematical and implementation specification for the SO-101 arm, with a source audit, and working code for its first baseline: a frozen RoboJEPA representation, a servo bridge and persistent adaptation of small layers.",
outcomeLabel: "Where it stands",
outcome: "Released weights, real data, GPUs and a real arm have not been run yet, so whether adaptation helps on real data is still open. The live robot driver and the recurrent belief are not built.",
tags: ["robotics", "world models", "unfinished"],
hue: 346
},
{
repo: "llm-introspection-probes",
lead: "I tested",
rest: "whether a model naming an injected concept is introspection or something simpler.",
standout: "The injected position still gained when the prompt never asked about injection, which looks more like salience capture than a report. On one small model.",
detail: "Preregistered experiments with competence gates, sham checks and random-direction controls. CI recomputes the results table and fails if the README disagrees. One experiment has data; two more are built and have not run.",
outcomeLabel: "What it showed",
outcome: "Logit lift was above zero in all six conditions. Capture verdict mixed, generic anomaly supported, control strength uninformative. The salience reading was not preregistered, and it is one model, not replicated at 4B or above.",
tags: ["interpretability", "introspection", "preregistered"],
hue: 96
},
{
repo: "sleep",
lead: "I tested",
rest: "whether a small language model can consolidate new facts offline without destroying what it knows.",
standout: "Anchoring on the model's own questions kept 26 points more real knowledge than replay plus KL while still learning new facts. 3 seeds, 2 nights, exploratory.",
detail: "It began as a bet that a measured signal could control consolidation better than a schedule. That signal failed its tests, so I abandoned it and followed what the data showed.",
outcomeLabel: "What it showed",
outcome: "Composed facts told outright reached reworded questions. False recall on look-alike names is unsolved, nothing is confirmed yet, and a ten-night confirmatory run is planned, not done.",
tags: ["consolidation", "language models", "preregistered"],
hue: 12
}
];