← Back to 20260208 Archive
Experiment Dashboard: Factor Map & Reverse Isomorphism
2-offset conjunctions, neuron ablation, state features, UM superset, reverse construction
Dominant Offset Pairs Across 128 Neurons
Top 20 Neurons by Ablation Importance
BPC Cascade: Building Up the Factor Map
No model
4.74
bpc (marginal)
2-offset only
0.85
bpc
+word_len
0.50
bpc
+in_tag
0.43
bpc
Sat-RNN
0.079
bpc
Hidden State Statistics
Distinct states
984
of 1024
Mean |h|
0.655
Flips/step
52
Reverse Isomorphism: BPC by Encoding Method
Data → UM counting → log-prob features → W_y only → 0.107 bpc. No W_x/W_h training.
UM Greedy Offset Selection: BPC vs Number of Offsets
6 offsets [1,8,45,36,48,10] reach 0.000 bpc (909 patterns = perfect prediction on 1024 bytes).
W_x Input Representation (Column Norms)
Jacobian Chain Growth (Why Gradients Fail)
W_h Frobenius norm = 16.98. Chaotic amplification swamps gradient signal.