🧠 RNN Interpretability Dashboard

Model Status Undertrained
6.02
bits/char
128
hidden units
82K
parameters

Model needs more training. Random baseline is 8 bpc. Good models achieve ~1.5-2.0 bpc.

Interactive Predictor Live

Enter a context and click Predict to see model output.

Strongest Learned Patterns
SourceTargetStrength
SPACE'-'
SPACE'='
SPACE'#'
SPACE'('
SPACE'f'
SPACE'C'
SPACE'b'
SPACE'<'

Patterns extracted via compute_influence (Wx × Wy).

Theory Validation

Many patterns weak due to undertrained model.

Hidden State Heatmap 128 neurons, blue=active (+1), red=suppressed (-1)

Run a prediction to see hidden state.