Probing trained model for event space discovery
Neurons that distinguish between contexts:
| Context | Unique Active | Unique Suppressed |
|---|---|---|
| prev=q | h[2], h[45], h[109], h[113] | h[32], h[91] |
| prev=0x20 | h[55], h[86], h[113], h[125] | h[32], h[90] |
| prev=< | h[2], h[55], h[113], h[125] | h[90], h[91] |
| prev=e | h[2], h[45], h[109], h[125] | h[32], h[90] |
| prev=. | h[45], h[109], h[113], h[125] | h[32], h[90] |
Common active neurons (all contexts): h[0], h[10], h[19], h[34], h[48], h[103]
Common suppressed neurons (all contexts): h[6], h[23], h[25]