Inside a KronLSTM layer

Source: https://kron-lstm.vercel.app/

This is a KronLSTM layer

Instead of neurons, it keeps one small matrix as memory. Every token writes a single key and value pair into it with a rank-one stamp, forgets a little, and reads an answer back out. Walk along time, one slab per token.