The decoder (autogressive implies "employs a causal mask") will have to reconstruct the initial document, using the encoder's output and previous uncorrupted tokens.
Even when he does commit, he nevertheless gets style https://kiananmrd599116.blazingblog.com/profile