DeepSeek V4.1 Flash is a beautiful model..
Firecrawl Link: https://firecrawl.link/caleb-writes-code
SubStack Link: https://calebwritescode.substack.com/
DeepSeek V4.1 Flash full analysis starting from their model architecture that introduced Engram.
Engram allows short term recurrent information to be stored and retrieved separate to the language backbone.
DeepSeek also went back to use CED, Causal Encoder Decoder, and connects with CSA2 to bring down the KV cache and inference compute by running half the model's layers and also being selective about the layer selection.
The kernel optimization is also worth noting from their
#deeps