The Most Absurd Way To Train LLMs... With 3x Less Memory!?

Need high quality cloud GPUs? Check out Verda now, and use the code BYCLOUD-50 to get $50 of compute credits for just $5! https://verda.com/?utm_source=bycloud&utm_medium=referral&utm_campaign=sponsorship&utm_content=diffusion_blocks A great news for us gpu poors? This research DiffusionBlocks shows that you can train LLMs with 2-3x less memory with minimal performance loss. If crazier, you could even go up to 4x or 6x! my latest project: Intuitive AI Academy We just wrote a new piece on Optimization!! https://intuitiveai.academy/ limited time code "LOCKIN" for 35% off yearly plan My New