Liger Kernel v0.5 github.com/linkedin/Liger-Ke… Post Training Loss: Introducing the first open-source optimized post-training losses in Liger Kernel with ~80% memory reduction, featuring DPO, CPO, ORPO, SimPO, JSD, and more. No more OOM nightmares for post-training ML researchers! AMD CI: With AMD’s generous sponsorship of MI300s, we’ve integrated them into our CI. Special thanks to Embedded LLM for building the AMD CI infrastructure. XPU Support: In collaboration with Intel, we now support XPU, demonstrating comparable performance gains with other vendors.

Dec 10, 2024 · 5:27 PM UTC

5
21
1,373
Sort replies: Relevant Recent Liked