Liger Kernel v0.5
github.com/linkedin/Liger-Ke…
Post Training Loss: Introducing the first open-source optimized post-training losses in Liger Kernel with ~80% memory reduction, featuring DPO, CPO, ORPO, SimPO, JSD, and more. No more OOM nightmares for post-training ML researchers!
AMD CI: With AMD’s generous sponsorship of MI300s, we’ve integrated them into our CI. Special thanks to Embedded LLM for building the AMD CI infrastructure.
XPU Support: In collaboration with Intel, we now support XPU, demonstrating comparable performance gains with other vendors.
Dec 10, 2024 · 5:27 PM UTC
5
21
1,373

