Become a Patreon: / theaiepiphany
👨👩👧👦 Join our Discord community: / discord
Daniel Han from Unsloth AI joined us to walk us through his bug-hunting process and how to make LLM fine-tuning 30x faster. :)
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
check out unsloth ai: unsloth.ai/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00:00 - 00:01:40 Intro
00:01:40 - 00:03:21 Hyperstack GPUs! (sponsored)
00:03:21 - 00:06:30 About Daniel, getting started with ML
00:06:30 - 00:11:00 Using Desmos to check grads
00:11:00 - 00:38:00 Deep dive into Gemma bugs
00:38:00 - 00:50:00 approximate GELU bug
00:50:00 - 00:54:15 What are the bottlenecks to speeding up the runtime?
00:54:15 - 00:58:30 comparison with llm.c?
00:58:30 - 01:00:00 Is multi-GPU coming to Unsloth? :)
01:00:00 - 01:05:19 Reproducibility in ML research
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR
The AI Epiphany - / theaiepiphany
One-time donation - www.paypal.com/paypalme/theai...
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💼 LinkedIn - / aleksagordic
🐦 Twitter - / gordic_aleksa
👨👩👧👦 Discord - / discord
📺 KZitem - / theaiepiphany
📚 Medium - / gordicaleksa
💻 GitHub - github.com/gordicaleksa
📢 AI Newsletter - aiepiphany.substack.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#unslothai #llms #finetuning #ml
Негізгі бет Ғылым және технология Fine-tune LLMs 30x faster! With Daniel Han (Unsloth AI)
Пікірлер: 13