➡️ Trelis Function-calling Models (incl. Trelis Tiny): trelis.com/function-calling/
➡️ ADVANCED-inference Repo: trelis.com/enterprise-server-...
➡️ ADVANCED-fine-tuning Repo: trelis.com/advanced-fine-tuni...
➡️ One-click Fine-tuning & Inference Templates: github.com/TrelisResearch/one...
➡️ Trelis Newsletter: Trelis.Substack.com
➡️ Trelis Resources and Support: Trelis.com/About
Affiliate Links (support the channel):
- Vast AI - cloud.vast.ai/?ref_id=98762
- RunPod - tinyurl.com/4b6ecbbn
Resources:
- Slides: tinyurl.com/4kvnu4ad
- Chat fine-tuning datasets: huggingface.co/collections/Tr...
- One-click LLM templates: github.com/TrelisResearch/one...
Models:
- DeepSeek Coder 1.3B: huggingface.co/deepseek-ai/de...
- Phi 2: huggingface.co/microsoft/phi-2
- TinyLlama: huggingface.co/TinyLlama/Tiny...
- Trelis Tiny: huggingface.co/Trelis/Tiny
Repo Access (purchase includes lifetime access to improvements):
- ADVANCED Fine-tuning: trelis.com/advanced-fine-tuni...
- ADVANCED Inference: trelis.com/enterprise-server-...
Chapters:
0:00 Best Small Language Models
0:19 Video Overview
1:23 Benefits of Tiny LLMs
2:09 Fine-tuning and Inference Repo Overviews
4:28 Performance Comparison - TinyLlama, DeepSeek Coder and Phi 2
16:21 Fine-tuning Tiny Language Models
33:55 Function-calling quantized models with llama.cpp
44:44 Challenges and Tricks - Function-calling with Tiny Models
1:00:00 What are the best Tiny Language models?
Reminder: Be careful when using private keys (e.g. OpenAI or HuggingFace). If they are exposed, make sure to rotate them, as I do after each video.
Негізгі бет Ғылым және технология The Best Tiny LLMs
Пікірлер: 53