What to learn how to customize tiny llama on your own dataset? Here is how to do it.
🦾 Discord: / discord
☕ Buy me a Coffee: ko-fi.com/promptengineering
|🔴 Patreon: / promptengineering
💼Consulting: calendly.com/engineerprompt/c...
📧 Business Contact: engineerprompt@gmail.com
Become Member: tinyurl.com/y5h28s6h
💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
LINKS:
TinyLlama Github: github.com/jzhang38/TinyLlama
TinyLlama Chat-Demo: tinyurl.com/e48uftef
TinyLlama Paper: arxiv.org/pdf/2401.02385.pdf
Google Colab: tinyurl.com/4eny9cvc
Blogpost: tinyurl.com/krskjumf
Learn about LoRA: Mixtral: • Fine-tune Mixtral 8x7B...
The Dataset: huggingface.co/datasets/burke...
TIMESTAMPS:
[00:00] Introduction
[01:07] Training dataset
[02:29] Setting Up the Code
[04:19] Formatting the Dataset
[06:49] Setting Up the Model and LoRAs
[09:58] Training the Model
[10:37] Merging the Model and LoRa Adapters
[11:31] Inference and Testing
[14:02] Conclusion and Future Prospects
All Interesting Videos:
Everything LangChain: • LangChain
Everything LLM: • Large Language Models
Everything Midjourney: • MidJourney Tutorials
AI Image Generation: • AI Image Generation Tu...
Негізгі бет Ғылым және технология Fine-Tune Your Own Tiny-Llama on Custom Dataset
Пікірлер: 53