This video describes the step-by-step, detailed explanation on how to finetune llama 2 on a single GPU efficiently with QLoRA. Following are the topics covered in the video:
1. Overview of Supervised fine-tuning and RLHF
2. Why is Finetuning required?
3. What is LoRA and how is it helpful?
4. How to prepare an Instruct Dataset for finetune generative models?
5. How to train the LLAMA 2 model using Instruct Dataset?
6. Inference using fine-tuned LLAMA 2 Model.
Notebook: github.com/karndeepsingh/gene...
Dataset: huggingface.co/datasets/knkar...
Connect with me on :
1. LinkedIn: / karndeepsingh
2. Telegram Group: telegram.me/datascienceclubac...
3. Github: www.github.com/karndeepsingh
Background Music:
Sweet Dreams by BatchBug | / batchbug
Music promoted by www.chosic.com/free-music/all/
Creative Commons Attribution 3.0 Unported License
creativecommons.org/licenses/...
#llms #llama2 #finetune #qlora #huggingface
Негізгі бет Finetune LLAMA2 on custom dataset efficiently with QLoRA | Detailed Explanation| LLM| Karndeep Singh
Пікірлер: 35