In this video, we will look at all the exciting updates to the LocalGPT project that lets you chat with your documents. The new updates include support for GGUF format model with llama cpp, better prompt template for restricting answering using Llama-2 template and a lot more!
If you like the repo, don't forget to give it a ⭐
💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
▬▬▬▬▬▬▬▬▬▬▬▬▬▬ CONNECT ▬▬▬▬▬▬▬▬▬▬▬
☕ Buy me a Coffee: ko-fi.com/prom...
|🔴 Support my work on Patreon: Patreon.com/PromptEngineering
🦾 Discord: / discord
▶️️ Subscribe: www.youtube.co...
📧 Business Contact: engineerprompt@gmail.com
💼Consulting: calendly.com/e...
💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
LINKS:
Github Link: github.com/Pro...
LocalGPT- Detailed walkthrough: • LocalGPT: OFFLINE CHAT...
LocalGPT with Llama2: • Llama-2 with LocalGPT:...
LocalGPT with Memory: • LocalGPT API: Build Po...
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Timestamps:
[00:00] Intro
[00:54] LlamaCpp with GPU
[04:54] GPU VRAM Required for LLMs
[06:33] Which LLMs are supported
[07:00] Adding Documents to Vector Store
[08:08] Chatting with Documents
[11:25] Limit Answers to the given context
[14:18] Where are the models downloaded.
[15:23] Define Context Window
[16:00] Change N_GPU_layers
[16:22] Change the Embedding model
[16:50] Change the LLM
All Interesting Videos:
Everything LangChain: • LangChain
Everything LLM: • Large Language Models
Everything Midjourney: • MidJourney Tutorials
AI Image Generation: • AI Image Generation Tu...
Негізгі бет Ғылым және технология LocalGPT Updates - Tips & Tricks
Пікірлер: 85