Great tutorial as usual😊. I have two queries: 1. You are using sqlite-vec for fast retrieval? Otherwise just store query and response in any db and using cosine similarity on the customer query fetch the top most relevant response. 2. Why are you using LLMs here, is it just bcoz to get the concise and short answer? Because LLMs might hallucinate in some cases which i think can be more harmful sometimes.
@venelin_valkov
Ай бұрын
1. I use it because it is fast and easy to understand for this use case (simple RAG from scratch). You can use whichever vector store or database works for you. I prefer SQLite because it is an easy "run your database everywhere" solution. sqlite-vec works with SQLite and performs the similarity search for you. One general rule I follow is, "When the database can do something for you, let it do it" (as long as it is fast and simple enough). A great benefit of this approach is that your code often becomes simpler to read and understand. 2. The LLM is responsible for combining the context (retrieved questions and answers) and providing an understandable and relevant answer to the user's query. I completely agree with you that the LLM can sometimes produce incorrect responses, but it generally provides more conversational answers and takes into account the chat history. Thank you for your kind words!
@VLM234
Ай бұрын
@@venelin_valkov thank you so much for your kind response.
@Onur-j1e
Ай бұрын
Hello, thanks for the great tutorial. I'm stuck at this section: "db = sqlite3.connect("example.db") db.enable_load_extension(True) sqlite_vec.load(db) db.enable_load_extension(False)" I'm doing everything but it says "OperationalError: The specified module could not be found." on sqlite__vec.load() side. Can you help me on that?
@surygarcia6823
Ай бұрын
Can I export the chatbot so I can integrate it into an app?
@pepeka1772
Ай бұрын
Hi, how's it going? I want to integrate a chatbot into my website. NO WhatsApp. Is it possible to create a CMS to manage this chatbot?
@venelin_valkov
Ай бұрын
Possible - yes! It will be a project though, wouldn't go with building it from scratch. Checkout LangChain and/or LlamaIndex as starting points. Look at pgvector if you happen to use Postgres/Supabase. Also, there exist some premade solutions that work quite well. Btw, me and a few friends are building exactly such system that will be made available to the public, will make a video once it is released. Best of luck!
@awssecuritylabs
Ай бұрын
Hi.. how can i subscribe to ml expert
@venelin_valkov
Ай бұрын
Hi, You can subscribe for MLExpert here: www.mlexpert.io/ Let me know if you have any questions! Thank you for watching!
Пікірлер: 10