Man, you always go THE deepest with your AI insights and videos. Kudos, bro! Always #AIDOPE 🍪
@MarcoZaro
9 ай бұрын
Hi very interesting indeed, one question what are the requirements to run the model? I’m asking because my goal will be to use flowiseai hosted locally , then host a vector database like supabase, ingest our technical document and create a chatbot for our needs completely local. At the moment I’m using OpenAI ChatGPT api but I want to do it completely offline for privacy reason
@ollydix
8 ай бұрын
Lol I'm doing the same
@Shari_Tejp
5 ай бұрын
Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this
@MilhanIqbal
6 ай бұрын
Beautifully explained. Thanks a bunch
@yes4me
7 ай бұрын
Can we download the python code?
@benoitheroux6839
9 ай бұрын
I'd like to know why you choose the older version (v2.2.1) instead of the newest one, the 2.6 ? the size of the dolphin-2.6-mistral-7b.Q5_K_M.gguf is almost the same ?
@kawsarahmad
9 ай бұрын
Brilliant as always!
@MythicMemorie
Ай бұрын
i cant open the Model's python file. Notepad says file is too large. What do i do??
@vbywrde
9 ай бұрын
Very good information, and well presented. Thank you!
@JungUndStabil
3 ай бұрын
Hey, is my Mac mini m2 strong enough to use opensource ki?
@arpitkumar4525
6 ай бұрын
What are the minimum system requirements to run models locally?
@VassilisPerantzakis
8 ай бұрын
Just a question. What is your hardware configuration for running the local models?
@uighkgui
8 ай бұрын
i got a 1080ti and for some reason i can't get it run on my GPU.. is my GPU too old??
@DarrenTarmey
4 ай бұрын
were can i get this code and do i have to load it into visual studio
@bobsmith-hv1kb
9 ай бұрын
Is there a link to the script?
@mihaes7172
8 ай бұрын
How should I choose among LLMs for download? what are the criteria?
@CrumblyVOD
8 ай бұрын
This was so incredibly helpful... thank you!
@harithummaluru3343
9 ай бұрын
amazing content. greatly appreciated
@JeeteshSurana
7 ай бұрын
Can you please provide the test3.py file?
@nic-ori
9 ай бұрын
Thanks!👍👍👍 Useful information.
@noumaniftikhar5184
3 ай бұрын
Love that...a mage from Warcraft teaching AI
@MrUpgradable
4 ай бұрын
Legend, thanks for sharing this
@Ghrenig
9 ай бұрын
Excellent - what is your hardware setup?
@oliverli9630
9 ай бұрын
Sam Altman: "How dare you!"
@user---------
9 ай бұрын
Dont clear understand, isn't it possible to just download models from HF and use them locally? Why is LM studio local server need?
@KhajaMD143
8 ай бұрын
Yes very much possible to do without lm studio, but what lm studio brings to the table is one UI for all that you do in different terminal windows otherwise. It becomes very messy, with the terminals running, then you want to change some configurations, you want to jump from one model to another etc.,
@3xOGsavage
8 ай бұрын
well thanks to you i got a new way to use local ai model as a API. never knew this was possible too. can you make more such videos?
@Shari_Tejp
5 ай бұрын
Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this
@saeedasgaritehrani
7 ай бұрын
Tnx, very helpful! Are you ENTP? 🤔
@legendaryman4336
9 ай бұрын
do you do this so you can get the fully uncensored output? I tried asking it iffy stuff and it gave me a nope in LM Studio. Same model
@AberrantArt
9 ай бұрын
Did you try it on the uncensored model he describes at the end?
@abenjamin13
9 ай бұрын
Always appreciate the overview, thank you.
@husamui
8 ай бұрын
How would you deploy this to use via api?
@SirTunkur
9 ай бұрын
Fungerar AMD gpu's?
@RamazKadgaev
9 ай бұрын
Are there models on LMStudio that can do image recognition like GPT4?
@kate-pt2ny
9 ай бұрын
llava
@RamazKadgaev
9 ай бұрын
You are right, there is llava model, but I dont see LMStidio ui option to add photo in chat mode. May be there is python option?
@akdisrael
5 ай бұрын
woooow thanks for this im free with chatgpt
@Yomi4D
8 ай бұрын
Thank you.
@abhipatil4844
9 ай бұрын
awesome
@serenditymuse
9 ай бұрын
Cool and very useful. . But I would appreciate videos on how to do this without being beholden to some company and its apparently closed source product. Government crackdowns are coming and I want as much of my toolchain on my own hardware and in my control as possible beforehand.
@watchdog163
9 ай бұрын
Can you explain a little bit more about what you mean by government crackdowns? Are you talking about the copyright issues with OpenAI and big industries like Hollywood and Newspapers suing them and potentially having them raided by FBI, CIA or some other corrupt agency?
@legendaryman4336
9 ай бұрын
Yup me too I downloaded that shit as much as I could to my local drives. 500GB+ so far... Gimme!! I wouldn't be surprised if they removed uncensored models from the web. Actually they will 100%, because it's a security threat to them. Prepare for the end folks be smart lol
@AberrantArt
9 ай бұрын
Are you saying lm studio is the issue? Just curious to understand what you mean.
@mackroscopik
8 ай бұрын
@@AberrantArtyes it is not open-source
@randallblake1213
Ай бұрын
My understanding is that Jan AI is an open source alternative to LM Studio but there are not many tutorials on how to use the local inference server.
@palashjyotiborah9888
9 ай бұрын
You are Late for the party 🥳
@funprog
9 ай бұрын
Very Very slow though
@ohaleceiffel
6 ай бұрын
Ugh still too involved for non techies like me. Cant someone just package all this up in an executable? I mean that’s the whole f-ing point of ai isn’t it? So we don’t have to bother with command line BS. Pfft!
@alx8439
8 ай бұрын
Step number one - to download some proprietary shit... Not interested
Пікірлер: 54