yep that was funny. Got to find humor where we can lol
@Blendershick
8 ай бұрын
Amazing thank you!
@ScottDevOps
8 ай бұрын
thanks for watching. Glad you liked it. This is amazing stuff happening these days.
@giancarlo8830
5 ай бұрын
CAn you train the local models like upload your documents?
@ScottDevOps
5 ай бұрын
Thanks for watching, check this link it might help you jan.ai/docs/use-tools
@Pr0toPoTaT0
8 ай бұрын
Yeah that's gotta be it. Sorry. HAHAHA. I feel dumb for leaving this last comment now though. But you will boost your views so much leaving comments as they are, the likes go up, comments get posted. Algorithm sends more people your way. Totally a win win :)
@FalloutUrMum
7 ай бұрын
I keep trying to install CUDA but it won't work. I have a GTX 1660 Super with the most recent Nvidea driver installed. Anything I'm missing?
@ScottDevOps
7 ай бұрын
What kind of error(s) are you getting?
@niazmurshid
8 ай бұрын
Which language model can i run in my i5 3570s 4GB Ram without GPU machine?
@ScottDevOps
8 ай бұрын
Hello. Just checking, did you get it up and running on your computer yet?
@niazmurshid
8 ай бұрын
@@ScottDevOps no
@Pr0toPoTaT0
8 ай бұрын
Do you approve your messages? Lol im so confused
@fabiojojo-x9c
8 ай бұрын
Paste no working inside JAN
@ScottDevOps
8 ай бұрын
can you explain a little more what problem you are facing? Are you using Windows 10 or Windows 11, or other OS?
@SizZ1eR
8 ай бұрын
IN the settings I dont see "enable gpu acc", how come is that?
@ScottDevOps
8 ай бұрын
Hello there. Have you seen this guide yet: github.com/janhq/jan/blob/3bfa2773bdee03646e89e38367ef76a7b97a66af/docs/docs/guides/08-troubleshooting/03-gpu-not-used.mdx#L2 A few questions for you: Which Nvidia card are you using and how much RAM does it have? What OS are you using? Did you install it with the EXE or use the actual github source code like I did in the video? Some things to consider: In NVIDIA command line tools, if you don't see the option "Enable GPU Acc" (GPU Acceleration), there could be several reasons: - Version Difference: The tool or driver version you are using might not support GPU acceleration, or the feature could be named differently. - GPU Compatibility: Your NVIDIA GPU might not be compatible with the GPU acceleration feature required by the tool. - Driver Issues: The necessary drivers for GPU acceleration might not be installed or updated on your system. * Operating System Compatibility: - The exact operating system you are using might not support the GPU acceleration feature, or there could be compatibility issues. - Hardware Limitations: Your system's hardware might not meet the requirements for GPU acceleration. Maybe consider these options if you have not yet: - Update your NVIDIA drivers and tools to the latest version. Check the tool's documentation for specific instructions or requirements for enabling GPU acceleration. - Ensure your hardware and operating system are compatible with the feature.
@SizZ1eR
8 ай бұрын
@ScottDevOps GPU is an RTX3070 with 8GB VRAM and 6,144 CUDA cores, GameReady driver is the current latest 546.33 and I installed the nVidia Cuda Toolkit v12.3 (also the currently latest version) CPU is Ryzen 3900 and mem is 2x16GB DDR4, OS is Win11. All drivers othersie are up to date as well. And as im writing this and giving it yet another shot, it now runs super fast, compared to earlier where it would be rather slow using the Hermes Neural 7B Q4 model. Yet in the settings there are still no "GPU accel" option, but oh well, its running super fast, instantly reply when I ask it something and types the answer super fast as well. So I guess its working really good, but then that begs the question, would it perform even better with GPU accel? X-)
@ScottDevOps
8 ай бұрын
@ScottDevOps also there is this discord for help: Get help in [Jan Discord] discord.gg/mY69SZaMaC
@SizZ1eR
8 ай бұрын
Just checked compatibility list as well, my 546 gameready driver and my RTX3070 is compatible with Cuda 12.3 it says, so another one to check off the list. Ill chk the discord and see if I can get further information there, thank you for all your help, its truly and highly appreciated 🙂
@ScottDevOps
8 ай бұрын
Yes, I would think it should perform even faster with GPU support. You can also post an Issue on the github repo github.com/janhq/jan/issues for Jan.AI. The developers of that tool should know why that is happening. I also noticed many times it was very fast! :-) PS If you get an answer let us know, Thanks!
@hypersharp_
7 ай бұрын
does anyone know how to get the offline api key for jan?
@Pr0toPoTaT0
8 ай бұрын
Hey I have a question, do you know how to turn .bin files or pytorch files to a gguf or something compatible for import with Jan? I'm loving the UI obviously coming from terminal ollama but I would like to get my LLM's put onto this and I really don't know how(to be honest, haven't put more then 10 hours into learning and downloading LLM's and as you know, that's mostly downloading. Nevermind found a tool to convert! Just had to install the python requirements and now its doing its thing in another VM. Thanks dude, your video was super awesome and informative!!!
@ScottDevOps
8 ай бұрын
Glad my video helped you! Hey thats great. I am glad you found an answer. What tool did you find?
@enricva
8 ай бұрын
Hello, I am looking for a way to feed a chatbot daily with emails (I would copy & paste the content of each) I receive from different people, and then be able to ask questions about that content. Does anyone know how I can do this?
@ScottDevOps
8 ай бұрын
What operating system are you using? can you explain in more detail about your configuration and tools you are using?
@joj0laki475
8 ай бұрын
How do I change the installation location? I have it installed on the C drive, but I need it to be installed on F. Since there is no room on C for large models
@ScottDevOps
8 ай бұрын
Let me see if I can find out, if you haven't already discovered a way to do that.
@shaheralsyabi2680
8 ай бұрын
Great guide Thank you, does jan have web interface can be accessed and used by many users?? Trying to make it accessible by users in network by URL
@ScottDevOps
8 ай бұрын
:-) Thanks for watching. I will give that a try and see what I can come up with.
@XITIJTHOOL
7 ай бұрын
Is Jan uncensored?
@ScottDevOps
7 ай бұрын
Jan AI allows users to adjust their settings so they can change alignment, moderation and censorship levels to their needs on LLM settings.
@stephenzzz
8 ай бұрын
Great guide thanks!
@ScottDevOps
8 ай бұрын
thanks for watching, glad it was helpful.
@agxxxi
6 ай бұрын
Appreciate this vid. Although a suggestion- tone down the music. Gets quite distracting
Пікірлер: 38