Awesome, man! I was not aware of customizing Ollama with this kind of Python script! Thanks :)
@blackstonesoftware7074
Ай бұрын
This is quite useful! It gives me some great ideas for my own local apps!
@fastmamajama
26 күн бұрын
wow this is too easy to be real. i am using opencv to record videos of flying saucers. i could record images and use llama to verify if there is a flying saucer in it. can i also search videos with videos: instead of images:?
@rajm5349
3 күн бұрын
can we get the answer in different languages as per the client requrement just like in hindi or tamil or japanese etc if possible
@brpatil_007
4 сағат бұрын
Is ollama and llava is free to use and I have spec 16GB/1TB RTX 3050Ti what no. of model is suitable for my device 13B one or else. And I already using ollama basic 4GB model in my device is it ok to run 13B model and some Other model like OpenAi or Gemini API??
@GuillermoGarcia75
2 ай бұрын
Riding the awesomeness wave again!
@derekchance8197
17 күн бұрын
Are there models that recognize a photo and then vectorizes it?
@AlissonSantos-qw6db
2 ай бұрын
Nice, very helpful! Is it possible to create embeddings of pictures with the model?
@R8R809
2 ай бұрын
Thanks for the video, how to make sure that I install Ollama on the GPU not on the CPU?
@wasgeht2409
2 ай бұрын
Thanks :) Is it possible to use this model as an ocr alternativ to get for example informationen from a jpeg image which is an id-card ?
@sumukhas5418
2 ай бұрын
This will be too much heavy for just that Instead considering yolo would be a better option
@wasgeht2409
2 ай бұрын
@@sumukhas5418 Thanks for the answer :) Actually I am trying pytesseract to read id-card information, which are photographed by a phone and the results are not very good :/ Do you have some ideas, how I could get some better results?
@giovannicordova4803
2 ай бұрын
If my local ram is 8 gb, which ollama model would you recommend to use?
@WebWizard977
2 ай бұрын
deepseek-coder ❤
@WebWizard977
2 ай бұрын
deepseek-coder ❤
@yuvrajkukreja9727
24 күн бұрын
how to add long term memory in this local llm ???
@potatoes1000
Ай бұрын
is this fully offline? I am not sure you downloaded the 13B 7.4Gb package
@throwyourmindat
2 ай бұрын
Hi could you please explain why someone has to refresh to get some reasonable output at least what we expect !? Why does something like this happens with such ai models ?
@aigapol123
2 ай бұрын
Each Input for the model comes with a random seed, that's why you don't get the same responses with the same input every time, because of that you could try multiple times until you get a reasonable response.
@Isusgsue
2 ай бұрын
What a nice vid. Can I do a ai without using open ai ?
With 4-bit quantization, for LLaVA-1.5-7B, it uses less than 8GB VRAM on a single GPU, typically the 7B model can run with a GPU with less than 24GB memory, and the 13B model requires ~32 GB memory. You can use multiple 24-GB GPUs to run 13B model
Пікірлер: 27