@TimCarambat I had to pause the video just to leave a comment! I'm deeply impressed by the excellence and simplicity of the content presented here. It's truly remarkable to have access to such tools, created by a team that clearly demonstrates passion and a keen ear for what we all think and wish would be great to have, and at every update, distilling all p of these wishes into a few simple clicks within this amazing piece of technology! I'm immensely grateful for the opportunity to experienceh the brilliance of software engineering and development of Anything LLM, especially within the context of open-source communities. Participating in the advancement of genuine and incredible open tools is a privilege. Thank you Tim! I will be promoting this project to the moon and back, because this deserves to be known.
@TimCarambat
4 ай бұрын
This is so incredibly kind. Sharing with team!
@camdizzlethe1st
4 ай бұрын
haha I was just about to leave a comment when I read yours. I feel the same. What a champion Tim is. I do not know if I will ever install AnythingLLM but I think I will donate to Tim regardless.
@ts757arse
3 ай бұрын
Aye, I was interested in anythingLLM a while back but chose another project for my inference server. I've found getting half decent agent capabilities to be a huge time sink for someone with my skill set (I'm a physical security guy, not a programmer) and the results just weren't worth the time invested. Even basic agent capabilities with RAG, memory and so on in a package that I can just plug into ollama sounds awesome. Prepping the server now. Here's hoping.
@Biskern
2 ай бұрын
You are a gift from god, TIm Carambat. Thank you for your continous efforts to make these technologies available to the rest of us. If this was 10.000 years ago, YOU're the guy teaching the rest of us how to make fire with flint and tinder. May you and your loved ones be blessed for eternity!
@TimCarambat
2 ай бұрын
This is very high praise. I appreciate the kind comment!
@trsd8640
2 ай бұрын
AnythingLLM NEEDS to get more attention, because its simply great! I can’t wait to see custom agents in AnythingLLM! Well done!
@surfkid1111
4 ай бұрын
You built an amazing piece of software. Thank god that I stumbled across this video.
@bro_truth
3 ай бұрын
Bro this has to be the most comprehensive, simple, engaging and all around entertaining video on AI I've ever watched. Your presentation, explanations, and exert level knowledge base are all 'S' tier! Bra-freakin'-vo! Subscriber well earned and deserved! 🏆👏🏽👏🏽
@liviuspinu11
4 ай бұрын
Thank you for explaining quantisation in details for niebiews.
@jimg8296
3 ай бұрын
Been using for the past few months and is my go-to app for local RAG. Adding agents huge plus. Looking forward to being able to add my own AutoGen agents to the list with their own special tools. Thanks for the great work Tim.
@gordonwoo8127
3 ай бұрын
Thank you very much. As soon as I saw that RAG was built in and it was simple to use, I immediately started finding readme pdfs on various topics to ensure I could use this tool as efficiently as possible. After my targeted pdfs are found, I plan on grabbing data from how-to and wiki.
@yusufaliyu9759
4 ай бұрын
Great this will make LLM more understandable for many ppl.
@TheDrMusician
4 ай бұрын
This is by far the easiest and most powerful way to use LLMs locally, full support, like and sub. And many thanks for the amazing work, especially being open source.
@TimCarambat
4 ай бұрын
🫡
@fxstation1329
4 ай бұрын
What I love about your tutorials is that you succinctly explain all the things that come across during the tutorial. Thanks!
@flusyrom
3 ай бұрын
Funny ! I heard yesterday for the first time about AnythingLLM during an AI-info event.... and discarded the idea of giving it more attention because it was presented as "just another local RAG support". And now I stumble across this video by chance - and the additional agent functionality changes everything ! BTW, very well presented , this feature ! My immediate idea & feedback: if there was ANY chance to model custom agents in Flowise and re-import the JSON exports of this Flowise flow as input for an AnythingLLM custom agent, you'd save yourself the trouble of designing your own agent editor AND would start with a comparably large installed base. OK, maybe that's just wishful thinking..... but maybe I'm also not the only one with this wish to facilitate local agent building ;-)
@jonathan58475
4 ай бұрын
Tim, thank you for making the world a better place with this awesome tool! :)
@SiliconSouthShow
4 ай бұрын
Fantastic Tim! Mine doesnt have agent config, guess i need to delete and udate, ill try that, looks great! keep up good work, i love anythingllm i really do!
@quinnlintott406
4 ай бұрын
I had no idea you had a channel talking about your software. Im a big fan of your work!
@SiliconSouthShow
4 ай бұрын
@TimCarambat I'm excited to see the features you talked about work with the ollama like in the video for the agent, as of now, its same as before I updated, but it's exciting to think of the future.
@MaliciousCode-gw5tq
4 ай бұрын
Damm,... finally found the tools that i been looking for..MAN you save my day, i have been crazy stuck finding webui for my ollama remote server..your a gift from heaven keep it up your helping alot of people like us..thank you so much..❤❤❤😂😅😊😊
@lostmusichits
2 ай бұрын
Excellent video! Thank you for explaining things plainly and quickly. Valuable.
@coryrichter3680
3 ай бұрын
Very cool to play with, look forward to seeing where the Agents go, nice work!
@jakeparker918
4 ай бұрын
This is so dope. Great no-code solution and it's awesome that it's open source.
@jimg8296
4 ай бұрын
Anythingllm is awesome. Glad to hear custom agents are on the roadmap. It's the big hole in capability. Also need config to change agent promt. I scan a lot of code and the @ is used often to define decorators.
@yasin6904
3 ай бұрын
Im a chronic video skipper but watched this back to back. Great explanations and can't wait to try this out! Would love to see more videos, tutorials or even lectures from you. You really have a knack for explaining things!😊
@yasin6904
3 ай бұрын
PS I've starred on Github!
@TimCarambat
3 ай бұрын
I really appreciate you saying this. I have gotten a comment or two prior saying im the worst at it. Can't please everyone! Glad you found it useful.
@ilanlee3025
3 ай бұрын
Good stuff, will try it out. Subscribed. Looking forwards to seeing how this develops.
@Spot120
3 ай бұрын
Yo honestly it feels great when guys like you make your software completely free and i also think you should keep a option of donation. after seeing guys like you i will make something great and i will make it completely free to use and open source. again thanks dude!❤.
@mmar5896
Ай бұрын
Thanks for building anything llm with these features. For many days I was searching for better UI than a terminal and more features for ollama models. And you have done it. Thank you very much.
@fluffsquirrel
Ай бұрын
This is absolutely absurd. Thank you so much, this is an incredible project and I hope it gets more attention. I'm sold!
@figs3284
4 ай бұрын
Incredible.. gonna make building tools so much easier. Cant wait to see more agent abilities added!
@anwhelan
18 күн бұрын
Hey. Nice to meet you. I’ve just come across this now and honestly, this couldn’t come at a better time. I already realised the potential of AnythingLLM and was looking at how to utilise it as I’m building some text to action agents and your video just accelerated my path to objective. I have subscribed and look forward to more of your posts. Nice work 👍🙏👍
@rockon-wbfqlkjqhsydic72683
3 ай бұрын
Great job! This is wonderful! I will be responding after using to let you know my thoughts if you care to see them :)
@Whitehatxtsh
Ай бұрын
Mind blowing simple, coherent and full of information. Think didn`t come across something similar in all terms on KZitem ( I`m not leaving comments often but this really really worth it ). Good job Tim Carambat !
@michaelklimpel3020
4 ай бұрын
Big thanks man. This video helps alot for me as an beginner to understand how good a local llm is and which Usecases we have. Thumbs up for this great video.
@benjox7315
Ай бұрын
NNNooooo!!! Thank you!! Great tool! Have lots of process documents at work and because of compliance and privacy issues, we are not allowed to upload any documents onto the internet. This is a game changer!!!!
@johnbramich
3 ай бұрын
Can't wait to use this. Thank you!
@tunoajohnson256
4 ай бұрын
Awesome vid! Really impressed with how you presented the information. 🙏 thank you
@akikuro1725
4 ай бұрын
Awesome! thank you for this. looking forward to more information/details/examples on using agents w/AnythingLLM!
@myronkoch
2 ай бұрын
I've been using this for months, and it's fantastic. Dude, thanks. Amazing work.
@TimCarambat
2 ай бұрын
@@myronkoch this is such a nice thing to hear. Thank you for your support!
@roshinidas9984
Ай бұрын
This is awesome! I was looking for frameworks similar to this and now i see that this is way better than what we were looking for. Great job on this one!
@pr0d1gyvisions74
3 күн бұрын
Man, i faded this project when it first came out, now im like... wow...
@TimCarambat
3 күн бұрын
@@pr0d1gyvisions74 still free!
@the_potmo
2 ай бұрын
If you type ollama show you can see the context window of the model FYI
@OpenAITutor
4 ай бұрын
Amazing Tim. Keep up the good work.
@tinkerman1790
Ай бұрын
Amazing Tools, AnythingLLM!!! I love it so mich! With my M1Max Macbook Pro, it runs very smooth locally. Starred AnythingLLM for sure!!! Keeps your great work and thx a million for sharing.
@TimCarambat
Ай бұрын
love to hear this! Email us any feedback! team@mintplexlabs.com
@vulcan4d
4 ай бұрын
This is awesome work. I looked at the other simple to install Windows front ends and stumbled on this. Pretty cool stuff and I love how you can add documents and external websites to feed it information. An offline LLM is soooooo much more preferred. The only item I don't understand is why you could just ask a regular question once you provided the document, but used @agent when asking to summarize a document.
@TimCarambat
4 ай бұрын
IMO, i find having a local LLM that even is **only** like 75% as good as on online alternative is just much more rewarding. Like i can be on an airplane, open my laptop, and start brainstorming with an AI. Pretty neat. Next evolution would be a local AI on your phone but i dont think we have that tech _yet_
@RichSad45
2 ай бұрын
Very strong video Tim. I'm going to give this all a try right now.
@jasonhorne6820
Ай бұрын
Amazing program Tim. So easy to understand and use. You and the team have a done a stellar job. Cheers
@sharankumar31
4 ай бұрын
this is seriously very neat tool👏👏👏 Pls add some feature to custom develop agents with function calls. It will be helpful for our local automations.
@TimCarambat
4 ай бұрын
This is shown in the UI that we will be supporting custom agents soon!
@K600K300
27 күн бұрын
I have loved everything llm since the beginning.
@nangelov
Ай бұрын
Thanks for developing AnythingLLM and for the tutorial! I did not know I can create agents that can go online!
@MartinBlaha
4 ай бұрын
Thank you! Will test it for sure. I think you guys are on the exact right path 😎👍
@azkongs
Ай бұрын
This is a very nice too! I appreciate you doing this intro video personally.
@incaseidie
2 ай бұрын
i saved this months ago was just starting out on a new project and realized your from the future.
@marpla78
2 ай бұрын
@TimCarambat really caught my attention, not a technical guy (product designer) here but it was clear to understand, I'll definitely give it a try since I'm building some related products. Mini feedback the UI could have some "love" like my boss says but the overall experience feels natural...not too consumer face but natural enough. Will love to hear more from you and your team if there's a chance. Fabi, from Argentina 🇦🇷🤘
@enriquebruzual1702
3 ай бұрын
I love this tool, I already made several Workspaces, each with its own LLM and RAG. This video was good how with an explanation. I am a Python developer and I would like to create my own agents
@themax2go
2 ай бұрын
productive criticism input: instead of saying "we do this...that..." say "typing / clicking / ... will ..." - this with provide 1. clear instruction(s) to follow and 2. explain the purpose of that action, all in one go, saving time and reducing / eliminating confusion
@TimCarambat
2 ай бұрын
Thank you, you are correct - that instruction would be much more clear.
@surfer_silver
2 ай бұрын
You should format yr comment for better readibility...
@sashkovarha
4 ай бұрын
This explained the rag and agents parts I couldn't set up. Great educational content for those who are not programmers. Appreciate your explanations being without that much of "pre-supposed" know-how, that coders have - which is most tutorials on youtube... I still didn't get why there's a difference between @agent commands and just regular chat
@TimCarambat
4 ай бұрын
In a perfect world, they are the same. AnythingLLM originally was only rag. In the near future @agent won't be needed and agent commands will work seamlessly in the chat. So @agent is temporary for now so you know for sure you want to possibly use some kind of tool for your prompt. Otherwise, it's just simple rag
@zirize
4 ай бұрын
I think it's a very good application, easy to use, and after testing it for a day or so, I have some wishes. 1. direct commands Bypass Agent LLM in Agent mode. It takes time for the agent to understand the sentence and convert it into internal command, and url parsing sometimes fails depending on the agent. For example, a command that scrapes the specified URL and shows the result, or a command that lists the currently registered documents with numbering. And a command that summarizes the document by this number instead of its full name. 2. I wish there was a way to pre-test the settings in the options window to make sure they are correct, such as specifying LLM or search engine. I hope this application is widely known and loved by many people.
@smudgepost
3 ай бұрын
Absolutely everything I'm looking for. Thank you!
@aimademerich
4 ай бұрын
Would love to see this run stable diffusion and comfy ui workflows
@kangoclap
4 ай бұрын
looking forward to utilizing AnythingLLM, it looks really awesome! congrats on creating such an impressive application! thank you!
@iantrolinger5499
3 ай бұрын
this demo is fire
@Lucas-iv6ld
2 ай бұрын
Thanks, i'm saving this video
@HarpaAI
4 ай бұрын
🎯 Key Takeaways for quick navigation: 00:00 *🤖 Introduction to Ollama & AnythingLLM and AMA* - Introduction to Ollama and AnythingLLM - Explanation of AMA application for running LLMs on local devices - Overview of quantization process and agent capabilities in LLMs 02:30 *🧠 Understanding Model Quantization and Selection* - Importance of selecting the right quantization level for LLMs - Differences between various quantization levels like Q1 and Q8 - How quantization impacts model performance and reliability 06:07 *🛠 Setting up AnythingLM with Q8 Model and AMA* - Instructions for setting up AMA with Q8 LLW model - Steps to download and run AnythingLM on local devices - Connecting to AMA server and configuring privacy settings 08:27 *💬 Enhancing Model Knowledge Using RAG and Workspace* - Uploading documents for model referencing in workspace - Improving model responses by utilizing documents in the workspace - Configuring workspace settings for better model performance 11:41 *🌐 Using Agents for Advanced Functionality in AnythingLLM* - Utilizing agents to enhance LLMs capabilities beyond basic text responses - Enabling web scraping, file generation, summarization, and memory functions - Integrating external services like Google for web browsing functionalities Made with HARPA AI
@FlynnTheRedhead
4 ай бұрын
So training/finetuning is coming up as well? Loving the progress and process updates, keep up the great work Tim!
@TimCarambat
4 ай бұрын
how'd you know!? We will likely make some kind of external supplemental process for fine-tuning, but at least make the tuning process easy to integrate with AnythingLLM. RAG + Fine-tune + agents = very powerful without question
@FlynnTheRedhead
4 ай бұрын
@@TimCarambat That's awesome to hear!! I created an agent to get insider info, that's how I know of course!
@TimCarambat
4 ай бұрын
@@FlynnTheRedhead !!!!! I thought i was hearing clicks during my phone calls!!!
@aimattant
2 ай бұрын
looks great - will take a look after I have played around with Llava and Ollama.
@gillopez8660
4 ай бұрын
Wow this is amazing... I'm gonna go star you!
@thegristleking
2 ай бұрын
Super useful, thanks very much! I haven't been able to get the Google integration to work reliably yet; I'm not trusting what it pulls back when I ask for (what I think) are simple things, like the ingredients for a very specific product. Scraping that site and pulling in the page data fixes that. Again, very cool!
@flintsparkmedia8219
2 ай бұрын
This is stunning. Thank you for your effort, skill and time to create this for folks! I think I'm still sitting here - stupefied - over how powerful this is. Great job.
@SamBeera
3 ай бұрын
Hi Tim, thank you very much for the great video showcasing open source llms, and tools like anythingllm to create agents. I followed your video and successfully was able to do everything in your video. Are there other agentic videos for other usecases you made, look forward to see them. Cheers
@filipeeduardo1177
3 ай бұрын
that is really good, CrewAI is amazing but not all users interested in LLMs have the time to configure that much of stuff,
@TimCarambat
3 ай бұрын
I was diving deep into CrewAI the other day because I would love to have CrewAI users be able to "port" their work into AnythingLLM but found CrewAI doesn't have like a "server" or REST API, its like just a library like LangChain is - so scripts and static code :/ CrewAI+ (their hosted and paid model) is the only thing we could possibly integrate with - which is not ideal. AutoGenStudio is probably the only other AI Agent framework/tool we could integrate with. SuperAgent as well,
@spartanmod3
27 күн бұрын
Awesome presentation.
@AntiSmithhh
Ай бұрын
super-killer-mega-feature!!!111
@StunMuffin
3 ай бұрын
I really appreciate your time to explain a lot of things to us. ❤🎉
@spacetimepotato
3 ай бұрын
There were some concepts I didn't quite understand; for example, tunneling from the Windows PC to the Mac (if it's on your local network, why work with VPN protocols rather than client/server - due to needing a stateful connection vs. 200 response code or something?). But the interface itself is brilliant! And I think that when it becomes agent-swarm-capable it's going to be a much better option for me than Crew AI, as it feels more intuitive, I am just going to need multiple agents working together. I have never installed a local LLM, but you have inspired me to give it a try. Thanks!
@iam8333
3 ай бұрын
Billionaire alert🎉 seriously dope content , easy to understand effective communication
@am4_m037
2 ай бұрын
Good explanation, subscribed
@ImSlo7yHD
4 ай бұрын
This is perfect it just needs more tools and agent customization like crew ai and it is going to be an absolute killer for the ai industry.
@TimCarambat
4 ай бұрын
Will be coming soon! Just carving out how agents should work within the context of AnythingLLM and should be good. Also, it would be nice to be able to just import your current CrewAI and use it in AnythingLLM - save you the work you have done so far
@stanTrX
4 ай бұрын
This is the easiest all-in-one platform. Thanks. More videos please ❤
@mrinalraj4801
4 ай бұрын
Great work. Thanks a lot 🙏
@d.d.z.
4 ай бұрын
You are amazing. Thank you 🎉
@johnbrewer1430
4 ай бұрын
@sergiofigueiredo1987, @TimCarambat, I agree with Sergio. Wow! I have Ollama installed locally on a Windows machine in WSL. (I was leery of the Windows preview, but I may switch because NATing the Docker container is a pain.) I also pondered how to build a vector DB on my machine and integrate agents. You guys have already done it!
@kamerondewart7002
2 ай бұрын
feedback. I discovered this the same day as fabric. If you have not looked at it please do. If there is a way to include it inside of AnythingLLM it would be my dream tool. Well that and a note capability for saving a quick note as text or audio that can be transcribed, turned into a note with a reliable and easy to read format. One button record and stop/send to create a note for later review right on the first page. I'm building something like that already as a stand alone but I'm a noob trying something simple to learn with. It would be great if someone who knows what they are doing could put it into a tool I already plan to use a lot in the future. I love it so far. I have only been playing with it for a day.
@UrbanCha0s
4 ай бұрын
Looks really good and simple. I tried PrivateGPT using conda/Poetry and could never get it to work, so jumped into WSL for Windows connecting to Ubuntu running ollama, via WEBUI. Works great, but this just looks so much easier. Will have to give it a try. What I do like with the WEBUI I have is I can select different model, and even use multiple models at the same time.
@TimCarambat
4 ай бұрын
Yeah, we didnt want to "rebuild" what is already built and amazing like text-web-gen. No reason why we cant wrap around your existing efforts on those tools and just elevate that experience with additional tools like RAG, agents, etc
@Bob-yj3zr
2 ай бұрын
This is really cool. the best i have used so far.
@felixoluoch1371
2 ай бұрын
Great job, impressive, inconceivable , best LLM channel I've come across. Kindly fix discord invite link, thanks.
@themax2go
2 ай бұрын
using (setting up, testing) anythingllm for the first time now... would love an updated vid, including how to use it w/ searxng !
@TimCarambat
2 ай бұрын
Ah, yeah we have come a long way! We also are about to launch an automated fine-tuning pipeline so you can get a GGUF tuned from you data to run again locally. So there is a lot to talk about!
@themax2go
Ай бұрын
@@TimCarambat amazing, can't wait!
@digitalasylum369
2 ай бұрын
Thank you! This is so awesome!
@LuisYax
Ай бұрын
Tim, you are the man. Great work from you and your team on all of these great software. You are making complex simple. One request or a pointer in the right direction, are there any CLI tools to execute the agents and out put result to any of the workspaces. The GUI is great but at some point all of that needs some automation. Anyway, keep up the great work.
@TimCarambat
Ай бұрын
This is a great point, so we do have an API that you can use but it currently does not support agents :( Guess i know what needs to be fixed now - you are not the first to voice this!
@AliAlias
2 ай бұрын
Thanks 🙏, easy tutorial ❤
@biorig
3 ай бұрын
WOW! Mindblown! The RAG is fantastic! I uploaded a 'Davidson's textbook of medicine' and was able to ask questions and what not out of it! Thank you for the AnythingLLM Desktop. Thank you! Thank you! I have no more words!
@agentred8732
3 ай бұрын
Did you ask it questions that validated that the agent/bot was not straying from its training data, and into realms of general knowledge - or hallucination? I have a gigabytes-large proprietary data set that I need to train on, without straying. Open to ideas from anyone reading this comment. Thanks!
@biorig
3 ай бұрын
@@agentred8732 The answers were pretty much on the point. I am trying to upload a much larger 'Harrison's Textbook of Medicine', but seems there are limits to the size of the book that can be uploaded. So far, no hallucination, but I may not be pushing it to the edge. I was told that if we train it on too much material, the output gets generalised and loses depth - I am not yet able to test it with more material.
@alpha007org
3 ай бұрын
Which model are you running? I tried llama 8B q8, and when I asked question about "Release Notes History.pdf", the results were ... bad.
@biorig
3 ай бұрын
@@alpha007org OpenAI API.
@automatalearninglab
Ай бұрын
This is so cool! 🎉🎉🎉🎉❤
@themax2go
4 ай бұрын
very cool!!! subbed!
@TokyoNeko8
4 ай бұрын
Debug mode would be ideal. Agent to scrape the web just exits without any error even though I do have search engine api defined
@amulbhatia-te9jl
4 ай бұрын
Would it be possible to see a vide of setting up your Ollama models on Anything LLM, I followed these instructions but my ollama models never load.
@FayeSabre
2 ай бұрын
I'm a bit late to this but holy shit is this app good. Amazing stuff.
@SiliconSouthShow
4 ай бұрын
wOOHOO I GOT IT NOW! ID LOVE A UPDATE BUTTON LOL!
@TimCarambat
4 ай бұрын
It probably just was not refreshed yet. I think we have it on a 1 hour expiration to check so it may have been in between checks
@star95
4 ай бұрын
Great video! I also want to know how well the RAG function of AnythingLLM performs. It's important that text, images, and papers are handled properly and meaningful chunking are achieved
@dozieweon
3 ай бұрын
You are invited to the cookout 😂. Amazing video.
@scumdivision
2 ай бұрын
Awesome Tool! Installed it today and i'm super hyped to have such a powerful tool running on my PC ! I was wondering if it was possible to access the agent functions through the API? Couldn't something about in the documentation.
@LakerTriangle
4 ай бұрын
Literally sitting here wondering this when you dropped the video
@JacquesvanWyk
4 ай бұрын
Really awesome demonstration. I am excited about agents. Would be nice to be able to build custom tools in python for agents to use.
Пікірлер: 459