love it... as i am still a noob..would love to see a llm example with summarization model ..and to see the format involved .. thank you again!!!
@chiggly007
3 ай бұрын
Agreee this would be helpful to see
@kaloyanmirchev5006
3 ай бұрын
Thank you for presenting such great ideas. My imagination surely goes wild when I attempt to think of possible applications..
@tecbrain
3 ай бұрын
Fantástico vídeo. Gracias por el tiempo que inviertes. Ahora me queda entender bien el código.
@UtopIA-IA
3 ай бұрын
OMG! that is so powerful, thank you, I am alone doing projects of this type and this will be very useful for me, thanks for sharing you knowledge.
@flcor
3 ай бұрын
One note: the row-column decomposition is valid for matrices whose rows (columns) are not linearly independent - that’s probably why they train on the row-columns themselves and not on general matrices that cannot be factorized into row-column form. So, there’s clearly a tradeoff here between memory and linear independence.
@olivierdulac
3 ай бұрын
Thank you, great content
@underfitted
3 ай бұрын
Glad you enjoyed it
@restrollar8548
3 ай бұрын
Awesome as usual!
@alextiger548
3 ай бұрын
Fantastic stuff ,Thank you!
@mabadolat
3 ай бұрын
This is great stuff, Santiago! I wish you had posted this video a few weeks ago. We just completed our final class project where we trained five different BertClassifier models on five different tasks. Our fine-tuning and inference code structure is very similar to yours. We definitely could have used this approach to use just the specialized adapters instead of the full BERT models. However, I have one question: I'm not clear whether the full model will ever be used during this process after we get fine-tuned adapters, or just the fine-tuned weight matrix for evaluation and inference?
@underfitted
3 ай бұрын
You need to use both: the general model + the finer tuned adapter. The adapter describes how the general model should change on the fly
@abdullah_mufti
3 ай бұрын
very well explained
@jayng4028
3 ай бұрын
Nice tutorial, would like to ask how to fine tune an AI model that generate interior design?
@allanmogley
2 ай бұрын
How do you make those models that interact with data, Like I once saw someone create something really amazing that inteprets data from a a database and makes interpretations and reports from the data wothout hallucinating (It only fetches from the underlying DB)
@monugarg8627
2 ай бұрын
Hey sir. Very good explanation. Sir is it possible for you to make a video on Ai Agents and tools please.
@syedasadzaman9591
2 ай бұрын
Good Stuff! Santaigo. The channel name should be `Tutorials That do not Suck!` =}
@kencottrell
3 ай бұрын
When you have the original model + plus the Adapter model, can the original model still solve the save generic tasks? In other words, can you perform original inferencing tasks PLUS specific tasks?
@underfitted
3 ай бұрын
Yes you can
@Leo-ph7ow
3 ай бұрын
Thanks!
@devevangelista
3 ай бұрын
if run this with 16G memory and RTX 2060 could work?
@sirojiddinnuriyev2839
3 ай бұрын
There are a lot of contents how to fine-tune LLMs with LoRA or QLoRA. You gave us same food just with ‘apple genius’ keyword.
@underfitted
3 ай бұрын
I’m glad you knew everything I said already! Good for you.
@krishnasoni8169
2 ай бұрын
I cannot talk with the agent,the connection is established but it aint respond or neither taking image i/p please suggest something
@AngusLou
3 ай бұрын
Can you make a Google Colab notebook for the same fine-tuning?
@underfitted
3 ай бұрын
Yes. Just load this notebook in Google Colab
@m.active
Ай бұрын
there isn't a general solution to decompose a matrix of M*N into two vectors of M*1 and 1*N. If that was the case we could have some all the issues in the data compression by now. A lossless compression of 99.99% for huge matrix is a strange achievement.
@robertobreve8623
3 ай бұрын
The jupyter notebook has broken images.
@2021philyou
3 ай бұрын
Missing all the info that is needed to implement the idea on own data set
Пікірлер: 31