dude, you provide so much alpha for us by doing these actional pragmatic rundowns of the documentation. Thanks again.
@MachineLearningStreetTalk
6 ай бұрын
The man is back in the game!!!
@connor-shorten
6 ай бұрын
Haha absolutely! Thanks Tim!
@Karl-Asger
6 ай бұрын
DSPy to the moon 👏
@connor-shorten
6 ай бұрын
Haha indeed, thanks Karl!
@kevon217
6 ай бұрын
Love how easy it is to plugin different models for different tasks within the same DSPy program.
@arnonil
6 ай бұрын
Could someone please clarify what "parse float rating" means? Generally speaking, I admire your enthusiasm and appreciate the effort you put into your content. However, I found myself a bit perplexed by some of the new jargon and terminology. Providing clear definitions could significantly enhance comprehension for us, the audience. Keep up the excellent work-I'm eagerly looking forward to your upcoming content.
@connor-shorten
6 ай бұрын
Thank you so much for the kind words of encouragement! "Parse float rating" refers to extracting a float value from the initial response from an LLM -- this is one way to achieve structured output parsing with LLMs, there are many others as this is one of the biggest issues in LLM programming these days. DSPy also has DSPy Assertions with `dspy.Suggest` / `dspy.Assert` that is similar to this 2 model call philosophy, another idea is to first validate a response with a pydantic schema and then if it fails, format a retry prompt -- so I guess also 2 model calls in philosophy. The other approach would be maybe like deeply integrated decoding in the LLM itself -- idk, I've settled on the 2 model call solution personally, hope it works for you as well!
@thirukarthikanadar615
3 ай бұрын
Hi Connor, thanks for the awesome content. I have one small suggestion - Instead of covering maximum information, if it was topic by topic it would be more better. Example: In depth Information on 1 topic "Optimizers (formerly Teleprompters)". Thank you🙂
@ecardenas300
6 ай бұрын
Awesome video!
@connor-shorten
6 ай бұрын
Thanks Erika!
@ronaldbrinkerink7862
6 ай бұрын
My head is spinning, but man this is really opening up possibilities for optimizing and overcome all childdiseases of llm inference. Thans conner, keep up the great work
@truliapro7112
6 ай бұрын
Teaching too fast for this complex topic.
@davidw8668
6 ай бұрын
Thank you Connor for these updates and "adding depth" to the DSPy topic ;) I really appreciate it and it looks like you're about to become Mr DSPy here on youtube, keep the content coming.
@thewimo8298
5 ай бұрын
I love your energy throughout this video Connor!
@AyaAya-fh2wx
5 ай бұрын
Dude, you must be getting millions in karma for this. Thanks. Great tutorial
@fkxfkx
6 ай бұрын
If DSPy can autonomously optimize prompts, what about doing the same with code on the fly? How might we go about having code examine itself, its operation efficiency, its results and come up with self improvements Could DSPy be harnessed for this task? I could see doing both at once to get increased performance across 2 domains of prompt + code optimization
@connor-shorten
6 ай бұрын
Yeah I think you are definitely thinking on the right path. It is crazy how you can connect the loop with synthetic data to achieve this. You could use the python interpreter and use things like `time.time() - start`, but I'm not sure how you might interface deeper performance inspections like a cpu or lock profile for example.
4 ай бұрын
Performance as in speed is not always the target. In order for the code to be optimizable, you would need to give it data matching the real world. If you just optimize for unrealistic dummy data, the optimized one may be faster for that use case but completely fail in the real world. I think a more realistic approach would be something where the LLM can have a discussion with you and showcase different approaches with their pro's and con's, and allow you to decide.
@fkxfkx
4 ай бұрын
@ that’s not at all realistic or imaginative. You seem to be stuck in legacy thinking. Try using your imagination.
@kevon217
6 ай бұрын
Would love a video on the TRACE great video!
@davidwynter6856
6 ай бұрын
I think spending quite a lot of time in the DSPy code is not ideal. You have to race through it because of the time constraints. Maybe get GPT4 to describe the code and use that to explain how it works?
@8eck
5 ай бұрын
Is there video about optimization with gradient descent?
@lakshaysagarrana3965
5 ай бұрын
Connor be experimenting with video formats.
@PrathameshSaraf
5 ай бұрын
How can we get metadata that is associated with any chunk of docs
@eliasfarias3670
6 ай бұрын
Hi! have you tried DSPY with the Google Gemini API? because it gives me an authentication error with GCP
@frazuppi4897
6 ай бұрын
can you share a link to the notebook?
@connor-shorten
6 ай бұрын
Hey! Just updated the description! Thanks so much!
@frazuppi4897
6 ай бұрын
@@connor-shortenthanks to you for the amazing video
@larsbell1569
6 ай бұрын
Maybe we could be dividing by 4 instead of 5.
@hamzafarhan5429
5 ай бұрын
How do you get the final optimized prompt?
@redflipper992
5 ай бұрын
print(f"""I'm actually a retard""")
@shivamkumar-qp1jm
Ай бұрын
Give also options for gemini model now gemini is also good
@haralc
7 күн бұрын
I keep wondering if I'm not just getting the joke when you start laughing briefly while talking ...
@redflipper992
5 ай бұрын
My dude... I can tell this is an 'extra-curricular activity' that you've done for us. But there is a lot of handwaving especially toward the end when you're getting tired. I really appreciate the video and production, but certain parts are an all-or-none type of deal. It would be good if you could take a breather and give those sections the attention and unpackaging that they deserve. Anyhow, thank you for what you've done so far~
Пікірлер: 35