Start building awesome projects with $15 free credits using BrightData today: brdta.com/conaticus1
@AWIRE_onpc
5 ай бұрын
no
@xulaxwtf
5 ай бұрын
no
@aryanszone4963
5 ай бұрын
no
@noviui
4 ай бұрын
no thanks
@user-uv3nv2bc6v
3 ай бұрын
no
@jaymarksum6542
6 ай бұрын
I’m impressed, can’t wait to see you build a multithreaded web server in assembly
@da40au40
6 ай бұрын
Why do I find it super funny 😅😅😅.
@ArthursHD
5 ай бұрын
@@da40au40 Me too :D
@DanskeCrimeRiderTV
5 ай бұрын
it's not impressive. Of course querying a few hundred or even hundred thousand web pages isn't as complicated or slow of a task than querying trillions of webpages.
@KibitoAkuya
5 ай бұрын
@@DanskeCrimeRiderTV google also wastes time deciding wether you are allowed to see or not certain sites
@DanskeCrimeRiderTV
5 ай бұрын
@@KibitoAkuya what does that have to do with anything? Google is still faster at querying trillions of results than this.
@lifeofme702
6 ай бұрын
I don't know what this guy said, and still was mind-blown of all the effort this guy puts
@conaticus
6 ай бұрын
Thanks much so 🙏 It would not be possible without your support
@ccost
5 ай бұрын
7:40 flashing those questionable websites in a sponsored video is quite the move
@twitchizle
5 ай бұрын
You scared of porn?
@asm_x86
6 ай бұрын
That's really impressive, I can't even figure out how to run it.
@ZuperPotato
6 ай бұрын
Nice username
@conaticus
6 ай бұрын
Just added some instructions to the READMEs if you're interested :)
@asm_x86
6 ай бұрын
@@conaticus thanks, I'll do that
@greensporevalley
6 ай бұрын
SERBIA MENTIONED 🎉🎉🎉
@RealMephres
6 ай бұрын
@europa_the_last_battle>goes to comments >sees meme comment >looks at replies >only a LARPer replied lol
@jawadmansoor6064
5 ай бұрын
that name rings a bell, maybe from some kind of Serbian movie?
@RealMephres
5 ай бұрын
@@MAXHASS-ph5ib tell that to the LARPer dawg
@slimeyar
5 ай бұрын
@@RealMephrestell that to yourself 😊
@RealMephres
5 ай бұрын
@@slimeyar you first
@coderan5029
5 ай бұрын
This is basically what we learned in my big data class, but we used map-reduce to do the TF-IDF calculations, so it's impressive you figured this out on your own
@6IGNITION9
5 ай бұрын
filter out JS for another 10x bandwidth savings alternatively use an adblocker. (can puppeteer do that? It's just chromium right?)
@dreamsofcode
6 ай бұрын
🔥🔥🔥
@80sVectorz
5 ай бұрын
3:07 Best pronunciation of Euclidean I have every heard :P
@CrazyDiamondo
5 ай бұрын
Where?
@80sVectorz
5 ай бұрын
@@CrazyDiamondo I added a timestamp
@devinlauderdale9635
6 ай бұрын
The problem is this approach is susceptible to SEO spamming/invisible SEO keywords
@conaticus
6 ай бұрын
Yeah for sure, realistically it should be moderated based on user interaction as well
@SG-kn2jl
5 ай бұрын
Why did you choose TF-IDF instead of word2vec or any context aware model?
@skorp5677
5 ай бұрын
+1 Woule like to know
@R_Y_Z_E_N
5 ай бұрын
Google also does the same but with disstributed computing to reduce the overall time . Just scale the database horizontally and mimic googles apporach
@rafaelpereiracoias1047
5 ай бұрын
Nice video and nice code, keep up the good work!
@aryakvn6051
3 ай бұрын
You could calculate and cache TF values on the fly so you don’t fill up your ram as quickly but still get a decent response time.
@ExpandedCuber
6 ай бұрын
Let's go another conaticus video
@foqsi_
5 ай бұрын
Love this dude and his video projects
@conaticus
5 ай бұрын
🙏
@turb0004
5 ай бұрын
Please finish your file explorer in rust fully, because the idea of it is awesome. Love your videos, content is very engaging 🎉
@miro5182
3 ай бұрын
You can use a chrome like TLS config to not get blocked by cloud flare in a lot of cases, using a browser for scraping isn’t viable when tracking about scanning the internet.
@MySachincool
4 ай бұрын
Subscribed & notifications on :) you deserve more recognition bruh
@alexmoses3215
4 ай бұрын
Programming 🤝 martincitopants…match made in heaven
@JoshuaLonsako
5 ай бұрын
W ad plug, it's 100% relevant and actually necessary to fulfill the premise of this vid.
@errplane_
6 ай бұрын
oh my fuck i saw this on your github last night
@jugurtha292
5 ай бұрын
very nice, built something similar for my info retrieval class. we have to use okapi bm25 formula for the ranking but overall very similar. scrape, tokenize, parse, inverted index, rank
@polyshrub
5 ай бұрын
This is very impressive, what was the size of the database when indexing is finished? Seems like it would be quite big
@synapsenova299-fp7tf
5 ай бұрын
>goes to youtube homepage >finds this video >yipeee >oh >lets try it
@madalenaferreira3018
5 ай бұрын
great video, gave me ptsd from my information retrieval class though
@GermanTimecrafter
6 ай бұрын
such a cool video! i love the way how you explain what you are doing :) random question but what is your editor font?
@conaticus
5 ай бұрын
Appreciate it :) I'm using Jetbrains Mono it's free to download
@lonelybookworm
5 ай бұрын
Well of course it is very fast, it only has like 200 websites
@stayhappy-forever
5 ай бұрын
thats insane, hows this only at 12k views
@MortonMcCastle
5 ай бұрын
Good! The world needs a new Google Search, one that's more like how it was in the 2000s.
@a224kkk
5 ай бұрын
Nice, you re-invented the lucene library
@jsalsman
5 ай бұрын
I believe it's "inverted indexing", as inverse indexing is something else.
@HyperCodec
5 ай бұрын
Bro managed to memleak in js
@joenutt1232
5 ай бұрын
Create your own database engine for shits and giggles
@conaticus
5 ай бұрын
B+Trees 💀
@iritesh
5 ай бұрын
Awesome effort ✨
@gamedirection_us
5 ай бұрын
🍎 👀 .. Apple being like "when will it be ready?".
@gopallohar5534
4 ай бұрын
ain't see rust there!
@Raven-fu1zz
5 ай бұрын
Remember, never return an over 18 site without an over 18 word in the search request
@maksymilianglowacki1409
5 ай бұрын
is this engine oneline or ( wouldt it be abel to be oneline for otcher users ) so otcher also coulst enjoy it? or was it dust a peak or somthing you made cuz ( you where bored or smt )
@Nerdimo
6 ай бұрын
Impressive, seriously!
@monotonedevelopment
5 ай бұрын
If only windows file explorer could do the same
@SandWire
5 ай бұрын
For this we have thing named Everything :)
@allenfpascua
6 ай бұрын
Super good editing 🫡🫡🫡🫡
@conaticus
5 ай бұрын
Would not possible with your breathtaking animations 😄
@sleepybraincells
6 ай бұрын
Why is there Rust in the thumbnail? This was written in Javascript
@conaticus
5 ай бұрын
Used Rust for the API and TF-IDF matching - decided not to keep in much of the footage for that as it was already explained in the animations
@AquaQuokka
6 ай бұрын
Rewrite your genetic code in Rust.
@pyyrr
6 ай бұрын
i would rather be bug free so i will pass
@gammongaming9081
5 ай бұрын
yk what would be funny? making the slowest search engine possible without like halting the program for a set time, just with maths
@a6gittiworld
5 ай бұрын
Supa dope. I would like to use this search engine of yours
@humanontheinternet6510
4 ай бұрын
Auto solve captcha you say🧐
@v037_
5 ай бұрын
I found a worthy opponent
@--bountyhunter--
3 ай бұрын
bro thought he could scrape my web and get away with it.
@animeworld4775
5 ай бұрын
what is things that i should to know or learn to create like these projects
@binpersonal
5 ай бұрын
"some fucking genius" lmao
@thekwoka4707
5 ай бұрын
How much did the scraping cost if it wasn't free?
@callowaysutton
5 ай бұрын
Next time use the Common Crawl dataset ;)
@ethanstewart1011
5 ай бұрын
How did you manage to get a node.js memory leak??
@mahrezjanati3426
5 ай бұрын
first time watching a vid of yours ... i have one question : why are you vibrating ??
@-rate6326
5 ай бұрын
Cause he is vibrator
@InioluwaFalade-Tolulope
3 ай бұрын
don't know either
@SlimyFrog123
6 ай бұрын
Now make your own email system to go along with it. 😉
@iCrimzon
3 ай бұрын
Cant wait for you to rewrite JS in binary 🎉🎉
@Faeest
5 ай бұрын
why disallow and user-agent matter? can't you just scrap everything?
@skorp5677
5 ай бұрын
You can but it might be illegal
@Xanmattauri
5 ай бұрын
@google acquire this man
@deepfan14
4 ай бұрын
Bro make a compiler programming language
@schoolbreakyay
2 ай бұрын
Can i not use brightdata?
@_DarkLiquid
6 ай бұрын
discord clone when
@igrb
5 ай бұрын
nice
@gaimnbro9337
5 ай бұрын
Nice job :D
@upcoming-k6p
5 ай бұрын
You should host it
@Horn7xBG
5 ай бұрын
hub 🎉🎉
@danielisop3182
5 ай бұрын
What did u mean by the websites u shouldn’t have searched
@ColorVisor
Ай бұрын
whats the link?
@larry_berry
6 ай бұрын
Lol. Got notif after clicking the video.
@fangg194
5 ай бұрын
you seem ok
@ALTERRAa8
5 ай бұрын
6:08 nahhhhhhhhhhh whats bro even searching 💀💀💀💀
@AttaaH
3 ай бұрын
0:33 🤨
@Miluum
5 ай бұрын
1:06 automatically solve captchas? i knew these things exist just to waste our time and energy
@neologicalgamer3437
5 ай бұрын
Bro sounds like WilburSoot
@AhmedMo-ec4kz
4 ай бұрын
Great video 😊 FYI: bright data is an Israeli company 😮
@etherbeans
6 ай бұрын
da goat
@playtatus1758
5 ай бұрын
how do you edit your vids
@conaticus
5 ай бұрын
Allen uses adobe after effects for the amazing animations - I just use Davinci to cut things up 😁
@playtatus1758
5 ай бұрын
@@conaticus ok thx
@daemonkisure2952
5 ай бұрын
how can i install this search engine?
@conaticus
5 ай бұрын
Instructions are on the Github repos :)
@juniordevmedia
6 ай бұрын
what TF is IDF ?!!
@neofox2526
6 ай бұрын
idk man but watching it makes me feel smart
@jamesbarret4240
5 ай бұрын
Term frequency (the number of times a given word or so shows up in total) - inverse document frequency (the number of times it shows up in a specific document). The wikipedia article is pretty good: en.wikipedia.org/wiki/Tf-idf
@Tech_Code127-76
6 ай бұрын
Good
@J0Y22
5 ай бұрын
shockedd
@Macellaio94
5 ай бұрын
Liked and subbed
@susannerudolph8469
5 ай бұрын
then brightdata makes captchas useless
@educacionespecialchannel3756
5 ай бұрын
Captcha's effectiveness has been in question for quite some time now.
@brettmiddleton5013
3 ай бұрын
protects against amateurs but keeps it simple enough that an expert won’t breach/destroy their data to get what they want.
@Ayymoss
6 ай бұрын
MAKE LONGER VIDEOS
@brettmiddleton5013
3 ай бұрын
So you’re telling me I can access restricted data by telling it to, basically, ignore restrictions??? I Have been calling myself dev, admin, ownr, root in vain for far too long
@monkshee
6 ай бұрын
damn
@planktonfun1
5 ай бұрын
Still not fast and scalable enough. The result is not even relevant, you made bing not google
@LaugeHeiberg
5 ай бұрын
wow really? Im also surprised one single guy didnt manage to make a product rivaling Google
@gamefun2525
3 ай бұрын
wow Sheldon, you got your Nobel yet?
@_sohom
5 ай бұрын
Make a better version of VSCode.
@ph03n1x_dev
6 ай бұрын
You made a search engine for porn?! Thats disgusting... is it on GitHub?! 👀
@conaticus
6 ай бұрын
All open source and ready to play around with 😂
@ssoka-m5n
5 ай бұрын
rust is a real badass❤❤
@lukamajcenic1172
5 ай бұрын
This is just an ad for BrightData. Compared to previous videos very low effort.
@kavinbharathi
6 ай бұрын
Not to be the 🤓☝️ guy, but "Jana Vembunarayanan" is pronounced 'Ja' as in 'Jarvis' and 'na' as usual. Just fyi
@conaticus
6 ай бұрын
Thank you, I'll do this if I ever pronounce it again 😂
@flashyexe1
5 ай бұрын
this result dont make any sense xha... very fast
@vrljk
5 ай бұрын
SRBIJAAAAAA
@DanskeCrimeRiderTV
5 ай бұрын
how is this impressive? Of course it's gonna be faster. You aren't querying billions or even trillions of web pages unlike Google? So this search engine isn't even faster than Google...
@conaticus
5 ай бұрын
It wasn't meant to be impressive it was meant to be informative and entertaining 👍
@DanskeCrimeRiderTV
5 ай бұрын
@@conaticus your thumbnail implies it is faster than Google. And I believe the original title did too.
@FaZekiller-qe3uf
5 ай бұрын
Disappointing
@avi7278
4 ай бұрын
You need to learn how to sync up your audio and video.
@FeTetra
5 ай бұрын
⬛🟧 http scrape?????
@coderx8634
6 ай бұрын
Love your content. You and your quality have really improved. Keep it up ❤
Пікірлер: 184