Very beautiful! It would be interesting to see the dynamics when an input digit is moved left/right/up/down inside the input matrix, provided that the network result is resilient to such moves.
@notsure186
Жыл бұрын
This dataset is centered. Usually it is a toy example. Would be possible with augmentation to do that.
@bltzcstrnx
Жыл бұрын
This is usually done before classification. The preprocessor recognize the character first then segmented it. So the classifier already have a properly formatted image.
@michelspeiser5789
Жыл бұрын
Very nice. This could look even cooler if you clustered the neurons based on simultaneous activations, and relocated the neurons based on this clustering.
@wmvanvliet
Жыл бұрын
Interesting idea. I might try that.
@hamishmatthews21
Жыл бұрын
@@wmvanvliet Please do! Have subscribed.
@wmvanvliet
Жыл бұрын
You mean like this? kzitem.info/news/bejne/1Hp60H6Ip6B5lKQ
@krisztiankoblos1948
Жыл бұрын
@@wmvanvliet Nice :)
@michelspeiser5789
Жыл бұрын
@@wmvanvliet Exactly like this :) Fantastic
@krofnoops
Жыл бұрын
This made me want to dive deeper into solidifying my understanding in neural networking. I love data visualizations so much, they are the ultimate reward/feedback when you learn and want to verify your knowledge.
@kennjank9335
10 ай бұрын
This has nothing to do with data. This is merely illustrating flows of information. Where are the decision points and output nodes? Other than being "real purdy" this has little value.
@krofnoops
10 ай бұрын
@@kennjank9335 check your ignorance for it becomes blatant arrogance.
@kennjank9335
10 ай бұрын
@@krofnoops YAWN, I have forgotten more about AI than you will ever know. I wrote my first Aerospace-Defense system in 1988. Implemented neural networks in 1994 for global banks. I was designing, developing, and delivering AI SOLUTIONS before you were an itch in your daddy's pants. I built the first viable NLP speech recognition and synthesis systems for the government. Let me guess, you're a Zoomer or Millie. Go away now little man. This table is for educated adults. Better yet. Go stare at some captivating but useless animations, Manga perhaps.
@kennjank9335
10 ай бұрын
@@krofnoops YAWN, I was developing AI and neural network apps before you were an itch in your Daddy's pants. Go away, newbie, come back when you have grown up. Go kissy face with your smartphone.
@enricotartarotti
Жыл бұрын
@marijn von Vliet can I use a snippet of this video on an upcoming video on my channel about AI? Will add credits on screen to your channel
@wmvanvliet
Жыл бұрын
If you spell my name correctly, then sure :)
@halihammer
Жыл бұрын
This is a very beautiful visualization!
@okboing
2 жыл бұрын
If there's anything i learned about neural networks and machine learning, it's that the black box doesn't care how readable its thought process is, and it will stick with the first state that works, regardless of how.
@alexandresoutonogueira7675
Жыл бұрын
this is not a characteristic specific to neural networks, but a characteristic the evolutionary genetic algorithm aproach of machine learning.
@Mortequal
Жыл бұрын
Would be interesting if this was interactive. Set it to a number and then affect the output by selecting/pulling different points with the cursor.
@rodrigo-do-carmo
Жыл бұрын
This is so nice! Awesome work
@ai_is_a_great_place
Жыл бұрын
The algorithm was slow. But here we are 👌
@Klangraum
Жыл бұрын
Wow, that is a cool image-to-meaning representation.
@FreshSmog
Жыл бұрын
As amazing as it looks, it also involves lots of reading and writing to ram, and the CPU sending instructions repeatedly to simulate these virtual neurons. How amazing it much be within a living brain, where neurons communicate simultaneously of their own volition, without a cpu barking orders. And consumes barely any power compared to a computer performing ai tasks.
@DabuDave
Жыл бұрын
Looks like a model of the universe
@skaramicke
Жыл бұрын
I would like to see one where a number is showing on the display and then moves from one side to the other, so we can see the activations shift but still trigger the same resulting number.
@MicahBratt
Жыл бұрын
Wow that’s a cool visualization
@MODEST500
Жыл бұрын
Marvelous invention of Man since the internet . God bless you . Thanks for sharing .
@KomodozGaming
Жыл бұрын
This is perfection!
@Vladferrum
Жыл бұрын
Breathtaking and frightening at the same time.
@Askejm
Жыл бұрын
love this visualization, you should render it in 8k or at least convert the high bitrate 1080p to 8k 80 mbps so we can see all of the details (youtube does 8k at 80-160 mbps)
@yacwac
Жыл бұрын
Wow really amazing is this same as Latent Space?
@neerajnigam6
Жыл бұрын
Where are the convolution layers? Looks like image itself is intelligent and firing fully connected neurons in layer 1
@sergeypalkin
Жыл бұрын
It makes more visible how our brain works.
@Tigrou7777
Жыл бұрын
It looks like a spider had fun
@SavageStephen
Жыл бұрын
This is like some Tony Stark type shit fr fr
@siddhanthbhattacharyya4206
4 ай бұрын
god i love deep learning
@KlausRosenberg-et2xv
8 ай бұрын
Consider that is a neural network only for a single number recognition with limited pixels, imagine what GPT-4 is like. I saw a post that its data consisted in 680 kilometers of 2 bookshelves per meter full of books. It's an absurd quantity of data.
@cagatayaksoy9771
10 ай бұрын
How is it decoded to what the neurons firing in the last layer correspond to?
@DaHaiZhu
Жыл бұрын
Think for a moment: What if consciousness is nothing more than this - patterns in a network. Cause and effect. No free-will. No self determination. We are all just complex machines. And the only anomaly in our lives is when something inside us fails.
@wmvanvliet
Жыл бұрын
Even it it were true that our consciousness is nothing more than a super complex network, I don't see how that would mean no free-will or self-determination. The network would be our "self". The network would be you. To say "the network decided" is to say "I decided".
@a---------------
Жыл бұрын
@@wmvanvliet always been curious to how nature could have a mutual relationship with biological neurons in the human brain
@wmvanvliet
Жыл бұрын
@@a--------------- For context, it requires a pretty large artificial neural network just to accurately simulate a single biological neuron. kzitem.info/news/bejne/zWpuk5WYpGV9i2k
@MrCmon113
Жыл бұрын
Consciousness is the circumstance that it is like something to be you, like something to be a cat, etc. So it just being "patterns in a network" is nonsense. "Patterns in a network" could 1to1 correspond to consciousness, but they still wouldn't be it. "Free will" is nonsense, no matter what. And you're not a machine, because you're no one built you.
@peoplez129
Жыл бұрын
We're all ultimately just slaves to physics and principles. But saying that is not consciousness is foolish, because there would be nothing if these things didn't exist. You are not an entity born out of nothing. You are an entity built on many complex structures, and to exist, you must exist within the parameters of those structures. It's that simple. These networks are merely ways to do things that otherwise would be impossible. They're tools and tricks. No different than how any creature does biological tricks to survive in an environment. These networks are not just how we perceive the world, but also how we learn, so these networks aren't fixed, they reorder as needed, in response to stimuli, and in response to itself. This is how you become better at things, or don't just wake up one day holding a different personality. This is also why things like brain damage can cause a persons personality to change, because their network is damaged in critical ways that fundamentally erases parts of who they were, because the network is firing differently with those missing components. Even when the brain makes new connections in attempt to bypass issues, it's not actually bringing anything back, it's just trying to work with what it has.
@vtrandal
Жыл бұрын
Bravo! Fantastic! Brilliant!
@bishbish9111
Жыл бұрын
When will be available in cinemas?
@Offchops2659
Жыл бұрын
Still missing a cortex. Looks cool thanks, y'all are still stuck in the box
@deardevildaregod6503
Жыл бұрын
umm... if the single light from begining can cast lot of line, why it still need that "neural" to draw bigger number sorry for my stupid question, i just didnt get it
@70shahin
2 жыл бұрын
Very informative and actually nice. At least a picky subscriber found a new channel to subscribe. (although Dmitiev channel hasn't been updated for a while.) two questions though, 1.Any libraries in Python that has been used for this visualization? I bet it was Javascript :/ 2. You don't check your email? :D
@wmvanvliet
2 жыл бұрын
Visualization code is here: github.com/wmvanvliet/scns/tree/main/visualizations/multilayer_perceptron I don't always respond to email.
@70shahin
2 жыл бұрын
@@wmvanvliet all good :)
@soamf
Жыл бұрын
Wow! Just beautiful!
@emiliotonixgleason3276
Жыл бұрын
How there 2d conv is translated in this video ?
@wmvanvliet
Жыл бұрын
This is a multilayer perceptron. No 2d conv is being performed. For a visualization of a convolutional neural network, I refer to @DenisDmitrievDeepRobotics incredible original source I so shamelessly imitated: kzitem.info/news/bejne/lICHmZyPpKFmZI4
@Jowanoofy_ZO
Жыл бұрын
Looking at it is killing mer
@bigchocolatemandingowarrio2475
Жыл бұрын
me who knows nothing about the video: what is this fascinating thing
@wmvanvliet
Жыл бұрын
This is what is known as an "artificial neural network" that has been designed to transform an image into a number. In this case, the image is that of a handwritten digit. You can see the individual pixels as the first "layer" of the network. These pixels are numbers going from 0 (completely black) to 1 (completely white). The pixel-numbers are multiplied with a matrix of other numbers to produce 1096 new values. These values are visualized as the second "layer" in the model. Then these values are multiplied again with a matrix of other numbers to produce the third layer, and again to produce the fourth layer and finally, one more time to produce 10 new numbers. These final 10 numbers follow an interesting pattern. When the input image represents a handwritten 1, the first of the 10 final numbers tends to be higher than the others. When the input image represents a handwritten 2, the second of the final numbers tends to be higher than the others, etc.
@ultimateloser3411
Жыл бұрын
Face recognition network next
@frun
Жыл бұрын
Neural networks is NOT the only approximation technique.
@gautam1337
Жыл бұрын
beautiful
@Jandodev
Жыл бұрын
This is really cool
@jakekeene3527
Жыл бұрын
Did you use a hash table?
@Holuunderbeere
Жыл бұрын
Love it
@ssuriset
Жыл бұрын
So it's just one instance of neutral network... is it a training set?
@wmvanvliet
Жыл бұрын
It is indeed just one instance of a trained neural network. The images that are being fed into the network in this visualization are indeed part of the training set that was used to train the network. The MNIST dataset.
@mhihcsan9745
Жыл бұрын
Great content
@diogenmusic8310
Жыл бұрын
думаю вечность рядом очень
@enricotartarotti
Жыл бұрын
Cool, now do GPT (just kidding, this is incredibly fascinating)
@ufox77
Жыл бұрын
That’s amazing.
@KnowL-oo5po
Жыл бұрын
In order to master ai we need to master the brain
@usamam2227
Жыл бұрын
What is it
@TheCitygear
Жыл бұрын
Good!
@prashantkumar2963
2 жыл бұрын
WOW
@TheUltimateTurk
Жыл бұрын
and people still deny intelligent design? bruh
@BigDataLogin
Жыл бұрын
Color
@david1r200
Жыл бұрын
OMG!! Isso ficou lindo.
@Ultimate_Tito_TheExplorer
Жыл бұрын
Im not trying to offend. I dont know what it means my guy, so complex if you ask me.
@2fifty533
Жыл бұрын
this video is just meant to be a visualization, not a full blown explanation of how neural networks work, if you actually wanna understand then just search it up, there are plenty of good videos out there
@ДмитрийКузин-я2з
2 жыл бұрын
что-то тут нето.. Это не интеллект. Это виденье человека, о том как выглядит ИИ.. Но это всё не то.
@petevenuti7355
Жыл бұрын
Yes, this is not what intelligence looks like. But it is just *one* way to represent *one* specific type of neural network used in a field that's just *called* artificial intelligence. Of course, must credit a human for it's creation, that's why it's called artificial, yes?
@ДмитрийКузин-я2з
Жыл бұрын
@@petevenuti7355 Yes. I agree. :) Humanity is taking the first steps in this direction.
@SeyidAr
Жыл бұрын
Make it organic and you have yourself a brain.
@PhillipAmthor
Жыл бұрын
r/Dataisbeautiful
@corie990gt9
Жыл бұрын
Wtf?
@wmvanvliet
Жыл бұрын
?
@ryanninjutsu
Жыл бұрын
the hell did i watch ? what is that mean ? can someone speak in english ?
@Yutaro-Yoshii
Жыл бұрын
It would be so cool if we could physically make something like this with wires and potentiometers.
@wmvanvliet
Жыл бұрын
Interestingly, that is exactly how the first perceptron worked. It was a physical machine: kzitem.info/news/bejne/tKub3KVjpIyVfKw
@Yutaro-Yoshii
Жыл бұрын
@@wmvanvliet Wow! That's such a cool contraption! I'd never have believed if someone told me that there was an AI in the 50s that could distinguish woman's images from men's.
@Leenux
Жыл бұрын
@@Yutaro-Yoshii Even today it is not 100% correct, but still, any oscillation above 90% of correctess is a very good outcome
@iCore7Gaming
Жыл бұрын
It has been. Was one of the first AI. But you can actually use solid state drives instead.
@cpul01
Жыл бұрын
We can : en.wikipedia.org/wiki/Seven-segment_display
@Nothing-cx4jt
2 жыл бұрын
Excellent work. I liked the way you separated the layers visualization. Would love to see more. I was looking for online course or tutorial to understand the whole process of creating this visualization better. Thank you so much for sharing it and the code along.
@semtex6412
Жыл бұрын
took an AI class, i was so flabbergasted with backpropagation/stochastic gradient descent had to visualize what it would look like so i googled it. can't thank you enough!
@alexander_richter
Жыл бұрын
this doesnt show either. Its just showing the activations of the forward pass.
@milesbennet4572
Жыл бұрын
It's all math from the 90s. The newest AI models like chat GPT all use the transformer blocks structure and Adams Optimizer instead of stochastic gradient descent. The mathematics behind it are completely different than that of Neurons with activations. However all these models still throw in a good old fashioned linear layer here and there to transfer latent space into a desired output.
@alexander_richter
Жыл бұрын
@@milesbennet4572 the mathematics is quite similar. Except in transformers some activations become weights and are multiplied with other activations. And the Adam optimizer is just a few lines of code if you implement it from scratch.
@milesbennet4572
Жыл бұрын
@@alexander_richter Yes I know, but I mean the mathematics behind it is different from the standard Neural Network with the sigmoid or Relu. But I agree, it still builds upon it ofcourse.
@MrCmon113
Жыл бұрын
I suppose you can look at visualizations of backpropagation. But the point is to calculate partial derivatives in such a way that you spare yourself as much computation as possible.
@xDevoneyx
Жыл бұрын
Very nice animation to get a good intuitive sense of what is going on. Also cool to see that some other outcomes light up dimly. Indicating it is not an absolute system but based on weights. Thank you for posting it.
@Slarti
Жыл бұрын
Interestingly enough back in 1988 when I started my computer science degree course one of the final year students had, for his final year project, written a machine learning program that could learn the alphabet on an Atari ST.
@jensk9564
2 жыл бұрын
Hi Marijn, very cool visualization. Great work. One question: is it possible to use a couple of stills of this video for a book??
@wmvanvliet
2 жыл бұрын
Sure! (with attribution). Also, if there is something specific you want out of this visualization, feel free to ask. It's generated through a script that pretty easy to modify to produce specific shots.
@jensk9564
2 жыл бұрын
@@wmvanvliet Hi Marijn, sounds wonderful! how should the right credit be? Just your name?
@wmvanvliet
2 жыл бұрын
@@jensk9564 Yes, just the name would be fine
@jensk9564
2 жыл бұрын
@@wmvanvliet sounds great. I will get back to you with the stills chosen and show you how it will be arranged. Thanks again! Jens
@KarthikNaga329
Жыл бұрын
@@wmvanvliet which software did you use to generate this?
@MegawattKS
Ай бұрын
I watched this a few times and then stopped it at time 0:02 and was staring at the center of the cube. Interestingly it still looked like it was very slowly spinning! If I look to the right a little, so the numbers come into my field of concentration, it stops, of course. But it restarts if I shift focus back to the cube center. It seems the visualization has trained my brain's neural network ! ;-)
@Astrojamus
Жыл бұрын
i dont even know what this is but cool and also how long did this take
@wmvanvliet
Жыл бұрын
This is a visualization of an algorithm designed to detect handwritten digits (a neural network algorithm). This took about a day to put together.
@kennjank9335
10 ай бұрын
This visualization has no value other than eye candy for Zoomers and Millies. Just showing connections has no intellectual value, it explains nothing. The idiot comments about "cool" are typical newbie observations. Where are the data input nodes? Where is the central intelligence application i.e. the superordinate output node? A beautiful waste if nothing else.
@carveratutube
Жыл бұрын
Thanks. This makes it very easy to understand how an NN works 👏
@WeedsePoentah
Жыл бұрын
that a lot of if else statements
@mzubuki
Жыл бұрын
Look to Jesus, the son of the most high God, believe his word. Seek God and his sweet amazing grace. Good people don't always use their eyes.
@ollieoniel
Жыл бұрын
Looks harder to mentally understand after watching XD
@cvetelingeorgiev1527
Жыл бұрын
Why every layer looks like it consists of random point cloud with a roughly rectangular(box) shape ?
@rubenhayk5514
Жыл бұрын
I see this network already smart enough to be a manager.
@nehalkalita1
Жыл бұрын
Visualising in 3D has made it more meaningful.
@promiscuouscrab4040
Жыл бұрын
KZitem’s Algorithm desperately trying to pin down my interests & humor.
@samwebber3109
Жыл бұрын
Couldn't you train a neural network to tell you what is going on in a given working neural network with a specific input
@nicholasdavidson5683
Жыл бұрын
This is what we should be using our phones / computers for. Instead of taking selfies.
@thedamnMorbiusclinic
Жыл бұрын
the hell with the assault of chatgpt and neural networks videos on my youtube ai garbage leave me alone
@user-wp8yx
2 ай бұрын
Super cool! ...Is it annoying to request more layers?
@desrucca
2 жыл бұрын
Where is the dense layers
@wmvanvliet
2 жыл бұрын
They are all dense layers. I only drew the strongest connections (highest weight) though
@kotcraftchannelukraine6118
Жыл бұрын
Try to make visualization of spiking neural network.
@w_ldan
Жыл бұрын
I remember watching a vsauce vid about it
@marcuscarana9240
Жыл бұрын
So that's what an intelligent computers' brain looks like.
@tobyreinhardt9022
Жыл бұрын
The trigonomix of the matrix is a little off. But otherwise, good.
@Kay_R
Жыл бұрын
CT scan of our future Lord. 💀
@pichirisu
Жыл бұрын
ok now can you make one for if I decide to not believe this at all thanks
@PhilipDenys
Жыл бұрын
that looks really cool :D
@IguanaJoose
Жыл бұрын
Have zero clue to what I just watched for a minute.
@Kometheus
Жыл бұрын
A much more sinister brain
@danp5073
Жыл бұрын
Looks like a Borg cube and that makes me uneasy
@remon563
Жыл бұрын
looking very cool. Is there a bridge to how mycelium networks work ?
@wmvanvliet
Жыл бұрын
No idea :)
@SuperKinahead
Жыл бұрын
I dont know whats going on, is anyone able to explain
@ArtOfTheProblem
Жыл бұрын
cool have you seen a transformer visualization?
@wmvanvliet
Жыл бұрын
Not exactly what you are looking for probably, but this is a pretty good visual explainer: jalammar.github.io/illustrated-transformer/
Пікірлер: 286