Link to full IEEE playlist: kzitem.info/door/PLbg3ZX2pWlgJOTf5YXNq-rdXXuUkJTXHm
@pyro-millie5533
4 жыл бұрын
I freaking love information theory! This is such an elegant explanation of it and I can’t wait to watch and learn more!
@inarisound
5 жыл бұрын
Most underrated channel on earth.
@ArtOfTheProblem
5 жыл бұрын
Happy to have you as a viewer
@inarisound
5 жыл бұрын
@@ArtOfTheProblem my huge thanks for creating very clear, concise content. I highly recommend to promote yourself through subreddits (Reddit), FB groups, Instagram and post your work on boards and forums... 52K is nothing for a great content you produce. Create a schedule like : 30 min to promote my video on Reddit (Monday) 30 min on FB (Tuesday) ..... etc. Don't do it on all platforms at once... it's overwhelming. and of course keep it up, great work!
@Denverse
4 жыл бұрын
When he says 2020, my eyes just got bigger!
@zaquar
6 жыл бұрын
An Art of the Problem video in the feed is a good day. And this week has already had 2 good days!
@sin_tel
6 жыл бұрын
I like the minimalist music!
@prasanthvijayakumar4441
6 жыл бұрын
Just 46 K subscribers for this channel is probably humanity's biggest flaw
@CrucialMuzic
6 жыл бұрын
Wow a new video already!?!? Are you going to make this a habit? Great video as always, thanks so much!
@walltowall5
6 жыл бұрын
That's really clever idea. Taking advantage of the fact that you can increase information without increase information size.
@StefanTheFink
5 жыл бұрын
That's absolutely brilliant 😍
@Septimius
6 жыл бұрын
As a network engineer, I was confused, since this wasn't put out as a new idea, but instead was put forth as how things work today.
@prabhatkaushal294
2 жыл бұрын
nice one!! homie explained it in a very essy manner.
@richardfutrell9668
5 жыл бұрын
Excellent presentation, I didn't understand network coding until seeing this
@ArtOfTheProblem
5 жыл бұрын
great to hear, that was the goal
@Icix1
6 жыл бұрын
Can we get a more technical explanation or in depth overview on how this works? As presented it seems to be missing many key details including: How does the key to decode each mixed packet arrive at the host? What happens when packets are lost in transit or corrupted? Isn't this really just a bandaid for poor design? If the internet of old is starting to show signs of being unscalable, perhaps the real solution is to look at distributed networks? What about security, isn't this really dangerous? Is this HTTPS compliant? (seems like no?) imo the biggest flaw seems to be security. In a world where intelligence agencies dominate the lines companies are increasingly moving towards encrypting everything, but this theory seems fundamentally incompatible with the idea of unique discrete packets. The hub would cause the host to throw everything out because it would see this as tampering with the message.
@lynmyd
6 жыл бұрын
For more detail see the paper itself (linked in description)
@zenithparsec
2 жыл бұрын
@@lynmyd I guess you didn't get it either from the video, or you could have answered all of his points. Thanks for clarifying. I've never heard of "network encoding" as being "adding packets together and then subtracting them". It doesn't make sense. You have mixed 2 packets together, and then sent one without mixing? So why not send the other without mixing? What is being "mixed"? Everything or just metadata or packet data? Is it actually mixing? I'm probably just an idiot, but I expect to learn something from videos that proport to teach.
@fireant002
6 жыл бұрын
Another issues is, that this method seems to rely on content being multicasted, which today it is not. AFAIK multicast is not even allowed on the Internet (your ISP won't route multicast traffic into the Internet).
@TobyGarcia
6 жыл бұрын
True, multicast is typically restricted to local network groups for protocols like ARP. But IPv6 incorporates the concept of multicast streams, for precisely this purpose.
@fireant002
6 жыл бұрын
But even IPV6 multicast streams are usually restricted to LAN, no? When I investigated multicast for BitTorrent like protocol, my conclusion was that while theoretically possible, it practically would not work because of the blocking.
@anandsarwate4071
6 жыл бұрын
So one thing to note is that generally speaking, research involves phrasing things like "if instead of what we do now, we did A, then we would get X, Y, Z." So it's true, we don't do multicasting now but in future systems we might, precisely because you would be able to get the advantages of network coding.
@rboes208
3 жыл бұрын
Video needs way more views! Great stuff
@RadixTheTroll
6 жыл бұрын
I love how active you guys are getting, love all your content. Do you happen to have a patreon or something similar?
@ArtOfTheProblem
6 жыл бұрын
Thanks for your support! www.patreon.com/artoftheproblem
@_ata_3
5 жыл бұрын
Great videos, great explanations. I also like the music in all of your videos very much.
@ArtOfTheProblem
5 жыл бұрын
much appreciated and great to hear
@hoangtrongminhuc8348
2 жыл бұрын
Really high quality video, thank you!
@dauab2
6 жыл бұрын
Great video. Informative and accessible.
@AlbinSeverinson
5 жыл бұрын
Great videos. Thanks ^^
@shubham2488
3 жыл бұрын
And he is so right about 2020- post covid19 6:35
@garelyshev
6 жыл бұрын
But how recieving node will understand what package was used for addition? I mean middle node can sum packages that won't be at the recieving end. For example if there will be third household, that request package "7". Middle node sum it and get 11 (7+4). But recieving end has only package "1", and result in package 10. Сompletely wrong package.
@anandsarwate4071
6 жыл бұрын
What is missing from the description of the scheme (which is to make it easier to explain at a first pass but then on later inspection needs explication) is that we think of packets as being large so that there can be a small "header" which can store the coefficients. This already exists in current packet structure so it's not a stretch. So basically the packet header will contain something like "this packet corresponds to 2 * packet 5 + 3 * packet 2" and then the body (the "payload") of the packet would have 2 * packet5 + 3 * packet 2 -- the multiplication and addition is done over a "finite field" so it's not exactly an XOR but if the final system of equations received by the destination can be solved then decoding would be successful.
@garelyshev
6 жыл бұрын
ok, you can add some information in "header", but here we talking about summing unique packages. Second package will not arrive at destination node, so you can't refer to it in some small code. So in my mind "header" can not be less than the original package. Am I missing something?
@garelyshev
6 жыл бұрын
I mean that at the end there can be neither package 5 nor packet 2 in the clear. To decode one based on another.
@anandsarwate4071
6 жыл бұрын
So this will depend on the persistence of the session and whether or not the number of unique packets in a session is on the order of the number of potential packets. Suppose a packet payload is 1000 bits: that's 2^1000 possible payloads so would require 1000 bits to encode in the header, naively. However, in a real network, not all 2^{1000} packets are possible. So if the number of messages *actually* in the network in a certain time window is smaller than the number of messages *potentially* in the network then there is some advantage to be had. Finally, you might raise the issue of coordination between packet originators. In a real system there might be some segmentation: for example, Netflix could multicast more of its content out to ensure greater reliability to individual subscribers.
@shelockguan9060
5 жыл бұрын
your video is so good , i believe your channel will thrive like 3blue1brown , he worked in khan academy as well! best wishes you are so unique
@ArtOfTheProblem
5 жыл бұрын
thanks so much for the positive feedback
@TheOtherAndre
6 жыл бұрын
Excellent video - finally understand how the internet works! :-D
@logolojr.4924
3 жыл бұрын
Great video! Really made the concept clear
@ArtOfTheProblem
3 жыл бұрын
thanks for the feedback
@Mr_Oszy
6 жыл бұрын
Very nice explanation..
@atexnik
6 жыл бұрын
How will the router undo the encoded packets, if the non-encoded packet fails to arrive? Where is this ever used? What type of network?
@slipvyne
6 жыл бұрын
it's not used.
@mmenjic
2 жыл бұрын
6:11 there must be more video packets than audio packets because video has more data than audio so how would this system solve the problem when all audio packets are sent but there are more video packets to send ??
@salimsaqib
6 жыл бұрын
Great video !! Really appreciate it !!
@GustavoGaming
6 жыл бұрын
great video
@johnjac
6 жыл бұрын
can you link to the paper? Thanks!
@ArtOfTheProblem
6 жыл бұрын
thanks, added to the description
@icantellyouhadenoughytfort8539
6 жыл бұрын
What software do you use for the animations?
@aasimbaig01
6 жыл бұрын
InterPlanetary File System (IPFS) Please make a video on this topic ... very interesting topic...
@khalilbrsc
6 жыл бұрын
Or Tahoe LAFS =)
@aasimbaig01
6 жыл бұрын
NULL yeah these 2 technology are the future of internet unless earth explode...
@mohamedrafikboulmelh1988
5 жыл бұрын
Hi I would like to know how I can implement the intersessional network coding with the COPE protocol I use as simulator GNS3 on a network SDN thank you cordially
@SecretEyeSpot
3 жыл бұрын
Has that prediction of 75% video streams by 2020 come to fruition?
@louis058
6 жыл бұрын
I feel like this video doesn't go into enough detail. There ought to be more than this. I imagine that instead of literally adding the two packets together, which could produce a carry, you XOR them. Secondly, does this mean that you have to rely on the fact that other people using the same connections will happen to download the same content as you do, if not all the time, then at least most of the time? I feel like such an assumption would at least need some data to back it up.
@anandsarwate4071
6 жыл бұрын
So yes, it's an XOR-like operation (actually addition over a finite field). It would rely on users receiving extra content to help with the unmixing. This falls out of the multicast assumption which would have to be a feature of the network you are using. In general a lot of comments have been of the form "this wouldn't work right now in today's internet." This sort of misses the point of research in general, which is to say "if we build networks somewhat differently, we can do this thing." Finally, the ideas behind network coding are useful in distributed storage systems -- they become a lot more efficient to repair when drives fail. See simons.berkeley.edu/sites/default/files/docs/2681/slidesgopalan1.pptx
@ragpie475
6 жыл бұрын
Security could be a problem when your data is mixed with other routes.
@TobyGarcia
6 жыл бұрын
Yup, you can become a MITM without even trying.
@Septimius
6 жыл бұрын
Not really. You would have to know all the other data someone else is receiving.
@KittyBoom360
6 жыл бұрын
Yeah, so maybe it would only be used for like video streaming on KZitem and not for sensitive data.
@animowany111
6 жыл бұрын
Unfortunately, this feels like a really impractical solution. It assumes there is more than one way to get information to a destination. And how do the routers know the receiver knows part of the mixed information, allowing to undo it? What if one of the packets gets lost? I believe a more practical approach is distributed networking, like peer to peer applications. I actually recently came across an open source project called cjdns, that allows to create a completely encrypted, redundant, peer to peer network, using either wired connections or tunneling over existing internet infrastructure. The protocol has a few scaling issues, but I imagine a futuristic internet would look somewhat like that - connect to the two nearest nodes (via some wireless protocol), and be connected to everybody while you forward traffic for other people.
@anandsarwate4071
6 жыл бұрын
The payload of the packet is quite large compared to the header. The coefficients/information about the mix can be encoded in the packet header. With regard to packet loss, this is already an issue in regular internet communication: packets are resent or re-requested when they are lost. The same thing can happen here.
@happmacdonald
6 жыл бұрын
No, animowany111 has a point. Information can be placed into the header of the packet at the source (in this example, the video source V or audio source A) or it can be introduced into the mixed packet at the midpoint router M. So the question is, when midpoint router M receives a packet from V to user 1 and a packet from A to user 2, how can M know that some *other* midpoint router is also sending an exact replica of packet A to user 1 as well in order to mix the packets at M and know that user 1 is even going to receive a duplicate of that packet A in order to unmix it again? Because in reality that *would* never happen unless users 1 and 2 happened to be watching the exact same pair of media streams (with the exact same bitrate!) at the exact same time indices (on both streams) simultaneously.. and with no retransmissions as that would slew the users back out of sync again, and no differences in mtu which ought to become even more pronounced with the adoption of IPv6. But even if they did meet all these criteria, then communicating this confluence to midpoint routers (or the presumably unrelated media sources even realizing the confluences exist to begin with) still doesn't make sense to me at all. Also bear in mind that a majority of streaming content today is both encrypted on the wire and watermarked per-user due to the draconian concerns of copyright cartels. Users getting duplicated packets of content flies in the face of those requirements, which already serve to undercut a thousand other well-meaning network optimizations, CDN strategies, and client-side caching patterns.
@sebastianrossetti6167
6 жыл бұрын
I don't why but i love reading people write shit they know way better than i could ever hope to understand. It really puts me in perspective of how much there's to know about every little detail around our lives that we usually just ignore
@shelockguan9060
5 жыл бұрын
thanks !!!
@russelltalker
6 жыл бұрын
Soo... data compression?
@ArtOfTheProblem
6 жыл бұрын
We are doing videos on compression next (LZW)
@TobyGarcia
6 жыл бұрын
Lots of issues to contend with here. Lost/corrupted/dropped packets seem like a big concern with this concept, since they would simultaneously impact multiple data streams negatively. The working scenario seems beneficial, but you have to think about how bad the situation could get when things start to break down. Additionally, there would be practical limits to combining packets. Say your data traverses 10 routers/hubs. It would be possible that packets could be combined multiple times along the way, requiring multiple excisions to get back to your original packet. This could easily come to take longer than waiting for your data to pass through the bottleneck. Then there's security; today, if someone wants to obtain my enciphered data, they have to find a way to become a man-in-the-middle to snoop the packets. But with this method, my secure data could become combined with someone else's data, with the resultant packet coming to both myself and that other. After excising his data, he could hold onto my data instead of discarding it, resulting in potential data breach without any need to setup MITM. I'm sure there are a lot of other issues that have to be thought through, carefully. Just a few off the top of my head.
@anandsarwate4071
6 жыл бұрын
True, lots of issues between theory and practice. I might contend that spending the time to figure out the issues (better crypto protocols, for example) in exchange for the benefits in terms of congestion control and throughput. When packet-based systems were first proposed, congestion control was not well developed either. Lots of issues had to be dealt with incrementally or on the fly. And yet, the world did not end and the status quo seems semi-comfortable. It's only thanks to that experience that we can ask to think through these issues. I'm not saying the prescription is to move fast and break things but rather to see if the benefits justify the costs/time to implement. Your points are valid and just go to show that this (or any) future way of thinking about networks/communication have a steeper implementation path than their predecessors. But unless you're of the "stone tools were good enough for my parents so they're good enough for me" mindset, I think there are interesting implications for how we design future networks.
@jawaherabdulwahabfadhil2329
5 жыл бұрын
pklz, i want video about Bell libraries space time with MIMO
@ArtOfTheProblem
5 жыл бұрын
we have a mimo video: kzitem.info/news/bejne/xJh6moKpk4N8jKw
@jpphoton
6 жыл бұрын
modulated udp
@smokeybobca
6 жыл бұрын
The background tones at the 3:30 mark are a bit loud and distracting. Great video though.
@gianni9557
4 жыл бұрын
Quando il robot diventa pericoloso, c'è una confusione che, per caso, è dannosa
@oranjizer
6 жыл бұрын
This idea wont work. I get that 1+4=5 but how the hell can you combine 2 packets into 1 packet?
@worstedwoolens
6 жыл бұрын
LotusEater This idea has been working for almost two decades my dude
@mikip3242
6 жыл бұрын
Yeah at first it looks like information is lost. since you transformed two bits (two packets) in just one. But the truth is that the information isn't lost since you are still receiving two bits (the other one in a different line and having been part of the process of making the mixture). The information does not get compresed in one packet but gets distributed in a way that can get to its destination at the same time. You needed two bits and two bits you recieve (only that those bits have changed in a way that is usefull for the transportation)
Пікірлер: 80