To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/CraftComputing/ - Plus the first 200 of you will get 20% off Brilliant’s annual premium subscription!
@rushunt2131
Жыл бұрын
Your shirt is brilliant!
@amateurwizard
Жыл бұрын
You pronounced it correctly (not that anyone minds if you didn't, just nice to see)
@Nobe_Oddy
Жыл бұрын
why does your intro have the sound of water pouring into a glass??? you would think you'd have at least used a carbonated beverage pouring sound for it... right??? You have the MIC... you have the BEVERAGE.... now fix it!!! (and lemme have the beverage when you're done plz?? ... that's the whole reason I wrote this... I wuntz bierz plz :P) :)
@zachsoanes6417
Жыл бұрын
Forgot to put the command in the video description - as you said at 15:45 ;)
@marcogenovesi8570
Жыл бұрын
those mad lads at Mikrotik just sent not just one but a couple of their flagship 100gb switches plus accessories, no questions asked. Jeff truly wields the power of the gods
@BenCos2018
Жыл бұрын
Facts haha
@Tuetuopay
Жыл бұрын
iperf3 tip: it natively supports multiple parallel streams with the -P flag, no need for multiple instances ;) great upgrade though, it gave me the itch to dust off my own 100Gbps cards I have lying around
@akmattb
Жыл бұрын
THIS
@postnick
Жыл бұрын
i Still cannot justify the 2x 2.5 giabit switches i need in my basement and office, this guy is doing 100 gig! Good for you great content! Keep it comming!!!
@ewenchan1239
Жыл бұрын
I have a 36-port 100 Gbps Infiniband switch in my basement.
@bojinglebells
Жыл бұрын
yeah, really is frustrating that consumer networking has been dragging ass for the better part of TWO decades now. I swear they've introduced 2.5Gbps and 5Gbps just to nickle and dime us instead of going to 10 where they can keep overcharging businesses
@wiziek
Жыл бұрын
@@ewenchan1239 ah stop trolling
@wiziek
Жыл бұрын
@@bojinglebells it hasn't, you have no idea what are you talking about. most consumers don't even use 1gbs looking at how widespread is wifi. 2,5 and 5gbs was introduced for entrerprise, to reuse cat5e cables. anyway there are already 400gb devices available or even 800g, of course not for consumers or average enterprise...
@bojinglebells
Жыл бұрын
@@wiziek they don't put 2.5G on consumer products so that enterprise can use them. But sure, keep being a know-it-all ass.
@paulbrooks4395
Жыл бұрын
I’d like to see RDMA in Linux and Windows through SMB Direct, as well as iSCSI and NFS. RDMA should remove all CPU bottlenecks since the transfers will not longer use traditional file stacks. Make sure when doing any tests with iSCSI to turn off synchronous writes with TrueNAS, it will allow better performance for tests-although it shouldn’t matter once you get NVMe.
@ivanmaglica264
Жыл бұрын
Well, not quite correct... RDMA itself removes the TCP stack and goes RAM to RAM via Infiniband, like DMA does from let's say sound card to RAM, but between machines. File-systems are still involved, especially in userland program space, where fopen, read, write and fclose operations are used.
@AegisHyperon
Жыл бұрын
It's super driver dependent and the drivers suck ass. Tried to implement it for a fileserver project a while back but couldn't get it to not drop packets.
@rayl6599
Жыл бұрын
NVMe ROCEv2 requires converged enhanced ethernet support to avoid flow control issues else reliability issues may result - I do not think these are CEE capable.
@MikeHarris1984
Жыл бұрын
Your shirt... That little saying is grilled deep into my head. After many years of making thousands tens of thousands hundreds of thousands of patch cables over the last 20+ years.
@BeeWhere
Жыл бұрын
This is the level of absurdity that I love from the channel. I was finally able to upgrade my NAS and main pc to 10 gig. Because I needed to upgrade my NAS and didn't want to deal with migrating 30TB the data over a 1g connection.
@ZaPirate
Жыл бұрын
Great video. With 100gb you could pretty much run all the VM storage over iscsi. Would make for an interesting project.
@llortaton2834
Жыл бұрын
That's what i did but with 40Gbe on my proxmox
@marcogenovesi8570
Жыл бұрын
most of the clients I work for have 10Gbit (either fiber channel or ethernet) for VM storage.
@ewenchan1239
Жыл бұрын
"over iscsi" or NFS
@RowanHawkins
Жыл бұрын
The way you are installing that is making my DC senses tingle. MicroTic designed this to be a back of rack device. I bet the fans are blowing the wrong way for your configuration. That's why the power and QSFP are on the same side. Edge switches have power on one side and ports on the opposite side because you generally link them to patch ports for your end devices off the front. Also MultiMode (OM4) is fine and spec'd up to 100G over 125m(400ft). The problem as you saw is the QSFP28's at that configuration want 8 or more likely 12 strand MPO and they are not cheap. I really wish you had been clearer that the switch to SingleMode infrastructure wasn't a limitations of the OM4 itself but a budget limitation of buying the hardware to allow OM4 to operate at 100Gb speeds. OM5 is the same issue, however old Datacenter infrastructure that I supported ran either 24, 48 or 96 strands to each cabinet using 1x12 MPO so even with the cost saving of SM which is a relative recent thing, it was still cheaper to buy the MM compatible 100GBSR QSFP28 modules than to replace the cable plant would be.
@RubyRoks
Жыл бұрын
The fact that all of this is as (relatively) inexpensive as it is is freaking crazy to me
@RobertRidleyE
Жыл бұрын
It's great to see a good use of 100gig. I upgraded to 10gig with the crs326 and crs317 switches a few years back and think I am good for the foreseeable future.
@jannikmeissner
Жыл бұрын
On systems with only one X16 slot, I would recommend running your 100G NIC in the X16 and your GPU in the X8 or X4 slot, the GPU might only lose a few per cent of performance, but your 100G NIC will thank you.
@Lisa_Minci96
Жыл бұрын
Having a personal, local fiber network in you home just sounds so cool to me lol
@javiej
Жыл бұрын
For file transfers and real applications (such us streaming) you would need to setup NFS over RDMA or Samba over RDMA. I don't think the bottleneck is in the SSD raid. Standard ethernet works fine for synthetic benchmarks using specialized applications (like iperf), but for getting similar speeds with network filesystems and non specialized apps you really need RDMA.
@jyvben1520
Жыл бұрын
Remote direct memory access
@ATGEnki
Жыл бұрын
I bought a 2u wall mount rack and bolted it under my desk for my PDU. Works perfectly and keeps everything out of the way. Also installed some under desk pockets to hold power bricks and the like.
@Azlehria
Жыл бұрын
It took a long time for me to finally try out some MikroTik hardware. It was their Wireless Wire kit, which is ironic given my long-standing distaste for infrastructure wireless, but genuinely the best choice. Other than some configuration bobbles - they're the link in the middle of a double-NAT setup - it's been _very_ nice. Incredibly reliable and simple to install. I know double-NAT is bad, but I haven't been able to successfully argue for taking over the ISP-provided external router yet.
@MrBreadoflife
Жыл бұрын
I appreciate the shirt, after doing thousands of cable ends in my life thus far.
@PacketWrangler
Жыл бұрын
It's crazy how far transfer speeds have gone. It was only like 15 years ago we were splitting DS0's off of DS1's to backhaul voice on cell sites.
@gearboxworks
Жыл бұрын
When those lights first came on, Jeff was grinning like a kid who just had the best Xmas of his life! 😆
@CraftComputing
Жыл бұрын
It was like getting my Super Nintendo all over again 😁
@gearboxworks
Жыл бұрын
@@CraftComputing - There is an unmistakable look of pure joy, that can’t be faked. You had that look just then. 😆
@ZaPirate
Жыл бұрын
never clicked so fast on a video
@marc3793
Жыл бұрын
One thing I'd really like to see is inter-vlan routing speeds. Hardware offloading etc. There seems to be very little information around correctly setting this up without just killing your switches/routers cpu. Usually if you're geeky enough to have 10 or 100gb networking then you're going to have vlans. :-) It would help me get on the 10/100gb train!
@stephenp4440
Жыл бұрын
I was going to ask how he setup inter-vlan routing with that Ubiquiti UDM-Pro. I went to 25 Gbps and I had to collapse my VLANs to put all of the 25 Gbps clients in a single VLAN if I still wanted to use the UDM-Pro. An alternative might be to use the Mirotik as the inter-vlan router but I don't know what the speeds are. The UDM-Pro just couldn't cut it for me.
@breadworkshop
Жыл бұрын
Love to see the Rack Studs, they're so great.
@brandishwar
Жыл бұрын
MikroTik hasn't touched SwitchOS for two years, so no surprise they haven't ported it over to the faster-than-10Gb switches. The latest version is 2.13. And their site is saying the CRS504 is RouterOS v7 only, so they've probably abandoned SwitchOS. Given my experience trying to use RouterOS as well, I can say that performance will fall through the floor if you try to actually use that as a router. I had that problem with the aforementioned CRS317, which is why I have an OPNsense router instead.
@josemachado7830
Жыл бұрын
Oh, that t-shirt. I want one!
@Nealio6s
Жыл бұрын
I was thinking the same!
@CraftComputing
Жыл бұрын
vkc.sh/product-tag/t568b-cheat-sheet/
@ErikS-
Жыл бұрын
I grew up having a BBS on 9600 baud (9.6 kbps) and the move to 19,200 baud was a giant leap. That was still all over a circuit switched telephone network, i.e. not IP networks yet. The speeds you reach in this video are like 10 million times higher... Talk about progress...
@davidbango7404
Жыл бұрын
Good job wearing green! This comes from a Professional Brewer in Ireland who was raised in The PACNW! Happy St.Patricks day. Let me Know if you ever want to Homebrew. Super fast switch I just ordered the 570/80 you just presented.
@I4get42
Жыл бұрын
Awesome Shirt in the 2nd half. Cerritos Strong!
@michaelmcinerney2853
Жыл бұрын
So it's 5 months later, and I have only now picked my jaw back up off the floor after hearing you say you got those 16 Intel 100gig transceivers for 5 bucks each.
@CraftComputing
Жыл бұрын
If it makes you feel any better, I still can't believe it myself.
@Davidx_117
Жыл бұрын
Those bottom power plugs shown at 9:59 & 13:39 aren't in all the way which is a fire hazard since it could lead to arcing so definitely get those in all the way, and you should get that dust off too so it doesn't get into the sockets. Anyway, great vid, it's always fun to sit back and watch your videos
@CraftComputing
Жыл бұрын
I bumped them while wiggling behind the rack. I did fix them.
@Davidx_117
Жыл бұрын
@@CraftComputing Good to hear 👍
@mikesbark6626
Жыл бұрын
Oh my gosh, love the t-shirt!!! When I first noticed it I just laughed and laughed. Mostly only network geeks will get it. Well done!
@eivinha
Жыл бұрын
Quite outdated for *this* video though 😂
@tropmonky
Жыл бұрын
My goodness. I have a hard enough time using all of my 10GBE setup, even between servers doing large VM backups! hahahaha. Good video, looking forward to more videos on it.
@ericblenner-hassett3945
Жыл бұрын
I do not have the kind of speed requirement, files, workloads, etc., that said it is definitely drool worthy. I agree on the ' typical ' workload usage and could do with that kind of speed and storage for my Steam Library and wonder what kind of load times you could get using a net-box on that network.
@Itay1787
Жыл бұрын
I have been waiting for this video so much!! And it's 30 minutes! fun! Keep creating amazing content!
@PatientXero607
Жыл бұрын
The one thing I like about Mikrotik is I don't have to fight with GBIC and SFP compatibility! Intel, 10Gtek, Nokia (FTTH SFP). It doesn't care and it just works.
@dctaken
Жыл бұрын
Took me a minute to realize what that shirt means. I'm drinking and eating as I'm watching this and thinking about that shirt. I like it.
@RandarTheBarbarian
Жыл бұрын
When you said 100 gigabit full duplex it gave me a full duplex. I've been considering a network upgrade for a bit and I'd very much like to get 10g links in place, but 100g is almost an incomprehensible number.
@CraftComputing
Жыл бұрын
If your full duplex lasts more than 4 hours, make sure to call your doctor.
@robertboskind
Жыл бұрын
I'm surprised how long it took me to understand that shirt... I always think OrangeWhite-Orange-GreenWhite-Blue.... in my head
@charlesdesmond1
Жыл бұрын
Jeff, In this video, you were just like a kid at Christmas, so Merry Christmas! enjoy your massive bandwidth.
@ExpressITTechTips
Жыл бұрын
Imagine Mikrotik being nice enough to send you two of these - we can but dream. Amazing stuff
@Superminaren
Жыл бұрын
Awesome video, I have a question regarding safety though: Could you please be more clear on the dangers of leaving SFP/QSFP lasers open? It can permanently blind someone, and proper precaution should be taken when handling lasers.
@fourthplanet
8 ай бұрын
That is fast. I know less than Linus about the linux universe but it is always fun to see the hardware. Also glad you mentioned the tree grinder across the street. For most of the video i was sure that you had a noisy fan near a microphone. Cheers
@jonathanbuzzard1376
Жыл бұрын
This comes up on my KZitem feed the day two new 32x200Gbps switches where delivered at work 😂
@djohnsto2
Жыл бұрын
I get about the same, ~ 35 Gbps per stream with iperf3, and about 16 Gbps with plain SMB. Using RDMA (SMB-Direct) I can achieve 40 Gbps file copies, but only in one direction. (Uploading from W11Pro4WS to Svr2022) Tried enabling PFC+DCB on my equipment, speed went down. More troubleshooting needed.
@chucksw1
Жыл бұрын
Nice network, good job!
@CraftComputing
Жыл бұрын
vkc.sh/product-tag/t568b-cheat-sheet/
@nticompass
Жыл бұрын
Looks to be from the KZitem channel "Veronica Explains" 🙂
@mallon04008
Жыл бұрын
I don't know if I've seen Jeff this giddy before!
@CraftComputing
Жыл бұрын
I'm a simple man. I see 100Gb lights, I smile.
@3k3k3
Жыл бұрын
Looking forward to the Truenas testing with Cache and all that 🙂
@lightfoot256
Жыл бұрын
Was waiting for someone to review this switch in the wild. Interesting regarding the cpu bottleneck. Assuming there’s a hardware DMA workaround that doesn’t involve CPU. We’re getting close to RAM speeds let alone storage.
@CptPatch
Жыл бұрын
I love the t568b shirt and the Boimler shirt and I'm totally jealous of your new network setup. I can barely saturate the 10g on my home network, but my homelab storage server is a whole lot smaller than your monster.
@Hitek146
Жыл бұрын
But don't most people say "orange-white" rather than "white-orange", etc???? Because it's orange insulation with a white stripe on it?
@VeronicaExplains
Жыл бұрын
@@Hitek146 I learned it as "white-orange" because verbally it's easier for me to differentiate. Saying "orange" twice in a row makes me lose track. Plus, I don't think the design would have worked as well with the colors all on the left-hand side of the shirt.
@Hitek146
Жыл бұрын
@@VeronicaExplains I agree that the colors all being on the left would be less visually attractive, but I think you have it backwards about the verbal repetition. Putting "white" first means that you are saying "orange" twice, which is what you say is what makes you lose track. Saying "white-orange, orange" puts the two oranges together, while saying "orange-white, orange" separates the two orange words. I always say "orange-white, orange, green-white, blue, blue-white, green, brown-white, brown", only putting the two blues together, rather than putting the two oranges and browns together. Plus, in my experience terminating old-school telephony cabling, where there can be hundreds of pairs in one bundle of many various colors, including purple, the stripe is always said last...
@VeronicaExplains
Жыл бұрын
@Hitek146 I don't think I have it backwards from my angle, since I know what I remember in the server room (you do you though). Besides, it's a t-shirt, the design was the most important part for me.
@WillFuI
Жыл бұрын
I would like to see the peak of cloud gaming
@NYCMesh
Жыл бұрын
Our mikrotic gear is cheap but unfortunately buggy. Their OSPF implementation has a memory leak. CCR2004 has a few problems that severely limit bandwidth. Also ROS7 still has some blocker bugs for us.
@NateWheeler1
Жыл бұрын
Awesome video, Jeff. LOVE Mikrotik!
@SB-qm5wg
Жыл бұрын
I've very happy with my MikroTik gear.
@MrFoof82
Жыл бұрын
If you want to push the network, storage, and CPU a bit, database ETL (extract, transform and load) will be a good general stress test. Not only are you capable of saturating the network link, but for how long, and for how much data that has to be process, structured, and stored in a database that can then be queried quickly. I'm not sure what's out there for "canned" large footprint ETL benchmarks though.
@dezznuzzinyomouth2543
Жыл бұрын
Damn 100gig... I would only need that between my two servers... Despite I was only cnsidering a 25g upgrade... Thanks alot Jeff... My bank account is getting drained
@VeronicaExplains
Жыл бұрын
I could run so many guestbooks with hundred gigabit networking.
@MikeKirkpatrick
Жыл бұрын
I couldn't help but spit my coffee out when you mentioned how much you paid for those optics....
@kenzieduckmoo
Жыл бұрын
at 100gig i think thats when you start to think about using DPUs in your end systems, not just NICs
@mikejakubik
Жыл бұрын
To avoid the scheduler on FreeBSD bouncing around on diff cores, use the command cpuset with iperf to lock down the process to a specific core. I was able to achieve much better rates when benchmarking like this.
@l4rzzz
Жыл бұрын
You made me an alcoholic. Always drinking your episodes with beer :)!
@Yuriel1981
Жыл бұрын
Recent convo with my self: I'm thinking of upgrading the house to a 10gb network network infrastructure. Me: cool your gonna need a new switch and nic. Also me: yeah I can get a 2x10, 4x2.5 switch and a 10gb rj45 nic, plus cable and supplies to do the house runs for like 500$ Me: wow cool do you work an IT or Tech job or something? Also me: I'm a welder Me:........ Also me: I have a problem.
@RemyL75
Жыл бұрын
FINALLY!!!!!!
@sagejpc1175
Жыл бұрын
That is one snazzy shirt you got, Jeff!
@KaizenHydraxis
11 ай бұрын
Curious what distance those single mode optics are rated for? Did you put attenuators on the (preferably) receive ends of the links? You are going to shorten the life on your optics if you are blasting 10km optic power levels over 3meter cables.
@kevinkrau9876
Жыл бұрын
I would love to see a iSCSI netwoork boot comparisson between a sata ssd and nvme. In addition to that mount a GameDrive for steam and see what kind of cpu usage is generated through the streamed block storage with that much bandwidth
@lemonbrothers3462
Жыл бұрын
I think the elephant in the room is how the hell you got those optics for 5$ each
@ProjectSmithTech
Жыл бұрын
Great Scott's. That is some seriously impressive gear, thanks for sharing.
@jgirlyt
Жыл бұрын
Installing multi-mode fiber, omg what were you thinking oh the humanity
@ychto
Жыл бұрын
What, no 400Gbps?
@CraftComputing
Жыл бұрын
Baby steps.
@-ColorMehJewish-
Жыл бұрын
Damn --- I have not been this jealous in a while lol. That's sick tho Youre setup gives me something to aim towards... maybe one day
@t3chieXandeum
Жыл бұрын
Is there a reason you aren't using the -P (parallel) flag on iperf3? -P 30 would run 30 parallel streams... Not sure if that changes your single thread testing though... Great video, love watching this stuff!
@Clarence-Homelab
Жыл бұрын
that zoom in on the cocktail shaking hahahahahahaha
@Clarence-Homelab
Жыл бұрын
I'm a sucker for fast networking ^^ Awesome video, Jeff. Why would RAIDZ-1 be preferrable to a striped mirror (RAID10) configuration in your use case? Other than the the fact that you have more storage space. Wouldn't RAID10 be better for write speeds and potential rebuilding of the pool in a worst case scenario?
@jacketpotato2058
Жыл бұрын
Nice!
@osaether
Жыл бұрын
Great video as allways! But why, MikroTik, did you put the AC power inlets on the same side as the network ports?
@marcogenovesi8570
Жыл бұрын
a lot of networking rack enclosures don't have access in the rear so hotswapping the PSUs would be impossible. This switch is trying to target the broadest possible audience
@enthuscimandiri1640
Жыл бұрын
some rack cannot access the back of equipment like the telecom operator use in bts
@SomeMorganSomewhere
Жыл бұрын
@@marcogenovesi8570 this ^^^ a lot of places you simply can't get to the back of the gear (without disturbing a bunch of other stuff which would defeat the purpose of having the hot swap power supplies)
@davidmcken
Жыл бұрын
What MTU do you run? Jumbo frames can help with reducing the packet per second rate which can affect everything from number of interrupts the NICs have to handle which can have beneficial side effects to limit the effect of single-threaded performance on the overall benchmark results. As for testing, I would want to know the CPU usage of the tiks while running these tests, its most likely the switch chip will handle the entire data path there can be exceptions. Can you also comment to what type of SFPs you got for that price, I assume nothing past 10km stuff (and normal 1310nm). I am happy to hear that the intel SFPs work in the Melanox cards as past experience with Intel+SFPs is they don't work with anything but themselves (the tiks accept pretty much anything). We have been heavily using broadcom cards as a result unless the setup specifically calls for Intel (seems usually for their offload functionality).
@novellahub
Жыл бұрын
Looks like it is Christmas at Crafting Computing!
@Ghostdance86
Жыл бұрын
Great video! At this point, do you really even need to copy back the footage to edit it, or can you do that directly on the remote drives (using copy-on-write so you don't overwrite the originals or have to create a copy. Deduplication might net you some interesting savings there, too). I have a funny feeling you might run into issues and bottlenecks with SMB, the File Explorer equivalent or similar. But still, that would be a use case I'd like to see. Maybe you could also try playing some disk-intensive games directly from remote storage and seeing if they remain playable? Just a "totally overkill hardware for gaming" kind of idea. And thanks for the idea of running single-mode over multi-mode if you want "cheap" future upgradability. I'd like to run some fiber lines around the house for the connection between the desktop and the NAS. I'm looking at 10Gbps right now, but it would suck to be stuck there in the future.
@itunassub
Жыл бұрын
I NEED to know where you got that shirt, it would be an absolute hit at work.
@stephenharrison7479
Жыл бұрын
I'd love to know Mikrotik's decision behind all those power input options. Dual mains input, sure, makes sense. POE, yep, good idea at that power level, random extra DC input via terminal block connector, wait what? Please tell me theirs some crazy engineer at Mikrotik that, like me, has a garage without mains power and a dodgy solar setup, and they wanted to run some 100G setup out there directly from that! (I suspect it's more likely something to do with data centre's having a low voltage feed from UPS's / shared PSU's rather than dedicated PSU's in various boxes and all that - but it's kind of an interesting option to include when panel space wise when some other network connection might have been nice). Probably just a home lab issue, but sure would be nice to have one (or more 🙂) 10G port option for WAN/LAN inter-connect rather than having to use one of the 100G's split into 4s, and have one as the link to the regular WAN/LAN. At the price point they've got to be thinking a bunch of us crazy home lab's ( 🙂hello 🙂) are going to be buying this right. (obviously I'm hoping Mikrotik are reading this - and as someone who has multiple switches with 2 40Gbe ports on it, that's also super frustrating when just one (or two) extra 40Gbe's more would have made such a difference due to uplink switch connection usage taking them both and not allowing a server to be 40Gbe linked as well, but I digress....). For other videos - I'd like to see more details on the various optics / cable selections, having messed with 40G/10G stuff I've found the optics for SPF+/SPF28/QSFP+/others to be quite a minefield, and quite unclear how well 10/25/40/100 play together. great if you can get them at a few $, but at higher prices it's not fun to be figuring it out. I've started down the 8/12 core MPO fiber for the 40G stuff, does that work in a 100G switch? (as in, are optics sensibly priced, available and work, does 8 work or is the full 12 fiber thing needed), are there single mode QSFP's for 40G (and 10G) - what are the options for nice keystone connections (so far I've seen single/multimode only - I'm guessing size wise that's our only choice really) - I could go on. Also, great video 😊thanks. I nearly unsubscribed at the cocktail part, but then found I wasn't actually subscribed (not sure what happened there, I thought I was, maybe YT tricked me!), so I subscribed despite the cocktail....
@hopkinssm1
Жыл бұрын
Data centers and certain telecom cabinet installs prefer DC power, as they can convert it much more efficiently/ cheaper at scale then on each individual unit. Ironically, so.ilar to, but the exact opposite of how Google has small DC batteries installed in the tray with every server motherboard so they don't have to worry about whole data center power redundancy.
@marcogenovesi8570
Жыл бұрын
This is the patented Mikrotik shotgun approach, they want to target the biggest possible crowd and adding PoE and terminal block connectors is very simple and cheap. Adding more connectivity would mean increasing the cost significantly and it's not what they are going for with these switches. For what they are (modern low power 100gb) it's insanely cheap already. 40G is not inter-operable with 10/25/100/400G and as a technology is a dead end as everyone has jumped ship to the 10/25/100/400g train years ago (hence why the 40g stuff is cheap and plentiful on ebay)
@SomeMorganSomewhere
Жыл бұрын
@@hopkinssm1 Also pretty much every major networking vendor has DC input options (or in some cases as a standard feature) on their networking equipment so if you want to play in that space you need to do the same.
@userperson5259
Жыл бұрын
And I just finally upgraded my workstation from an AMD Phenom II x6 1100T to a Haswell i7. (Yes, Haswell). My IP Camera network is Fast Ethernet based (10/100) - and has no bottlenecks. Man I wish I could justify upgrading. Oh well, that's what makes something like so fun to watch. I'm not a huge fan of Mikrotik/Router OS. Much prefer pfsense.
@Jerrec
9 ай бұрын
I also had the same issue with Mellanox ConnectX2 and 4 Cards on some HPE Workstations.
@denton3737
Жыл бұрын
We're a rural ISP running 100Gb/s rings off of a 400Gb/s Coherent DWDM core.
@FlaxTheSeedOne
Жыл бұрын
Neext to the person suggesting RDMA, The Nvme Pool should be a raid 10. a z1 will have over head in terms of block distribution, and be a cpu hog when writing at those speeds
@goldmax1412
Жыл бұрын
I had a weired idea to try using high speed nvme storage with 100Gb connection as RAM on older systems (ddr2/ddr3). To finally have the opportunity to download the RAM via the Internet. But this is difficult to implement because you will need a special custom DIMMs with a 100GB network connection and software to run it.
@ewenchan1239
Жыл бұрын
Install very little physical RAM on your system, put your swap partition on that, and use swap-as-RAM. You used to be able to do this with GlusterFS version 3.7. Been there, done that.
@goldmax1412
Жыл бұрын
@@ewenchan1239 nah, it won't be the same as purely "internet" RAM sticks. And how will you do it on a windows machine?
@alexzaslavskis4623
Жыл бұрын
is really amazing... readly proud for latvian guys... )) mikrotik well done )))
@1leggeddog
Жыл бұрын
I want that wiring t-shirt! white orange orange....
@CraftComputing
Жыл бұрын
Link in the description :-)
@CoryMT
Жыл бұрын
Ok, this is probably dumb. But I'm curious if there is any practical use for a ram drive on your server shared over the 100 Gbps network. I'm also curious how a 100 Gbps connection compares to 10 Gbps in latency. Also, regarding your future plans to use an NVME pool, I've heard that ZFS actively hinders NVME performance (according to a presentation by Allan Jude from last year), so a different file system for comparison may be interesting.
@rdsii64
Жыл бұрын
And he got a haircut too! LOL
@lugaidster
Жыл бұрын
I got a Celestica dx010 and can't even get to 25. Still love the overkill. I went with bcachefs for testing my storage in a tiered configuration, I don't have all that many nvme drives to put my data just there.
@auroran0
Жыл бұрын
Putting a like on this just for the jazz montage.
@snapsetup
Жыл бұрын
Wow. Overkill - Love it!
@wayland7150
Жыл бұрын
I like the Ethernet colour code T-shirt.
@grigorkyokuto7546
5 ай бұрын
oh an AE-5, Classic!
@seethruhead7119
Жыл бұрын
I really want to see how you maximize the network. I've been meaning to pick up the same router, but I'm not sure how I should be setting up NVME drives to maximize. Should I be using a 16x pcie 4.0 slot with a 4x4x4x4x PCIE bifurcation card? Striped + Mirrored? What about sata ssds, how fast can those be made in ZFS. What about tiered storage with an HDD, SSD, and NVME pool. With the stuff you're actively working on being moved to the NVME pool? (
@josephahles7529
Жыл бұрын
get this man an ltt screwdriver
@lepsycho3691
Жыл бұрын
Well I guess I'm done waiting for the 40gig Brocade icx-6610 part deux!
@andyburns
Жыл бұрын
100Gb very cool for most businesses let alone home, but that mains lead about to pull out of the wall, can you get 90° NEMA plugs so the strain is downwards?
@AIC_onyt
Жыл бұрын
quit his job in IT to build his own data center. what a chad
@augurseer
Жыл бұрын
Bandwidth usage during live editing session. Real world usage examples.
@Sapious1
2 ай бұрын
Love this! Give me hope for my future ;-)
@andiszile
Жыл бұрын
With 100G and DPU you could boot off network as it was local nVME drive. That would be interesting project, albeit expensive one.
Пікірлер: 293