Hello Kevin from Pensacola, Florida... because of work and time availability, haven't been able to watch your live events but great videos and i appreciate your Raspberry Pi tips and projects. Thanks again! Be well!
@TreeLuvBurdpu
7 ай бұрын
"what the bot's going on there?" Is a new favorite phrase.
@aravjain
7 ай бұрын
Great video, Kevin! Thanks again for creating this!
@sunday-thequant8477
6 ай бұрын
i loved the tutorial bro! im actually loving to learn docker, i wanna create my own cluster.
@abzs5811
7 ай бұрын
Can you make the screen bigger next time so we can see up close what you’re typing in the terminals cheers bro, good video
@armisis
7 ай бұрын
Building mine bit by bit, I want to make a cluster powerful enough to run my plex, nas, home assistant, and maybe if I can figure it out a local Mincraft server... I am aiming for a 8 Raspberry PI 5 cluster but due to finances will have to add the nodes as i get them or change them from pi 4 to pi 5 as I get the 5 in, I have a load of 4s laying around.
@armisis
5 ай бұрын
Not had luck ran a Minecraft server no one could join.
@consig1iere294
2 ай бұрын
Can you do a Blender render with the cluster for some of simpletons to understand the power of the cluster please.
@HometownUnicorn
7 ай бұрын
Hey Kevin, I really love your videos. This one's great but I'm just wanting to set up a portainer .Would you be able to if you've not already show us how to set up portainer and docker and some containers? Because I like the way that you present it and the way that you can teach us how to do this. Thank you.
@TreeLuvBurdpu
7 ай бұрын
What about using them for running local LLMs? Do we need a GPU?
@kevinmcaleer28
7 ай бұрын
You can absolutely run a LLM on the cluster - that's what I used for a recent video on Ollama and WebUI
@eMgotcha77
7 ай бұрын
Can the LLM workload be distributed? I know you can run multiple instances, yes, but can you "split" a huge LLM to multiple PIs. LLMs can use way more RAM than any PI has.
@kevinmcaleer28
7 ай бұрын
@@eMgotcha77 Thats a great question - I've not seen that done yet, but it should be possible to break the work in to parallel tasks and for them to work on it independently. Pretty sure Ollama could be used to do that
@ivint
7 ай бұрын
Great video, thank you. But can't understand why use Docker Swarm instead of Kubernetes.
@kevinmcaleer28
7 ай бұрын
Uses less memory, which is essential on single board computers with limited resources. Its also simpler to learn for people with no experience in container orchestration.
@steve230870
7 ай бұрын
Great video, just put together a Pi cluster with 3 raspberry pi 4 using the uctronics case, will add a 4th node eventually. New to docker and swarms, so your videos have been really useful.
@DeepakNayak-vg8vu
6 ай бұрын
Hey Kevin, absolutely gr8 and superbly done presentation. Question: can I use PoE instead individual power adapter to above cluster configuration?
@kevinmcaleer28
6 ай бұрын
Yes - you’ll need a PoE Hat to use that power though as I understand it
@armisis
5 ай бұрын
I thought swarm would be parellel processing for containerised applications. Not what I experienced. Got all these devices but cannot find a great home use yet....
@RickySupriyadi
7 ай бұрын
in terms of security i really want to hear your thought this setup vs qubes os setup
@kevinmcaleer28
7 ай бұрын
I'm not familar with qubes os. I'll look into this and let you know
@BjornNeven
7 ай бұрын
Hi, great video, can you please elaborate on the network setup part?
@Pngwolffman
7 ай бұрын
Can I use different Raspberry Pi's in a cluster? So basically, a combination of Raspberry Pi 3, Pi 4, and Pi 5. Could I even possibly add an X86 computer like a Zimaboard to run specific x86 containers? How about managing them so that the lower powered Pis get the easier workloads?
@aslukili
5 ай бұрын
interesting
@neilvass6805
7 ай бұрын
Great Clear Video Thank you. I have just setup a super6c CM4 cluster with a view to learning about clusters. I was planning to use k3s but Docker swarm looks easier to use and still meets my needs. My Questions: 1/ Do I need to worry about setting up public-key authentication on all the nodes before I start. (This is confusing me right now) 2/ I am am planning to run InfluxDB and Grafana so do I need/can I setup persistent storage for this. 3/ Can I use the multiple attached NVME drives in such a way as to provide a duplicate of all the swarm data and containers in case one manager node fails and how many manager nodes would you suggest! 4/ Is there a way to simply backup this storage every night to my seperate NaS storage in case I have a major problem. Thanks.
@kevinmcaleer28
7 ай бұрын
Hi Neil, Some great questions there. 1 - don't think you need to worry about that, ssh is fine, 2) Yes you'll need to setup a bind volume rather than using a container volume, that way you can persist the data even if the container is recreated. This also means you'll need to constrain that container to a specific node (where the data is). 3) I'm not aware of any multi-NVMe hats or bases yet, but I'm sure they will be available **soon**. Docker doesn't do live file system replication across the cluster. 4) Yes - just follow the docker docs - docs.docker.com/desktop/backup-and-restore/
@neilvass6805
7 ай бұрын
Thank you for a quick response. I can move forward now using your answers@@kevinmcaleer28
@seridyan
7 ай бұрын
Hi Kevin, how do you power your Raspberry PI 5 cluster? POE?
@kevinmcaleer28
7 ай бұрын
I use 4 27watt power supplies!
@investidorcalejado8344
5 ай бұрын
would a raspberry pi cluster, with 30+ raspberries, be good for metatrader 5 backtesting?
@kevinmcaleer28
5 ай бұрын
Save your money (buy the pis though)
@molonlabe8792
5 ай бұрын
I'd be interested to know your opinion on uilding a Pine4 RockPro cluster.
@walkwgod7
17 күн бұрын
Maybe it could be good for you to add amazon affiliate links to your description as well.
@kevinmcaleer28
17 күн бұрын
@@walkwgod7 it can be but it’s difficult to update 370+ videos to include these as they expire and can change if the product is no longer available
@walkwgod7
17 күн бұрын
@@kevinmcaleer28 updating old videos would be too much ... Most videos get their views the moment it is put out up to 2 weeks. I wouldn't worry about a video afterwards. Also, Amazon would still have the product up there mostly but would say out of stock. Just would be nice to see what products were used in this video and if you can make a little profit on the side from it, it could help you out as well. Thanks for the reply.
@rca7591a
7 ай бұрын
Pi 5, you gonna heat your house with that cluster? I'm trying to figure out how to mitigate the heat generated from a single Pi 5.
@srsqtee
7 ай бұрын
Thanks for the video. Curious, are you running a single power supply per pi? I have two raspberry pi 5s and 2 4bs and Im wondering if theres a more efficient way to power them
@offakerala
3 ай бұрын
You can use multiport mobile chargers like Anker charger, 60w 6 port charging station or you get cheaper Chinese charges.
@srsqtee
3 ай бұрын
@@offakerala i have actually tried this, but because I use SSD as storage instead of SD card, my power requirements are a lot higher :(
@offakerala
3 ай бұрын
@@srsqtee Oh ok, then its better to use power supplies as per the current consumption. Did you install K3S or Swarm?
@srsqtee
3 ай бұрын
@@offakerala yea I ended up having a separate power supply for each. Once i can get my hands on some PoE hats for these, Ill swap to those. I have been running k3s on my pi cluster for a few years now. Whatre you installing on yours?
@offakerala
3 ай бұрын
@@srsqtee I am a newbie, made a K3S cluster with 5 X pi 4B's. I tied to make custom power supplies, unfortunately dint work. I feel pi's need some kind of isolation. Or may be something like an Online UPS setup backed by a battery might work. Not sure though :)
@abzs5811
6 ай бұрын
Hey Kev. I have a q! I was thinking to use wifi for my clusters . But now I’m seriously thinking about Ethernet. Which Cat/ Cat e cable to use? Cat 6/ 7 or even 8???
@ananyabhat9874
6 ай бұрын
Could I use Raspi 3 instead of Raspi 5?
@kevinmcaleer28
6 ай бұрын
Yes! Raspberry Pi 3B only have 1Gb of Ram, which might restrict what you can do with it, but it will work fine (One of my Pi 4's is a 1Gb and that's happily serving up www.kevsrobots.com to 1000s of people per month)
@ananyabhat9874
6 ай бұрын
Hey! Thanks a lot for replying! Could this be done for a college project using just one or two raspi boards!?
@kevinmcaleer28
6 ай бұрын
@@ananyabhat9874Sure - you'll need to Pi's minimum to make a swarm, otherwise if its just on one Pi its a standalone docker instance
@kevinmcaleer28
6 ай бұрын
I've created a free docker course you can check out here: www.kevsrobots.com/learn/docker/
@chrisparker8539
7 ай бұрын
Great video as usual, Kevin. One note for you though. You said "depreciate" when talking about, well I forget what it was now, but the word is "deprecate". Keep up the great work!
@kevinmcaleer28
7 ай бұрын
Thanks Chris
@bradfeet3418
Ай бұрын
What is the correct definition of a supercomputer?
@kevinmcaleer28
Ай бұрын
According to whom?
@bradfeet3418
Ай бұрын
@@kevinmcaleer28 computational scientist?
@bluesdog88
7 ай бұрын
Hi Kevin, sorry I cant quite make out where you got the cluster rack from?
@kevinmcaleer28
7 ай бұрын
Hey - its from ThePiHut
@bluesdog88
7 ай бұрын
@@kevinmcaleer28 Thank you ;)
@wanjalaproduction
3 ай бұрын
@kevinmcaleer28 Can you share the link to the case?
@marcusworrell7175
7 ай бұрын
I can't get my nvme base to work. I have pineberry pi. I think I know what the issue is. I'm waiting on a raspi5 charger. The old ones worm, but I don't think I have enough juice for external pcie. We will see. I want to make sure I can get one to work before I buy 4, lol. Also, I'm running Ubuntu. I don't think that changes anything except the name of the configuration file that you edit to enable pcie. If anyone else is running Ubuntu with nvme base, and you have it working, please let me know if that's the only difference.
@cicadaskoan6260
4 ай бұрын
Might want to check the compatibility of the drive on the pineboard. Not all work.
@Robert-sj8ld
7 ай бұрын
👍👍👍👍👍👍
@abzs5811
7 ай бұрын
Please do better close ups please! 🙏🏽
@darah.k3221
6 ай бұрын
buy a rpi 5 was waste of my time and money
@abzs5811
6 ай бұрын
Explain pls??? Cause I got 4
@darah.k3221
6 ай бұрын
@@abzs5811 with adaptor, case, heatsink and memory the price will be equal to a mini pc. mini pc is more powerfull and faster pci with m2 nand and better os support. i wish i would buy a mini pc instead
@jamescarrico1233
6 ай бұрын
How is that? Just out of curiosity.
@armisis
6 ай бұрын
Wow I have 6 rpi 5 and their all. Clustered and brilliant
@marci1270
5 ай бұрын
Docker swarm is very uncool in 2024 better use kubernetes.
@kevinmcaleer28
5 ай бұрын
It’s not a fashion cluster - it has work todo.
@marci1270
5 ай бұрын
@@kevinmcaleer28 K8s is heavly production ready and used by your most used apps like youtube. I dont know why you think, that k8s cannot do some work.
@RichardKovacs
5 ай бұрын
@@marci1270 utilization should be higher compare to docker swarm, but the features are not comparable :) if i have to run something simple i wote on Nomad
@Sven_Dongle
7 ай бұрын
A "supercomputer" with boulder sized granularity of tasking and dog slow switching fabric isnt very interesting. To make this shine ideally a crossbar that would plug into the PCIe to interconnect the nodes combined with a custom linux distro that would present a virtualized, unified image of a multi-core processor architecture and a ccNUMA memory that could run native apps transparently, even if recompilation of source was necessary. Granted, the cost would increase but usability and performance would be orders of magnitude beyond this setup. There are already switching fabrics that could be utilized so it wouldnt be a ground up endeavor; infiniband, or even ethernet thats now pushing 10gb+ and MPI drivers integrated into the linux kernel would make it doable.
@kevinmcaleer28
7 ай бұрын
That would be an entirely different show; this show was about showing everyone how to build a cluster using a bunch of Raspberry Pi 5 (first 4 seconds). I am interested in the progress you make on your suggestion, though
@Sven_Dongle
7 ай бұрын
@@kevinmcaleer28 Perhaps then the term "supercomputer" could have been de-clickbaited from the title 😀
@kevinmcaleer28
7 ай бұрын
@@Sven_Dongle it’s not inaccurate
@Sven_Dongle
7 ай бұрын
@@kevinmcaleer28 And yet somehow, not truly accurate. It's like the Schrödinger's Cat of titles.
Пікірлер: 79