One of my favorite things about your videos is that you're not scared of giving us technical details a bunch of other creators leave out. And I always find the discussion of how earlier versions failed really fascinating. A thought I had about the item usage reward, have you considered doing something along the same lines as the guy who made the trackmania AI? His AI never learned how to drift, because driving solidly without drifting is quicker than starting a drift without knowing how to capitalize on it. He then trained his AI to prioritize drifting over everything else basically and then removed the drift reward after it learned how to drift constantly, and it then managed to unlearn the constant drifting, while still retaining the knowledge of how to start a drift. So once the AI is comfortable with using items you don't need to reward it for using them anymore, other than the indirect rewards that come from getting ahead in the race through the item usage.
@aitango
2 ай бұрын
I look to include even more details in the future! Starting with rewards and phasing them out over time is something I should really do more often, it’s a very elegant solution
@RENZOHENGELMOLEN
2 ай бұрын
ai tango is a comment bot 💀💀💀💀💀💀🥶🥶🥶🥶🥶
@aitango
2 ай бұрын
?!?
@gregsmith8977
2 ай бұрын
@@RENZOHENGELMOLEN ?!?
@chillie4396
2 ай бұрын
Damn the bots are trying to frame people now lmao
@gaggix7095
2 ай бұрын
You are playing as Dry Bowser as it's shown in the AI coaching section. Also it seems the AI model hasn't learn to take the shortcut, probably a situation too unusual for the model to have learned it casually.
@samuelthecamel
2 ай бұрын
Yeah, it would probably need special training to learn how to take shortcuts
@SpeedyGwen
2 ай бұрын
I mean, even for humans, casual players who never looked at other people play usually dont know about most shortcuts, even I was blown away when discovering on the internet certain shortcuts that I never even atempted because they need things like mushrooms and I never found them while having a mushroom as a kid
@L0LoLOLoL0LOL
Ай бұрын
he game them a small punishment for driving offroad but shouldve also added a reward for driving on offroad while using mushrooms etc
@sylvercritter
2 ай бұрын
12:53 You are playing as Dry Bowser. The timestamp shows DB backing up and getting an item, which is very unlikely to be an action with a positive reward for such a niche play.
@kidkid
2 ай бұрын
That's not the only reason, it was obvious from the way he was playing in general, saving mushrooms for shortcuts for example
@pinkiepi3482
Ай бұрын
Reverse gear also isn't listed in the reward predictions.
@donskelz7771
2 ай бұрын
Very cool! I'm developing my own Mario kart neural network/reinforcement learning code right now too. This series is really entertaining and has helped with planning/problem solving 🙂
@aitango
2 ай бұрын
That's really cool, hope it goes well for you. I know Reinforcement Learning can be tough at times, but hope you can get things working! Also, check the description to join a discord server! It's pretty new, but hoping to get many interested devs on there
@pigeon_official
2 ай бұрын
@@aitango i remember in a previous video some time you said you used the rainbow deep Q learning algorithm. do you still use that? how often does architectures like the algorithms you use change like should you ever restart the learning if a slightly better algorithm comes out?
@Litschi21
2 ай бұрын
How's it going rn (How good is the AI)?
@donskelz7771
2 ай бұрын
@@Litschi21 Still in development, learning different neural algorithms and seeing which type best fits the best for my system and provides optimization with both disk space and processing time to execution
@Litschi21
2 ай бұрын
@@donskelz7771Cool! Let me know if you have any updates (if possible of course)!
@phiros95
2 ай бұрын
The backing up into item boxes at 12:55 did not look like AI behavior, so I guess Dry Bowser.
@dznutskong
2 ай бұрын
Also missed a POW Dodge while the others didn't and, unless I missed something in the footage, was the only one that knew what a stand-still mini turbo was. It's probably Dry Bowser.
@domino2560
2 ай бұрын
It's also very obvious if you look at 10:40
@FuzzyJeffTheory
2 ай бұрын
I’m excited to see the agents tackle a full Grand Prix
@nobafan7515
2 ай бұрын
Imagine if he made 12 agents play online.
@Cpt_Bennx
2 ай бұрын
Great video! Loved the addition of the AI coaching 👍
@aitango
2 ай бұрын
Thank you! 👍
@numbug1234
2 ай бұрын
This makes me wanna see AI handle a co-op game, but like this case where there's two or more independent AI that train the Master AI, rather than one AI holding two virtual controllers
@FrostbytesYT
2 ай бұрын
Gone back through some of your old videos and this is really impressive… is getting to the point where AI as a whole can beat the design of the original developers coded AI.. it’s scary and I hope companies find a way to implement stuff like this in the future for other games to become super adaptive Earned a subscription and a like from me and a tip for just how cool this is
@aitango
2 ай бұрын
Thank you ever so much, means the world to hear such kind words
@wp_3df
2 ай бұрын
Dry Bowser was able to resist the instant and extreme gratification of using the bullet for several seconds, so that was probably the human player!
@TheBena007
2 ай бұрын
I'm guessing Dry Bowser based on the inhuman speed the other players are releasing their miniturbos
@robvadeberg
2 ай бұрын
Yeah and when looking at the AI feedback, when the graph spikes who is screwing up? That's right, Dry Bowser
@nobafan7515
2 ай бұрын
Thats really cool how the ai's were able to share training data and not just be 4 different ai's.
@aitango
2 ай бұрын
Yeah I was unsure if it would work well, but seemed to do amazingly to my happy surprise
@00vidmaster00
2 ай бұрын
You make some of my favorite videos keep up the great work can’t wait to see what you do next!!
@aitango
2 ай бұрын
Glad you like them, thanks!
@e4d5exd5Qxd5
Ай бұрын
A time trial video against famous historical ghosts would be such an amazing video to watch
@ClashBluelight
Ай бұрын
For the items, maybe try giving the AI a continuous small reward for holding items behind it? That would protect it from most assaults, and if it presses and holds the item button shortly after hitting any item box, it'll still nearly immediately use items like bullet bills and stars, while holding things like green shells.
@checkmate1284
2 ай бұрын
Have you considered giving a reward for hitting other plays with items? Also, maybe a punishment for getting hit?
@LinkPemonade
2 ай бұрын
I am unbelievably happy that someone made this, love MKW and ai is really cool, best of both worlds
@aitango
2 ай бұрын
Really glad you like it! I think its a pretty cool and unique combo :)
@knownas2017
2 ай бұрын
Thank you for another great video, friend. c:
@aitango
2 ай бұрын
My pleasure!
@OmegaChip
2 ай бұрын
I just got home how did you know to upload right now
@aitango
2 ай бұрын
It was just for you of course!
@Stabidistabstab_PBP
2 ай бұрын
He is in your walls...
@josiahsimmons9866
2 ай бұрын
I think the title is a little too complicated! And the thumbnail has a bit too much information in it. I didn't click the video the first two times I saw it because of that. Hopefully a little feedback helps!
@aitango
2 ай бұрын
Thanks, always good to get feedback on the title and thumbnail given how important they are for KZitem!
@xBlze
2 ай бұрын
As someone who loves Mario Kart and has no idea about IT, I like the way you put the most important information in a nutshell. I appreciate the videos and I'm looking forward for some more!!
@aitango
2 ай бұрын
Glad you enjoyed it, thank you!
@damienvanderhorst2943
2 ай бұрын
I was waiting for a new video on AI Mario Kart! I am so glad it’s here, seriously underrated channel for how interesting this content is. Also everything makes sense which is the best
@aitango
2 ай бұрын
Glad you enjoy it, thanks for the kind words
@MarreNysman
2 ай бұрын
Yaay a new video!! I think you was playing dry bowser. And that is because dry bowser plays different and hold his drifts longer compared to the others
@maestroeragon
2 ай бұрын
Fantastic video as always, love seeing your content :) I guessed who you were! Shortcuts with item turbos + item usage + using reverse view gave me a strong suspicion, and the backing up to get a bullet bill was the confirmation ^^
@Wizzkidwas
22 күн бұрын
You're Dry Bowser He was the only one who would consistently hold items behind him, the AI pretty much never does that
@flightmonkey
2 ай бұрын
Good video. I have a strong feeling you are playing as dry bowser
@jeynarl
2 ай бұрын
Also grew up with Mario kart in various forms. On the mobile app version of the game I don't even play multiplayer since I'll often get pitted against really dedicated players who can consistently lob bananas in front of me. I can only imagine the ai here doing that on an even greater scale and it terrifies me
@lisasmith2726
2 ай бұрын
I’m genuinely curious to see how long the AI would take to beat something like Elden Ring and what the gameplay would look like once it fully mastered everything. Also, great video and commentary. :)
@aitango
2 ай бұрын
Thank you! I haven't played elden ring before, but from what I know I imagine the AI would find very strange ways of beating it!
@Savage_Moose_Roller
18 сағат бұрын
I can’t believe my fear of AI comes from someone trying to teach it how to play Mario Kart
@aitango
10 сағат бұрын
Strange how things work haha
@sas7782
2 ай бұрын
another certified banger 🗣🔥
@aitango
2 ай бұрын
Thanks, really glad you enjoyed it!
@drachma1651
2 ай бұрын
Drybones is the only one who changes their strats based on items. Any time you get a mushroom you offroad the corner and actually time item usage. Also the only character that doesn't have pixel perfect drive lines lol.
@rizzmox4118
2 ай бұрын
+1 editing rep
@aitango
2 ай бұрын
:)
@aname4390
2 ай бұрын
Very cool! Do you think it would be possible to teach it more advanced tactics by connecting a racer to the main AI and have it repeat tactics like dodging blue shells with mushrooms? Or practicing shortcuts?
@aitango
2 ай бұрын
So I think using what's called "curriculum learning" could definitely be used to do that. Effectively, I'd just get a savestate right before a blue shell when the AI has a mushroom, then the AI would be likely to learn that.
@littlelum9773
2 ай бұрын
The only thing left is to put the AI into the actual game itself... The coaching thing sounds cool too. I imagine it would help speedruners practice
@jackb4
2 ай бұрын
Do you know how modern reinforcement algorithms perform on FPS games? Would be interesting to see if they can outperform the bots in those games.
@nobafan7515
2 ай бұрын
True, but depending on the game he could get banned, so i hope that won't be a problem.
@Celeste-ty5pb
2 ай бұрын
lotsa fps games have singleplayers, private matches, and local splitscreen matches, i dont think itd be a problem :) esp like xbox 360 era shooters
@lonelyPorterCH
2 ай бұрын
Pretty sure you are bone bowser You hold your items for protection and as soon as you get a star you get offroad to cut more corners^^
@blubbfisch98
2 ай бұрын
That's really impressive and entertaining
@anonym5160
2 ай бұрын
Can you please make AI play Taikyoku Shogi?🙏🙏🙏
@aitango
2 ай бұрын
I believe the AI company Deepmind already made an AI to play Shogi, using their famous algorithm AlphaZero
@Clumsiifi
2 ай бұрын
Hey! I know Mario games are the most known ones, but there’s a game that I would like to see AI try, it’s Spelunky. Love your videos!
@PrehistoricWaffle
2 ай бұрын
Great video! You can tell that your dry bowser from the frame 1 mini turbos that the AI gets.
@danielwutz4431
Ай бұрын
Great Video! I was wondering how you are merging together the different Q learning AIs?
@Vincent-qe7bs
2 ай бұрын
now we need netplay to play against them haha. Im also waiting for the next pro to play against your ai
@aitango
2 ай бұрын
I want TWD98!
@UnionSince452
2 ай бұрын
You were Dry Bowser. How can i tell? The AI was releasing their mini turbo frame perfect, whereas we could actually see the blue flame on Dry Bowser as you drove.
@rhysalexander5697
2 ай бұрын
Great Vid! Did you have to account for the different visual placements of the lap counter, position, and item, as with 4 player they're on opposite sides, or did you pull this info directly from the emulator?
@kimmandu6907
2 ай бұрын
my toxic trait thinking that I would easily beat them even tho I haven't reached 9999vr 😂😂 Anyways Great vid!
@aitango
2 ай бұрын
Everybody gangsta until they lose haha
@anotheruser133
Ай бұрын
I wonder if you are going to be able to train the AI off of staff ghost lines, that would be fun to watch, and then have it compete against CPUS.
@anotheruser133
Ай бұрын
Can’t wait till you try to make a 4-player AI speedrun for NSMB on the Wii for
@salih2D1
2 ай бұрын
You have come very far!
@aitango
2 ай бұрын
Thanks! Good to see some long-term fans of the channel!
@ruggianzapastellanza9384
2 ай бұрын
You were playing as skelobowser right? He holds the miniturbo way longer than the other players… you also reversed for some juicy items Got ya?
@RENZOHENGELMOLEN
2 ай бұрын
yes
@LunarEclipset
2 ай бұрын
Were you playing as DK?
@aitango
2 ай бұрын
What makes you think that?
@LunarEclipset
2 ай бұрын
@@aitango The movement. Drifting on general at the curves and mostly item usage. The Ai's would instantly use their items, however DK would strategisely use them to cut the track and to his advantatge. (However I saw some other people say Dry Bowser, hope that I'm not wrong)
@RENZOHENGELMOLEN
2 ай бұрын
na he is dry bowser he drove back to take an item the bot can't do that
@sofia.eris.bauhaus
2 ай бұрын
it seems that for optimal play the AI should focus more on finishing first, not just being first during the race. maybe after it reached a sufficient skill (not sure how to measure that) there should be an "finish position reward" that is slowly scaling up. first i thought it should maybe replace the position reward completely at some point, but i don't think it makes sense to to deprive it of such a useful source of reward altogether.
@DreadedGhoul575
Ай бұрын
If there was an AI in the future to learn any game (or Dolphin games only), I'd definitely try it on Shrek Smash n Crash Racing, since I'd love to see what it would be like seeing them melee and such lol!.
@florismmsmit
2 ай бұрын
The only thing left to do is to use all characters on all circuits against itself
@cyb3r._.
Ай бұрын
I know this would take longer but I’m wondering if you could train it without the position rewards, rather just giving a huge reward at for high positions at the end i’m curious if it will pick up a bagging-type strat also (this would take even longer to train but whatever) maybe lessen the slowness punishment and and increase the checkpoint reward or something so that the ai can find shortcuts?
@cyb3r._.
Ай бұрын
maybe also split the punishment for slowness into a sudden deceleration punishment and a slowness punishment
@web_082
2 ай бұрын
The only problem is the AI doesn’t understand concepts like bagging and so it can only front run. If it was set to play the team mode that is popular for competitive, I wonder if it would figure it out by itself.
@timberlin4075
2 ай бұрын
dry bowser is the only one who doesnt hop randomly
@PenguinBoi27
2 ай бұрын
Such a fucking cool channel Keep up the phenomenal work 💪👍
@aitango
2 ай бұрын
Thank you, will keep the videos coming!
@him9104
2 ай бұрын
My idea technically:D
@idcrafter-cgi
2 ай бұрын
if you now give each of the four ai drivers full access to all of the screen then coul it probably get to be even more devious and maybe even ambush more
@aitango
2 ай бұрын
I considered doing that, but thought it might confuse the AI a bit! Would be funny to see the AI start screen-peaking though
@animeliodas1337
2 ай бұрын
The next videos "AI defeating the best players in the world"
@aitango
2 ай бұрын
Let's hope, if someone like TWD98 would be interested I'd love to make an AI for them to face
@JordianLoL
2 ай бұрын
@@aitango Would it be possible to the AI to play online with random people? Since it seems people are using the dolphin emulator to play now. Obvious problem being the AI can't drive on all the maps.
@aitango
2 ай бұрын
Quite a bit of work would need to go into setting that up, but it is possible. I'd likely need to get in touch with someone who runs something like Wiimmfi and get special permissions
@joeshmo7858
2 ай бұрын
I could tell that you were playing as dry bowser because you were adjusting your angle or rapidly moving your joystick while using standstill miniturbos
@samuelthecamel
2 ай бұрын
We need to get Troy in a race with the AI
@Engieanimations
2 ай бұрын
It would be cool to see an ai for kirby bosses, or kirby in general cause i wanna see a speedrunner ai beat a boss up lol
@studipity
Ай бұрын
There are so many tells that you're playing as dry bowser, I'd be shocked if anyone didn't get it. Forget the backing up for an item at 12:55, the way the AI drives can only be described as 'indecision'. It still struggles to complete drifts, it loves to hop out of them instead of holding it for the entire corner. It does stupid wheelie-hop-wheelies that no human player would do unless they were looking behind them trying to dodge a shell or something. Also, current MKWii players are much much better players than yourself, as these are the people who have stuck with the game and downloaded things like CTGP and played online with Wiimfi. You'd be below average in online servers today (
@renakunisaki
2 ай бұрын
I need to learn how to make AIs like this.
@pumpkinzz5728
2 ай бұрын
I wonder if it’s possible to train AI to race like a team in a 6 v 6 scenario
@aitango
2 ай бұрын
Setting that up would be quite tough as playing locally only allows 4! If possible though, it would be very interesting what it could come up with
@redacteddev8842
16 күн бұрын
You should play around with the goldeneye game on Wii, which has a 4 player split screen versus mode.
@JustBen-xv1cr
2 ай бұрын
Great vid tango! And I have a suggestion, Super meat boy, that one would be absolutely insane :)
@aitango
2 ай бұрын
Is there a version available on Dolphin Emulator? If so I'm happy to give it a go at some point
@Yipper64
2 ай бұрын
@@aitango far as I can tell super meat boy was never released for the wii :/
@JustBen-xv1cr
Ай бұрын
@@aitango oh I didn’t know it had to be dolphin thanks though
@Technic_Neo
Ай бұрын
Imagine developing an Ai to defeat the time trial pro ai's lol.
@hellfire3278
2 ай бұрын
Cool AI. It plays almost like a pro but I wonder does it can run on different map with the same knoledge. Cause I mean right now you have the basic of what is a mario kart race on a simple map, so theoreticaly it can generalize to other map. Maybe with sub optimal line but you know... I would love to see your AI able to play on different map.
@aitango
2 ай бұрын
I do have a video on AI generalising to other maps! Check my my video, "Can AI play a track its never seen before?"
@vavadadeur150
2 ай бұрын
T'as video est géniale franchement continue
@sutsuj6437
2 ай бұрын
I really want to do something like this, but I have no patience to search through memory values for useful data, nor an idea on how to access them (memory values) in real time in python.
@aitango
2 ай бұрын
That part is pretty tedious, however there are some good tools out there which make it a lot faster
@tulip1634
2 ай бұрын
Would be cool if you gave it reward for going through offroad without a speed detriment, like with a mushroom or whilst hopping (as long as it actually saves time)
@tulip1634
2 ай бұрын
Plus reward for hitting people.
@tulip1634
2 ай бұрын
So it's definitely Dry Bowser right
@Hélène-b9t
2 ай бұрын
After watching your video, I want to play this game right away!
@aitango
2 ай бұрын
You should, Mario Kart Wii is a brilliant game!
@jocabulous
2 ай бұрын
I think instead of rewarding for just using an item, they should be rewarded for successfully using an item. Like if they hit another racer with a shell, or boost through offroad with a mushroom
@metaljeremy
2 ай бұрын
i can see by the way you drive, dry bowser haha. also i would love to drive against your best ai
@adef-pj1du
Ай бұрын
idea i notice that if you connect mario kart trough wiimfi the in game cpu's get a little more difficult then normal if you could apply this to the game and train the AI's again may be the then get better by learning from te cpu's
@yanntal954
22 күн бұрын
I bet you can't make an AI that can even beat bots in Speedrunners. Yes, it is like a 2D version of mario kart (sort of) but it will never be able to figure out how to swing or wall jump.
@Cyanight08
Ай бұрын
you should make it so that the ai gets a reward for hitting it's item and not just using it
@MrHardTruck
2 ай бұрын
All your videos are really interesting! Do you plan on training a model for time trial runs that could beat world records? I race a very mean ghost valley 2 and id be curious if and how fast it could beat my PB! Its 53.918 no shortcuts/glitch
@aitango
2 ай бұрын
Time trials are something I’ve wanted to do for a really long time! Maybe I’m even going it right now :)
@MrHardTruck
2 ай бұрын
@@aitango Sick! Cant wait to see the results
@LeedleFace1212
2 ай бұрын
Would it be possible to make a reward for hitting an opponent with an item to boos the chance of that heppening? I believe the game keeps track of it in one way or another because if you hit someone with an item, your character will react, so I feel like it should be.
@vincenzofranchelli2201
Ай бұрын
itd still get crushed competitively
@bumpybumpybumpybumpy
2 ай бұрын
I wonder if it would preform better or worse if it was given only specific memory values rather than images. I also wonder if it would compute any quicker.
@aitango
2 ай бұрын
It would certainly compute faster, however the challenge would be collecting enough memory values that actually give the AI enough information. In theory though, it could work very well
@nepser
2 ай бұрын
cool video
@aitango
2 ай бұрын
Thanks!
@hi_imdamien4948
2 ай бұрын
Dry bowser? because the other 3 would immediately release miniturbos and you cant even see the blue, you held it slightly longer
@JPK314
2 ай бұрын
What learning algorithm are you using? The way you describe it makes me think its not an actor / critic model
@aitango
2 ай бұрын
The algorithm is a q-learning based approach. It’s built off of rainbow dqn, with additional improvements. I’m hoping to publish it soon
@JPK314
2 ай бұрын
@@aitango interesting, thanks! Great work on this
@MoreInsane96
2 ай бұрын
That's neat and all, but when can we play against it? 😏
@aitango
2 ай бұрын
100k subs :)
@hmjkal
14 күн бұрын
yo if you could can you teach Ai how to play cod? or you could do any type of Shooting game idrc😅
@23bcx
2 ай бұрын
this falls for the classic problem of over sampling
@pim1244
2 ай бұрын
plz realase sourse code so we can use it to
@aitango
2 ай бұрын
If I hit 100k subs, I will!
@renakunisaki
2 ай бұрын
🙄
@Mechjeb661
Ай бұрын
@@aitangoPeople will use it to cheat.
@nachorosfer
2 ай бұрын
is there any chance you release a mod or something to play against the ai? I would love to play against it.
@aitango
2 ай бұрын
If I knew how to do that I'd love to. If anyone knows how to, please get in touch!
@vincenzofranchelli2201
Ай бұрын
is there anyway to teach it shortcuts?
@goldenarmour7975
2 ай бұрын
dry bowser took a shortcut so I assume you were him
@nobafan7515
2 ай бұрын
Is it possible to make more than 20 checkpoints if it needs more?
@renakunisaki
2 ай бұрын
I think they're just what the game defines. However it must also interpolate them to show your position, so, using that data would give effectively unlimited checkpoints.
@aitango
2 ай бұрын
Yeah so I can technically use as many as I want, but the reason I don't use too many is because they aren't evenly spread out when you start looking really closely. If I use fewer, they tend to be a bit more consistent
@Isaac-ry3ks
2 ай бұрын
Mario Kart wii online with ai next?
@aitango
2 ай бұрын
I'd love to! I really hope to get into contact with someone who runs Wiimmfi and set that up
@DictatePM
2 ай бұрын
Uhhh... DK or Rosalina maybe?
@somanyrandomthingss
Ай бұрын
You should make the ai play chess
@johnboyboy919
2 ай бұрын
dry bowser. the ai does a lot of hops. and in 1 clip you went in reverse for a power up. and like who plays as dk, rosalina, or that other guy???
@aitango
2 ай бұрын
The AI is controlling all of them except the one I control!
@cholsreammos
2 ай бұрын
Nah id win
@aitango
2 ай бұрын
That's what I thought... until I didn't
@cholsreammos
2 ай бұрын
@@aitango yeah id probably lose to these. If it was mk7 tho i think i might have a chance.
Пікірлер: 187