If you're looking to create your own website, I genuinely recommend this video's sponsor, Hostinger. Go to hostinger.com/drsam and user the code DRSAM at checkout to get up to 91% off.
@mauriciocortespersonal
4 жыл бұрын
Probably H. Clinton is a IA
@PeterMaddison2483
Жыл бұрын
If you really want it to me more realistic, make it so it can only park in reverse as that's how I was taught to paralel park (front wheel steering). I see now how it would be different with rear wheel steering, so you could do two trials.
@multiarray2320
Жыл бұрын
impressive that you found a sponsor for your channel. can you upload more videos?
@ProjectPhysX
4 жыл бұрын
And now try it with two cars competing for a single parallel parking lot. I want to see some reckless AI driving!
@SamuelArzt
4 жыл бұрын
I did that for normal parking: kzitem.info/news/bejne/pKePsZyYsnp3p3Y But parallel would surely be fun as well :D
@aligamiles
3 жыл бұрын
@@SamuelArzt so can you do it for parallel parking?
@jeI6009
4 жыл бұрын
i'm a high school student in Korea who asked for your advice last time. Thanks to your help, it was solved well last time. Thank you. Whenever I see your research, I am always amazed and want to emulate you. I'll always support you in Korea🇰🇷🇰🇷🇰🇷
@ROBA05
4 жыл бұрын
1:58 "I'll just drive home"
@wallnut6250
4 жыл бұрын
too tired didnt learn
@meowththatsright7881
4 жыл бұрын
Tutorial on how to do it please?
@HakikatBirSinghBhatti
2 жыл бұрын
Saw this video last year, had a wonderful ride through the youtube algorithm, came across the 2 min papers yt channel. I'm a doctor by training, completed my MBBS last yr but now pursuing AI, ML and Data Science Post Graduation program for it's applications in Healthcare. So, Yes. YOU ARE MY INSPIRATION, Sir.
@SamuelArzt
2 жыл бұрын
What a ride! That‘s awesome! Great to hear. Thanks for sharing, that really means a lot to me. I wish you all the best on your journey.
@chilipepper9176
2 жыл бұрын
@@SamuelArzt Are you still making videos? Or have you stopped making videos?
@SamuelArzt
2 жыл бұрын
@@chilipepper9176 I might be doing more videos in the future. Unfortunately, at the moment it's hard to find the time to do so, though.
@OfficialYunas
4 жыл бұрын
Increasing the environment complexity while training usually helps. For example, start with the cars far apart and a huge desired parking space. Then gradually make the environment harder while training, e.g. cars less apart and parking space smaller.
@revimfadli4666
4 жыл бұрын
Or use Hindsight Experience Replay, learning how to acheve failures also makes the AI learn how its environment works
@OfficialYunas
4 жыл бұрын
@@revimfadli4666 That's also a good idea.
@revimfadli4666
4 жыл бұрын
Big yes to the format, informative & shows the thought process. Btw would hindsight experience replay help with the learning?
@SamuelArzt
4 жыл бұрын
Thanks! Yes, HER is a really interesting concept in my opinion, but I never got to try it out. I definitely want to do that in the future! 😀
@Kram1032
4 жыл бұрын
try something like a slow but steady increase in difficulty wherein at first just getting close is enough and then gradually the difficulty increases until only near-perfect parking is possible. You could even find inspiration in POET (Paired Open-Ended Trailblazer) and its recent improvement Enhanced POET wherein, basicaly, the concept is that the environment gets its own process (they used evolution but you could also make it some learning algorithm) to gradually modify the environment in ways that try to keep the agent as close to the frontier of its abilities as possible, allowing for gradual improvement. I suspect that'd be a lot of work though. It'd involve some sort of controllable procedural generation of your city scene. Currently that, as far as I can tell, is lovingly handcrafted.
@Firzj
2 жыл бұрын
where are the new videos? Did the AI overtake your channel ? 👍👽
@berkayherek1173
4 жыл бұрын
To be honest I think it was really good video and nice explanations I liked how you change stufs and tell us everything.
@SpEsHuL
Жыл бұрын
I wish this guy made more AI Content especially with the new advancements in AI
@SamuelArzt
Жыл бұрын
What kind of content would you be interested in seeing, especially with the recent advancements in mind? 🙂
@KrXYT
Жыл бұрын
@@SamuelArzt Chess ai 😃
@SpEsHuL
Жыл бұрын
@SamuelArzt To be honest anything related to AI I found it really interesting and fun to watch you could do for example a plane landing on an airport from a high altitude figuring its way to properly land, and know when to decrease its altitude just an idea I would probably be happy with videos similar to this one :)
@SpEsHuL
Жыл бұрын
@SamuelArzt I do not know that much about AI but know that there are lots of new things and smarter ai's but ofc and feel like you could make more complex requests to the AI and it would learn to do them but honestly I think I would enjoy any types of similar content to this one. :)
@SamuelArzt
Жыл бұрын
@@SpEsHuL I see, thanks for the input. I really appreciate that!
@algorithminc.8850
3 жыл бұрын
Fun channel. Subscribed. Who needs comedy shows, when they can watch AI systems being trained. Always a good laugh. Reminds me of back in the 80's and 90's, the interesting results of textual systems - the early attempts of AI. There's some of that in the interesting five-part series "The Machine that Changed the World." I have some of those old-school videos in the "business" section of my KZitem, if you have interest. Thanks for the great channel ... enjoying it.
@MrCool-lo3ls
4 жыл бұрын
Hey, I've had this idea now for quite some time but I lack the experience and capabilities to try it out myself: You could probably have the ai begin learning in an easy environment and once you're happy with the results make the rules a bit more strict - kinda like school but the ai is only judged not stressed. For example the the ai might learn to do simple stuff like get close to the parking spot, next you make rules more strict for the position, then it has to face the right way and last, it needs to actually stopand after that you could add all kinds of fancy rules to a somewhat trained ai. I've thought about a similar thing with the network itself, small networks are fast to train but have not much complexity and big ones take an eternity to train. So what about starting with a small network and having it grow whenever there seems to be no improvement on tge results? I would absolutely love these concepts to be tried out but I just cant do it myself yet.
@SamuelArzt
4 жыл бұрын
Those are great concepts and it shows great creativity and true passion that you were able to come up with them on your own. There are already a lot of implementations which are at least similar to what you are thinking of here. The staged learning is often called "curriculum learning" and is already implemented in the ML-Agents framework for instance. I just never got around to trying it myself. Adapting the network's topology during training is also something that has been tried in many scientific papers. However, as you probably already guessed its hard to do that in a way that actually benefits the training instead of making it even more complicated (i.e. taking longer). I am not sure whether there is any state of the art model / architecture that makes use of such a concept since frankly I am not up to date with all the subfields of machine learning these days (which I think is getting more and more complicated, if not impossible, to be anyway). Most solutions rely on a rather fixed topology I think. But that still shouldn't stop you from trying to do better or finding new ideas! You might just be able to find the slight variation that actually succeeds and is better than any other method.
@MudakTheMultiplier
2 жыл бұрын
I know it's been a year, but I feel like scaling the perfect parking reward exponentially would help guide the ai into actually finding the spot.
@oxiigen
4 жыл бұрын
great and interesting research! thank you!
@kiwi_2_official
2 жыл бұрын
will you make more of these? it would be nice to see AIs try to drive on roads and go from point A to point B or go through courses as fast as possible or some things like that
@lass7212
4 жыл бұрын
Keep up the good work, also are you Danish or scandinavian?
@SamuelArzt
4 жыл бұрын
Thanks! I'm from Austria actually 😄
@lass7212
4 жыл бұрын
@@SamuelArzt Ahh Austrian, i have been to Mattsee before, absolutely wonderful place
@SamuelArzt
4 жыл бұрын
Yeah, there really are some beautiful places here. Sometimes it is hard to fully appreciate the beauty of your own home country, but I learned to do so in the last couple of years 🙂
@komi9274
3 жыл бұрын
can you teach us how to make a basic ai that does stuff like this please! I'm really interested in how you get this to work.
@simeonstoyanov5226
4 жыл бұрын
Hey, I'm wondering whether extending the length of the sensors around the car would help? Depending on where you spawn, often times the car needs to be in position from a greater distance than the sensors can reach? We can see the whole map, but if the agent can only see as far as its sensors, then I'd imagine it'd be pretty difficult to drive like that.
@SamuelArzt
4 жыл бұрын
Hey, that's a great suggestion, as it would actually be pretty easy to do with this setup. I will give that a try in the future, thanks!
@nikkiofthevalley
2 жыл бұрын
@@SamuelArzt It would likely increase training time by quite a bit, but a much more flexible (and realistic) approach to how the agent senses the area around it would be to just give the agent a 1D depth texture rendered from a camera at the car's position with a high FOV.
@mbeware
4 жыл бұрын
It would be interesting to see the AI select the best parking spot... And I don't know if there is a time rewards (less time bigger reward). And for the strange parking methods of entering the parking spot to reverse, maybe give a penalty where going on the curb??
@SamuelArzt
4 жыл бұрын
Yeah I agree, that would be really interesting. It would also increase the difficulty quite a lot though 😄 I tried time rewards (or rather penalties, i.e. a very small penalty every second that passes), but that didn't really have any positive effects with this setup. I am sure it would be beneficial to use timed rewards on a pre-trained model though. A penalty for driving on the sidewalks would make sense, but I would also need to figure out an input which enables the agent to recognize the ground it is currently driving or about to drive on. Currently it only gets depth sensors and its relative position in the environment. I didn't want to risk it to learn the environment by hard.
@mabynke
4 жыл бұрын
@@SamuelArzt Instead of a new kind of penalty for driving on the sidewalk, how about placing something there, such as a wall or a car?
@Keamybakunin
4 жыл бұрын
Hello is it possible to get the resources used in the video ? The parking and the vehicule ? Thanks.
@robertjames9191
4 жыл бұрын
Here's an idea for your next video. Make the car learn how to drive and park at a specific location and it needs to stay in the correct lane of traffic
@_CloudyBunny
4 жыл бұрын
Oh man, you are the god!! Can you make a tutorial, please?
@OfficialYunas
4 жыл бұрын
The Artificial Intelligence part behind it is mostly already there for you to play with. Here is a link you can look at: unity3d.com/de/how-to/unity-machine-learning-agents After that introduction, it should be straight forward to create your own setting.
@geekwu6159
4 жыл бұрын
Watched your video, i really wanna learn machine learning. Could u recommend book or some kind of learning curriculum?
@gavindesantis
Жыл бұрын
Please make more videos
@felipelopez3722
3 жыл бұрын
I love your videos. I found them two dyas ago.
@kevinlu6531
3 жыл бұрын
Hi Samual, impressive with your demonstration. I am new to Deep learning/AI field, any learning roadmap recommended? Really appreciated your advice.
@theguyyouheardabout6658
2 жыл бұрын
Wya man just found the channel, really into it and would love to see how ones starts a project like this
@IMSezer
3 жыл бұрын
could you help us to learn RL, unity and communication of these?
@rcsibiu
4 жыл бұрын
6:23 the AI simply quit and let the car in the middle of the parking space "you want perfect parking, go f yourself, why don't you park it?" I think the AI thought it's not worth the time consumed and the hassle to perfect park it anymore and just abandoned it's quest
@Sovietneko
10 ай бұрын
I wanna ask something when do you gonna upload?
@blueorb7030
3 жыл бұрын
Separate the location reward from the angle reward! Give the ai more vision! Have the the reward be much more incremental!
@manuelsenge57
3 жыл бұрын
Awesome Video :) so the loss (or discounted reward) in the last setting (perfect parking) converged but the agent didn't learn to park?
@bsgmz
4 жыл бұрын
Hi It is very nice video. I am curious about if you add penalty for moving on sidewalk. Can you add that? Thanks
@SamuelArzt
4 жыл бұрын
Hi, thanks for the kind word! That is a great idea, since it is of course note desirable for the car to drive on the sidewalk. However, since the agent is only fed depth information from its sensors, I decided to not penalize that, as there is no way for it to actually tell whether it is about to drive onto a sidewalk or not. I thought that would only promote it to learn the environment by hard. The next step would be to have complete visual inputs, but that would make the task orders of magnitude harder ^^
@bsgmz
4 жыл бұрын
@@SamuelArzt Maybe it can be done by only add 2 RGB sensor. 1 on front 1 on backward. Also if you like Total War Attila you can subscribe on my channel. :)
@simeonstoyanov5226
4 жыл бұрын
@@SamuelArzt You could potentially add like a fence or something on the edge of the sidewalk?
@brianroys1868
3 жыл бұрын
"drifting U-turn into a parking spot, in reverse" -- that's how I park ;-)
@9090-u4m
2 жыл бұрын
It would be interesting to consistently teach it to drive only on the right side of the road, turn at an intersection, and then park in any way.
@ioda006
3 жыл бұрын
Awesome work. I'm just starting on ML-agents. Do you share any of your projects or models? I would love to be able to play around with it in Unity.
@SamuelArzt
3 жыл бұрын
Thanks for the kind words! Unfortunately I am not able to she the entire project for this one. But the models are actually from an asset pack, you can find it in the asset store. Search for "Simple Poly World". I released a gist of the agent code for the normal parking a while ago though: gist.github.com/ArztSamuel/499e617844ca4ce6e222183bd23752f0
@ioda006
3 жыл бұрын
@@SamuelArzt Thank you so much for the quick reply! That gist will get me started. Hope you've got some more ml-agents projects to share in the future. I really like how you show what the agent is doing throughout the training and talk about the different tweaks you make.
@SamuelArzt
3 жыл бұрын
Thanks, hearing that means a lot to me! Unfortunately, it's really hard for me to find time for these projects at the moment. I would really like to bring back Explained in a Minute though... I actually also planned on doing a full fledged tutorial on one of these parking projects, since there seems a lot of interest. I only wish the YT algorithm wasn't so unpredictable though 😅 really hard to put more time into it with so much risk involved.
@ioda006
3 жыл бұрын
@@SamuelArzt I like that video too. I think your others are popular because they show groundbreaking machine learning tactics that get people talking. You've identified Unity as a ML experimentation platform in a way people don't yet recognize it to be. But yeah I realize it takes a lot of time to build even just one experiment like this, let alone producing video for it as well. Dunno if you'd be interested in this, but there is a distinct lack of tutorial material out there for ml-agents - even the stuff on the learn.unity.com website is pretty meh. Much smaller than a general audience, but if you're looking for a business endeavor (ex: paid classes on Udemy or get picked up by Unity for a paid gig like Immersive Limit did), there's a *lot* of room right now. Could drive people from youtube to your paid class.
@SamuelArzt
3 жыл бұрын
@@ioda006 Yeah, I totally agree with you. I would love to collaborate with Unity on a project like that. That would be absolutely awesome. I kind of dislike the typical paid Udemy course approach. I would love to be able to provide content (especially educational content) for free. But I totally understand why educators move to platforms like that. Maybe I should actually take the initiative and contact Unity instead of waiting for them to somehow "discover" me 😅
@mamertvonn
4 жыл бұрын
Alternate Title: How Elon Musk started
@DanskeCrimeRiderTV
4 жыл бұрын
He started by founding PayPal.
@officaljayplaz6899
4 жыл бұрын
@@DanskeCrimeRiderTV r/whoooosh it's a joke dude
@TheFinalIllusion
3 жыл бұрын
@@officaljayplaz6899 but it's not funny if it's not accurate
@erikm9768
4 жыл бұрын
Why not reward based on how parallel the car angle is to the street rather than just being strict about giving any points at all
@Drifty_Car
4 ай бұрын
So what game you wanna called it Make sure its on Googleplaystore
@pieTone
2 жыл бұрын
2:00 The ai be like: Im outta here
@thomaskleine6121
2 жыл бұрын
Danke, das du das machst! Es ist echt sehr lernintesiv!
@andreikocmnh9145
4 жыл бұрын
Please show us how to do it!
@alitabasi4710
3 жыл бұрын
What's your Damage reward in Crashing with cars or other object And going in side walk, in comparing of Positive Reward? Because in last video I saw that Car crashed to other object and it repeated till last part.
@YeshuaGod22
3 жыл бұрын
Is it just aiming to get its centre of mass into the box, or its entire form? If the former, then a much thinner and marginally shorter target box would help accuracy a lot, I'd imagine
@revimfadli4666
2 жыл бұрын
He said from the center of the parking spot
@ChraO_o
Жыл бұрын
The vectors should be only at the front and the reflection of the side mirror of the car but damn this ai is lit..
@beefykenny
4 жыл бұрын
Which programming languages did you use for this project?.
@SamuelArzt
4 жыл бұрын
This was done with the Unity ML-Agents framework. So the Unity part (i.e. the simulation) used C# scripts and the machine learning part used Python.
@LIGHTBULBCODING
2 жыл бұрын
Can't you speed the whole system up with unity scripts, or would that stop it working properly ?
@ThatTonybo
2 жыл бұрын
I'd love to see the cars start to drive normally now. Make them park in normal ways, then make them drive normally within the lines. The possibilities are endless to make a really amazing traffic AI.
@sebastianjost
2 жыл бұрын
That's basically what Tesla and all other brands trying to achieve autonomous driving are doing. Of course it's much easier with just a few rules and in such a simplified simulation, but that makes it possible to explore on you own PC.
@suleymanadin
4 жыл бұрын
will you teach us how? what I want to learn most in this life is artificial coding.
@alessiobenvenuto5159
4 жыл бұрын
Mee too
@theyoshi202
4 жыл бұрын
16k views? This is criminally underrated. Great video 👍
@error220_33
Жыл бұрын
please show how make an tiny i.a. training. and protect scape to internet....
@leungmica4615
4 жыл бұрын
Can you add some pedestrian and present in 3D, Great video!
@blairlane7425
4 жыл бұрын
It would be cool if you added actual moving cars that are driving on the road.
@kukugame3153
11 ай бұрын
Source code please Would love to see your reward system
@SamuelArzt
11 ай бұрын
I have released a stripped down version of the agent code here: gist.github.com/ArztSamuel/499e617844ca4ce6e222183bd23752f0
@Spider_head.
2 ай бұрын
Yeah @@SamuelArzt is still alive
@jonmenard
3 жыл бұрын
what are some of the inputs you are giving the neural network? I am trying my own attempt at something very similar. However, the car never seems interested in readjusting.
@SamuelArzt
3 жыл бұрын
Inputs are only the sensor readings (normalized), target position (x,y) and rotation (y) and current position (x,y) and rotation (y). Positions were normalized to the allowed bounds. You can also find the most important parts of the Agent code I used for normal parking here: gist.github.com/ArztSamuel/499e617844ca4ce6e222183bd23752f0
@jonmenard
3 жыл бұрын
@@SamuelArzt thank you!! I think my problem was the size of my hidden lays, there was only one and it was only 10 neurones. I am now trying with 4 layers of 64
@duerrkeno
2 жыл бұрын
5:52 - AI is meant to learn parallel parking, accidentally learns to do a three point turn
@rc8092
4 жыл бұрын
Intenta hacer que encuentre un sitio de estacionamiento libre y que se estacione en el.
@진강수-k7q
3 жыл бұрын
Will you open source the project? I want to try this too!
@3vol2
4 жыл бұрын
Another great video!
@ahammedshamir2264
4 жыл бұрын
Can you share video tutorial of how you did this? Is this done in unity?
@SamuelArzt
4 жыл бұрын
Yes, this was done in Unity with the ML-Agents framework. I'm not currently working on a tutorial, but who knows what the tide could bring.
@kamillatocha
3 жыл бұрын
why not reward it more if the angle with parking spot is almost 0
@SamuelArzt
3 жыл бұрын
Yep, that's exactly what I did.
@YeshuaGod22
3 жыл бұрын
I bet it would learn quicker if you put more eyes at the front and rear facing eyes on the wing mirrors.
@Ulsaf
2 жыл бұрын
what happens if you run a successful ai for many more attempts. will it just laser beam precisely park
@LoudEscapeARK
2 жыл бұрын
Continue caring about your channel. It is future
@CritiqueAI
2 жыл бұрын
Did yuo ever work out why the parking didn't become perfect?
@OfficialYunas
4 жыл бұрын
Can you tell us the algorithm you used and the parameters?
@SamuelArzt
4 жыл бұрын
I used the PPO implementation of ML-Agents. Here are the most important training parameters: batch_size: 512 beta: 2.5e-3 buffer_size: 2048 epsilon: 0.2 hidden_units: 128 lambd: 0.95 learning_rate: 3.0e-4 max_steps: 50e6 memory_size: 512 num_layers: 3 time_horizon: 512 sequence_length: 64
@manolov4074
3 жыл бұрын
How do you train for 3 hours or more ? Do you increase the steps in the yaml ?
@SamuelArzt
3 жыл бұрын
Yes, I tweaked all hyperparameters of the yaml input file. Including the max steps in order to train for a longer period of time.
@manolov4074
3 жыл бұрын
@@SamuelArzt I am trying to do the same thing , inspired from your video. But it just doesn't learn. Would you be able to share the yaml configuration ?
@SamuelArzt
3 жыл бұрын
@@manolov4074 Sure, but keep in mind that ML-Agents has changed a lot since then and some hyperparameters might have changed / been removed or added: trainer: ppo batch_size: 512 beta: 2.5e-3 buffer_size: 2048 epsilon: 0.2 gamma: 0.95 hidden_units: 128 lambd: 0.95 learning_rate: 3.0e-4 max_steps: 5e6 memory_size: 512 normalize: false num_epoch: 3 num_layers: 3 time_horizon: 512 sequence_length: 64 summary_freq: 1000 use_recurrent: false use_curiosity: false
@manolov4074
3 жыл бұрын
@@SamuelArzt Thank you ! I have some serious memory leak issues with the Unity ml i don't know why . It happens only during training . So I don't have a memory leak in my code. Must be either my YAML or their library . Thanks Tho :)
@woojinkim3
4 жыл бұрын
Where can I get those cars model?
@SamuelArzt
4 жыл бұрын
They are available in the Unity Asset Store (Simple Poly World).
@woojinkim3
4 жыл бұрын
Samuel Arzt thanks very much. The video was great
@sunniestpluto
2 жыл бұрын
Ai learns to park using a real car. I would love to see a home trained ai do this
@LUVVEOUS
3 жыл бұрын
Let it drift and give it extra reward for shortest time
@zetathix
3 жыл бұрын
I just hope to see it do parking while other cars use the road, maybe a mayhem haha
@OscarHines
3 жыл бұрын
Now we need active traffic at the same time
@noando1405
2 жыл бұрын
Are you from finland. Your accent sounds really finnish.
@SamuelArzt
2 жыл бұрын
I'm from Austria, but I guess most european english accents sound somewhat similar 😄
@ecozones2d627
4 жыл бұрын
There is a video or a file explaining the code?
@SamuelArzt
4 жыл бұрын
I am thinking of doing a "behind the scenes" video explaining a bit more of the actual code and concepts behind it and trying some community suggestions. So that might be coming in the future!
@liujanis636
4 жыл бұрын
Samuel Arzt That would be awesome, my dude! And make sure to make it really technical for those of us who want to learn something :)
@packediceisthebestminecraf9007
2 жыл бұрын
To make a drift parking AI, you would probably have to add a reward for starting to brake at a high speed and land at the parking spot after that.
@foxyscontent713
3 жыл бұрын
MAKE THE AI DRIFT A TURN
@1ceblock
3 жыл бұрын
is it possible to train an AI to play a game that you didnt make yourself? for example is it possible to train a AI to play a game like CS:GO with deep learning? would be a really interesting video.
@Skulhunter5
3 жыл бұрын
Why didn't you just use the same AI as last time? It would have been really interesting to see if the AI learned to drive into the parking lot without crashing or if it learned to drive into the parking lot backwards/forward. Or how easy it can adapt to the new circumstances.
@matte3990
Жыл бұрын
you should make an ai operate a racetrack
@Kisssonik
Жыл бұрын
What do I need to learn to do something like that?😅😅😅 I’m serious 🧐
@ctprjcstv3998
3 жыл бұрын
Test this scenario: trying to park while cars are moving in the street
@@Lukas-qd7fy yeah, that was unfair competition... I was able to comment 3 days before the video was released. 😂
@Ahsoka501st
4 жыл бұрын
Was this trained in real time?
@SamuelArzt
4 жыл бұрын
During training the simulation is sped up manifold and multiple instances of the simulation are running in parallel. As mentioned at the different stages in the video, the training took 3 - 10 hours this way, depending on how many simulation steps the agents were allowed to train before the training was stopped.
@patrickday3393
4 жыл бұрын
If only you brought the green car from the last video, and not the silly red one
@SamuelArzt
4 жыл бұрын
Haha, fair point. 😂
@prateeksaini9258
4 жыл бұрын
Can you upload your code in github?
@benurm2390
3 жыл бұрын
You could reward it the less time it takes to park, and also the faster it learns (so it will try to be more intelligent and don't try again things that didn't work).
@DanielLCarrier
3 жыл бұрын
I'd make it give a higher reward for being closer to the center of the parking lot and angled right, but never have a strict cutoff for what's good enough. Also, give it a penalty for leaving the road.
@SamuelArzt
3 жыл бұрын
That first suggestion is pretty much what I did, yeah. Didn't do the second one, because the sensors wouldn't be able to detect going off road, resulting in a penalty which the agent can't sense in advance.
@fusion5329
4 жыл бұрын
Do AI Learns to land Falcon 9 [Serious]
@SamuelArzt
4 жыл бұрын
I like that idea... 🤔😄
@fusion5329
4 жыл бұрын
@@SamuelArzt You seriously haven't thought about this before? It was like the first thing that came to my mind but whatever i have no motivation to do it so i wrote it here hoping someone else would try it.
@kagereact
2 жыл бұрын
Wann kommt hier eigentlich mal ein neues Video? 🥲
@pieTone
2 жыл бұрын
Would really like to upload something.. I know you aare busy tho
@wender_maker
2 жыл бұрын
WANT. VIDEO. NEW. I. MORE.
@Sammeep02
Жыл бұрын
No different than a human learning to parallel park.
@mrctrl5923
3 жыл бұрын
More video (i watching in Türkey)
@Blue_Monkey
4 жыл бұрын
You should have set the sidewalk off-limits and immediately fail when it hits something
Пікірлер: 184