First of all thanks to you, I learned ffill, bfill and interpolate functions from here. But it's recommended from many professionals that missing values should be imputed with mean, median & mode.
@kaustubhjain7066
3 жыл бұрын
the chill moment when he codes and sips up coffee, cool man great work !!!
@YOGIT_Singh
Жыл бұрын
Bro, you are Doing such great work.. The way you are explaining things is excellent and easy to understand. Kudos to you .
@alishalbayev264
3 жыл бұрын
I just started watching but I see that you are really good man, thanks
@kamalkantmahour9641
4 жыл бұрын
Sir, please tell me the book from where I can learn all these concepts and programming skills required for this.
@santhoshbharath2910
2 жыл бұрын
hats off to you man, you really made my day, you gave me a good confidence today, once again thankyou so much sir
@gideonopoku-gyamfi1114
Жыл бұрын
So please which do you think is more efficient to be used without changing the accuracy of the data
@kdausu90
3 жыл бұрын
This guy is chill af
@harshvardhansahay3864
Жыл бұрын
This video has really me understand the data cleaning process. Thanks Man.
@ganeshkumarpatel
4 жыл бұрын
Please explain to fiilna or replace zero with mean value by groupby... Means you have 3 groups in data frame and you want to fillna with respective to group mean
@RavikaUniverse.
10 ай бұрын
awesome ,good and precise data cleaning please load some more stuff related to pandas
@kurosaki2510
2 жыл бұрын
Could you make a tutorial on Big Data as well, for situations with e.g. 500k rows and 200 columns where you don't see all of your data and don't know what kinds of Nan values to expect and therefore can't name them textually? Big thanks in advance :)
@oktafajarandrian7352
2 жыл бұрын
Up
@Alexander-ms2ct
Жыл бұрын
It’s a **kwark called “chunksize=“ the integer passed to it is the amount per chunk. So if you select 1000 and have a df of 500k. It would load 500 times. In pieces
@ravitejapavuluri945
3 жыл бұрын
You said everything but but missed the one I am waiting for is filling NaN with mean or media values.
@littlecreator4838
2 жыл бұрын
Hi,very nice explanation. I am totally new to python. Can you pls make a tutorial on how to install jupyter and all the other required libraries to perform forecasting.
@kousumichaudhuri3793
Жыл бұрын
Thanks a lot bro. The way you explained the steps are really helpful.
@kunalkishore5260
2 жыл бұрын
what to mention in na_values if we dont know the missing vlaues or there are hundreds of different missing values
@Nitswits007
4 жыл бұрын
Would you be able to provide mentorship. I have started learning DS . Want to keep moving in a direction .jyst don't stop due to coding lag.
@rashigupta5611
2 жыл бұрын
How to get how many type different type of value is there to put in na_values? I mean to say the value you have mentioned for missing_value.. how you are getting that.. we cant check the file if that has huge data
@SONALIKUMARI-is9jc
4 жыл бұрын
What if the file is not there on which we want to work?
@sheetalurankar4660
4 жыл бұрын
Explain the more concepts like standardizing, matching, consolidation so we get all idea about data cleaning.
@waynefmj
3 жыл бұрын
This
@ranamahrous7814
3 жыл бұрын
i want messy dataset for practicing do u know where can i find one? or do u have one ?
@sifar1857
2 жыл бұрын
Great tutorial! No need to hesitate on referring to the code snippets btw… I don’t think any sane person watching this has the expectation for you to memorise a to z what you want to articulate…
@poojakumarirollno9880
10 ай бұрын
Great job sir . Thank you so much for great explaining . Can u make more videos on data analytics
@jayakhanal1720
3 жыл бұрын
how to cleaning data that is TZAN dataset from kaggle for,music genre classification using cnn?
@sammy0722
4 жыл бұрын
Nice way of explaining. One request, do make one video on Outlier removal. Thanks.
@SoumilShah
4 жыл бұрын
you got it !! will add on my to do List
@aliaitazaz7040
Ай бұрын
Learnt something new, THANK YOU!
@angshumanbardhan3729
4 жыл бұрын
Thank you for making this video.
@mahidhar9787
3 жыл бұрын
how can we replace using mean, median & mode
@RaviPrakash-ml8qb
Жыл бұрын
Very useful video keep it up champ
@comptegmail273
2 жыл бұрын
Hello sir, thank you so much for the tutorial. I'm actually stuck since my source in a CSV file. Except that sadly the file I'm working is extremely complex with indefinete columns since my main columns are repeated everyday based on the date. I've been stuck on this problem since over a week. Is there a way I could reach out to you and have your mail to maybe help solve this problem? Thanks a lot in advance.
@deutschvalley3574
3 жыл бұрын
How i can handle float values 2.o or 0.04576 kindly let me i am doing a research using a big datasets
@ehteshamali2893
3 жыл бұрын
interpolation is basically like average? right?
@vandanasharma.sharma33
4 жыл бұрын
Can't we add any value to these NaN?
@ShresthBhakta
Жыл бұрын
Thanks Soumil, really helpful !!
@sonalikoli384
Жыл бұрын
i have question i wrote print(os.listdir()). but i got many files that is inside my jupyter. may i know how can i import my csv file that i have clean.
@kelikisbiyantoro2518
3 жыл бұрын
thankyou very much soumilshah, its help for me
@bloom6874
Жыл бұрын
here values in missing_values list are case-sensitive or case-insensitive?
@sunilkhandale9232
3 жыл бұрын
I want to replace 4wd with fwd in particular column please help
@nazeer9933
Жыл бұрын
The dataset which you have is having fewer instances what if we have thousands of rows of data how to find Nan, and Na there in the dataset ...? if you see this please respond ASAP
@bhawitbalodi4324
2 жыл бұрын
Pls can you tell me that from where you bought that LAPTOP stand? Pls attach link in comment
@Ayanshedipelly2312
Ай бұрын
How to do interpolation for categorical variable
@rommel23nb
25 күн бұрын
Thanks Mr. Shah--- I used these commands to prepare a cheat sheet for data cleaning--- regards
@shyamkumar-fh2fh
4 жыл бұрын
Can u tell about yourself... The company u are working and can u give some tips to get a job in data science field as a fresher
@Young-Prof
Ай бұрын
This is amazing. I learned a lot. I want to come to India to study Data Analytics
@laibakhan1835
Жыл бұрын
Great job well done n thanx a lot ...I explained v well
@slayergaming1852
Жыл бұрын
This video really helped me a lot, but I still got more to understand. I've zero basic knowledge on this. I'm working on a thesis which needs some coding to complete. I've few questions to what you've explained in this video; 1. What if there are lot of dataset and how do you define the missing value for each? 2. What was that in the missing value you defined "np.nan" ? As I said earlier, I'm working on a project which is about human-in-the-loop code. Initially I'll be given the dataset and have to figure out a code to include human for feedback from system (Reinforcement Learning). I would like get your response, and if possible any helpful idea or suggestions on the project mentioned above. Thank you
@debanjangg
Жыл бұрын
1. You can use separate lists (with diff variable names,) or a single list as a master list for all the datasets. Depends on the said datasets and the data they contain. 2. np.nan is the "NaN" value in the dataset, which means Not a Number. So basically the np.nan returns a float object whose value is NaN. Hope this helps.
@slayergaming1852
Жыл бұрын
@@debanjangg That was helpful. Thanks mate!🤩
@luckycreative7418
9 ай бұрын
1) u can also use unique function to get only unique values Example df['Customers'].unique in the example above u will get all the unique values in the column 'Customers'
@AyaanKhan-rh5vx
28 күн бұрын
I have a csv file and when i am using concat function it automatically name unnamed group 1,2,3... Also the alignment gets messy with songle line of code How to fix it
@eshaal2525
Жыл бұрын
Hi...I have na values but tha boxplot is even not showing it null...
@rakshansadhu2073
3 жыл бұрын
Loved it man
@GracefulTalesPluto
9 ай бұрын
what is the use of ffill? Isn't it data corruption? filling nulls with values from above rows
@user-iu2ph6ws8i
11 ай бұрын
Hii Soumil, right now I'm working on language translation project for that I have collected the data, but I'm facing preprocessing data could you please help me with that.
@crazystuff5854
2 жыл бұрын
Superb broo Rock on
@kyleevalencia1827
3 жыл бұрын
Sir, i'm still new in python and this data cleaning thing. And i want to ask what is 11 in df11 ?? is it some kind of function ?? and i also don't understand the snippet concept
@kashyapsantoki4889
3 жыл бұрын
df11 is just variable you can take anything df11a,df12 df15 anything and snippet is basically a piece of code which he already have
@user-zu7wc4xr2m
Жыл бұрын
essentially you explained it very well
@hamdansiddiqui3294
2 жыл бұрын
Great video very helpful
@alaberedaisy8171
4 ай бұрын
Thank you so much. This was really helpful
@harrymary100
3 жыл бұрын
Nice tutorial keep it up
@greeshmatejamyna
Жыл бұрын
i can use excel for it right ? my work will be more easy kindly persuade me y i have to use python instead of excel here
@enricomendiola9952
Жыл бұрын
Hello can you include in this video in cleaning special characters using pandas regular expression?
@alinajaved2165
2 жыл бұрын
I need your help please please...how it work in automatically cleaning data?
@rohitsanam8829
4 жыл бұрын
Please make a video outlier treatment and detection
@samimerk5313
2 жыл бұрын
Thank you for thr explanation!
@world52love
17 күн бұрын
how to handle zero values in csv file and how to fill those values
@shilpachowdhury8860
2 жыл бұрын
Sir, by running the data cleaning code in jupyter notebook by following the same code instruction given by u, when i run the code in the output it is not showing unnamed:0 temperature humidity & in my jupyter system it is showing such as v1 &v2 in the output.Why it is so?can u plz explain.
@deepthi5970
Жыл бұрын
I also faced the same problem. When we creating a new csv file there is no unnamed 0 : column... But if we saved the same file as csv into a folder it will create a new column lke unnamed 0: If we read this data the output will be like in this video.. If repeated each time one extra column will add. For avoiding use index= False while saving a code. It will work
@NaveenKumarsoma
4 жыл бұрын
why you have used np.nan in the mission_values?
@asifurchoudhury9905
3 жыл бұрын
SAME QUESTION.
@mohammedkaifmirza7585
2 жыл бұрын
overall good tutorial, the only thing that is missing is source code (jupyter notebook)
@IndianHacker-hisBest
Жыл бұрын
bro, could you please share the dataset in the description ?
@enricomendiola9952
Жыл бұрын
This is a great video😊
@thewhiskybottle4641
11 ай бұрын
Take the ads off please, thanks, great tutorial by the way.
@abhinavsingh4208
3 жыл бұрын
Thanks for this video !
@husnarazool9866
3 жыл бұрын
How to save the dataset after cleaning process in python?
@rishibaul5000
2 жыл бұрын
Use file operations
@sayantikabiswas8739
Жыл бұрын
thanks for teaching ffill, bfill, interpolate and fillna ...it was a great session
@darshan7673
3 жыл бұрын
from where i can download this dataset can anyone provide me link
@balatechtvm1438
Жыл бұрын
Thank you sir. I'm very satisfied
@rinkubaria3900
Жыл бұрын
So helpful 👌
@maniteja2167
4 жыл бұрын
nan palce -1 how to clean that
@akashme-ek3vc
Жыл бұрын
please donot stop uploading such videos
@sudeepjayaprakash9224
Жыл бұрын
Thank you sir helped me a lot
@spyder5204
2 жыл бұрын
Good and nice explaination
@siddheshbhalerao3152
Жыл бұрын
sir, facing a issue in a code to convert the variable from object to integer in jupyter notebook:- it shows the error:-invalid literal for int() with base 10: '-'
@bloom6874
Жыл бұрын
you can typecast object into int
@Lejhand10
4 жыл бұрын
well explained .
@aditi4677
3 жыл бұрын
This was really useful. Thankyou!
@kiranpawar8798
5 ай бұрын
What is noisy data
@minhaaj
4 жыл бұрын
good job
@jeevankumarreddyravuru8710
3 жыл бұрын
Do you have any pandas cheat scheet
@ogunoyeadebamigbe1715
Жыл бұрын
Good job
@jaiprakashlic484
Жыл бұрын
BRO YOU SHOULD HAVE UPLOADED CSV FILE AS WELL.
@swetathakur8144
4 жыл бұрын
Hello sir, I got an assignment , I am having difficulty in understanding the question , can u help , plz ... Plz reply
@SoumilShah
4 жыл бұрын
Sweta Thakur what’s is question. ?
@swetathakur8144
4 жыл бұрын
@@SoumilShah it's a long question based on unsupervised problem .. can I have your email id, so that I can contact you
@SoumilShah
4 жыл бұрын
Sweta Thakur I won’t solve your assignment I will only tell you what to do Usually I’m free on sat and Sunday Shahsoumil519@gmail.com
@shafiqahmed1976
3 жыл бұрын
data.fillna({"P11,":NEGATIVE}) NameError: name 'NEGATIVE' is not defined ?? Please help me ?what can I can do??
@leavemealone3198
3 жыл бұрын
Maybe you didn’t install the libraries?
@laithdarras6389
Жыл бұрын
Very helpful
@thekras177
Жыл бұрын
I refer to using mean but thank you it was helpful
@machinelearning1357
Жыл бұрын
really great
@sabbirahmmed7161
2 жыл бұрын
Thanks a lot ❤️
@chaitanyaparmar8639
Жыл бұрын
bro can u give this data set? asap
@aiswaryacd7419
2 жыл бұрын
How install Android phone Jupiter notebook
@mayukbasu7228
4 жыл бұрын
Where can I get the data set?
@marouaneyoussfi3560
4 жыл бұрын
thank you
@harshalkshirsagar7618
Жыл бұрын
yo thanks a lot
@chandreshsingh9795
4 жыл бұрын
Thank you, it was helpful what if we want to fill with mean
Пікірлер: 133