You have good content. You should upload more of end-end projects. It will definitely give your channels the credit it deserves.
@AGenerationthatFearsGod
9 күн бұрын
ML projects
@safkaify7875
2 ай бұрын
Well spoken, well prepared, nicely presented. Thank you for helping others. One suggestion (IMHO): I would reduce the last 10 minutes to 2 to 3 minutes, for example: In dashboard, instead of showing the removal of each and every dataframe, I would just show the removal of one, and tell the audience "Likewise, you can remove all the other dataframes". Same thing for adding title (header) to each visualization and arranging visualizations: I would just do it for one and tell audience "Likewise you can add title to all other visualization and arrange them per your requirements". Then I would just fast forward (skip) to show the final view of the dashboard with a few seconds of my comments.
@kuladeepk1255
9 ай бұрын
Absolutely blown away by this KZitem video! In just one word: phenomenal. It's like diving into an encyclopedia dedicated to CI/CD pipelines. My quest for a basic explanation led me to countless sources, but this video turned out to be an absolute goldmine.
@geetak5285
8 ай бұрын
Great, Nice Sales KPI Use case, Simple explanation, much Intuitive, Thank for your content contribution.
@Tasfiomi
3 ай бұрын
Well explained and detailed ! Superb Content. Appreciated your time & efforts !
@hritikapal683
10 ай бұрын
Absolutely terrific content, done with my first pyspark project. Subscribed too for more projects videos keep them coming ✨
@1112electronics
2 ай бұрын
thanks a lot for creating such a grate video by doing and explaining. Great job. awesome ..keep it up
@VenkatKondragunta
6 ай бұрын
Hi, that's good explanation, I liked it. but my advise is please don't say Ok all the times and don't go fast. If you can improve these 2 things in your explanation then you can become good tutor.
@learnbydoingit
6 ай бұрын
Yes working on it thanks for ur feedback
@AGenerationthatFearsGod
8 күн бұрын
@@learnbydoingit Honestly don't think this is important. Krish Naik does this but his channels is very popular. Don't have to change
@RaviKumar-o4p2o
Жыл бұрын
Nice explanation.Very much easy to underatnd.Thank you very much .
@prasannakumar7097
4 ай бұрын
Nice video pls do more projects on pyspark
@ETLMasters
Жыл бұрын
Thanks. Would love see more project like these in future.
@fashionate6527
10 ай бұрын
great explanation
@biramdevpawar9902
9 ай бұрын
Instead of joining both df for each KPI we can join it once & cache it. so that it will increase performance.
@bhavyakanzariya7124
8 ай бұрын
good examples. easy to understand.
@dbarhate
2 ай бұрын
Nice stuff. Thanks.
@vadderamu5422
9 ай бұрын
Thanks a lot for valued information.
@skateforlife3679
10 ай бұрын
So is Spark use for aggregating and viewing data only like this ?? It's for Data analyst so ? No, Could you show a real example with data coming from a source (exemple an API) and writing production code to send spark job on batch data ?
@ADESHKUMAR-yz2el
2 ай бұрын
thanks man. good stuff
@ayeshasyedKhan
Ай бұрын
Thanks brother..great content
@ayeshasyedKhan
Ай бұрын
This project is of data engineering or Data analytics ? Please reply ?
@sachinchavanmusic1412
10 ай бұрын
very helpful video 🙏
@ranjansrivastava9256
11 ай бұрын
Very nice Video !!!! Great job !!!!
@omkarm7865
11 ай бұрын
very nice
@vikrammore-y4t
9 ай бұрын
best content,thank you
@kunal6782
11 ай бұрын
Everything is very good... just try to not say "OK"
@Vinod-dd2vc
9 ай бұрын
Super tutor🔥🙏
@nileshyadav7543
11 ай бұрын
great work
@SanjayKumar-qp8ss
18 күн бұрын
Amazing content, thanks a ton!
@bhargavchaitanya3399
7 ай бұрын
Thank you
@vishnuannavarapu3888
10 ай бұрын
All your videos are commendable. Could you please create a video on scheduling the execution of a Databricks notebook using Azure Data Factory (ADF) pipeline?
@learnbydoingit
10 ай бұрын
Ok
@spicytuna08
5 ай бұрын
can u show an example where pandas failed due to memory where pyspark was able to overcome the memory problem?
@chitrarekhatiwari6629
Жыл бұрын
Thanks
@learnbydoingit
Жыл бұрын
Welcome
@stan8966
Жыл бұрын
Excellent content. Thank you
@learnbydoingit
Жыл бұрын
My pleasure!
@mmp9371
Жыл бұрын
Hi Sir, one question on the query "frequency of customer who visited restaurant". In the Sales.csv file there are 27 records with restaurant entries.Your output giving 21 records. In your video you did ".agg(countDistinct("ordered_date"))" I changed that with "agg(count("customer_id"))" and I got 27 records matching with the input file. Request you to look into it and suggest if any misunderstanding from my end.
@learnbydoingit
Жыл бұрын
Actually data I created with so many duplicate records.. So may be issue that's good u are debugging that's what is expectation
@AsadChoudhary-b3d
11 ай бұрын
Hi do you also support people in their data engineering jobs?
@RutujaBsk
5 ай бұрын
Thanks for the informative session. Can you please let me know if we can import all the functions together instead of importing them one by one ( eg: from pyspark.sql.functions import month,year,quarter ) like we import libraries pandas,matplotlib, etc in Python?
@learnbydoingit
5 ай бұрын
We can import in one time all libraries
@giri41
5 ай бұрын
Sir, how can get system date and calculate the current month??
@learnbydoingit
5 ай бұрын
current_date()
@prachideokar7639
4 ай бұрын
Can we show this project for 2 years of experience in data engineer in real time
@prachideokar7639
4 ай бұрын
Plz rply
@VasiSultan
11 ай бұрын
Hey, was there a need to use inferschema option when you are manually defining the schema? Can you please reply? Also, from where we can download the data set for practice?
@learnbydoingit
11 ай бұрын
If it's not in description you get in telegram and if schema there no need Inferschema
@ibrahimhussain2442
5 ай бұрын
Hi, Im working on the pay-as-you-go service of Databricks. When I'm uploading the file its not giving me the path of my computer where the file is stored. It's getting stored in the 'hive' of the databricks as a table and sales.csv its getting changed to delta format. Can you tell me how to upload a csv file and work on it. Thank you.
@learnbydoingit
5 ай бұрын
Are u able to upload in databricks metastore or not ?
@ibrahimhussain2442
5 ай бұрын
@@learnbydoingit I was able to resolve it by going into the settings -> Advanced -> Enabling DBFS File Browser.
@sobhareddymangoform
7 ай бұрын
this is complete end to end project
@giri41
5 ай бұрын
Can you help on my project please .. on a part bases for money please
@learnbydoingit
5 ай бұрын
Please join telegram we can discuss
@giri41
5 ай бұрын
Telegram channel name??
@giri41
5 ай бұрын
@@learnbydoingitplease contact me
@ishasingh1039
7 ай бұрын
Can i download dashboard? if so please tell me how
@SantoshKumar-yr2md
7 ай бұрын
proper column name
@saikalyangonuguntla594
11 ай бұрын
Where can i execute my pyspark code,is it free or can i pay for using databricks
@learnbydoingit
11 ай бұрын
Databricks community edition and it's free
@saikalyangonuguntla594
11 ай бұрын
Thank you
@saikalyangonuguntla594
11 ай бұрын
Iam preparing for interviews,Iam watching and practicing your realtime pyspark projects it's very helpful for me, If possible can you make video on how to explain about real time project in interviews,and what type of questions could I expect they will ask about realtime projects.
@savithweraniyagoda1297
Жыл бұрын
How we can get the dataset?
@learnbydoingit
Жыл бұрын
Telegram link mentioned in the description
@CrceAC2
11 ай бұрын
Can you please provide the code of this video?
@learnbydoingit
11 ай бұрын
Would suggest do along with this video and if issue u can connect
@prachideokar7639
4 ай бұрын
How to connect on wtsup or telegram
@learnbydoingit
4 ай бұрын
Link in the description
@koushikthalanki1945
7 ай бұрын
great explanation
@sagardevara4174
14 күн бұрын
Awesome work
@TARRAJUVVIRAJU
11 ай бұрын
Price is in string format .then how you get aggregate sum ..
@SantoshKumar-yr2md
7 ай бұрын
well explained, at least you should increase zoom and while deriving column we can derive in one go all column like year, month, qtr
@IlseZubieta
7 ай бұрын
You're simply incredible! Thanks for uploading this for us :) God bless you!
@safkaify7875
2 ай бұрын
GOD bless you indeed for doing a prenominal job (hence helping others like me)
@shivamchandan50
7 ай бұрын
please make video on how to perform unit testing in spark
@prasannakumar7097
4 ай бұрын
Nice explanation. Please do more pyspark projects
@KishoreReddy-c3v
9 ай бұрын
hi bro content is very nice please a end to end project on data engineering using aws bro
@sanjeevpandey2753
4 ай бұрын
Hats off to your effort Man! Keep rocking ith aesome content
@sanskritisharma5447
Жыл бұрын
thanks for this project really helpful
@techhelphub3
8 ай бұрын
how can we store this dashboard into pdf or how can we share this dashboard to others and can you pls share the ppt that you are presented in the video
@learnbydoingit
8 ай бұрын
Give the link and access to dashboard ...
@Laura11001
5 ай бұрын
This was very useful for me!
@RasheedShaik-f1p
8 ай бұрын
Please upload more pyspark projects
@Arif-rs2il
3 ай бұрын
thank's bro
@DanyDaniel-ky5rm
8 ай бұрын
Telugu lo chepachuga bro
@mnirani5230
Жыл бұрын
Thanks for this
@gauravjoshi4035
11 ай бұрын
thanks
@shubhamtandon9815
8 ай бұрын
bro please stop using "ok". its so frustrating
@learnbydoingit
8 ай бұрын
😃 sure
@amanisdreaming3914
3 ай бұрын
earlier it was running but now for this command:- sales_df = sales_df.withColumn("order_month",month(sales_df.order_date)) sales_df = sales_df.withColumn("order_quarter",quarter(sales_df.order_date)) display(sales_df) this is the error i m getting:- AnalysisException: [DATATYPE_MISMATCH.UNEXPECTED_INPUT_TYPE] Cannot resolve "month(order_date)" due to data type mismatch: parameter 1 requires "DATE" type, however, "order_date" is of "INT" type.;
Пікірлер: 95