Thanks for the vedio Please continue this series. I learnt a lot from your ADF vedios.
@WafaStudies
2 жыл бұрын
Sure. Thank you 😊
@dipti2075
2 жыл бұрын
You are my guru Bhai , looking this video . Hope you will bring all the real time scenario videos on pyspark . Love from Odisha❣️❣️
@WafaStudies
2 жыл бұрын
Thank you 😊
@azurecontentannu6399
2 жыл бұрын
Very helpful. Thankyou so much for sharing
@WafaStudies
2 жыл бұрын
Thank you ☺️
@janardhanchokkakula3840
2 жыл бұрын
Wow please post daily one video
@WafaStudies
2 жыл бұрын
Thank you 😊
@janardhanchokkakula3840
2 жыл бұрын
@@WafaStudies i practiced it .Exited to see more videos . need some inputs on preparing for an interview basha bhai
@WafaStudies
2 жыл бұрын
@@janardhanchokkakula3840 Great. Ya will post more scenarios
@jaymakam9673
Жыл бұрын
Hi @Maheer eagerly waiting for more content in this playlist
@sravankumar1767
2 жыл бұрын
Nice explanation bro 👍 👌 👏
@WafaStudies
2 жыл бұрын
Thank you 😊
@PrimeLogin
Жыл бұрын
Thanks for all your efforts for skill-up to us! Can we try with lambda function, logic looks lengthy and hardcoded value in split
@phalgun9186
2 жыл бұрын
Hi Maheer Please let me know if you also take live classes.
@shuaibsaqib5085
Жыл бұрын
Hi MAheer bhai, in video you said u will past code in the description, but i cud not able to find it.
@barbershop9029
2 жыл бұрын
Sir , is there any playlist or videos to learn basics of pyspark , like phython playlist. Please create videos for real-time scenarios based on databricks.
@WafaStudies
2 жыл бұрын
Not sure. But i will be creating one in future 🙂
@nharshimha5
2 жыл бұрын
Hi Bro pls upload databricks realtime scenarios and interview questions. I learned a lot from your videos thanks a lot!
@g.suresh430
8 ай бұрын
Hi Maheer, When we have data like below. It will replace double quote of 1st row. Please check the output of this. string = '{"ID":"2","Name":"Suresh"Gajula","City":"Hyd"}' data = [(1,'{"ID":"1","Name":"Suresh","City":"Hyd"}'),(2,string)] schema = ['id','value'] df = spark.createDataFrame(data,schema) # display(df) from pyspark.sql.functions import split,lit,concat_ws,concat df = df.withColumn('value1',split('value','"Name":"')[0])\ .withColumn('value2',lit('"Name":"'))\ .withColumn('value3',split('value','"Name":"')[1]) # display(df) df = df.withColumn('value4',split('value3','"',2)) # display(df) df = df.withColumn('value5',concat_ws(' ','value4')) # display(df) df = df.withColumn('value6',concat('value1','value2','value5')).select('id','value','value6') display(df)
@RaushanKumar-bw6qf
Жыл бұрын
Thanks for all your efforts for skill-up to us! Could you please make a video on setup pyspark environment on pycharm locally?
@jerryyang7270
Жыл бұрын
This is a good practice to split strings. How about we use map? Is that easier?
@pallavigosavi6851
2 жыл бұрын
Thank you 🙏☺️
@WafaStudies
2 жыл бұрын
Welcome 😊
@abhishekjoshi48
2 жыл бұрын
Hi maheer, could you please suggest some books for databricks spark certification?
@focus8070
2 жыл бұрын
Please bro made a series of Cosmos dv and how I use jaca script to right query
@VishalSharma-lz6ky
2 жыл бұрын
Appreciated 😊
@WafaStudies
2 жыл бұрын
Thank you ☺️
@sonamkori8169
Жыл бұрын
Thanks.. Sir
@mukeshkola2931
4 ай бұрын
DataFrame[col1: bigint, col2: string, col3: string, col4: string, col5: string] I'm facing the above issue while trying to execute the code in Google Colab. Tried to define some schema also, But no luck. so please let me how to resolve it.
@hemakshudukoduru3487
2 жыл бұрын
What ever you did to accomplish that requirement that was good, but is there any way to reduce the code boss
@suryameenchirel09
2 ай бұрын
why do we need """"""? even if we use "" - will it gives the same result?
@venkateshgunturu7462
2 жыл бұрын
Nice explanation 👏. But this will work if the name has only one double quotes. We have to modify the code if we have more than one double quotes. How about using replace function?? Can you try that.
@g.suresh430
8 ай бұрын
Hi did you find out any other solution.
@mohitjoshi1361
Жыл бұрын
Is there any way to do the same for all columns without using? .withColumn as number of columns will be dynamic in my case.
Пікірлер: 37