amazing vide. Now i know where i am wrong. thx for the video.
@sravanalakshmipisupati6533
Жыл бұрын
Thanks a lot:)
@sravankumar1767
2 жыл бұрын
Please do more videos scenario based on pyspark .current project using pyspark we r doing transformations in ADB , adf only FOR data movement only.
@sravanalakshmipisupati6533
2 жыл бұрын
Sure, Sravan.
@shahids4583
8 ай бұрын
@sparklingFuture why cant we use pivot and filter data on top of it it will be single liner right?
@yashwantdhole7645
6 ай бұрын
Excellent
@sidtribhuvan6607
2 жыл бұрын
Thanks for the information
@sravanalakshmipisupati6533
2 жыл бұрын
Thanks a lot
@khandoor7228
Жыл бұрын
excellent lesson!
@sravanalakshmipisupati6533
Жыл бұрын
Thanks a lot.
@akashbalmiki3616
2 жыл бұрын
Your videos are awesome with more advance approach but pls upgrade your audio system. Its request.. 🙏
@sravanalakshmipisupati6533
2 жыл бұрын
Thanks a lot, Akash. Sure, thanks for the feedback. I'll take care of this..
@rajanib9057
Жыл бұрын
hello...can you please confirm when you first extracted data from CSV where did you mention the column names. how did the column names generate in the show command
@sravanalakshmipisupati6533
Жыл бұрын
Hi Rajani, I have given the header in the input file and used the option of header to true for displaying the header in show()
@rajanib9057
Жыл бұрын
@@sravanalakshmipisupati6533 thank you so much. Also can you please post more videos on ingesting and transforming data from/to on - premises databases and other cloud storages
@sravanalakshmipisupati6533
Жыл бұрын
@@rajanib9057 Thankyou. For the on premise, already most of the ingestion with different file formats are covered. Please check my videos - github.com/sravanapisupati/SampleDataSet/blob/main/KZitem_videos_list
@sravankumar1767
2 жыл бұрын
can you please this scenario how to Load CSV file in to JSON with Nested Hierarchy using pyspark in ADB like custid, custname, itemname,quanity this csv when we convert to nested json custid, custname, purchases { itemname : book, quantity : 2} like one customer buy multiple items
@sravanalakshmipisupati6533
2 жыл бұрын
Sure Sravan.
@sravankumar1767
2 жыл бұрын
@@sravanalakshmipisupati6533 Thank you
@sravanalakshmipisupati6533
2 жыл бұрын
@Sravan, please check the video kzitem.info/news/bejne/256Ys3-Ocpd6g4I
@DileepKumar-ko6cy
2 жыл бұрын
Good Explanation.👍
@sravanalakshmipisupati6533
2 жыл бұрын
Thank you:)
@sravankumar1767
2 жыл бұрын
How to Merge Spark DataFrame - Complex type if we have two json files json 1 schema and json2 schema is differenr how can we merge using pyspark. can you please explain this scenario.
@sravanalakshmipisupati6533
2 жыл бұрын
Sure Sravan, I will get back to you soon for all your questions. Could you please share sample data?
@sravankumar1767
2 жыл бұрын
@@sravanalakshmipisupati6533 ok
@sravanalakshmipisupati6533
2 жыл бұрын
Hi Sravan, You can read 2 JSON files separately as 2 Dataframes and then join them. If this is not what you are looking for, then please give me the detailed problem statement with some sample data. Thanks.
Пікірлер: 31