Best channel for understanding real time scenarios..
@rajasdataengineering7585
Жыл бұрын
Thank you
@nagulmeerashaik5336
Жыл бұрын
I'm a learning data engineering ....in your channel lot of information you have❤.,...
@rajasdataengineering7585
Жыл бұрын
Thank you. Happy to know it helps data engineers
@itsme-fe1vh
7 ай бұрын
It would be great if you can share the Data Sets and materials used during the session for practise.
@nagulmeerashaik5336
Жыл бұрын
Your videos so helpful...
@rajasdataengineering7585
Жыл бұрын
Glad you like them!
@_jasonj_
Жыл бұрын
Thanks for all your videos. Can you apply a schema to a read on a delta table or to the resulting dataframe? Literally every example of using schema's out there are on created static data or a csv file. How do I change the schema when reading from a delta table? I've streamed in txt files with variable length rows so wasn't able to assign a proper schema on the initial write but now I'm reading that data from delta and splitting out each record type into it's own delta table and want to apply the appropriate schema to each type.
@abhishekstatus_7
Жыл бұрын
It would be great if you can share the notebooks and materials used during the session
@SantoshKumar-yr2md
7 ай бұрын
what if we have 100 columns in dataset so we need to write structtype structfield for every column what other options because it may be tidious
@sabesanj5509
Жыл бұрын
Raja sir will this question be asked in spark interviews??
@rajasdataengineering7585
Жыл бұрын
Yes Sabesan, this is also one of the interview question
@sabesanj5509
Жыл бұрын
@@rajasdataengineering7585 Thanks Sir for notifying us👍
@rajasdataengineering7585
Жыл бұрын
Welcome
@vikramnimma
Жыл бұрын
Hi raja, great videos. If possible can you create delta live tables
@rajasdataengineering7585
Жыл бұрын
Hi Nimmakuri, sure will create a playlist for delta live tables
@mayurg8778
Жыл бұрын
Hello Raja it will be great if make video on delta live table It will help us to understand in easy way
@rajasdataengineering7585
Жыл бұрын
Hi Mayur, sure will post videos on delta live table
@mayurg8778
Жыл бұрын
@@rajasdataengineering7585 u are doing great job that bringing clarity on every topic and it's help us to understand the concepts thanks for for your efforts.
@rajasdataengineering7585
Жыл бұрын
Thank you for your comment!
@KahinBhiKuchBhi
Жыл бұрын
If infer_schema is inplace.. why we need 1st and 2nd method.. is there any reason ?
@rajasdataengineering7585
Жыл бұрын
Infer schema needs to scan the entire data to determine the data type, which hits the performance. So always try to avoid infer schema and use defined schema
Пікірлер: 23