Soumil Shah
I earned a Bachelor of Science in Electronic Engineering and a double master’s in Electrical and Computer Engineering. I have extensive expertise in developing scalable and high-performance software applications in Python. I have a KZitem channel where I teach people about Data Science, Machine learning, Elastic search, and AWS. I work as data collection and processing Team Lead at Jobtarget where I spent most of my time developing Ingestion Framework and creating microservices and scalable architecture on AWS. I have worked with a massive amount of data which includes creating data lakes (1.2T) optimizing data lakes query by creating a partition and using the right file format and compression. I have also developed and worked on a streaming application for ingesting real-time streams data via kinesis and firehose to elastic search- 4:29
- 15 сағат бұрын
How to Use Hudi Streamer with Hudi version 0.15.0 | Hands on Guide |
- 3:10
- 22 сағат бұрын
How to Execute Postgres Stored procedures in Spark | Hands on Guide
- 6:47
- 22 сағат бұрын
Learn How to Ingest Data from Hudi Incrementally hudi table changes into Postgres Using Spark
- 8:17
- Күн бұрын
Universal Datalakes: Interoperability with Hudi, Iceberg, and Delta Tables with AWS Glue Notebooks
- 4:30
- 14 күн бұрын
Learn How to Run Apache X Table Sync Command on AWS Cloud Shell | Interoperate Hudi Iceberg delta
- 6:33
- 14 күн бұрын
Learn How to Ingest XML files with AWS Glue into Hudi Datalakes | Step by Step guide
- 8:56
- 14 күн бұрын
Hudi with Spark SQL for Beginners | Insert| Updates | Delete | incremental Query | Stored procedures
- 5:19
- 14 күн бұрын
How we Utilized Hudi's Time Travel Query to Investigate Bid and Spend | Going Back in Time w...
- 5:55
- 14 күн бұрын
Hudi Cleaning Process | hoodie.keep.min.commits and hoodie.keep.max.commits Explained
- 2:58
- 21 күн бұрын
AWS Glue Tutorial: How to Filter and Exclude S3 Files while reading as Glue Dynamic Frame
- 3:58
- 21 күн бұрын
How to Read S3 Partitioned Data as Columns in AWS Glue DF
- 8:00
- 28 күн бұрын
Multiple Spark Writers to Hudi tables | Hands on Labs
- 24:00
- Ай бұрын
Hudi Streamer implementing Slowly Changing Dimension Type 2 and Query Real Time Trino | Hands on
- 4:43
- Ай бұрын
Demo Video : Hudi Delta Streamer Implementing Slowly Changing Dimension and Query that using Trino
- 5:57
- Ай бұрын
Learn how to Spinup Trino on Kubernetes running Locally on Windows | Mac machine | Simple Guide
- 1:04
- Ай бұрын
Пікірлер