During the presentation you will learn about the architecture of Spark’s web UI and the different SparkListeners that sit behind it to support its operation. You will learn what information about Spark applications the Spark UI presents and how to read them to understand performance of your Spark applications. This talk will demo sample Spark snippets (using spark-shell) to showcase the hidden gems of Spark UI like queues in FAIR scheduling mode, SQL queries or Streaming jobs.
- Күн бұрын
Deep Dive into Monitoring Spark Applications Using Web UI and SparkListeners (Jacek Laskowski)
- Рет қаралды 34,274
Пікірлер: 6