3.4.3
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SparkEngine
application UI
Details for Stage 802 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
60 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
22.0 KiB / 1
Output Size / Records:
0.0 B / 1
Associated Job Ids:
540
DAG Visualization
digraph G { subgraph clusterstage_802 { label="Stage 802"; 1720 [labelType="html" label="SQLExecutionRDD [1720]<br>jdbc at OutputSourceOperator.java:591"]; subgraph cluster4707 { label="Scan parquet "; 1716 [labelType="html" label="FileScanRDD [1716]<br>jdbc at OutputSourceOperator.java:591"]; 1717 [labelType="html" label="MapPartitionsRDD [1717]<br>jdbc at OutputSourceOperator.java:591"]; } subgraph cluster4703 { label="WholeStageCodegen (1)"; 1718 [labelType="html" label="MapPartitionsRDD [1718]<br>jdbc at OutputSourceOperator.java:591"]; } subgraph cluster4702 { label="DeserializeToObject"; 1719 [labelType="html" label="MapPartitionsRDD [1719]<br>jdbc at OutputSourceOperator.java:591"]; } subgraph cluster4708 { label="mapPartitions"; 1721 [labelType="html" label="MapPartitionsRDD [1721]<br>jdbc at OutputSourceOperator.java:591"]; } } 1716->1717; 1717->1718; 1718->1719; 1719->1720; 1720->1721; }
Show Additional Metrics
Select All
Scheduler Delay
Task Deserialization Time
Shuffle Read Fetch Wait Time
Shuffle Remote Reads
Shuffle Write Time
Result Serialization Time
Getting Result Time
Peak Execution Memory
Peak JVM Memory OnHeap / OffHeap
Peak Execution Memory OnHeap / OffHeap
Peak Storage Memory OnHeap / OffHeap
Peak Pool Memory Direct / Mapped
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
driver / ecm-5116
0
0
14:45:32
Loading Stage Page...