3.4.3
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
SparkEngine
application UI
Details for Stage 892 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
5 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
13.4 KiB / 1
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
600
DAG Visualization
digraph G { subgraph clusterstage_892 { label="Stage 892"; subgraph cluster5228 { label="Scan parquet "; 1905 [labelType="html" label="FileScanRDD [1905]<br>count at AbstractOperator.java:109"]; 1906 [labelType="html" label="MapPartitionsRDD [1906]<br>count at AbstractOperator.java:109"]; } subgraph cluster5224 { label="WholeStageCodegen (1)"; 1907 [labelType="html" label="MapPartitionsRDD [1907]<br>count at AbstractOperator.java:109"]; } subgraph cluster5223 { label="Exchange"; 1908 [labelType="html" label="MapPartitionsRDD [1908]<br>count at AbstractOperator.java:109"]; } } 1905->1906; 1906->1907; 1907->1908; }
Show Additional Metrics
Select All
Scheduler Delay
Task Deserialization Time
Shuffle Read Fetch Wait Time
Shuffle Remote Reads
Shuffle Write Time
Result Serialization Time
Getting Result Time
Peak Execution Memory
Peak JVM Memory OnHeap / OffHeap
Peak Execution Memory OnHeap / OffHeap
Peak Storage Memory OnHeap / OffHeap
Peak Pool Memory Direct / Mapped
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time
driver / ecm-5116
0
0
14:45:32
Loading Stage Page...