3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513110 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Node local: 13
Shuffle Read Size / Records:
1396.0 B / 13
Shuffle Write Size / Records:
1396.0 B / 13
Associated Job Ids:
331497
DAG Visualization
digraph G { subgraph clusterstage_513110 { label="Stage 513110"; subgraph cluster6303884 { label="Exchange"; 3625204 [labelType="html" label="ShuffledRowRDD [3625204] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303877 { label="WholeStageCodegen (3)"; 3625205 [labelType="html" label="MapPartitionsRDD [3625205] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303876 { label="InMemoryTableScan"; 3625206 [labelType="html" label="MapPartitionsRDD [3625206] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625207 [labelType="html" label="*(3) Sort [sort#94160419 ASC NULLS FIRST, description#94160423 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160419 ASC NULLS FIRST, description#94160423 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7536787]\n +- *(2) Project [sector_id#94396427, numcos#94396493, numdates#94396494, sort#94160419, description#94160423, universe#94396734, coverage#94396603]\n +- *(2) BroadcastHashJoin [sector_id#94396427], [sector_id#94160418], Inner, BuildRight, false\n :- *(2) Project [CASE WHEN ((sector_id#94396222 = NA) OR (sector_id#94396222 = null)) THEN null ELSE cast(sector_id#94396222 as int) END AS sector_id#94396427, CASE WHEN ((numcos#94396225 = NA) OR (numcos#94396225 = null)) THEN null ELSE cast(numcos#94396225 as float) END AS numcos#94396493, CASE WHEN ((numdates#94396226 = NA) OR (numdates#94396226 = null)) THEN null ELSE cast(numdates#94396226 as int) END AS numdates#94396494, CASE WHEN ((coverage#94396247 = NA) OR (coverage#94396247 = null)) THEN null ELSE cast(coverage#943... [3625207] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625208 [labelType="html" label="MapPartitionsRDD [3625208] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625209 [labelType="html" label="MapPartitionsRDD [3625209] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625210 [labelType="html" label="MapPartitionsRDD [3625210] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303875 { label="CollectLimit"; 3625211 [labelType="html" label="MapPartitionsRDD [3625211] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625212 [labelType="html" label="MapPartitionsRDD [3625212] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3625204->3625205; 3625205->3625206; 3625206->3625207; 3625207->3625208; 3625208->3625209; 3625209->3625210; 3625210->3625211; 3625211->3625212; }
3625203,3625204
3625207
Event Timeline
Enable zooming
Tasks: 13. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time