3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513036 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Node local: 13
Shuffle Read Size / Records:
1424.0 B / 13
Shuffle Write Size / Records:
1424.0 B / 13
Associated Job Ids:
331448
DAG Visualization
digraph G { subgraph clusterstage_513036 { label="Stage 513036"; subgraph cluster6302950 { label="Exchange"; 3624667 [labelType="html" label="ShuffledRowRDD [3624667] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302944 { label="WholeStageCodegen (3)"; 3624668 [labelType="html" label="MapPartitionsRDD [3624668] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302943 { label="InMemoryTableScan"; 3624669 [labelType="html" label="MapPartitionsRDD [3624669] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624670 [labelType="html" label="*(3) Sort [sort#94160419 ASC NULLS FIRST, description#94160423 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160419 ASC NULLS FIRST, description#94160423 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7535639]\n +- *(2) Project [sector_id#94382736, numcos#94382820, numdates#94382821, sort#94160419, description#94160423, universe#94383074, coverage#94382913]\n +- *(2) BroadcastHashJoin [sector_id#94382736], [sector_id#94160418], Inner, BuildRight, false\n :- *(2) Project [CASE WHEN ((sector_id#94382379 = NA) OR (sector_id#94382379 = null)) THEN null ELSE cast(sector_id#94382379 as int) END AS sector_id#94382736, CASE WHEN ((numcos#94382382 = NA) OR (numcos#94382382 = null)) THEN null ELSE cast(numcos#94382382 as float) END AS numcos#94382820, CASE WHEN ((numdates#94382383 = NA) OR (numdates#94382383 = null)) THEN null ELSE cast(numdates#94382383 as float) END AS numdates#94382821, CASE WHEN ((coverage#94382404 = NA) OR (coverage#94382404 = null)) THEN null ELSE cast(coverage#9... [3624670] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624671 [labelType="html" label="MapPartitionsRDD [3624671] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624672 [labelType="html" label="MapPartitionsRDD [3624672] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624673 [labelType="html" label="MapPartitionsRDD [3624673] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302942 { label="CollectLimit"; 3624674 [labelType="html" label="MapPartitionsRDD [3624674] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624675 [labelType="html" label="MapPartitionsRDD [3624675] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624667->3624668; 3624668->3624669; 3624669->3624670; 3624670->3624671; 3624671->3624672; 3624672->3624673; 3624673->3624674; 3624674->3624675; }
3624666,3624667
3624670
Event Timeline
Enable zooming
Tasks: 13. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time