3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512967 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Node local: 3
Shuffle Read Size / Records:
316.0 B / 3
Shuffle Write Size / Records:
316.0 B / 3
Associated Job Ids:
331402
DAG Visualization
digraph G { subgraph clusterstage_512967 { label="Stage 512967"; subgraph cluster6302066 { label="Exchange"; 3624161 [labelType="html" label="ShuffledRowRDD [3624161] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302060 { label="WholeStageCodegen (3)"; 3624162 [labelType="html" label="MapPartitionsRDD [3624162] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302059 { label="InMemoryTableScan"; 3624163 [labelType="html" label="MapPartitionsRDD [3624163] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624164 [labelType="html" label="*(3) Sort [sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7534562]\n +- *(2) Project [cap#94368001, numcos#94368018, numdates#94368020, sort#94160395, description#94160396, universe#94160397, (cast(numcos#94368018 as double) / cast(universe#94160397 as double)) AS coverage#94368378]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94368001))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7534555]\n : +- *(1) Filter isnotnull(cap#94368001)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94368001, numcos#94368018, numdates#94368020], [isnotnull(cap#94368001)]\n ... [3624164] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624165 [labelType="html" label="MapPartitionsRDD [3624165] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624166 [labelType="html" label="MapPartitionsRDD [3624166] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624167 [labelType="html" label="MapPartitionsRDD [3624167] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302058 { label="CollectLimit"; 3624168 [labelType="html" label="MapPartitionsRDD [3624168] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624169 [labelType="html" label="MapPartitionsRDD [3624169] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624161->3624162; 3624162->3624163; 3624163->3624164; 3624164->3624165; 3624165->3624166; 3624166->3624167; 3624167->3624168; 3624168->3624169; }
3624160,3624161
3624164
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time