3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513115 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Node local: 3
Shuffle Read Size / Records:
316.0 B / 3
Shuffle Write Size / Records:
316.0 B / 3
Associated Job Ids:
331500
DAG Visualization
digraph G { subgraph clusterstage_513115 { label="Stage 513115"; subgraph cluster6303932 { label="Exchange"; 3625235 [labelType="html" label="ShuffledRowRDD [3625235] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303926 { label="WholeStageCodegen (3)"; 3625236 [labelType="html" label="MapPartitionsRDD [3625236] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303925 { label="InMemoryTableScan"; 3625237 [labelType="html" label="MapPartitionsRDD [3625237] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625238 [labelType="html" label="*(3) Sort [sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7536858]\n +- *(2) Project [cap#94396456, numcos#94396483, numdates#94396484, sort#94160395, description#94160396, universe#94160397, (cast(numcos#94396483 as double) / cast(universe#94160397 as double)) AS coverage#94396752]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94396456))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7536851]\n : +- *(1) Filter isnotnull(cap#94396456)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94396456, numcos#94396483, numdates#94396484], [isnotnull(cap#94396456)]\n ... [3625238] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625239 [labelType="html" label="MapPartitionsRDD [3625239] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625240 [labelType="html" label="MapPartitionsRDD [3625240] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625241 [labelType="html" label="MapPartitionsRDD [3625241] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303924 { label="CollectLimit"; 3625242 [labelType="html" label="MapPartitionsRDD [3625242] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625243 [labelType="html" label="MapPartitionsRDD [3625243] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3625235->3625236; 3625236->3625237; 3625237->3625238; 3625238->3625239; 3625239->3625240; 3625240->3625241; 3625241->3625242; 3625242->3625243; }
3625234,3625235
3625238
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time