3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513041 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
89 ms
Locality Level Summary:
Node local: 3
Shuffle Read Size / Records:
316.0 B / 3
Shuffle Write Size / Records:
316.0 B / 3
Associated Job Ids:
331451
DAG Visualization
digraph G { subgraph clusterstage_513041 { label="Stage 513041"; subgraph cluster6302999 { label="Exchange"; 3624698 [labelType="html" label="ShuffledRowRDD [3624698] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302993 { label="WholeStageCodegen (3)"; 3624699 [labelType="html" label="MapPartitionsRDD [3624699] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302992 { label="InMemoryTableScan"; 3624700 [labelType="html" label="MapPartitionsRDD [3624700] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624701 [labelType="html" label="*(3) Sort [sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7535710]\n +- *(2) Project [cap#94382550, numcos#94382567, numdates#94382568, sort#94160395, description#94160396, universe#94160397, (cast(numcos#94382567 as double) / cast(universe#94160397 as double)) AS coverage#94382902]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94382550))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7535703]\n : +- *(1) Filter isnotnull(cap#94382550)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94382550, numcos#94382567, numdates#94382568], [isnotnull(cap#94382550)]\n ... [3624701] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624702 [labelType="html" label="MapPartitionsRDD [3624702] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624703 [labelType="html" label="MapPartitionsRDD [3624703] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624704 [labelType="html" label="MapPartitionsRDD [3624704] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302991 { label="CollectLimit"; 3624705 [labelType="html" label="MapPartitionsRDD [3624705] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624706 [labelType="html" label="MapPartitionsRDD [3624706] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624698->3624699; 3624699->3624700; 3624700->3624701; 3624701->3624702; 3624702->3624703; 3624703->3624704; 3624704->3624705; 3624705->3624706; }
3624697,3624698
3624701
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time