3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512819 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.2 s
Locality Level Summary:
Node local: 3
Shuffle Read Size / Records:
316.0 B / 3
Shuffle Write Size / Records:
316.0 B / 3
Associated Job Ids:
331304
DAG Visualization
digraph G { subgraph clusterstage_512819 { label="Stage 512819"; subgraph cluster6300195 { label="Exchange"; 3623081 [labelType="html" label="ShuffledRowRDD [3623081] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300189 { label="WholeStageCodegen (3)"; 3623082 [labelType="html" label="MapPartitionsRDD [3623082] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300188 { label="InMemoryTableScan"; 3623083 [labelType="html" label="MapPartitionsRDD [3623083] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623084 [labelType="html" label="*(3) Sort [sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7532312]\n +- *(2) Project [cap#94339344, numcos#94339347, numdates#94339348, sort#94160395, description#94160396, universe#94160397, (cast(numcos#94339347 as double) / cast(universe#94160397 as double)) AS coverage#94339557]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94339344))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7532305]\n : +- *(1) Filter isnotnull(cap#94339344)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94339344, numcos#94339347, numdates#94339348], [isnotnull(cap#94339344)]\n ... [3623084] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623085 [labelType="html" label="MapPartitionsRDD [3623085] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623086 [labelType="html" label="MapPartitionsRDD [3623086] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623087 [labelType="html" label="MapPartitionsRDD [3623087] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300187 { label="CollectLimit"; 3623088 [labelType="html" label="MapPartitionsRDD [3623088] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623089 [labelType="html" label="MapPartitionsRDD [3623089] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3623081->3623082; 3623082->3623083; 3623083->3623084; 3623084->3623085; 3623085->3623086; 3623086->3623087; 3623087->3623088; 3623088->3623089; }
3623080,3623081
3623084
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time