3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513056 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
20 ms
Locality Level Summary:
Node local: 1; Process local: 1
Shuffle Read Size / Records:
133.0 B / 3
Shuffle Write Size / Records:
155.0 B / 3
Associated Job Ids:
331462
DAG Visualization
digraph G { subgraph clusterstage_513056 { label="Stage 513056"; subgraph cluster6303192 { label="Exchange"; 3624821 [labelType="html" label="ShuffledRowRDD [3624821] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303185 { label="WholeStageCodegen (3)"; 3624828 [labelType="html" label="MapPartitionsRDD [3624828] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303184 { label="InMemoryTableScan"; 3624829 [labelType="html" label="MapPartitionsRDD [3624829] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624831 [labelType="html" label="*(3) Project [cap#94385214, turnover#94382804, (1.0 / cast(turnover#94382804 as double)) AS days_hold#94385248]\n+- *(3) Sort [cap_sort#94385125 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94385125 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7535950]\n +- *(2) Project [turnover#94382804, cap_description#94385124 AS cap#94385214, cap_sort#94385125]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94382550))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7535942]\n : +- *(1) Filter isnotnull(cap#94382550)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94382550, turnover#94382804], [isnotnull(cap#94382550)]\n : +- InMemoryRelation [cap#94382550, retIC#943... [3624831] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624832 [labelType="html" label="MapPartitionsRDD [3624832] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624833 [labelType="html" label="MapPartitionsRDD [3624833] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624835 [labelType="html" label="MapPartitionsRDD [3624835] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303183 { label="CollectLimit"; 3624836 [labelType="html" label="MapPartitionsRDD [3624836] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624837 [labelType="html" label="MapPartitionsRDD [3624837] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624821->3624828; 3624828->3624829; 3624829->3624831; 3624831->3624832; 3624832->3624833; 3624833->3624835; 3624835->3624836; 3624836->3624837; }
3624820,3624821
3624831
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time