3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512992 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
656.0 B / 1
Shuffle Write Size / Records:
155.0 B / 3
Associated Job Ids:
331417
DAG Visualization
digraph G { subgraph clusterstage_512992 { label="Stage 512992"; subgraph cluster6302246 { label="Exchange"; 3624284 [labelType="html" label="ShuffledRowRDD [3624284] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302235 { label="WholeStageCodegen (3)"; 3624285 [labelType="html" label="MapPartitionsRDD [3624285] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302234 { label="InMemoryTableScan"; 3624286 [labelType="html" label="MapPartitionsRDD [3624286] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624287 [labelType="html" label="*(3) Project [cap#94371319, turnover#94368165, (1.0 / cast(turnover#94368165 as double)) AS days_hold#94371349]\n+- *(3) Sort [cap_sort#94371230 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94371230 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7534802]\n +- *(2) Project [turnover#94368165, cap_description#94371229 AS cap#94371319, cap_sort#94371230]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94368001))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7534794]\n : +- *(1) Filter isnotnull(cap#94368001)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94368001, turnover#94368165], [isnotnull(cap#94368001)]\n : +- InMemoryRelation [cap#94368001, retIC#943... [3624287] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302410 { label="InMemoryTableScan"; 3624329 [labelType="html" label="MapPartitionsRDD [3624329] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624330 [labelType="html" label="MapPartitionsRDD [3624330] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624331 [labelType="html" label="MapPartitionsRDD [3624331] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302409 { label="CollectLimit"; 3624332 [labelType="html" label="MapPartitionsRDD [3624332] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624333 [labelType="html" label="MapPartitionsRDD [3624333] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624284->3624285; 3624285->3624286; 3624286->3624287; 3624287->3624329; 3624329->3624330; 3624330->3624331; 3624331->3624332; 3624332->3624333; }
3624283,3624284
3624287
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time