3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512844 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
656.0 B / 1
Shuffle Write Size / Records:
154.0 B / 3
Associated Job Ids:
331319
DAG Visualization
digraph G { subgraph clusterstage_512844 { label="Stage 512844"; subgraph cluster6300372 { label="Exchange"; 3623219 [labelType="html" label="ShuffledRowRDD [3623219] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300362 { label="WholeStageCodegen (3)"; 3623220 [labelType="html" label="MapPartitionsRDD [3623220] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300361 { label="InMemoryTableScan"; 3623221 [labelType="html" label="MapPartitionsRDD [3623221] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623222 [labelType="html" label="*(3) Project [cap#94342537, turnover#94339491, (1.0 / cast(turnover#94339491 as double)) AS days_hold#94342568]\n+- *(3) Sort [cap_sort#94342448 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94342448 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7532552]\n +- *(2) Project [turnover#94339491, cap_description#94342447 AS cap#94342537, cap_sort#94342448]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94339344))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7532544]\n : +- *(1) Filter isnotnull(cap#94339344)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94339344, turnover#94339491], [isnotnull(cap#94339344)]\n : +- InMemoryRelation [cap#94339344, retIC#943... [3623222] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300539 { label="InMemoryTableScan"; 3623249 [labelType="html" label="MapPartitionsRDD [3623249] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623250 [labelType="html" label="MapPartitionsRDD [3623250] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623251 [labelType="html" label="MapPartitionsRDD [3623251] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6300538 { label="CollectLimit"; 3623252 [labelType="html" label="MapPartitionsRDD [3623252] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623253 [labelType="html" label="MapPartitionsRDD [3623253] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3623219->3623220; 3623220->3623221; 3623221->3623222; 3623222->3623249; 3623249->3623250; 3623250->3623251; 3623251->3623252; 3623252->3623253; }
3623218,3623219
3623222
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time