3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513140 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
656.0 B / 1
Shuffle Write Size / Records:
154.0 B / 3
Associated Job Ids:
331515
DAG Visualization
digraph G { subgraph clusterstage_513140 { label="Stage 513140"; subgraph cluster6304106 { label="Exchange"; 3625358 [labelType="html" label="ShuffledRowRDD [3625358] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6304102 { label="WholeStageCodegen (3)"; 3625359 [labelType="html" label="MapPartitionsRDD [3625359] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6304101 { label="InMemoryTableScan"; 3625360 [labelType="html" label="MapPartitionsRDD [3625360] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625361 [labelType="html" label="*(3) Project [cap#94399081, turnover#94396615, (1.0 / cast(turnover#94396615 as double)) AS days_hold#94399110]\n+- *(3) Sort [cap_sort#94399020 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94399020 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7537098]\n +- *(2) Project [turnover#94396615, cap_description#94399019 AS cap#94399081, cap_sort#94399020]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94396456))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7537090]\n : +- *(1) Filter isnotnull(cap#94396456)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94396456, turnover#94396615], [isnotnull(cap#94396456)]\n : +- InMemoryRelation [cap#94396456, retIC#943... [3625361] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6304276 { label="InMemoryTableScan"; 3625403 [labelType="html" label="MapPartitionsRDD [3625403] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625404 [labelType="html" label="MapPartitionsRDD [3625404] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625405 [labelType="html" label="MapPartitionsRDD [3625405] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6304275 { label="CollectLimit"; 3625406 [labelType="html" label="MapPartitionsRDD [3625406] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625407 [labelType="html" label="MapPartitionsRDD [3625407] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3625358->3625359; 3625359->3625360; 3625360->3625361; 3625361->3625403; 3625403->3625404; 3625404->3625405; 3625405->3625406; 3625406->3625407; }
3625357,3625358
3625361
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time