3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513066 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
656.0 B / 1
Shuffle Write Size / Records:
155.0 B / 3
Associated Job Ids:
331466
DAG Visualization
digraph G { subgraph clusterstage_513066 { label="Stage 513066"; subgraph cluster6303192 { label="Exchange"; 3624821 [labelType="html" label="ShuffledRowRDD [3624821] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303185 { label="WholeStageCodegen (3)"; 3624828 [labelType="html" label="MapPartitionsRDD [3624828] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303184 { label="InMemoryTableScan"; 3624829 [labelType="html" label="MapPartitionsRDD [3624829] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624831 [labelType="html" label="*(3) Project [cap#94385214, turnover#94382804, (1.0 / cast(turnover#94382804 as double)) AS days_hold#94385248]\n+- *(3) Sort [cap_sort#94385125 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94385125 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7535950]\n +- *(2) Project [turnover#94382804, cap_description#94385124 AS cap#94385214, cap_sort#94385125]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94382550))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7535942]\n : +- *(1) Filter isnotnull(cap#94382550)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94382550, turnover#94382804], [isnotnull(cap#94382550)]\n : +- InMemoryRelation [cap#94382550, retIC#943... [3624831] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303343 { label="InMemoryTableScan"; 3624866 [labelType="html" label="MapPartitionsRDD [3624866] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624867 [labelType="html" label="MapPartitionsRDD [3624867] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624868 [labelType="html" label="MapPartitionsRDD [3624868] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303342 { label="CollectLimit"; 3624869 [labelType="html" label="MapPartitionsRDD [3624869] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624870 [labelType="html" label="MapPartitionsRDD [3624870] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624821->3624828; 3624828->3624829; 3624829->3624831; 3624831->3624866; 3624866->3624867; 3624867->3624868; 3624868->3624869; 3624869->3624870; }
3624820,3624821
3624831
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time