3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512505 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
61.6 KiB / 5931
Shuffle Write Size / Records:
61.6 KiB / 5931
Associated Job Ids:
331095
DAG Visualization
digraph G { subgraph clusterstage_512505 { label="Stage 512505"; subgraph cluster6296188 { label="Exchange"; 3620766 [labelType="html" label="ShuffledRowRDD [3620766] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6296185 { label="WholeStageCodegen (2)"; 3620767 [labelType="html" label="MapPartitionsRDD [3620767] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6296184 { label="InMemoryTableScan"; 3620768 [labelType="html" label="MapPartitionsRDD [3620768] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620769 [labelType="html" label="*(2) Sort [date#94278495 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94278495 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7527382]\n +- *(1) Project [date#94278495, (drawdown_length_gross#94278499 * -1) AS drawdown_length_gross#94278587]\n +- InMemoryTableScan [date#94278495, drawdown_length_gross#94278499]\n +- InMemoryRelation [date#94278495, allret#94278496, allcum#94278497, drawdown_gross#94278498, drawdown_length_gross#94278499, allretnet#94278500, allcumnet#94278501, drawdown_net#94278502, drawdown_length_net#94278503, numcos#94278504, largecum#94278527, largecumnet#94278528, largeret#94278530, largeretnet#94278531, midcum#94278532, midcumnet#94278555, midret#94278556, midretnet#94278557, smallcum#94278561, smallcumnet#94278562, smallret#94278563, smallretnet#94278564], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94277187 = null) THEN null ELSE cast(date#94277187 as date) END AS date#94277363, CASE WHEN (... [3620769] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620770 [labelType="html" label="MapPartitionsRDD [3620770] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620771 [labelType="html" label="MapPartitionsRDD [3620771] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620772 [labelType="html" label="MapPartitionsRDD [3620772] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6296183 { label="CollectLimit"; 3620773 [labelType="html" label="MapPartitionsRDD [3620773] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620774 [labelType="html" label="MapPartitionsRDD [3620774] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3620766->3620767; 3620767->3620768; 3620768->3620769; 3620769->3620770; 3620770->3620771; 3620771->3620772; 3620772->3620773; 3620773->3620774; }
3620765,3620766
3620769
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time