3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512224 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
51.6 KiB / 4850
Shuffle Write Size / Records:
51.6 KiB / 4850
Associated Job Ids:
330910
DAG Visualization
digraph G { subgraph clusterstage_512224 { label="Stage 512224"; subgraph cluster6292616 { label="Exchange"; 3618729 [labelType="html" label="ShuffledRowRDD [3618729] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6292613 { label="WholeStageCodegen (2)"; 3618730 [labelType="html" label="MapPartitionsRDD [3618730] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6292612 { label="InMemoryTableScan"; 3618731 [labelType="html" label="MapPartitionsRDD [3618731] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618732 [labelType="html" label="*(2) Sort [date#94225520 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94225520 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7523146]\n +- *(1) Project [date#94225520, (drawdown_length_gross#94225573 * -1) AS drawdown_length_gross#94225772]\n +- InMemoryTableScan [date#94225520, drawdown_length_gross#94225573]\n +- InMemoryRelation [date#94225520, allret#94225522, allcum#94225524, drawdown_gross#94225549, drawdown_length_gross#94225573, allretnet#94225597, allcumnet#94225621, drawdown_net#94225624, drawdown_length_net#94225627, numcos#94225630, largecum#94225633, largecumnet#94225636, largeret#94225638, largeretnet#94225642, midcum#94225645, midcumnet#94225648, midret#94225651, midretnet#94225654, smallcum#94225657, smallcumnet#94225659, smallret#94225661, smallretnet#94225673], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94225338 = null) THEN null ELSE cast(date#94225338 as date) END AS date#94225492, CASE WHEN (... [3618732] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618733 [labelType="html" label="MapPartitionsRDD [3618733] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618734 [labelType="html" label="MapPartitionsRDD [3618734] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618735 [labelType="html" label="MapPartitionsRDD [3618735] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6292611 { label="CollectLimit"; 3618736 [labelType="html" label="MapPartitionsRDD [3618736] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618737 [labelType="html" label="MapPartitionsRDD [3618737] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3618729->3618730; 3618730->3618731; 3618731->3618732; 3618732->3618733; 3618733->3618734; 3618734->3618735; 3618735->3618736; 3618736->3618737; }
3618728,3618729
3618732
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time