3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512357 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
53.7 KiB / 5034
Shuffle Write Size / Records:
53.7 KiB / 5034
Associated Job Ids:
330997
DAG Visualization
digraph G { subgraph clusterstage_512357 { label="Stage 512357"; subgraph cluster6294322 { label="Exchange"; 3619692 [labelType="html" label="ShuffledRowRDD [3619692] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6294319 { label="WholeStageCodegen (2)"; 3619693 [labelType="html" label="MapPartitionsRDD [3619693] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6294318 { label="InMemoryTableScan"; 3619694 [labelType="html" label="MapPartitionsRDD [3619694] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3619695 [labelType="html" label="*(2) Sort [date#94249789 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94249789 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7525099]\n +- *(1) Project [date#94249789, (drawdown_length_gross#94249798 * -1) AS drawdown_length_gross#94250044]\n +- InMemoryTableScan [date#94249789, drawdown_length_gross#94249798]\n +- InMemoryRelation [date#94249789, allret#94249792, allcum#94249794, drawdown_gross#94249796, drawdown_length_gross#94249798, allretnet#94249799, allcumnet#94249800, drawdown_net#94249801, drawdown_length_net#94249802, numcos#94249803, largecum#94249804, largecumnet#94249806, largeret#94249807, largeretnet#94249808, midcum#94249809, midcumnet#94249810, midret#94249811, midretnet#94249812, smallcum#94249813, smallcumnet#94249814, smallret#94249815, smallretnet#94249816], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94250069 = null) THEN null ELSE cast(date#94250069 as date) END AS date#94250291, CASE WHEN (... [3619695] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3619696 [labelType="html" label="MapPartitionsRDD [3619696] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3619697 [labelType="html" label="MapPartitionsRDD [3619697] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3619698 [labelType="html" label="MapPartitionsRDD [3619698] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6294317 { label="CollectLimit"; 3619699 [labelType="html" label="MapPartitionsRDD [3619699] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3619700 [labelType="html" label="MapPartitionsRDD [3619700] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3619692->3619693; 3619693->3619694; 3619694->3619695; 3619695->3619696; 3619696->3619697; 3619697->3619698; 3619698->3619699; 3619699->3619700; }
3619691,3619692
3619695
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time