3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512251 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
50.5 KiB / 4518
Shuffle Write Size / Records:
50.5 KiB / 4518
Associated Job Ids:
330928
DAG Visualization
digraph G { subgraph clusterstage_512251 { label="Stage 512251"; subgraph cluster6292967 { label="Exchange"; 3618940 [labelType="html" label="ShuffledRowRDD [3618940] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6292964 { label="WholeStageCodegen (2)"; 3618941 [labelType="html" label="MapPartitionsRDD [3618941] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6292963 { label="InMemoryTableScan"; 3618942 [labelType="html" label="MapPartitionsRDD [3618942] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618943 [labelType="html" label="*(2) Sort [date#94219358 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94219358 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7522653]\n +- *(1) Project [date#94219358, (drawdown_length_gross#94219374 * -1) AS drawdown_length_gross#94219457]\n +- InMemoryTableScan [date#94219358, drawdown_length_gross#94219374]\n +- InMemoryRelation [date#94219358, allret#94219360, allcum#94219364, drawdown_gross#94219370, drawdown_length_gross#94219374, allretnet#94219379, allcumnet#94219381, drawdown_net#94219382, drawdown_length_net#94219383, numcos#94219384, largecum#94219385, largecumnet#94219386, largeret#94219387, largeretnet#94219389, midcum#94219393, midcumnet#94219397, midret#94219400, midretnet#94219402, smallcum#94219404, smallcumnet#94219406, smallret#94219408, smallretnet#94219410], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94219172 = null) THEN null ELSE cast(date#94219172 as date) END AS date#94219331, CASE WHEN (... [3618943] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618944 [labelType="html" label="MapPartitionsRDD [3618944] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618945 [labelType="html" label="MapPartitionsRDD [3618945] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618946 [labelType="html" label="MapPartitionsRDD [3618946] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6292962 { label="CollectLimit"; 3618947 [labelType="html" label="MapPartitionsRDD [3618947] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3618948 [labelType="html" label="MapPartitionsRDD [3618948] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3618940->3618941; 3618941->3618942; 3618942->3618943; 3618943->3618944; 3618944->3618945; 3618945->3618946; 3618946->3618947; 3618947->3618948; }
3618939,3618940
3618943
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time