3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512427 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
63.1 KiB / 3211
Shuffle Write Size / Records:
63.1 KiB / 3211
Associated Job Ids:
331044
DAG Visualization
digraph G { subgraph clusterstage_512427 { label="Stage 512427"; subgraph cluster6295212 { label="Exchange"; 3620202 [labelType="html" label="ShuffledRowRDD [3620202] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6295209 { label="WholeStageCodegen (1)"; 3620203 [labelType="html" label="MapPartitionsRDD [3620203] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6295208 { label="InMemoryTableScan"; 3620204 [labelType="html" label="MapPartitionsRDD [3620204] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620205 [labelType="html" label="*(1) Sort [date#94263011 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94263011 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7526202]\n +- InMemoryTableScan [date#94263011, drawdown_gross#94263131, drawdown_net#94263141]\n +- InMemoryRelation [date#94263011, allret#94263013, allcum#94263127, drawdown_gross#94263131, drawdown_length_gross#94263135, allretnet#94263138, allcumnet#94263140, drawdown_net#94263141, drawdown_length_net#94263142, numcos#94263143, largecum#94263144, largecumnet#94263146, largeret#94263147, largeretnet#94263148, midcum#94263149, midcumnet#94263150, midret#94263151, midretnet#94263152, smallcum#94263153, smallcumnet#94263154, smallret#94263155, smallretnet#94263156], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94262636 = null) THEN null ELSE cast(date#94262636 as date) END AS date#94262742, CASE WHEN ((allret#94262637 = NA) OR (allret#94262637 = null)) THEN null ELSE cast(allret#94262637 as float) END... [3620205] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620206 [labelType="html" label="MapPartitionsRDD [3620206] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620207 [labelType="html" label="MapPartitionsRDD [3620207] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620208 [labelType="html" label="MapPartitionsRDD [3620208] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6295207 { label="CollectLimit"; 3620209 [labelType="html" label="MapPartitionsRDD [3620209] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3620210 [labelType="html" label="MapPartitionsRDD [3620210] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3620202->3620203; 3620203->3620204; 3620204->3620205; 3620205->3620206; 3620206->3620207; 3620207->3620208; 3620208->3620209; 3620209->3620210; }
3620201,3620202
3620205
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time