3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513023 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
68.2 KiB / 6432
Shuffle Write Size / Records:
68.2 KiB / 6432
Associated Job Ids:
331438
DAG Visualization
digraph G { subgraph clusterstage_513023 { label="Stage 513023"; subgraph cluster6302757 { label="Exchange"; 3624549 [labelType="html" label="ShuffledRowRDD [3624549] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302754 { label="WholeStageCodegen (2)"; 3624550 [labelType="html" label="MapPartitionsRDD [3624550] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302753 { label="InMemoryTableScan"; 3624551 [labelType="html" label="MapPartitionsRDD [3624551] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624552 [labelType="html" label="*(2) Sort [date#94377113 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94377113 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7535369]\n +- *(1) Project [date#94377113, (drawdown_length_gross#94377119 * -1) AS drawdown_length_gross#94377389]\n +- InMemoryTableScan [date#94377113, drawdown_length_gross#94377119]\n +- InMemoryRelation [date#94377113, allret#94377115, allcum#94377116, drawdown_gross#94377118, drawdown_length_gross#94377119, allretnet#94377120, allcumnet#94377121, drawdown_net#94377163, drawdown_length_net#94377164, numcos#94377167, largecum#94377169, largecumnet#94377192, largeret#94377193, largeretnet#94377219, midcum#94377225, midcumnet#94377253, midret#94377255, midretnet#94377278, smallcum#94377279, smallcumnet#94377281, smallret#94377282, smallretnet#94377283], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94377170 = null) THEN null ELSE cast(date#94377170 as date) END AS date#94377294, CASE WHEN (... [3624552] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624553 [labelType="html" label="MapPartitionsRDD [3624553] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624554 [labelType="html" label="MapPartitionsRDD [3624554] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624555 [labelType="html" label="MapPartitionsRDD [3624555] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302752 { label="CollectLimit"; 3624556 [labelType="html" label="MapPartitionsRDD [3624556] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624557 [labelType="html" label="MapPartitionsRDD [3624557] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624549->3624550; 3624550->3624551; 3624551->3624552; 3624552->3624553; 3624553->3624554; 3624554->3624555; 3624555->3624556; 3624556->3624557; }
3624548,3624549
3624552
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time