3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513019 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
111.8 KiB / 6432
Shuffle Write Size / Records:
111.8 KiB / 6432
Associated Job Ids:
331436
DAG Visualization
digraph G { subgraph clusterstage_513019 { label="Stage 513019"; subgraph cluster6302725 { label="Exchange"; 3624528 [labelType="html" label="ShuffledRowRDD [3624528] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302722 { label="WholeStageCodegen (1)"; 3624529 [labelType="html" label="MapPartitionsRDD [3624529] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302721 { label="InMemoryTableScan"; 3624530 [labelType="html" label="MapPartitionsRDD [3624530] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624531 [labelType="html" label="*(1) Sort [date#94377912 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94377912 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7535347]\n +- InMemoryTableScan [date#94377912, drawdown_gross#94377915, drawdown_net#94377919]\n +- InMemoryRelation [date#94377912, allret#94377913, allcum#94377914, drawdown_gross#94377915, drawdown_length_gross#94377916, allretnet#94377917, allcumnet#94377918, drawdown_net#94377919, drawdown_length_net#94377920, numcos#94377921, largecum#94377922, largecumnet#94377923, largeret#94377924, largeretnet#94377925, midcum#94377926, midcumnet#94377927, midret#94377928, midretnet#94377929, smallcum#94377930, smallcumnet#94377932, smallret#94377933, smallretnet#94377934], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94377170 = null) THEN null ELSE cast(date#94377170 as date) END AS date#94377294, CASE WHEN ((allret#94377171 = NA) OR (allret#94377171 = null)) THEN null ELSE cast(allret#94377171 as float) END... [3624531] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624532 [labelType="html" label="MapPartitionsRDD [3624532] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624533 [labelType="html" label="MapPartitionsRDD [3624533] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624534 [labelType="html" label="MapPartitionsRDD [3624534] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6302720 { label="CollectLimit"; 3624535 [labelType="html" label="MapPartitionsRDD [3624535] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624536 [labelType="html" label="MapPartitionsRDD [3624536] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624528->3624529; 3624529->3624530; 3624530->3624531; 3624531->3624532; 3624532->3624533; 3624533->3624534; 3624534->3624535; 3624535->3624536; }
3624527,3624528
3624531
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time