3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513089 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
129.3 KiB / 6432
Shuffle Write Size / Records:
129.3 KiB / 6432
Associated Job Ids:
331483
DAG Visualization
digraph G { subgraph clusterstage_513089 { label="Stage 513089"; subgraph cluster6303622 { label="Exchange"; 3625045 [labelType="html" label="ShuffledRowRDD [3625045] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303619 { label="WholeStageCodegen (2)"; 3625046 [labelType="html" label="MapPartitionsRDD [3625046] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303618 { label="InMemoryTableScan"; 3625047 [labelType="html" label="MapPartitionsRDD [3625047] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625048 [labelType="html" label="*(2) Sort [date#94392013 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94392013 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7536477]\n +- *(1) Project [date#94392013, allret#94392015 AS daily_gross#94392261, allretnet#94392022 AS daily_net#94392262]\n +- InMemoryTableScan [allret#94392015, allretnet#94392022, date#94392013]\n +- InMemoryRelation [date#94392013, allret#94392015, allcum#94392017, drawdown_gross#94392019, drawdown_length_gross#94392021, allretnet#94392022, allcumnet#94392024, drawdown_net#94392026, drawdown_length_net#94392029, numcos#94392031, largecum#94392033, largecumnet#94392058, largeret#94392083, largeretnet#94392084, midcum#94392086, midcumnet#94392111, midret#94392136, midretnet#94392138, smallcum#94392139, smallcumnet#94392141, smallret#94392143, smallretnet#94392145], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94390885 = null) THEN null ELSE cast(date#94390885 as date) END AS date#943909... [3625048] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625049 [labelType="html" label="MapPartitionsRDD [3625049] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625050 [labelType="html" label="MapPartitionsRDD [3625050] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625051 [labelType="html" label="MapPartitionsRDD [3625051] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303617 { label="CollectLimit"; 3625052 [labelType="html" label="MapPartitionsRDD [3625052] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625053 [labelType="html" label="MapPartitionsRDD [3625053] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3625045->3625046; 3625046->3625047; 3625047->3625048; 3625048->3625049; 3625049->3625050; 3625050->3625051; 3625051->3625052; 3625052->3625053; }
3625044,3625045
3625048
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time