3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513097 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Node local: 200
Shuffle Read Size / Records:
67.8 KiB / 6432
Shuffle Write Size / Records:
67.8 KiB / 6432
Associated Job Ids:
331487
DAG Visualization
digraph G { subgraph clusterstage_513097 { label="Stage 513097"; subgraph cluster6303690 { label="Exchange"; 3625086 [labelType="html" label="ShuffledRowRDD [3625086] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303687 { label="WholeStageCodegen (2)"; 3625087 [labelType="html" label="MapPartitionsRDD [3625087] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303686 { label="InMemoryTableScan"; 3625088 [labelType="html" label="MapPartitionsRDD [3625088] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625089 [labelType="html" label="*(2) Sort [date#94391227 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(date#94391227 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7536517]\n +- *(1) Project [date#94391227, (drawdown_length_gross#94391234 * -1) AS drawdown_length_gross#94391343]\n +- InMemoryTableScan [date#94391227, drawdown_length_gross#94391234]\n +- InMemoryRelation [date#94391227, allret#94391228, allcum#94391229, drawdown_gross#94391231, drawdown_length_gross#94391234, allretnet#94391254, allcumnet#94391257, drawdown_net#94391259, drawdown_length_net#94391260, numcos#94391261, largecum#94391262, largecumnet#94391263, largeret#94391264, largeretnet#94391265, midcum#94391266, midcumnet#94391267, midret#94391268, midretnet#94391269, smallcum#94391270, smallcumnet#94391271, smallret#94391272, smallretnet#94391273], StorageLevel(disk, memory, deserialized, 1 replicas)\n +- *(1) Project [CASE WHEN (date#94390885 = null) THEN null ELSE cast(date#94390885 as date) END AS date#94390995, CASE WHEN (... [3625089] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625090 [labelType="html" label="MapPartitionsRDD [3625090] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625091 [labelType="html" label="MapPartitionsRDD [3625091] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625092 [labelType="html" label="MapPartitionsRDD [3625092] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303685 { label="CollectLimit"; 3625093 [labelType="html" label="MapPartitionsRDD [3625093] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3625094 [labelType="html" label="MapPartitionsRDD [3625094] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3625086->3625087; 3625087->3625088; 3625088->3625089; 3625089->3625090; 3625090->3625091; 3625091->3625092; 3625092->3625093; 3625093->3625094; }
3625085,3625086
3625089
Event Timeline
Enable zooming
Tasks: 200. 2 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time