3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512918 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
656.0 B / 1
Shuffle Write Size / Records:
154.0 B / 3
Associated Job Ids:
331368
DAG Visualization
digraph G { subgraph clusterstage_512918 { label="Stage 512918"; subgraph cluster6301286 { label="Exchange"; 3623741 [labelType="html" label="ShuffledRowRDD [3623741] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301279 { label="WholeStageCodegen (3)"; 3623742 [labelType="html" label="MapPartitionsRDD [3623742] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301278 { label="InMemoryTableScan"; 3623743 [labelType="html" label="MapPartitionsRDD [3623743] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623744 [labelType="html" label="*(3) Project [cap#94356862, turnover#94354290, (1.0 / cast(turnover#94354290 as double)) AS days_hold#94356890]\n+- *(3) Sort [cap_sort#94356773 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94356773 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7533670]\n +- *(2) Project [turnover#94354290, cap_description#94356772 AS cap#94356862, cap_sort#94356773]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94354236))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7533662]\n : +- *(1) Filter isnotnull(cap#94354236)\n : +- InMemoryTableScan [cap#94354236, turnover#94354290], [isnotnull(cap#94354236)]\n : +- InMemoryRelation [cap#94354236, retIC#94354237, resretIC#94354238, numcos#94354239, num... [3623744] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301467 { label="InMemoryTableScan"; 3623786 [labelType="html" label="MapPartitionsRDD [3623786] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623787 [labelType="html" label="MapPartitionsRDD [3623787] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623788 [labelType="html" label="MapPartitionsRDD [3623788] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301466 { label="CollectLimit"; 3623789 [labelType="html" label="MapPartitionsRDD [3623789] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623790 [labelType="html" label="MapPartitionsRDD [3623790] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3623741->3623742; 3623742->3623743; 3623743->3623744; 3623744->3623786; 3623786->3623787; 3623787->3623788; 3623788->3623789; 3623789->3623790; }
3623740,3623741
3623744
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time