3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512770 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
672.0 B / 1
Shuffle Write Size / Records:
144.0 B / 3
Associated Job Ids:
331270
DAG Visualization
digraph G { subgraph clusterstage_512770 { label="Stage 512770"; subgraph cluster6299407 { label="Exchange"; 3622661 [labelType="html" label="ShuffledRowRDD [3622661] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6299397 { label="WholeStageCodegen (3)"; 3622663 [labelType="html" label="MapPartitionsRDD [3622663] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6299396 { label="InMemoryTableScan"; 3622665 [labelType="html" label="MapPartitionsRDD [3622665] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3622666 [labelType="html" label="*(3) Project [cap#94328190, turnover#94325173, (1.0 / cast(turnover#94325173 as double)) AS days_hold#94328224]\n+- *(3) Sort [cap_sort#94328101 ASC NULLS FIRST], true, 0\n +- Exchange rangepartitioning(cap_sort#94328101 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7531410]\n +- *(2) Project [turnover#94325173, cap_description#94328100 AS cap#94328190, cap_sort#94328101]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94324901))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7531402]\n : +- *(1) Filter isnotnull(cap#94324901)\n : +- *(1) ColumnarToRow\n : +- InMemoryTableScan [cap#94324901, turnover#94325173], [isnotnull(cap#94324901)]\n : +- InMemoryRelation [cap#94324901, retIC#943... [3622666] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6299595 { label="InMemoryTableScan"; 3622706 [labelType="html" label="MapPartitionsRDD [3622706] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3622707 [labelType="html" label="MapPartitionsRDD [3622707] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3622708 [labelType="html" label="MapPartitionsRDD [3622708] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6299594 { label="CollectLimit"; 3622709 [labelType="html" label="MapPartitionsRDD [3622709] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3622710 [labelType="html" label="MapPartitionsRDD [3622710] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3622661->3622663; 3622663->3622665; 3622665->3622666; 3622666->3622706; 3622706->3622707; 3622707->3622708; 3622708->3622709; 3622709->3622710; }
3622660,3622661
3622666
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time