3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 512893 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
40 ms
Locality Level Summary:
Node local: 3
Shuffle Read Size / Records:
318.0 B / 3
Shuffle Write Size / Records:
318.0 B / 3
Associated Job Ids:
331353
DAG Visualization
digraph G { subgraph clusterstage_512893 { label="Stage 512893"; subgraph cluster6301128 { label="Exchange"; 3623618 [labelType="html" label="ShuffledRowRDD [3623618] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301122 { label="WholeStageCodegen (3)"; 3623619 [labelType="html" label="MapPartitionsRDD [3623619] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301121 { label="InMemoryTableScan"; 3623620 [labelType="html" label="MapPartitionsRDD [3623620] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623621 [labelType="html" label="*(3) Sort [sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(sort#94160395 ASC NULLS FIRST, description#94160396 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7533447]\n +- *(2) Project [cap#94354236, numcos#94354239, numdates#94354240, sort#94160395, description#94160396, universe#94160397, (cast(numcos#94354239 as double) / cast(universe#94160397 as double)) AS coverage#94354585]\n +- *(2) BroadcastHashJoin [knownfloatingpointnormalized(normalizenanandzero(cap#94354236))], [knownfloatingpointnormalized(normalizenanandzero(cast(cap#94160394 as float)))], Inner, BuildLeft, false\n :- BroadcastExchange HashedRelationBroadcastMode(List(knownfloatingpointnormalized(normalizenanandzero(input[0, float, false]))),false), [id=#7533440]\n : +- *(1) Filter isnotnull(cap#94354236)\n : +- InMemoryTableScan [cap#94354236, numcos#94354239, numdates#94354240], [isnotnull(cap#94354236)]\n : +- InMemoryRelation [ca... [3623621] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623622 [labelType="html" label="MapPartitionsRDD [3623622] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623623 [labelType="html" label="MapPartitionsRDD [3623623] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623624 [labelType="html" label="MapPartitionsRDD [3623624] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6301120 { label="CollectLimit"; 3623625 [labelType="html" label="MapPartitionsRDD [3623625] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3623626 [labelType="html" label="MapPartitionsRDD [3623626] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3623618->3623619; 3623619->3623620; 3623620->3623621; 3623621->3623622; 3623622->3623623; 3623623->3623624; 3623624->3623625; 3623625->3623626; }
3623617,3623618
3623621
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time