3.2.1
Jobs
Stages
Storage
Environment
Executors
SQL
PlusAMP App Middleware
application UI
Details for Stage 513073 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
91 ms
Locality Level Summary:
Node local: 10
Shuffle Read Size / Records:
1236.0 B / 10
Shuffle Write Size / Records:
1236.0 B / 10
Associated Job Ids:
331471
DAG Visualization
digraph G { subgraph clusterstage_513073 { label="Stage 513073"; subgraph cluster6303395 { label="Exchange"; 3624910 [labelType="html" label="ShuffledRowRDD [3624910] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303388 { label="WholeStageCodegen (3)"; 3624911 [labelType="html" label="MapPartitionsRDD [3624911] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303387 { label="InMemoryTableScan"; 3624912 [labelType="html" label="MapPartitionsRDD [3624912] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624913 [labelType="html" label="*(3) Sort [fractile#94389097 ASC NULLS FIRST], true, 0\n+- Exchange rangepartitioning(fractile#94389097 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7536190]\n +- *(2) Project [fractile#94389097, size#94389099, value#94389100, growth#94389101, leverage#94389102, volatility#94389103, momentum#94389104, yield#94389105, ##94389106, min_date#94389107, max_date#94389108]\n +- *(2) BroadcastHashJoin [cap_description#94389121], [description#94160396], Inner, BuildRight, false\n :- *(2) Project [fractile#94389097, cap#94389098 AS cap_description#94389121, size#94389099, value#94389100, growth#94389101, leverage#94389102, volatility#94389103, momentum#94389104, yield#94389105, ##94389106, min_date#94389107, max_date#94389108]\n : +- *(2) Filter ((isnotnull(fractile#94389097) AND NOT (fractile#94389097 = -1)) AND isnotnull(cap#94389098))\n : +- InMemoryTableScan [##94389106, cap#94389098, fractile#94389097, growth#94389101, leverage#94389102, max_date#94389108, min_date#94389107, mo... [3624913] [Cached] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624914 [labelType="html" label="MapPartitionsRDD [3624914] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624915 [labelType="html" label="MapPartitionsRDD [3624915] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624916 [labelType="html" label="MapPartitionsRDD [3624916] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } subgraph cluster6303386 { label="CollectLimit"; 3624917 [labelType="html" label="MapPartitionsRDD [3624917] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; 3624918 [labelType="html" label="MapPartitionsRDD [3624918] [Unordered]<br>toLocalIterator at SparkDataStreamBuilder.scala:39"]; } } 3624910->3624911; 3624911->3624912; 3624912->3624913; 3624913->3624914; 3624914->3624915; 3624915->3624916; 3624916->3624917; 3624917->3624918; }
3624909,3624910
3624913
Event Timeline
Enable zooming
Tasks: 10. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time