No DAG visualization information to display for job 330616
| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|---|
| 511777 | default | toStream at SparkDataStreamBuilder.scala:39 scala.collection.AbstractIterator.toStream(Iterator.scala:1431) plusamp.middleware.model.core.data.SparkDataStreamBuilder.$anonfun$stream$1(SparkDataStreamBuilder.scala:39) plusamp.scala.util.Profile$.time(Profile.scala:22) plusamp.middleware.model.core.data.SparkDataStreamBuilder.<init>(SparkDataStreamBuilder.scala:39) plusamp.middleware.graphql.datafile.SparkAccessor.$anonfun$retrieveData$3(SparkAccessor.scala:77) scala.util.Success.$anonfun$map$1(Try.scala:255) scala.util.Success.map(Try.scala:213) scala.concurrent.Future.$anonfun$map$1(Future.scala:292) scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33) scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33) scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64) java.base/java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1426) java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290) java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020) java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656) java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594) java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) | 2025/08/01 18:52:46 | 33 ms |
1/1
| 647.0 B | |||
| 511776 | default | toLocalIterator at SparkDataStreamBuilder.scala:39
RDD: *(2) Sort [year#94014248 ASC NULLS FIRST], true, 0
+- Exchange rangepartitioning(year#94014248 ASC NULLS FIRST, 200), ENSURE_REQUIREMENTS, [id=#7506265]
+- *(1) Project [year#94014248, turnover#94014292, (1.0 / cast(turnover#94014292 as double)) AS days_hold#94014331]
+- *(1) Filter isnotnull(turnover#94014292)
+- InMemoryTableScan [turnover#94014292, year#94014248], [isnotnull(turnover#94014292)]
+- InMemoryRelation [year#94014248, retIC#94014249, resretIC#94014250, numcos#94014251, numdates#94014253, annual_bmret#94014255, annual_ret#94014257, std_ret#94014259, Sharpe_ret#94014261, PctPos_ret#94014262, TR_ret#94014264, IR_ret#94014266, annual_resret#94014268, std_resret#94014270, Sharpe_resret#94014272, PctPos_resret#94014274, TR_resret#94014275, IR_resret#94014277, annual_retnet#94014279, std_retnet#94014281, Sharpe_retnet#94014283, PctPos_retnet#94014285, TR_retnet#94014287, IR_retnet#94014289, turnover#94014292], StorageLevel(disk, memory, deserialized, 1 replicas)
...
org.apache.spark.sql.Dataset.toLocalIterator(Dataset.scala:3000) plusamp.middleware.model.core.data.SparkDataStreamBuilder.$anonfun$stream$1(SparkDataStreamBuilder.scala:39) plusamp.scala.util.Profile$.time(Profile.scala:22) plusamp.middleware.model.core.data.SparkDataStreamBuilder.<init>(SparkDataStreamBuilder.scala:39) plusamp.middleware.graphql.datafile.SparkAccessor.$anonfun$retrieveData$3(SparkAccessor.scala:77) scala.util.Success.$anonfun$map$1(Try.scala:255) scala.util.Success.map(Try.scala:213) scala.concurrent.Future.$anonfun$map$1(Future.scala:292) scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33) scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33) scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64) java.base/java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1426) java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290) java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020) java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656) java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594) java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) | 2025/08/01 18:52:46 | 33 ms |
9/9
| 4.1 KiB | 647.0 B |
| Stage Id ▾ | Pool Name | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|---|
| 511775 | Unknown Unknown | Unknown | Unknown |
0/0
|