== Physical Plan == CollectLimit (16) +- InMemoryTableScan (1) +- InMemoryRelation (2) +- * Project (15) +- * BroadcastHashJoin Inner BuildRight (14) :- * Filter (7) : +- InMemoryTableScan (3) : +- InMemoryRelation (4) : +- * Project (6) : +- Scan csv (5) +- BroadcastExchange (13) +- * Filter (12) +- InMemoryTableScan (8) +- InMemoryRelation (9) +- * Project (11) +- Scan csv (10) (1) InMemoryTableScan Output [11]: [Category#94152530, Label#94152531, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] Arguments: [Category#94152530, Label#94152531, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] (2) InMemoryRelation Arguments: [Category#94152530, Label#94152531, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(2) Project [Category#94152530, Label#94152531, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] +- *(2) BroadcastHashJoin [group#94250067], [group#94152529], Inner, BuildRight, false :- *(2) Filter isnotnull(group#94250067) : +- InMemoryTableScan [group#94250067, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130], [isnotnull(group#94250067)] : +- InMemoryRelation [group#94250067, annual_bmret#94250068, annual_ret#94250091, std_ret#94250116, Sharpe_ret#94250117, PctPos_ret#94250118, TR_ret#94250119, IR_ret#94250120, annual_resret#94250121, std_resret#94250122, Sharpe_resret#94250123, PctPos_resret#94250124, TR_resret#94250125, IR_resret#94250126, annual_retnet#94250127, std_retnet#94250128, Sharpe_retnet#94250129, PctPos_retnet#94250130, TR_retnet#94250131, IR_retnet#94250132, retIC#94250133, resretIC#94250134, turnover#94250135], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN (group#94249818 = null) THEN null ELSE group#94249818 END AS group#94250067, CASE WHEN ((annual_bmret#94249819 = NA) OR (annual_bmret#94249819 = null)) THEN null ELSE cast(annual_bmret#94249819 as float) END AS annual_bmret#94250068, CASE WHEN ((annual_ret#94249820 = NA) OR (annual_ret#94249820 = null)) THEN null ELSE cast(annual_ret#94249820 as float) END AS annual_ret#94250091, CASE WHEN ((std_ret#94249821 = NA) OR (std_ret#94249821 = null)) THEN null ELSE cast(std_ret#94249821 as float) END AS std_ret#94250116, CASE WHEN ((Sharpe_ret#94249822 = NA) OR (Sharpe_ret#94249822 = null)) THEN null ELSE cast(Sharpe_ret#94249822 as float) END AS Sharpe_ret#94250117, CASE WHEN ((PctPos_ret#94249823 = NA) OR (PctPos_ret#94249823 = null)) THEN null ELSE cast(PctPos_ret#94249823 as float) END AS PctPos_ret#94250118, CASE WHEN ((TR_ret#94249824 = NA) OR (TR_ret#94249824 = null)) THEN null ELSE cast(TR_ret#94249824 as float) END AS TR_ret#94250119, CASE WHEN ((IR_ret#94249825 = NA) OR (IR_ret#94249825 = null)) THEN null ELSE cast(IR_ret#94249825 as float) END AS IR_ret#94250120, CASE WHEN ((annual_resret#94249826 = NA) OR (annual_resret#94249826 = null)) THEN null ELSE cast(annual_resret#94249826 as float) END AS annual_resret#94250121, CASE WHEN ((std_resret#94249827 = NA) OR (std_resret#94249827 = null)) THEN null ELSE cast(std_resret#94249827 as float) END AS std_resret#94250122, CASE WHEN ((Sharpe_resret#94249828 = NA) OR (Sharpe_resret#94249828 = null)) THEN null ELSE cast(Sharpe_resret#94249828 as float) END AS Sharpe_resret#94250123, CASE WHEN ((PctPos_resret#94249829 = NA) OR (PctPos_resret#94249829 = null)) THEN null ELSE cast(PctPos_resret#94249829 as float) END AS PctPos_resret#94250124, CASE WHEN ((TR_resret#94249830 = NA) OR (TR_resret#94249830 = null)) THEN null ELSE cast(TR_resret#94249830 as float) END AS TR_resret#94250125, CASE WHEN ((IR_resret#94249831 = NA) OR (IR_resret#94249831 = null)) THEN null ELSE cast(IR_resret#94249831 as float) END AS IR_resret#94250126, CASE WHEN ((annual_retnet#94249832 = NA) OR (annual_retnet#94249832 = null)) THEN null ELSE cast(annual_retnet#94249832 as float) END AS annual_retnet#94250127, CASE WHEN ((std_retnet#94249833 = NA) OR (std_retnet#94249833 = null)) THEN null ELSE cast(std_retnet#94249833 as float) END AS std_retnet#94250128, CASE WHEN ((Sharpe_retnet#94249834 = NA) OR (Sharpe_retnet#94249834 = null)) THEN null ELSE cast(Sharpe_retnet#94249834 as float) END AS Sharpe_retnet#94250129, CASE WHEN ((PctPos_retnet#94249835 = NA) OR (PctPos_retnet#94249835 = null)) THEN null ELSE cast(PctPos_retnet#94249835 as float) END AS PctPos_retnet#94250130, CASE WHEN ((TR_retnet#94249836 = NA) OR (TR_retnet#94249836 = null)) THEN null ELSE cast(TR_retnet#94249836 as float) END AS TR_retnet#94250131, CASE WHEN ((IR_retnet#94249837 = NA) OR (IR_retnet#94249837 = null)) THEN null ELSE cast(IR_retnet#94249837 as float) END AS IR_retnet#94250132, CASE WHEN ((retIC#94249838 = NA) OR (retIC#94249838 = null)) THEN null ELSE cast(retIC#94249838 as float) END AS retIC#94250133, CASE WHEN ((resretIC#94249839 = NA) OR (resretIC#94249839 = null)) THEN null ELSE cast(resretIC#94249839 as float) END AS resretIC#94250134, CASE WHEN ((turnover#94249840 = NA) OR (turnover#94249840 = null)) THEN null ELSE cast(turnover#94249840 as float) END AS turnover#94250135] : +- FileScan csv [group#94249818,annual_bmret#94249819,annual_ret#94249820,std_ret#94249821,Sharpe_ret#94249822,PctPos_ret#94249823,TR_ret#94249824,IR_ret#94249825,annual_resret#94249826,std_resret#94249827,Sharpe_resret#94249828,PctPos_resret#94249829,TR_resret#94249830,IR_resret#94249831,annual_retnet#94249832,std_retnet#94249833,Sharpe_retnet#94249834,PctPos_retnet#94249835,TR_retnet#94249836,IR_retnet#94249837,retIC#94249838,resretIC#94249839,turnover#94249840] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/cam1/cam1_score/REPORT..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... +- BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7525166] +- *(1) Filter isnotnull(group#94152529) +- InMemoryTableScan [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] +- InMemoryRelation [group#94152529, Category#94152530, Label#94152531], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (3) InMemoryTableScan Output [10]: [group#94250067, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] Arguments: [group#94250067, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130], [isnotnull(group#94250067)] (4) InMemoryRelation Arguments: [group#94250067, annual_bmret#94250068, annual_ret#94250091, std_ret#94250116, Sharpe_ret#94250117, PctPos_ret#94250118, TR_ret#94250119, IR_ret#94250120, annual_resret#94250121, std_resret#94250122, Sharpe_resret#94250123, PctPos_resret#94250124, TR_resret#94250125, IR_resret#94250126, annual_retnet#94250127, std_retnet#94250128, Sharpe_retnet#94250129, PctPos_retnet#94250130, TR_retnet#94250131, IR_retnet#94250132, retIC#94250133, resretIC#94250134, turnover#94250135], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94249818 = null) THEN null ELSE group#94249818 END AS group#94250067, CASE WHEN ((annual_bmret#94249819 = NA) OR (annual_bmret#94249819 = null)) THEN null ELSE cast(annual_bmret#94249819 as float) END AS annual_bmret#94250068, CASE WHEN ((annual_ret#94249820 = NA) OR (annual_ret#94249820 = null)) THEN null ELSE cast(annual_ret#94249820 as float) END AS annual_ret#94250091, CASE WHEN ((std_ret#94249821 = NA) OR (std_ret#94249821 = null)) THEN null ELSE cast(std_ret#94249821 as float) END AS std_ret#94250116, CASE WHEN ((Sharpe_ret#94249822 = NA) OR (Sharpe_ret#94249822 = null)) THEN null ELSE cast(Sharpe_ret#94249822 as float) END AS Sharpe_ret#94250117, CASE WHEN ((PctPos_ret#94249823 = NA) OR (PctPos_ret#94249823 = null)) THEN null ELSE cast(PctPos_ret#94249823 as float) END AS PctPos_ret#94250118, CASE WHEN ((TR_ret#94249824 = NA) OR (TR_ret#94249824 = null)) THEN null ELSE cast(TR_ret#94249824 as float) END AS TR_ret#94250119, CASE WHEN ((IR_ret#94249825 = NA) OR (IR_ret#94249825 = null)) THEN null ELSE cast(IR_ret#94249825 as float) END AS IR_ret#94250120, CASE WHEN ((annual_resret#94249826 = NA) OR (annual_resret#94249826 = null)) THEN null ELSE cast(annual_resret#94249826 as float) END AS annual_resret#94250121, CASE WHEN ((std_resret#94249827 = NA) OR (std_resret#94249827 = null)) THEN null ELSE cast(std_resret#94249827 as float) END AS std_resret#94250122, CASE WHEN ((Sharpe_resret#94249828 = NA) OR (Sharpe_resret#94249828 = null)) THEN null ELSE cast(Sharpe_resret#94249828 as float) END AS Sharpe_resret#94250123, CASE WHEN ((PctPos_resret#94249829 = NA) OR (PctPos_resret#94249829 = null)) THEN null ELSE cast(PctPos_resret#94249829 as float) END AS PctPos_resret#94250124, CASE WHEN ((TR_resret#94249830 = NA) OR (TR_resret#94249830 = null)) THEN null ELSE cast(TR_resret#94249830 as float) END AS TR_resret#94250125, CASE WHEN ((IR_resret#94249831 = NA) OR (IR_resret#94249831 = null)) THEN null ELSE cast(IR_resret#94249831 as float) END AS IR_resret#94250126, CASE WHEN ((annual_retnet#94249832 = NA) OR (annual_retnet#94249832 = null)) THEN null ELSE cast(annual_retnet#94249832 as float) END AS annual_retnet#94250127, CASE WHEN ((std_retnet#94249833 = NA) OR (std_retnet#94249833 = null)) THEN null ELSE cast(std_retnet#94249833 as float) END AS std_retnet#94250128, CASE WHEN ((Sharpe_retnet#94249834 = NA) OR (Sharpe_retnet#94249834 = null)) THEN null ELSE cast(Sharpe_retnet#94249834 as float) END AS Sharpe_retnet#94250129, CASE WHEN ((PctPos_retnet#94249835 = NA) OR (PctPos_retnet#94249835 = null)) THEN null ELSE cast(PctPos_retnet#94249835 as float) END AS PctPos_retnet#94250130, CASE WHEN ((TR_retnet#94249836 = NA) OR (TR_retnet#94249836 = null)) THEN null ELSE cast(TR_retnet#94249836 as float) END AS TR_retnet#94250131, CASE WHEN ((IR_retnet#94249837 = NA) OR (IR_retnet#94249837 = null)) THEN null ELSE cast(IR_retnet#94249837 as float) END AS IR_retnet#94250132, CASE WHEN ((retIC#94249838 = NA) OR (retIC#94249838 = null)) THEN null ELSE cast(retIC#94249838 as float) END AS retIC#94250133, CASE WHEN ((resretIC#94249839 = NA) OR (resretIC#94249839 = null)) THEN null ELSE cast(resretIC#94249839 as float) END AS resretIC#94250134, CASE WHEN ((turnover#94249840 = NA) OR (turnover#94249840 = null)) THEN null ELSE cast(turnover#94249840 as float) END AS turnover#94250135] +- FileScan csv [group#94249818,annual_bmret#94249819,annual_ret#94249820,std_ret#94249821,Sharpe_ret#94249822,PctPos_ret#94249823,TR_ret#94249824,IR_ret#94249825,annual_resret#94249826,std_resret#94249827,Sharpe_resret#94249828,PctPos_resret#94249829,TR_resret#94249830,IR_resret#94249831,annual_retnet#94249832,std_retnet#94249833,Sharpe_retnet#94249834,PctPos_retnet#94249835,TR_retnet#94249836,IR_retnet#94249837,retIC#94249838,resretIC#94249839,turnover#94249840] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/cam1/cam1_score/REPORT..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... ,None) (5) Scan csv Output [23]: [group#94249818, annual_bmret#94249819, annual_ret#94249820, std_ret#94249821, Sharpe_ret#94249822, PctPos_ret#94249823, TR_ret#94249824, IR_ret#94249825, annual_resret#94249826, std_resret#94249827, Sharpe_resret#94249828, PctPos_resret#94249829, TR_resret#94249830, IR_resret#94249831, annual_retnet#94249832, std_retnet#94249833, Sharpe_retnet#94249834, PctPos_retnet#94249835, TR_retnet#94249836, IR_retnet#94249837, retIC#94249838, resretIC#94249839, turnover#94249840] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/output/cam1/cam1_score/REPORT_stats.csv] ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos_ret:string,TR_ret:string,IR_ret:string,annual_resret:string,std_resret:string,Sharpe_resret:string,PctPos_resret:string,TR_resret:string,IR_resret:string,annual_retnet:string,std_retnet:string,Sharpe_retnet:string,PctPos_retnet:string,TR_retnet:string,IR_retnet:string,retIC:string,resretIC:string,turnover:string> (6) Project [codegen id : 1] Output [23]: [CASE WHEN (group#94249818 = null) THEN null ELSE group#94249818 END AS group#94250067, CASE WHEN ((annual_bmret#94249819 = NA) OR (annual_bmret#94249819 = null)) THEN null ELSE cast(annual_bmret#94249819 as float) END AS annual_bmret#94250068, CASE WHEN ((annual_ret#94249820 = NA) OR (annual_ret#94249820 = null)) THEN null ELSE cast(annual_ret#94249820 as float) END AS annual_ret#94250091, CASE WHEN ((std_ret#94249821 = NA) OR (std_ret#94249821 = null)) THEN null ELSE cast(std_ret#94249821 as float) END AS std_ret#94250116, CASE WHEN ((Sharpe_ret#94249822 = NA) OR (Sharpe_ret#94249822 = null)) THEN null ELSE cast(Sharpe_ret#94249822 as float) END AS Sharpe_ret#94250117, CASE WHEN ((PctPos_ret#94249823 = NA) OR (PctPos_ret#94249823 = null)) THEN null ELSE cast(PctPos_ret#94249823 as float) END AS PctPos_ret#94250118, CASE WHEN ((TR_ret#94249824 = NA) OR (TR_ret#94249824 = null)) THEN null ELSE cast(TR_ret#94249824 as float) END AS TR_ret#94250119, CASE WHEN ((IR_ret#94249825 = NA) OR (IR_ret#94249825 = null)) THEN null ELSE cast(IR_ret#94249825 as float) END AS IR_ret#94250120, CASE WHEN ((annual_resret#94249826 = NA) OR (annual_resret#94249826 = null)) THEN null ELSE cast(annual_resret#94249826 as float) END AS annual_resret#94250121, CASE WHEN ((std_resret#94249827 = NA) OR (std_resret#94249827 = null)) THEN null ELSE cast(std_resret#94249827 as float) END AS std_resret#94250122, CASE WHEN ((Sharpe_resret#94249828 = NA) OR (Sharpe_resret#94249828 = null)) THEN null ELSE cast(Sharpe_resret#94249828 as float) END AS Sharpe_resret#94250123, CASE WHEN ((PctPos_resret#94249829 = NA) OR (PctPos_resret#94249829 = null)) THEN null ELSE cast(PctPos_resret#94249829 as float) END AS PctPos_resret#94250124, CASE WHEN ((TR_resret#94249830 = NA) OR (TR_resret#94249830 = null)) THEN null ELSE cast(TR_resret#94249830 as float) END AS TR_resret#94250125, CASE WHEN ((IR_resret#94249831 = NA) OR (IR_resret#94249831 = null)) THEN null ELSE cast(IR_resret#94249831 as float) END AS IR_resret#94250126, CASE WHEN ((annual_retnet#94249832 = NA) OR (annual_retnet#94249832 = null)) THEN null ELSE cast(annual_retnet#94249832 as float) END AS annual_retnet#94250127, CASE WHEN ((std_retnet#94249833 = NA) OR (std_retnet#94249833 = null)) THEN null ELSE cast(std_retnet#94249833 as float) END AS std_retnet#94250128, CASE WHEN ((Sharpe_retnet#94249834 = NA) OR (Sharpe_retnet#94249834 = null)) THEN null ELSE cast(Sharpe_retnet#94249834 as float) END AS Sharpe_retnet#94250129, CASE WHEN ((PctPos_retnet#94249835 = NA) OR (PctPos_retnet#94249835 = null)) THEN null ELSE cast(PctPos_retnet#94249835 as float) END AS PctPos_retnet#94250130, CASE WHEN ((TR_retnet#94249836 = NA) OR (TR_retnet#94249836 = null)) THEN null ELSE cast(TR_retnet#94249836 as float) END AS TR_retnet#94250131, CASE WHEN ((IR_retnet#94249837 = NA) OR (IR_retnet#94249837 = null)) THEN null ELSE cast(IR_retnet#94249837 as float) END AS IR_retnet#94250132, CASE WHEN ((retIC#94249838 = NA) OR (retIC#94249838 = null)) THEN null ELSE cast(retIC#94249838 as float) END AS retIC#94250133, CASE WHEN ((resretIC#94249839 = NA) OR (resretIC#94249839 = null)) THEN null ELSE cast(resretIC#94249839 as float) END AS resretIC#94250134, CASE WHEN ((turnover#94249840 = NA) OR (turnover#94249840 = null)) THEN null ELSE cast(turnover#94249840 as float) END AS turnover#94250135] Input [23]: [group#94249818, annual_bmret#94249819, annual_ret#94249820, std_ret#94249821, Sharpe_ret#94249822, PctPos_ret#94249823, TR_ret#94249824, IR_ret#94249825, annual_resret#94249826, std_resret#94249827, Sharpe_resret#94249828, PctPos_resret#94249829, TR_resret#94249830, IR_resret#94249831, annual_retnet#94249832, std_retnet#94249833, Sharpe_retnet#94249834, PctPos_retnet#94249835, TR_retnet#94249836, IR_retnet#94249837, retIC#94249838, resretIC#94249839, turnover#94249840] (7) Filter [codegen id : 2] Input [10]: [group#94250067, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] Condition : isnotnull(group#94250067) (8) InMemoryTableScan Output [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] (9) InMemoryRelation Arguments: [group#94152529, Category#94152530, Label#94152531], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (10) Scan csv Output [3]: [group#94152498, Category#94152499, Label#94152500] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/common/map_stats.csv] ReadSchema: struct<group:string,Category:string,Label:string> (11) Project [codegen id : 1] Output [3]: [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] Input [3]: [group#94152498, Category#94152499, Label#94152500] (12) Filter [codegen id : 1] Input [3]: [group#94152529, Category#94152530, Label#94152531] Condition : isnotnull(group#94152529) (13) BroadcastExchange Input [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7525166] (14) BroadcastHashJoin [codegen id : 2] Left keys [1]: [group#94250067] Right keys [1]: [group#94152529] Join condition: None (15) Project [codegen id : 2] Output [11]: [Category#94152530, Label#94152531, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] Input [13]: [group#94250067, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130, group#94152529, Category#94152530, Label#94152531] (16) CollectLimit Input [11]: [Category#94152530, Label#94152531, annual_ret#94250091, Sharpe_ret#94250117, PctPos_ret#94250118, annual_resret#94250121, Sharpe_resret#94250123, PctPos_resret#94250124, annual_retnet#94250127, Sharpe_retnet#94250129, PctPos_retnet#94250130] Arguments: 1000000