== Physical Plan == CollectLimit (16) +- InMemoryTableScan (1) +- InMemoryRelation (2) +- * Project (15) +- * BroadcastHashJoin Inner BuildRight (14) :- * Filter (7) : +- InMemoryTableScan (3) : +- InMemoryRelation (4) : +- * Project (6) : +- Scan csv (5) +- BroadcastExchange (13) +- * Filter (12) +- InMemoryTableScan (8) +- InMemoryRelation (9) +- * Project (11) +- Scan csv (10) (1) InMemoryTableScan Output [11]: [Category#94152530, Label#94152531, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] Arguments: [Category#94152530, Label#94152531, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] (2) InMemoryRelation Arguments: [Category#94152530, Label#94152531, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(2) Project [Category#94152530, Label#94152531, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] +- *(2) BroadcastHashJoin [group#94392140], [group#94152529], Inner, BuildRight, false :- *(2) Filter isnotnull(group#94392140) : +- InMemoryTableScan [group#94392140, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183], [isnotnull(group#94392140)] : +- InMemoryRelation [group#94392140, annual_bmret#94392142, annual_ret#94392144, std_ret#94392146, Sharpe_ret#94392147, PctPos_ret#94392148, TR_ret#94392149, IR_ret#94392150, annual_resret#94392151, std_resret#94392152, Sharpe_resret#94392175, PctPos_resret#94392177, TR_resret#94392178, IR_resret#94392179, annual_retnet#94392180, std_retnet#94392181, Sharpe_retnet#94392182, PctPos_retnet#94392183, TR_retnet#94392206, IR_retnet#94392209, retIC#94392210, resretIC#94392214, turnover#94392215], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN (group#94392035 = null) THEN null ELSE group#94392035 END AS group#94392140, CASE WHEN ((annual_bmret#94392036 = NA) OR (annual_bmret#94392036 = null)) THEN null ELSE cast(annual_bmret#94392036 as float) END AS annual_bmret#94392142, CASE WHEN ((annual_ret#94392037 = NA) OR (annual_ret#94392037 = null)) THEN null ELSE cast(annual_ret#94392037 as float) END AS annual_ret#94392144, CASE WHEN ((std_ret#94392038 = NA) OR (std_ret#94392038 = null)) THEN null ELSE cast(std_ret#94392038 as float) END AS std_ret#94392146, CASE WHEN ((Sharpe_ret#94392039 = NA) OR (Sharpe_ret#94392039 = null)) THEN null ELSE cast(Sharpe_ret#94392039 as float) END AS Sharpe_ret#94392147, CASE WHEN ((PctPos_ret#94392040 = NA) OR (PctPos_ret#94392040 = null)) THEN null ELSE cast(PctPos_ret#94392040 as float) END AS PctPos_ret#94392148, CASE WHEN ((TR_ret#94392041 = NA) OR (TR_ret#94392041 = null)) THEN null ELSE cast(TR_ret#94392041 as float) END AS TR_ret#94392149, CASE WHEN ((IR_ret#94392042 = NA) OR (IR_ret#94392042 = null)) THEN null ELSE cast(IR_ret#94392042 as float) END AS IR_ret#94392150, CASE WHEN ((annual_resret#94392043 = NA) OR (annual_resret#94392043 = null)) THEN null ELSE cast(annual_resret#94392043 as float) END AS annual_resret#94392151, CASE WHEN ((std_resret#94392044 = NA) OR (std_resret#94392044 = null)) THEN null ELSE cast(std_resret#94392044 as float) END AS std_resret#94392152, CASE WHEN ((Sharpe_resret#94392045 = NA) OR (Sharpe_resret#94392045 = null)) THEN null ELSE cast(Sharpe_resret#94392045 as float) END AS Sharpe_resret#94392175, CASE WHEN ((PctPos_resret#94392046 = NA) OR (PctPos_resret#94392046 = null)) THEN null ELSE cast(PctPos_resret#94392046 as float) END AS PctPos_resret#94392177, CASE WHEN ((TR_resret#94392047 = NA) OR (TR_resret#94392047 = null)) THEN null ELSE cast(TR_resret#94392047 as float) END AS TR_resret#94392178, CASE WHEN ((IR_resret#94392048 = NA) OR (IR_resret#94392048 = null)) THEN null ELSE cast(IR_resret#94392048 as float) END AS IR_resret#94392179, CASE WHEN ((annual_retnet#94392049 = NA) OR (annual_retnet#94392049 = null)) THEN null ELSE cast(annual_retnet#94392049 as float) END AS annual_retnet#94392180, CASE WHEN ((std_retnet#94392050 = NA) OR (std_retnet#94392050 = null)) THEN null ELSE cast(std_retnet#94392050 as float) END AS std_retnet#94392181, CASE WHEN ((Sharpe_retnet#94392051 = NA) OR (Sharpe_retnet#94392051 = null)) THEN null ELSE cast(Sharpe_retnet#94392051 as float) END AS Sharpe_retnet#94392182, CASE WHEN ((PctPos_retnet#94392052 = NA) OR (PctPos_retnet#94392052 = null)) THEN null ELSE cast(PctPos_retnet#94392052 as float) END AS PctPos_retnet#94392183, CASE WHEN ((TR_retnet#94392053 = NA) OR (TR_retnet#94392053 = null)) THEN null ELSE cast(TR_retnet#94392053 as float) END AS TR_retnet#94392206, CASE WHEN ((IR_retnet#94392054 = NA) OR (IR_retnet#94392054 = null)) THEN null ELSE cast(IR_retnet#94392054 as float) END AS IR_retnet#94392209, CASE WHEN ((retIC#94392055 = NA) OR (retIC#94392055 = null)) THEN null ELSE cast(retIC#94392055 as float) END AS retIC#94392210, CASE WHEN ((resretIC#94392056 = NA) OR (resretIC#94392056 = null)) THEN null ELSE cast(resretIC#94392056 as float) END AS resretIC#94392214, CASE WHEN ((turnover#94392057 = NA) OR (turnover#94392057 = null)) THEN null ELSE cast(turnover#94392057 as float) END AS turnover#94392215] : +- FileScan csv [group#94392035,annual_bmret#94392036,annual_ret#94392037,std_ret#94392038,Sharpe_ret#94392039,PctPos_ret#94392040,TR_ret#94392041,IR_ret#94392042,annual_resret#94392043,std_resret#94392044,Sharpe_resret#94392045,PctPos_resret#94392046,TR_resret#94392047,IR_resret#94392048,annual_retnet#94392049,std_retnet#94392050,Sharpe_retnet#94392051,PctPos_retnet#94392052,TR_retnet#94392053,IR_retnet#94392054,retIC#94392055,resretIC#94392056,turnover#94392057] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/momentum/..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... +- BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7536584] +- *(1) Filter isnotnull(group#94152529) +- InMemoryTableScan [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] +- InMemoryRelation [group#94152529, Category#94152530, Label#94152531], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (3) InMemoryTableScan Output [10]: [group#94392140, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] Arguments: [group#94392140, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183], [isnotnull(group#94392140)] (4) InMemoryRelation Arguments: [group#94392140, annual_bmret#94392142, annual_ret#94392144, std_ret#94392146, Sharpe_ret#94392147, PctPos_ret#94392148, TR_ret#94392149, IR_ret#94392150, annual_resret#94392151, std_resret#94392152, Sharpe_resret#94392175, PctPos_resret#94392177, TR_resret#94392178, IR_resret#94392179, annual_retnet#94392180, std_retnet#94392181, Sharpe_retnet#94392182, PctPos_retnet#94392183, TR_retnet#94392206, IR_retnet#94392209, retIC#94392210, resretIC#94392214, turnover#94392215], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94392035 = null) THEN null ELSE group#94392035 END AS group#94392140, CASE WHEN ((annual_bmret#94392036 = NA) OR (annual_bmret#94392036 = null)) THEN null ELSE cast(annual_bmret#94392036 as float) END AS annual_bmret#94392142, CASE WHEN ((annual_ret#94392037 = NA) OR (annual_ret#94392037 = null)) THEN null ELSE cast(annual_ret#94392037 as float) END AS annual_ret#94392144, CASE WHEN ((std_ret#94392038 = NA) OR (std_ret#94392038 = null)) THEN null ELSE cast(std_ret#94392038 as float) END AS std_ret#94392146, CASE WHEN ((Sharpe_ret#94392039 = NA) OR (Sharpe_ret#94392039 = null)) THEN null ELSE cast(Sharpe_ret#94392039 as float) END AS Sharpe_ret#94392147, CASE WHEN ((PctPos_ret#94392040 = NA) OR (PctPos_ret#94392040 = null)) THEN null ELSE cast(PctPos_ret#94392040 as float) END AS PctPos_ret#94392148, CASE WHEN ((TR_ret#94392041 = NA) OR (TR_ret#94392041 = null)) THEN null ELSE cast(TR_ret#94392041 as float) END AS TR_ret#94392149, CASE WHEN ((IR_ret#94392042 = NA) OR (IR_ret#94392042 = null)) THEN null ELSE cast(IR_ret#94392042 as float) END AS IR_ret#94392150, CASE WHEN ((annual_resret#94392043 = NA) OR (annual_resret#94392043 = null)) THEN null ELSE cast(annual_resret#94392043 as float) END AS annual_resret#94392151, CASE WHEN ((std_resret#94392044 = NA) OR (std_resret#94392044 = null)) THEN null ELSE cast(std_resret#94392044 as float) END AS std_resret#94392152, CASE WHEN ((Sharpe_resret#94392045 = NA) OR (Sharpe_resret#94392045 = null)) THEN null ELSE cast(Sharpe_resret#94392045 as float) END AS Sharpe_resret#94392175, CASE WHEN ((PctPos_resret#94392046 = NA) OR (PctPos_resret#94392046 = null)) THEN null ELSE cast(PctPos_resret#94392046 as float) END AS PctPos_resret#94392177, CASE WHEN ((TR_resret#94392047 = NA) OR (TR_resret#94392047 = null)) THEN null ELSE cast(TR_resret#94392047 as float) END AS TR_resret#94392178, CASE WHEN ((IR_resret#94392048 = NA) OR (IR_resret#94392048 = null)) THEN null ELSE cast(IR_resret#94392048 as float) END AS IR_resret#94392179, CASE WHEN ((annual_retnet#94392049 = NA) OR (annual_retnet#94392049 = null)) THEN null ELSE cast(annual_retnet#94392049 as float) END AS annual_retnet#94392180, CASE WHEN ((std_retnet#94392050 = NA) OR (std_retnet#94392050 = null)) THEN null ELSE cast(std_retnet#94392050 as float) END AS std_retnet#94392181, CASE WHEN ((Sharpe_retnet#94392051 = NA) OR (Sharpe_retnet#94392051 = null)) THEN null ELSE cast(Sharpe_retnet#94392051 as float) END AS Sharpe_retnet#94392182, CASE WHEN ((PctPos_retnet#94392052 = NA) OR (PctPos_retnet#94392052 = null)) THEN null ELSE cast(PctPos_retnet#94392052 as float) END AS PctPos_retnet#94392183, CASE WHEN ((TR_retnet#94392053 = NA) OR (TR_retnet#94392053 = null)) THEN null ELSE cast(TR_retnet#94392053 as float) END AS TR_retnet#94392206, CASE WHEN ((IR_retnet#94392054 = NA) OR (IR_retnet#94392054 = null)) THEN null ELSE cast(IR_retnet#94392054 as float) END AS IR_retnet#94392209, CASE WHEN ((retIC#94392055 = NA) OR (retIC#94392055 = null)) THEN null ELSE cast(retIC#94392055 as float) END AS retIC#94392210, CASE WHEN ((resretIC#94392056 = NA) OR (resretIC#94392056 = null)) THEN null ELSE cast(resretIC#94392056 as float) END AS resretIC#94392214, CASE WHEN ((turnover#94392057 = NA) OR (turnover#94392057 = null)) THEN null ELSE cast(turnover#94392057 as float) END AS turnover#94392215] +- FileScan csv [group#94392035,annual_bmret#94392036,annual_ret#94392037,std_ret#94392038,Sharpe_ret#94392039,PctPos_ret#94392040,TR_ret#94392041,IR_ret#94392042,annual_resret#94392043,std_resret#94392044,Sharpe_resret#94392045,PctPos_resret#94392046,TR_resret#94392047,IR_resret#94392048,annual_retnet#94392049,std_retnet#94392050,Sharpe_retnet#94392051,PctPos_retnet#94392052,TR_retnet#94392053,IR_retnet#94392054,retIC#94392055,resretIC#94392056,turnover#94392057] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/momentum/..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... ,None) (5) Scan csv Output [23]: [group#94392035, annual_bmret#94392036, annual_ret#94392037, std_ret#94392038, Sharpe_ret#94392039, PctPos_ret#94392040, TR_ret#94392041, IR_ret#94392042, annual_resret#94392043, std_resret#94392044, Sharpe_resret#94392045, PctPos_resret#94392046, TR_resret#94392047, IR_resret#94392048, annual_retnet#94392049, std_retnet#94392050, Sharpe_retnet#94392051, PctPos_retnet#94392052, TR_retnet#94392053, IR_retnet#94392054, retIC#94392055, resretIC#94392056, turnover#94392057] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/output/risk_factors/momentum/REPORT_stats.csv] ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos_ret:string,TR_ret:string,IR_ret:string,annual_resret:string,std_resret:string,Sharpe_resret:string,PctPos_resret:string,TR_resret:string,IR_resret:string,annual_retnet:string,std_retnet:string,Sharpe_retnet:string,PctPos_retnet:string,TR_retnet:string,IR_retnet:string,retIC:string,resretIC:string,turnover:string> (6) Project [codegen id : 1] Output [23]: [CASE WHEN (group#94392035 = null) THEN null ELSE group#94392035 END AS group#94392140, CASE WHEN ((annual_bmret#94392036 = NA) OR (annual_bmret#94392036 = null)) THEN null ELSE cast(annual_bmret#94392036 as float) END AS annual_bmret#94392142, CASE WHEN ((annual_ret#94392037 = NA) OR (annual_ret#94392037 = null)) THEN null ELSE cast(annual_ret#94392037 as float) END AS annual_ret#94392144, CASE WHEN ((std_ret#94392038 = NA) OR (std_ret#94392038 = null)) THEN null ELSE cast(std_ret#94392038 as float) END AS std_ret#94392146, CASE WHEN ((Sharpe_ret#94392039 = NA) OR (Sharpe_ret#94392039 = null)) THEN null ELSE cast(Sharpe_ret#94392039 as float) END AS Sharpe_ret#94392147, CASE WHEN ((PctPos_ret#94392040 = NA) OR (PctPos_ret#94392040 = null)) THEN null ELSE cast(PctPos_ret#94392040 as float) END AS PctPos_ret#94392148, CASE WHEN ((TR_ret#94392041 = NA) OR (TR_ret#94392041 = null)) THEN null ELSE cast(TR_ret#94392041 as float) END AS TR_ret#94392149, CASE WHEN ((IR_ret#94392042 = NA) OR (IR_ret#94392042 = null)) THEN null ELSE cast(IR_ret#94392042 as float) END AS IR_ret#94392150, CASE WHEN ((annual_resret#94392043 = NA) OR (annual_resret#94392043 = null)) THEN null ELSE cast(annual_resret#94392043 as float) END AS annual_resret#94392151, CASE WHEN ((std_resret#94392044 = NA) OR (std_resret#94392044 = null)) THEN null ELSE cast(std_resret#94392044 as float) END AS std_resret#94392152, CASE WHEN ((Sharpe_resret#94392045 = NA) OR (Sharpe_resret#94392045 = null)) THEN null ELSE cast(Sharpe_resret#94392045 as float) END AS Sharpe_resret#94392175, CASE WHEN ((PctPos_resret#94392046 = NA) OR (PctPos_resret#94392046 = null)) THEN null ELSE cast(PctPos_resret#94392046 as float) END AS PctPos_resret#94392177, CASE WHEN ((TR_resret#94392047 = NA) OR (TR_resret#94392047 = null)) THEN null ELSE cast(TR_resret#94392047 as float) END AS TR_resret#94392178, CASE WHEN ((IR_resret#94392048 = NA) OR (IR_resret#94392048 = null)) THEN null ELSE cast(IR_resret#94392048 as float) END AS IR_resret#94392179, CASE WHEN ((annual_retnet#94392049 = NA) OR (annual_retnet#94392049 = null)) THEN null ELSE cast(annual_retnet#94392049 as float) END AS annual_retnet#94392180, CASE WHEN ((std_retnet#94392050 = NA) OR (std_retnet#94392050 = null)) THEN null ELSE cast(std_retnet#94392050 as float) END AS std_retnet#94392181, CASE WHEN ((Sharpe_retnet#94392051 = NA) OR (Sharpe_retnet#94392051 = null)) THEN null ELSE cast(Sharpe_retnet#94392051 as float) END AS Sharpe_retnet#94392182, CASE WHEN ((PctPos_retnet#94392052 = NA) OR (PctPos_retnet#94392052 = null)) THEN null ELSE cast(PctPos_retnet#94392052 as float) END AS PctPos_retnet#94392183, CASE WHEN ((TR_retnet#94392053 = NA) OR (TR_retnet#94392053 = null)) THEN null ELSE cast(TR_retnet#94392053 as float) END AS TR_retnet#94392206, CASE WHEN ((IR_retnet#94392054 = NA) OR (IR_retnet#94392054 = null)) THEN null ELSE cast(IR_retnet#94392054 as float) END AS IR_retnet#94392209, CASE WHEN ((retIC#94392055 = NA) OR (retIC#94392055 = null)) THEN null ELSE cast(retIC#94392055 as float) END AS retIC#94392210, CASE WHEN ((resretIC#94392056 = NA) OR (resretIC#94392056 = null)) THEN null ELSE cast(resretIC#94392056 as float) END AS resretIC#94392214, CASE WHEN ((turnover#94392057 = NA) OR (turnover#94392057 = null)) THEN null ELSE cast(turnover#94392057 as float) END AS turnover#94392215] Input [23]: [group#94392035, annual_bmret#94392036, annual_ret#94392037, std_ret#94392038, Sharpe_ret#94392039, PctPos_ret#94392040, TR_ret#94392041, IR_ret#94392042, annual_resret#94392043, std_resret#94392044, Sharpe_resret#94392045, PctPos_resret#94392046, TR_resret#94392047, IR_resret#94392048, annual_retnet#94392049, std_retnet#94392050, Sharpe_retnet#94392051, PctPos_retnet#94392052, TR_retnet#94392053, IR_retnet#94392054, retIC#94392055, resretIC#94392056, turnover#94392057] (7) Filter [codegen id : 2] Input [10]: [group#94392140, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] Condition : isnotnull(group#94392140) (8) InMemoryTableScan Output [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] (9) InMemoryRelation Arguments: [group#94152529, Category#94152530, Label#94152531], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (10) Scan csv Output [3]: [group#94152498, Category#94152499, Label#94152500] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/common/map_stats.csv] ReadSchema: struct<group:string,Category:string,Label:string> (11) Project [codegen id : 1] Output [3]: [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] Input [3]: [group#94152498, Category#94152499, Label#94152500] (12) Filter [codegen id : 1] Input [3]: [group#94152529, Category#94152530, Label#94152531] Condition : isnotnull(group#94152529) (13) BroadcastExchange Input [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7536584] (14) BroadcastHashJoin [codegen id : 2] Left keys [1]: [group#94392140] Right keys [1]: [group#94152529] Join condition: None (15) Project [codegen id : 2] Output [11]: [Category#94152530, Label#94152531, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] Input [13]: [group#94392140, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183, group#94152529, Category#94152530, Label#94152531] (16) CollectLimit Input [11]: [Category#94152530, Label#94152531, annual_ret#94392144, Sharpe_ret#94392147, PctPos_ret#94392148, annual_resret#94392151, Sharpe_resret#94392175, PctPos_resret#94392177, annual_retnet#94392180, Sharpe_retnet#94392182, PctPos_retnet#94392183] Arguments: 1000000