== Physical Plan == CollectLimit (16) +- InMemoryTableScan (1) +- InMemoryRelation (2) +- * Project (15) +- * BroadcastHashJoin Inner BuildRight (14) :- * Filter (7) : +- InMemoryTableScan (3) : +- InMemoryRelation (4) : +- * Project (6) : +- Scan csv (5) +- BroadcastExchange (13) +- * Filter (12) +- InMemoryTableScan (8) +- InMemoryRelation (9) +- * Project (11) +- Scan csv (10) (1) InMemoryTableScan Output [11]: [Category#94152530, Label#94152531, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] Arguments: [Category#94152530, Label#94152531, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] (2) InMemoryRelation Arguments: [Category#94152530, Label#94152531, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(2) Project [Category#94152530, Label#94152531, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] +- *(2) BroadcastHashJoin [group#94170540], [group#94152529], Inner, BuildRight, false :- *(2) Filter isnotnull(group#94170540) : +- InMemoryTableScan [group#94170540, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585], [isnotnull(group#94170540)] : +- InMemoryRelation [group#94170540, annual_bmret#94170541, annual_ret#94170542, std_ret#94170544, Sharpe_ret#94170545, PctPos_ret#94170546, TR_ret#94170547, IR_ret#94170548, annual_resret#94170549, std_resret#94170550, Sharpe_resret#94170573, PctPos_resret#94170576, TR_resret#94170577, IR_resret#94170578, annual_retnet#94170582, std_retnet#94170583, Sharpe_retnet#94170584, PctPos_retnet#94170585, TR_retnet#94170586, IR_retnet#94170587, retIC#94170588, resretIC#94170589, turnover#94170590], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN (group#94170426 = null) THEN null ELSE group#94170426 END AS group#94170540, CASE WHEN ((annual_bmret#94170427 = NA) OR (annual_bmret#94170427 = null)) THEN null ELSE cast(annual_bmret#94170427 as float) END AS annual_bmret#94170541, CASE WHEN ((annual_ret#94170428 = NA) OR (annual_ret#94170428 = null)) THEN null ELSE cast(annual_ret#94170428 as float) END AS annual_ret#94170542, CASE WHEN ((std_ret#94170429 = NA) OR (std_ret#94170429 = null)) THEN null ELSE cast(std_ret#94170429 as float) END AS std_ret#94170544, CASE WHEN ((Sharpe_ret#94170430 = NA) OR (Sharpe_ret#94170430 = null)) THEN null ELSE cast(Sharpe_ret#94170430 as float) END AS Sharpe_ret#94170545, CASE WHEN ((PctPos_ret#94170431 = NA) OR (PctPos_ret#94170431 = null)) THEN null ELSE cast(PctPos_ret#94170431 as float) END AS PctPos_ret#94170546, CASE WHEN ((TR_ret#94170432 = NA) OR (TR_ret#94170432 = null)) THEN null ELSE cast(TR_ret#94170432 as float) END AS TR_ret#94170547, CASE WHEN ((IR_ret#94170433 = NA) OR (IR_ret#94170433 = null)) THEN null ELSE cast(IR_ret#94170433 as float) END AS IR_ret#94170548, CASE WHEN ((annual_resret#94170434 = NA) OR (annual_resret#94170434 = null)) THEN null ELSE cast(annual_resret#94170434 as float) END AS annual_resret#94170549, CASE WHEN ((std_resret#94170435 = NA) OR (std_resret#94170435 = null)) THEN null ELSE cast(std_resret#94170435 as float) END AS std_resret#94170550, CASE WHEN ((Sharpe_resret#94170436 = NA) OR (Sharpe_resret#94170436 = null)) THEN null ELSE cast(Sharpe_resret#94170436 as float) END AS Sharpe_resret#94170573, CASE WHEN ((PctPos_resret#94170437 = NA) OR (PctPos_resret#94170437 = null)) THEN null ELSE cast(PctPos_resret#94170437 as float) END AS PctPos_resret#94170576, CASE WHEN ((TR_resret#94170438 = NA) OR (TR_resret#94170438 = null)) THEN null ELSE cast(TR_resret#94170438 as float) END AS TR_resret#94170577, CASE WHEN ((IR_resret#94170439 = NA) OR (IR_resret#94170439 = null)) THEN null ELSE cast(IR_resret#94170439 as float) END AS IR_resret#94170578, CASE WHEN ((annual_retnet#94170440 = NA) OR (annual_retnet#94170440 = null)) THEN null ELSE cast(annual_retnet#94170440 as float) END AS annual_retnet#94170582, CASE WHEN ((std_retnet#94170441 = NA) OR (std_retnet#94170441 = null)) THEN null ELSE cast(std_retnet#94170441 as float) END AS std_retnet#94170583, CASE WHEN ((Sharpe_retnet#94170442 = NA) OR (Sharpe_retnet#94170442 = null)) THEN null ELSE cast(Sharpe_retnet#94170442 as float) END AS Sharpe_retnet#94170584, CASE WHEN ((PctPos_retnet#94170443 = NA) OR (PctPos_retnet#94170443 = null)) THEN null ELSE cast(PctPos_retnet#94170443 as float) END AS PctPos_retnet#94170585, CASE WHEN ((TR_retnet#94170444 = NA) OR (TR_retnet#94170444 = null)) THEN null ELSE cast(TR_retnet#94170444 as float) END AS TR_retnet#94170586, CASE WHEN ((IR_retnet#94170445 = NA) OR (IR_retnet#94170445 = null)) THEN null ELSE cast(IR_retnet#94170445 as float) END AS IR_retnet#94170587, CASE WHEN ((retIC#94170446 = NA) OR (retIC#94170446 = null)) THEN null ELSE cast(retIC#94170446 as float) END AS retIC#94170588, CASE WHEN ((resretIC#94170447 = NA) OR (resretIC#94170447 = null)) THEN null ELSE cast(resretIC#94170447 as float) END AS resretIC#94170589, CASE WHEN ((turnover#94170448 = NA) OR (turnover#94170448 = null)) THEN null ELSE cast(turnover#94170448 as float) END AS turnover#94170590] : +- FileScan csv [group#94170426,annual_bmret#94170427,annual_ret#94170428,std_ret#94170429,Sharpe_ret#94170430,PctPos_ret#94170431,TR_ret#94170432,IR_ret#94170433,annual_resret#94170434,std_resret#94170435,Sharpe_resret#94170436,PctPos_resret#94170437,TR_resret#94170438,IR_resret#94170439,annual_retnet#94170440,std_retnet#94170441,Sharpe_retnet#94170442,PctPos_retnet#94170443,TR_retnet#94170444,IR_retnet#94170445,retIC#94170446,resretIC#94170447,turnover#94170448] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/volatilit..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... +- BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7518657] +- *(1) Filter isnotnull(group#94152529) +- InMemoryTableScan [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] +- InMemoryRelation [group#94152529, Category#94152530, Label#94152531], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (3) InMemoryTableScan Output [10]: [group#94170540, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] Arguments: [group#94170540, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585], [isnotnull(group#94170540)] (4) InMemoryRelation Arguments: [group#94170540, annual_bmret#94170541, annual_ret#94170542, std_ret#94170544, Sharpe_ret#94170545, PctPos_ret#94170546, TR_ret#94170547, IR_ret#94170548, annual_resret#94170549, std_resret#94170550, Sharpe_resret#94170573, PctPos_resret#94170576, TR_resret#94170577, IR_resret#94170578, annual_retnet#94170582, std_retnet#94170583, Sharpe_retnet#94170584, PctPos_retnet#94170585, TR_retnet#94170586, IR_retnet#94170587, retIC#94170588, resretIC#94170589, turnover#94170590], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94170426 = null) THEN null ELSE group#94170426 END AS group#94170540, CASE WHEN ((annual_bmret#94170427 = NA) OR (annual_bmret#94170427 = null)) THEN null ELSE cast(annual_bmret#94170427 as float) END AS annual_bmret#94170541, CASE WHEN ((annual_ret#94170428 = NA) OR (annual_ret#94170428 = null)) THEN null ELSE cast(annual_ret#94170428 as float) END AS annual_ret#94170542, CASE WHEN ((std_ret#94170429 = NA) OR (std_ret#94170429 = null)) THEN null ELSE cast(std_ret#94170429 as float) END AS std_ret#94170544, CASE WHEN ((Sharpe_ret#94170430 = NA) OR (Sharpe_ret#94170430 = null)) THEN null ELSE cast(Sharpe_ret#94170430 as float) END AS Sharpe_ret#94170545, CASE WHEN ((PctPos_ret#94170431 = NA) OR (PctPos_ret#94170431 = null)) THEN null ELSE cast(PctPos_ret#94170431 as float) END AS PctPos_ret#94170546, CASE WHEN ((TR_ret#94170432 = NA) OR (TR_ret#94170432 = null)) THEN null ELSE cast(TR_ret#94170432 as float) END AS TR_ret#94170547, CASE WHEN ((IR_ret#94170433 = NA) OR (IR_ret#94170433 = null)) THEN null ELSE cast(IR_ret#94170433 as float) END AS IR_ret#94170548, CASE WHEN ((annual_resret#94170434 = NA) OR (annual_resret#94170434 = null)) THEN null ELSE cast(annual_resret#94170434 as float) END AS annual_resret#94170549, CASE WHEN ((std_resret#94170435 = NA) OR (std_resret#94170435 = null)) THEN null ELSE cast(std_resret#94170435 as float) END AS std_resret#94170550, CASE WHEN ((Sharpe_resret#94170436 = NA) OR (Sharpe_resret#94170436 = null)) THEN null ELSE cast(Sharpe_resret#94170436 as float) END AS Sharpe_resret#94170573, CASE WHEN ((PctPos_resret#94170437 = NA) OR (PctPos_resret#94170437 = null)) THEN null ELSE cast(PctPos_resret#94170437 as float) END AS PctPos_resret#94170576, CASE WHEN ((TR_resret#94170438 = NA) OR (TR_resret#94170438 = null)) THEN null ELSE cast(TR_resret#94170438 as float) END AS TR_resret#94170577, CASE WHEN ((IR_resret#94170439 = NA) OR (IR_resret#94170439 = null)) THEN null ELSE cast(IR_resret#94170439 as float) END AS IR_resret#94170578, CASE WHEN ((annual_retnet#94170440 = NA) OR (annual_retnet#94170440 = null)) THEN null ELSE cast(annual_retnet#94170440 as float) END AS annual_retnet#94170582, CASE WHEN ((std_retnet#94170441 = NA) OR (std_retnet#94170441 = null)) THEN null ELSE cast(std_retnet#94170441 as float) END AS std_retnet#94170583, CASE WHEN ((Sharpe_retnet#94170442 = NA) OR (Sharpe_retnet#94170442 = null)) THEN null ELSE cast(Sharpe_retnet#94170442 as float) END AS Sharpe_retnet#94170584, CASE WHEN ((PctPos_retnet#94170443 = NA) OR (PctPos_retnet#94170443 = null)) THEN null ELSE cast(PctPos_retnet#94170443 as float) END AS PctPos_retnet#94170585, CASE WHEN ((TR_retnet#94170444 = NA) OR (TR_retnet#94170444 = null)) THEN null ELSE cast(TR_retnet#94170444 as float) END AS TR_retnet#94170586, CASE WHEN ((IR_retnet#94170445 = NA) OR (IR_retnet#94170445 = null)) THEN null ELSE cast(IR_retnet#94170445 as float) END AS IR_retnet#94170587, CASE WHEN ((retIC#94170446 = NA) OR (retIC#94170446 = null)) THEN null ELSE cast(retIC#94170446 as float) END AS retIC#94170588, CASE WHEN ((resretIC#94170447 = NA) OR (resretIC#94170447 = null)) THEN null ELSE cast(resretIC#94170447 as float) END AS resretIC#94170589, CASE WHEN ((turnover#94170448 = NA) OR (turnover#94170448 = null)) THEN null ELSE cast(turnover#94170448 as float) END AS turnover#94170590] +- FileScan csv [group#94170426,annual_bmret#94170427,annual_ret#94170428,std_ret#94170429,Sharpe_ret#94170430,PctPos_ret#94170431,TR_ret#94170432,IR_ret#94170433,annual_resret#94170434,std_resret#94170435,Sharpe_resret#94170436,PctPos_resret#94170437,TR_resret#94170438,IR_resret#94170439,annual_retnet#94170440,std_retnet#94170441,Sharpe_retnet#94170442,PctPos_retnet#94170443,TR_retnet#94170444,IR_retnet#94170445,retIC#94170446,resretIC#94170447,turnover#94170448] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/volatilit..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... ,None) (5) Scan csv Output [23]: [group#94170426, annual_bmret#94170427, annual_ret#94170428, std_ret#94170429, Sharpe_ret#94170430, PctPos_ret#94170431, TR_ret#94170432, IR_ret#94170433, annual_resret#94170434, std_resret#94170435, Sharpe_resret#94170436, PctPos_resret#94170437, TR_resret#94170438, IR_resret#94170439, annual_retnet#94170440, std_retnet#94170441, Sharpe_retnet#94170442, PctPos_retnet#94170443, TR_retnet#94170444, IR_retnet#94170445, retIC#94170446, resretIC#94170447, turnover#94170448] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/output/risk_factors/volatility/REPORT_stats.csv] ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos_ret:string,TR_ret:string,IR_ret:string,annual_resret:string,std_resret:string,Sharpe_resret:string,PctPos_resret:string,TR_resret:string,IR_resret:string,annual_retnet:string,std_retnet:string,Sharpe_retnet:string,PctPos_retnet:string,TR_retnet:string,IR_retnet:string,retIC:string,resretIC:string,turnover:string> (6) Project [codegen id : 1] Output [23]: [CASE WHEN (group#94170426 = null) THEN null ELSE group#94170426 END AS group#94170540, CASE WHEN ((annual_bmret#94170427 = NA) OR (annual_bmret#94170427 = null)) THEN null ELSE cast(annual_bmret#94170427 as float) END AS annual_bmret#94170541, CASE WHEN ((annual_ret#94170428 = NA) OR (annual_ret#94170428 = null)) THEN null ELSE cast(annual_ret#94170428 as float) END AS annual_ret#94170542, CASE WHEN ((std_ret#94170429 = NA) OR (std_ret#94170429 = null)) THEN null ELSE cast(std_ret#94170429 as float) END AS std_ret#94170544, CASE WHEN ((Sharpe_ret#94170430 = NA) OR (Sharpe_ret#94170430 = null)) THEN null ELSE cast(Sharpe_ret#94170430 as float) END AS Sharpe_ret#94170545, CASE WHEN ((PctPos_ret#94170431 = NA) OR (PctPos_ret#94170431 = null)) THEN null ELSE cast(PctPos_ret#94170431 as float) END AS PctPos_ret#94170546, CASE WHEN ((TR_ret#94170432 = NA) OR (TR_ret#94170432 = null)) THEN null ELSE cast(TR_ret#94170432 as float) END AS TR_ret#94170547, CASE WHEN ((IR_ret#94170433 = NA) OR (IR_ret#94170433 = null)) THEN null ELSE cast(IR_ret#94170433 as float) END AS IR_ret#94170548, CASE WHEN ((annual_resret#94170434 = NA) OR (annual_resret#94170434 = null)) THEN null ELSE cast(annual_resret#94170434 as float) END AS annual_resret#94170549, CASE WHEN ((std_resret#94170435 = NA) OR (std_resret#94170435 = null)) THEN null ELSE cast(std_resret#94170435 as float) END AS std_resret#94170550, CASE WHEN ((Sharpe_resret#94170436 = NA) OR (Sharpe_resret#94170436 = null)) THEN null ELSE cast(Sharpe_resret#94170436 as float) END AS Sharpe_resret#94170573, CASE WHEN ((PctPos_resret#94170437 = NA) OR (PctPos_resret#94170437 = null)) THEN null ELSE cast(PctPos_resret#94170437 as float) END AS PctPos_resret#94170576, CASE WHEN ((TR_resret#94170438 = NA) OR (TR_resret#94170438 = null)) THEN null ELSE cast(TR_resret#94170438 as float) END AS TR_resret#94170577, CASE WHEN ((IR_resret#94170439 = NA) OR (IR_resret#94170439 = null)) THEN null ELSE cast(IR_resret#94170439 as float) END AS IR_resret#94170578, CASE WHEN ((annual_retnet#94170440 = NA) OR (annual_retnet#94170440 = null)) THEN null ELSE cast(annual_retnet#94170440 as float) END AS annual_retnet#94170582, CASE WHEN ((std_retnet#94170441 = NA) OR (std_retnet#94170441 = null)) THEN null ELSE cast(std_retnet#94170441 as float) END AS std_retnet#94170583, CASE WHEN ((Sharpe_retnet#94170442 = NA) OR (Sharpe_retnet#94170442 = null)) THEN null ELSE cast(Sharpe_retnet#94170442 as float) END AS Sharpe_retnet#94170584, CASE WHEN ((PctPos_retnet#94170443 = NA) OR (PctPos_retnet#94170443 = null)) THEN null ELSE cast(PctPos_retnet#94170443 as float) END AS PctPos_retnet#94170585, CASE WHEN ((TR_retnet#94170444 = NA) OR (TR_retnet#94170444 = null)) THEN null ELSE cast(TR_retnet#94170444 as float) END AS TR_retnet#94170586, CASE WHEN ((IR_retnet#94170445 = NA) OR (IR_retnet#94170445 = null)) THEN null ELSE cast(IR_retnet#94170445 as float) END AS IR_retnet#94170587, CASE WHEN ((retIC#94170446 = NA) OR (retIC#94170446 = null)) THEN null ELSE cast(retIC#94170446 as float) END AS retIC#94170588, CASE WHEN ((resretIC#94170447 = NA) OR (resretIC#94170447 = null)) THEN null ELSE cast(resretIC#94170447 as float) END AS resretIC#94170589, CASE WHEN ((turnover#94170448 = NA) OR (turnover#94170448 = null)) THEN null ELSE cast(turnover#94170448 as float) END AS turnover#94170590] Input [23]: [group#94170426, annual_bmret#94170427, annual_ret#94170428, std_ret#94170429, Sharpe_ret#94170430, PctPos_ret#94170431, TR_ret#94170432, IR_ret#94170433, annual_resret#94170434, std_resret#94170435, Sharpe_resret#94170436, PctPos_resret#94170437, TR_resret#94170438, IR_resret#94170439, annual_retnet#94170440, std_retnet#94170441, Sharpe_retnet#94170442, PctPos_retnet#94170443, TR_retnet#94170444, IR_retnet#94170445, retIC#94170446, resretIC#94170447, turnover#94170448] (7) Filter [codegen id : 2] Input [10]: [group#94170540, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] Condition : isnotnull(group#94170540) (8) InMemoryTableScan Output [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] (9) InMemoryRelation Arguments: [group#94152529, Category#94152530, Label#94152531], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (10) Scan csv Output [3]: [group#94152498, Category#94152499, Label#94152500] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/common/map_stats.csv] ReadSchema: struct<group:string,Category:string,Label:string> (11) Project [codegen id : 1] Output [3]: [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] Input [3]: [group#94152498, Category#94152499, Label#94152500] (12) Filter [codegen id : 1] Input [3]: [group#94152529, Category#94152530, Label#94152531] Condition : isnotnull(group#94152529) (13) BroadcastExchange Input [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7518657] (14) BroadcastHashJoin [codegen id : 2] Left keys [1]: [group#94170540] Right keys [1]: [group#94152529] Join condition: None (15) Project [codegen id : 2] Output [11]: [Category#94152530, Label#94152531, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] Input [13]: [group#94170540, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585, group#94152529, Category#94152530, Label#94152531] (16) CollectLimit Input [11]: [Category#94152530, Label#94152531, annual_ret#94170542, Sharpe_ret#94170545, PctPos_ret#94170546, annual_resret#94170549, Sharpe_resret#94170573, PctPos_resret#94170576, annual_retnet#94170582, Sharpe_retnet#94170584, PctPos_retnet#94170585] Arguments: 1000000