== Physical Plan == CollectLimit (16) +- InMemoryTableScan (1) +- InMemoryRelation (2) +- * Project (15) +- * BroadcastHashJoin Inner BuildRight (14) :- * Filter (7) : +- InMemoryTableScan (3) : +- InMemoryRelation (4) : +- * Project (6) : +- Scan csv (5) +- BroadcastExchange (13) +- * Filter (12) +- InMemoryTableScan (8) +- InMemoryRelation (9) +- * Project (11) +- Scan csv (10) (1) InMemoryTableScan Output [11]: [Category#94152530, Label#94152531, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] Arguments: [Category#94152530, Label#94152531, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] (2) InMemoryRelation Arguments: [Category#94152530, Label#94152531, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(2) Project [Category#94152530, Label#94152531, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] +- *(2) BroadcastHashJoin [group#94292242], [group#94152529], Inner, BuildRight, false :- *(2) Filter isnotnull(group#94292242) : +- InMemoryTableScan [group#94292242, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273], [isnotnull(group#94292242)] : +- InMemoryRelation [group#94292242, annual_bmret#94292244, annual_ret#94292245, std_ret#94292247, Sharpe_ret#94292249, PctPos_ret#94292251, TR_ret#94292253, IR_ret#94292255, annual_resret#94292257, std_resret#94292259, Sharpe_resret#94292260, PctPos_resret#94292262, TR_resret#94292264, IR_resret#94292266, annual_retnet#94292268, std_retnet#94292269, Sharpe_retnet#94292271, PctPos_retnet#94292273, TR_retnet#94292275, IR_retnet#94292277, retIC#94292279, resretIC#94292281, turnover#94292282], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN (group#94292104 = null) THEN null ELSE group#94292104 END AS group#94292242, CASE WHEN ((annual_bmret#94292105 = NA) OR (annual_bmret#94292105 = null)) THEN null ELSE cast(annual_bmret#94292105 as float) END AS annual_bmret#94292244, CASE WHEN ((annual_ret#94292106 = NA) OR (annual_ret#94292106 = null)) THEN null ELSE cast(annual_ret#94292106 as float) END AS annual_ret#94292245, CASE WHEN ((std_ret#94292107 = NA) OR (std_ret#94292107 = null)) THEN null ELSE cast(std_ret#94292107 as float) END AS std_ret#94292247, CASE WHEN ((Sharpe_ret#94292108 = NA) OR (Sharpe_ret#94292108 = null)) THEN null ELSE cast(Sharpe_ret#94292108 as float) END AS Sharpe_ret#94292249, CASE WHEN ((PctPos_ret#94292109 = NA) OR (PctPos_ret#94292109 = null)) THEN null ELSE cast(PctPos_ret#94292109 as float) END AS PctPos_ret#94292251, CASE WHEN ((TR_ret#94292110 = NA) OR (TR_ret#94292110 = null)) THEN null ELSE cast(TR_ret#94292110 as float) END AS TR_ret#94292253, CASE WHEN ((IR_ret#94292111 = NA) OR (IR_ret#94292111 = null)) THEN null ELSE cast(IR_ret#94292111 as float) END AS IR_ret#94292255, CASE WHEN ((annual_resret#94292112 = NA) OR (annual_resret#94292112 = null)) THEN null ELSE cast(annual_resret#94292112 as float) END AS annual_resret#94292257, CASE WHEN ((std_resret#94292113 = NA) OR (std_resret#94292113 = null)) THEN null ELSE cast(std_resret#94292113 as float) END AS std_resret#94292259, CASE WHEN ((Sharpe_resret#94292114 = NA) OR (Sharpe_resret#94292114 = null)) THEN null ELSE cast(Sharpe_resret#94292114 as float) END AS Sharpe_resret#94292260, CASE WHEN ((PctPos_resret#94292115 = NA) OR (PctPos_resret#94292115 = null)) THEN null ELSE cast(PctPos_resret#94292115 as float) END AS PctPos_resret#94292262, CASE WHEN ((TR_resret#94292116 = NA) OR (TR_resret#94292116 = null)) THEN null ELSE cast(TR_resret#94292116 as float) END AS TR_resret#94292264, CASE WHEN ((IR_resret#94292117 = NA) OR (IR_resret#94292117 = null)) THEN null ELSE cast(IR_resret#94292117 as float) END AS IR_resret#94292266, CASE WHEN ((annual_retnet#94292118 = NA) OR (annual_retnet#94292118 = null)) THEN null ELSE cast(annual_retnet#94292118 as float) END AS annual_retnet#94292268, CASE WHEN ((std_retnet#94292119 = NA) OR (std_retnet#94292119 = null)) THEN null ELSE cast(std_retnet#94292119 as float) END AS std_retnet#94292269, CASE WHEN ((Sharpe_retnet#94292120 = NA) OR (Sharpe_retnet#94292120 = null)) THEN null ELSE cast(Sharpe_retnet#94292120 as float) END AS Sharpe_retnet#94292271, CASE WHEN ((PctPos_retnet#94292121 = NA) OR (PctPos_retnet#94292121 = null)) THEN null ELSE cast(PctPos_retnet#94292121 as float) END AS PctPos_retnet#94292273, CASE WHEN ((TR_retnet#94292122 = NA) OR (TR_retnet#94292122 = null)) THEN null ELSE cast(TR_retnet#94292122 as float) END AS TR_retnet#94292275, CASE WHEN ((IR_retnet#94292123 = NA) OR (IR_retnet#94292123 = null)) THEN null ELSE cast(IR_retnet#94292123 as float) END AS IR_retnet#94292277, CASE WHEN ((retIC#94292124 = NA) OR (retIC#94292124 = null)) THEN null ELSE cast(retIC#94292124 as float) END AS retIC#94292279, CASE WHEN ((resretIC#94292125 = NA) OR (resretIC#94292125 = null)) THEN null ELSE cast(resretIC#94292125 as float) END AS resretIC#94292281, CASE WHEN ((turnover#94292126 = NA) OR (turnover#94292126 = null)) THEN null ELSE cast(turnover#94292126 as float) END AS turnover#94292282] : +- FileScan csv [group#94292104,annual_bmret#94292105,annual_ret#94292106,std_ret#94292107,Sharpe_ret#94292108,PctPos_ret#94292109,TR_ret#94292110,IR_ret#94292111,annual_resret#94292112,std_resret#94292113,Sharpe_resret#94292114,PctPos_resret#94292115,TR_resret#94292116,IR_resret#94292117,annual_retnet#94292118,std_retnet#94292119,Sharpe_retnet#94292120,PctPos_retnet#94292121,TR_retnet#94292122,IR_retnet#94292123,retIC#94292124,resretIC#94292125,turnover#94292126] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/esg_innovation/innovat..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... +- BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7528597] +- *(1) Filter isnotnull(group#94152529) +- InMemoryTableScan [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] +- InMemoryRelation [group#94152529, Category#94152530, Label#94152531], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (3) InMemoryTableScan Output [10]: [group#94292242, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] Arguments: [group#94292242, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273], [isnotnull(group#94292242)] (4) InMemoryRelation Arguments: [group#94292242, annual_bmret#94292244, annual_ret#94292245, std_ret#94292247, Sharpe_ret#94292249, PctPos_ret#94292251, TR_ret#94292253, IR_ret#94292255, annual_resret#94292257, std_resret#94292259, Sharpe_resret#94292260, PctPos_resret#94292262, TR_resret#94292264, IR_resret#94292266, annual_retnet#94292268, std_retnet#94292269, Sharpe_retnet#94292271, PctPos_retnet#94292273, TR_retnet#94292275, IR_retnet#94292277, retIC#94292279, resretIC#94292281, turnover#94292282], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94292104 = null) THEN null ELSE group#94292104 END AS group#94292242, CASE WHEN ((annual_bmret#94292105 = NA) OR (annual_bmret#94292105 = null)) THEN null ELSE cast(annual_bmret#94292105 as float) END AS annual_bmret#94292244, CASE WHEN ((annual_ret#94292106 = NA) OR (annual_ret#94292106 = null)) THEN null ELSE cast(annual_ret#94292106 as float) END AS annual_ret#94292245, CASE WHEN ((std_ret#94292107 = NA) OR (std_ret#94292107 = null)) THEN null ELSE cast(std_ret#94292107 as float) END AS std_ret#94292247, CASE WHEN ((Sharpe_ret#94292108 = NA) OR (Sharpe_ret#94292108 = null)) THEN null ELSE cast(Sharpe_ret#94292108 as float) END AS Sharpe_ret#94292249, CASE WHEN ((PctPos_ret#94292109 = NA) OR (PctPos_ret#94292109 = null)) THEN null ELSE cast(PctPos_ret#94292109 as float) END AS PctPos_ret#94292251, CASE WHEN ((TR_ret#94292110 = NA) OR (TR_ret#94292110 = null)) THEN null ELSE cast(TR_ret#94292110 as float) END AS TR_ret#94292253, CASE WHEN ((IR_ret#94292111 = NA) OR (IR_ret#94292111 = null)) THEN null ELSE cast(IR_ret#94292111 as float) END AS IR_ret#94292255, CASE WHEN ((annual_resret#94292112 = NA) OR (annual_resret#94292112 = null)) THEN null ELSE cast(annual_resret#94292112 as float) END AS annual_resret#94292257, CASE WHEN ((std_resret#94292113 = NA) OR (std_resret#94292113 = null)) THEN null ELSE cast(std_resret#94292113 as float) END AS std_resret#94292259, CASE WHEN ((Sharpe_resret#94292114 = NA) OR (Sharpe_resret#94292114 = null)) THEN null ELSE cast(Sharpe_resret#94292114 as float) END AS Sharpe_resret#94292260, CASE WHEN ((PctPos_resret#94292115 = NA) OR (PctPos_resret#94292115 = null)) THEN null ELSE cast(PctPos_resret#94292115 as float) END AS PctPos_resret#94292262, CASE WHEN ((TR_resret#94292116 = NA) OR (TR_resret#94292116 = null)) THEN null ELSE cast(TR_resret#94292116 as float) END AS TR_resret#94292264, CASE WHEN ((IR_resret#94292117 = NA) OR (IR_resret#94292117 = null)) THEN null ELSE cast(IR_resret#94292117 as float) END AS IR_resret#94292266, CASE WHEN ((annual_retnet#94292118 = NA) OR (annual_retnet#94292118 = null)) THEN null ELSE cast(annual_retnet#94292118 as float) END AS annual_retnet#94292268, CASE WHEN ((std_retnet#94292119 = NA) OR (std_retnet#94292119 = null)) THEN null ELSE cast(std_retnet#94292119 as float) END AS std_retnet#94292269, CASE WHEN ((Sharpe_retnet#94292120 = NA) OR (Sharpe_retnet#94292120 = null)) THEN null ELSE cast(Sharpe_retnet#94292120 as float) END AS Sharpe_retnet#94292271, CASE WHEN ((PctPos_retnet#94292121 = NA) OR (PctPos_retnet#94292121 = null)) THEN null ELSE cast(PctPos_retnet#94292121 as float) END AS PctPos_retnet#94292273, CASE WHEN ((TR_retnet#94292122 = NA) OR (TR_retnet#94292122 = null)) THEN null ELSE cast(TR_retnet#94292122 as float) END AS TR_retnet#94292275, CASE WHEN ((IR_retnet#94292123 = NA) OR (IR_retnet#94292123 = null)) THEN null ELSE cast(IR_retnet#94292123 as float) END AS IR_retnet#94292277, CASE WHEN ((retIC#94292124 = NA) OR (retIC#94292124 = null)) THEN null ELSE cast(retIC#94292124 as float) END AS retIC#94292279, CASE WHEN ((resretIC#94292125 = NA) OR (resretIC#94292125 = null)) THEN null ELSE cast(resretIC#94292125 as float) END AS resretIC#94292281, CASE WHEN ((turnover#94292126 = NA) OR (turnover#94292126 = null)) THEN null ELSE cast(turnover#94292126 as float) END AS turnover#94292282] +- FileScan csv [group#94292104,annual_bmret#94292105,annual_ret#94292106,std_ret#94292107,Sharpe_ret#94292108,PctPos_ret#94292109,TR_ret#94292110,IR_ret#94292111,annual_resret#94292112,std_resret#94292113,Sharpe_resret#94292114,PctPos_resret#94292115,TR_resret#94292116,IR_resret#94292117,annual_retnet#94292118,std_retnet#94292119,Sharpe_retnet#94292120,PctPos_retnet#94292121,TR_retnet#94292122,IR_retnet#94292123,retIC#94292124,resretIC#94292125,turnover#94292126] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/esg_innovation/innovat..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... ,None) (5) Scan csv Output [23]: [group#94292104, annual_bmret#94292105, annual_ret#94292106, std_ret#94292107, Sharpe_ret#94292108, PctPos_ret#94292109, TR_ret#94292110, IR_ret#94292111, annual_resret#94292112, std_resret#94292113, Sharpe_resret#94292114, PctPos_resret#94292115, TR_resret#94292116, IR_resret#94292117, annual_retnet#94292118, std_retnet#94292119, Sharpe_retnet#94292120, PctPos_retnet#94292121, TR_retnet#94292122, IR_retnet#94292123, retIC#94292124, resretIC#94292125, turnover#94292126] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/output/esg_innovation/innovation/REPORT_stats.csv] ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos_ret:string,TR_ret:string,IR_ret:string,annual_resret:string,std_resret:string,Sharpe_resret:string,PctPos_resret:string,TR_resret:string,IR_resret:string,annual_retnet:string,std_retnet:string,Sharpe_retnet:string,PctPos_retnet:string,TR_retnet:string,IR_retnet:string,retIC:string,resretIC:string,turnover:string> (6) Project [codegen id : 1] Output [23]: [CASE WHEN (group#94292104 = null) THEN null ELSE group#94292104 END AS group#94292242, CASE WHEN ((annual_bmret#94292105 = NA) OR (annual_bmret#94292105 = null)) THEN null ELSE cast(annual_bmret#94292105 as float) END AS annual_bmret#94292244, CASE WHEN ((annual_ret#94292106 = NA) OR (annual_ret#94292106 = null)) THEN null ELSE cast(annual_ret#94292106 as float) END AS annual_ret#94292245, CASE WHEN ((std_ret#94292107 = NA) OR (std_ret#94292107 = null)) THEN null ELSE cast(std_ret#94292107 as float) END AS std_ret#94292247, CASE WHEN ((Sharpe_ret#94292108 = NA) OR (Sharpe_ret#94292108 = null)) THEN null ELSE cast(Sharpe_ret#94292108 as float) END AS Sharpe_ret#94292249, CASE WHEN ((PctPos_ret#94292109 = NA) OR (PctPos_ret#94292109 = null)) THEN null ELSE cast(PctPos_ret#94292109 as float) END AS PctPos_ret#94292251, CASE WHEN ((TR_ret#94292110 = NA) OR (TR_ret#94292110 = null)) THEN null ELSE cast(TR_ret#94292110 as float) END AS TR_ret#94292253, CASE WHEN ((IR_ret#94292111 = NA) OR (IR_ret#94292111 = null)) THEN null ELSE cast(IR_ret#94292111 as float) END AS IR_ret#94292255, CASE WHEN ((annual_resret#94292112 = NA) OR (annual_resret#94292112 = null)) THEN null ELSE cast(annual_resret#94292112 as float) END AS annual_resret#94292257, CASE WHEN ((std_resret#94292113 = NA) OR (std_resret#94292113 = null)) THEN null ELSE cast(std_resret#94292113 as float) END AS std_resret#94292259, CASE WHEN ((Sharpe_resret#94292114 = NA) OR (Sharpe_resret#94292114 = null)) THEN null ELSE cast(Sharpe_resret#94292114 as float) END AS Sharpe_resret#94292260, CASE WHEN ((PctPos_resret#94292115 = NA) OR (PctPos_resret#94292115 = null)) THEN null ELSE cast(PctPos_resret#94292115 as float) END AS PctPos_resret#94292262, CASE WHEN ((TR_resret#94292116 = NA) OR (TR_resret#94292116 = null)) THEN null ELSE cast(TR_resret#94292116 as float) END AS TR_resret#94292264, CASE WHEN ((IR_resret#94292117 = NA) OR (IR_resret#94292117 = null)) THEN null ELSE cast(IR_resret#94292117 as float) END AS IR_resret#94292266, CASE WHEN ((annual_retnet#94292118 = NA) OR (annual_retnet#94292118 = null)) THEN null ELSE cast(annual_retnet#94292118 as float) END AS annual_retnet#94292268, CASE WHEN ((std_retnet#94292119 = NA) OR (std_retnet#94292119 = null)) THEN null ELSE cast(std_retnet#94292119 as float) END AS std_retnet#94292269, CASE WHEN ((Sharpe_retnet#94292120 = NA) OR (Sharpe_retnet#94292120 = null)) THEN null ELSE cast(Sharpe_retnet#94292120 as float) END AS Sharpe_retnet#94292271, CASE WHEN ((PctPos_retnet#94292121 = NA) OR (PctPos_retnet#94292121 = null)) THEN null ELSE cast(PctPos_retnet#94292121 as float) END AS PctPos_retnet#94292273, CASE WHEN ((TR_retnet#94292122 = NA) OR (TR_retnet#94292122 = null)) THEN null ELSE cast(TR_retnet#94292122 as float) END AS TR_retnet#94292275, CASE WHEN ((IR_retnet#94292123 = NA) OR (IR_retnet#94292123 = null)) THEN null ELSE cast(IR_retnet#94292123 as float) END AS IR_retnet#94292277, CASE WHEN ((retIC#94292124 = NA) OR (retIC#94292124 = null)) THEN null ELSE cast(retIC#94292124 as float) END AS retIC#94292279, CASE WHEN ((resretIC#94292125 = NA) OR (resretIC#94292125 = null)) THEN null ELSE cast(resretIC#94292125 as float) END AS resretIC#94292281, CASE WHEN ((turnover#94292126 = NA) OR (turnover#94292126 = null)) THEN null ELSE cast(turnover#94292126 as float) END AS turnover#94292282] Input [23]: [group#94292104, annual_bmret#94292105, annual_ret#94292106, std_ret#94292107, Sharpe_ret#94292108, PctPos_ret#94292109, TR_ret#94292110, IR_ret#94292111, annual_resret#94292112, std_resret#94292113, Sharpe_resret#94292114, PctPos_resret#94292115, TR_resret#94292116, IR_resret#94292117, annual_retnet#94292118, std_retnet#94292119, Sharpe_retnet#94292120, PctPos_retnet#94292121, TR_retnet#94292122, IR_retnet#94292123, retIC#94292124, resretIC#94292125, turnover#94292126] (7) Filter [codegen id : 2] Input [10]: [group#94292242, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] Condition : isnotnull(group#94292242) (8) InMemoryTableScan Output [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] (9) InMemoryRelation Arguments: [group#94152529, Category#94152530, Label#94152531], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (10) Scan csv Output [3]: [group#94152498, Category#94152499, Label#94152500] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/common/map_stats.csv] ReadSchema: struct<group:string,Category:string,Label:string> (11) Project [codegen id : 1] Output [3]: [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] Input [3]: [group#94152498, Category#94152499, Label#94152500] (12) Filter [codegen id : 1] Input [3]: [group#94152529, Category#94152530, Label#94152531] Condition : isnotnull(group#94152529) (13) BroadcastExchange Input [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7528597] (14) BroadcastHashJoin [codegen id : 2] Left keys [1]: [group#94292242] Right keys [1]: [group#94152529] Join condition: None (15) Project [codegen id : 2] Output [11]: [Category#94152530, Label#94152531, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] Input [13]: [group#94292242, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273, group#94152529, Category#94152530, Label#94152531] (16) CollectLimit Input [11]: [Category#94152530, Label#94152531, annual_ret#94292245, Sharpe_ret#94292249, PctPos_ret#94292251, annual_resret#94292257, Sharpe_resret#94292260, PctPos_resret#94292262, annual_retnet#94292268, Sharpe_retnet#94292271, PctPos_retnet#94292273] Arguments: 1000000