== Physical Plan == CollectLimit (16) +- InMemoryTableScan (1) +- InMemoryRelation (2) +- * Project (15) +- * BroadcastHashJoin Inner BuildRight (14) :- * Filter (7) : +- InMemoryTableScan (3) : +- InMemoryRelation (4) : +- * Project (6) : +- Scan csv (5) +- BroadcastExchange (13) +- * Filter (12) +- InMemoryTableScan (8) +- InMemoryRelation (9) +- * Project (11) +- Scan csv (10) (1) InMemoryTableScan Output [11]: [Category#94152530, Label#94152531, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] Arguments: [Category#94152530, Label#94152531, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] (2) InMemoryRelation Arguments: [Category#94152530, Label#94152531, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(2) Project [Category#94152530, Label#94152531, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] +- *(2) BroadcastHashJoin [group#94378122], [group#94152529], Inner, BuildRight, false :- *(2) Filter isnotnull(group#94378122) : +- InMemoryTableScan [group#94378122, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139], [isnotnull(group#94378122)] : +- InMemoryRelation [group#94378122, annual_bmret#94378123, annual_ret#94378124, std_ret#94378125, Sharpe_ret#94378126, PctPos_ret#94378127, TR_ret#94378128, IR_ret#94378129, annual_resret#94378130, std_resret#94378131, Sharpe_resret#94378132, PctPos_resret#94378133, TR_resret#94378134, IR_resret#94378135, annual_retnet#94378136, std_retnet#94378137, Sharpe_retnet#94378138, PctPos_retnet#94378139, TR_retnet#94378140, IR_retnet#94378251, retIC#94378252, resretIC#94378275, turnover#94378276], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN (group#94377982 = null) THEN null ELSE group#94377982 END AS group#94378122, CASE WHEN ((annual_bmret#94377983 = NA) OR (annual_bmret#94377983 = null)) THEN null ELSE cast(annual_bmret#94377983 as float) END AS annual_bmret#94378123, CASE WHEN ((annual_ret#94377984 = NA) OR (annual_ret#94377984 = null)) THEN null ELSE cast(annual_ret#94377984 as float) END AS annual_ret#94378124, CASE WHEN ((std_ret#94377985 = NA) OR (std_ret#94377985 = null)) THEN null ELSE cast(std_ret#94377985 as float) END AS std_ret#94378125, CASE WHEN ((Sharpe_ret#94377986 = NA) OR (Sharpe_ret#94377986 = null)) THEN null ELSE cast(Sharpe_ret#94377986 as float) END AS Sharpe_ret#94378126, CASE WHEN ((PctPos_ret#94377987 = NA) OR (PctPos_ret#94377987 = null)) THEN null ELSE cast(PctPos_ret#94377987 as float) END AS PctPos_ret#94378127, CASE WHEN ((TR_ret#94377988 = NA) OR (TR_ret#94377988 = null)) THEN null ELSE cast(TR_ret#94377988 as float) END AS TR_ret#94378128, CASE WHEN ((IR_ret#94377989 = NA) OR (IR_ret#94377989 = null)) THEN null ELSE cast(IR_ret#94377989 as float) END AS IR_ret#94378129, CASE WHEN ((annual_resret#94377990 = NA) OR (annual_resret#94377990 = null)) THEN null ELSE cast(annual_resret#94377990 as float) END AS annual_resret#94378130, CASE WHEN ((std_resret#94377991 = NA) OR (std_resret#94377991 = null)) THEN null ELSE cast(std_resret#94377991 as float) END AS std_resret#94378131, CASE WHEN ((Sharpe_resret#94377992 = NA) OR (Sharpe_resret#94377992 = null)) THEN null ELSE cast(Sharpe_resret#94377992 as float) END AS Sharpe_resret#94378132, CASE WHEN ((PctPos_resret#94377993 = NA) OR (PctPos_resret#94377993 = null)) THEN null ELSE cast(PctPos_resret#94377993 as float) END AS PctPos_resret#94378133, CASE WHEN ((TR_resret#94377994 = NA) OR (TR_resret#94377994 = null)) THEN null ELSE cast(TR_resret#94377994 as float) END AS TR_resret#94378134, CASE WHEN ((IR_resret#94377995 = NA) OR (IR_resret#94377995 = null)) THEN null ELSE cast(IR_resret#94377995 as float) END AS IR_resret#94378135, CASE WHEN ((annual_retnet#94377996 = NA) OR (annual_retnet#94377996 = null)) THEN null ELSE cast(annual_retnet#94377996 as float) END AS annual_retnet#94378136, CASE WHEN ((std_retnet#94377997 = NA) OR (std_retnet#94377997 = null)) THEN null ELSE cast(std_retnet#94377997 as float) END AS std_retnet#94378137, CASE WHEN ((Sharpe_retnet#94377998 = NA) OR (Sharpe_retnet#94377998 = null)) THEN null ELSE cast(Sharpe_retnet#94377998 as float) END AS Sharpe_retnet#94378138, CASE WHEN ((PctPos_retnet#94377999 = NA) OR (PctPos_retnet#94377999 = null)) THEN null ELSE cast(PctPos_retnet#94377999 as float) END AS PctPos_retnet#94378139, CASE WHEN ((TR_retnet#94378000 = NA) OR (TR_retnet#94378000 = null)) THEN null ELSE cast(TR_retnet#94378000 as float) END AS TR_retnet#94378140, CASE WHEN ((IR_retnet#94378001 = NA) OR (IR_retnet#94378001 = null)) THEN null ELSE cast(IR_retnet#94378001 as float) END AS IR_retnet#94378251, CASE WHEN ((retIC#94378002 = NA) OR (retIC#94378002 = null)) THEN null ELSE cast(retIC#94378002 as float) END AS retIC#94378252, CASE WHEN ((resretIC#94378003 = NA) OR (resretIC#94378003 = null)) THEN null ELSE cast(resretIC#94378003 as float) END AS resretIC#94378275, CASE WHEN ((turnover#94378004 = NA) OR (turnover#94378004 = null)) THEN null ELSE cast(turnover#94378004 as float) END AS turnover#94378276] : +- FileScan csv [group#94377982,annual_bmret#94377983,annual_ret#94377984,std_ret#94377985,Sharpe_ret#94377986,PctPos_ret#94377987,TR_ret#94377988,IR_ret#94377989,annual_resret#94377990,std_resret#94377991,Sharpe_resret#94377992,PctPos_resret#94377993,TR_resret#94377994,IR_resret#94377995,annual_retnet#94377996,std_retnet#94377997,Sharpe_retnet#94377998,PctPos_retnet#94377999,TR_retnet#94378000,IR_retnet#94378001,retIC#94378002,resretIC#94378003,turnover#94378004] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/leverage/..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... +- BroadcastExchange HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7535436] +- *(1) Filter isnotnull(group#94152529) +- InMemoryTableScan [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] +- InMemoryRelation [group#94152529, Category#94152530, Label#94152531], StorageLevel(disk, memory, deserialized, 1 replicas) +- *(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (3) InMemoryTableScan Output [10]: [group#94378122, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] Arguments: [group#94378122, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139], [isnotnull(group#94378122)] (4) InMemoryRelation Arguments: [group#94378122, annual_bmret#94378123, annual_ret#94378124, std_ret#94378125, Sharpe_ret#94378126, PctPos_ret#94378127, TR_ret#94378128, IR_ret#94378129, annual_resret#94378130, std_resret#94378131, Sharpe_resret#94378132, PctPos_resret#94378133, TR_resret#94378134, IR_resret#94378135, annual_retnet#94378136, std_retnet#94378137, Sharpe_retnet#94378138, PctPos_retnet#94378139, TR_retnet#94378140, IR_retnet#94378251, retIC#94378252, resretIC#94378275, turnover#94378276], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94377982 = null) THEN null ELSE group#94377982 END AS group#94378122, CASE WHEN ((annual_bmret#94377983 = NA) OR (annual_bmret#94377983 = null)) THEN null ELSE cast(annual_bmret#94377983 as float) END AS annual_bmret#94378123, CASE WHEN ((annual_ret#94377984 = NA) OR (annual_ret#94377984 = null)) THEN null ELSE cast(annual_ret#94377984 as float) END AS annual_ret#94378124, CASE WHEN ((std_ret#94377985 = NA) OR (std_ret#94377985 = null)) THEN null ELSE cast(std_ret#94377985 as float) END AS std_ret#94378125, CASE WHEN ((Sharpe_ret#94377986 = NA) OR (Sharpe_ret#94377986 = null)) THEN null ELSE cast(Sharpe_ret#94377986 as float) END AS Sharpe_ret#94378126, CASE WHEN ((PctPos_ret#94377987 = NA) OR (PctPos_ret#94377987 = null)) THEN null ELSE cast(PctPos_ret#94377987 as float) END AS PctPos_ret#94378127, CASE WHEN ((TR_ret#94377988 = NA) OR (TR_ret#94377988 = null)) THEN null ELSE cast(TR_ret#94377988 as float) END AS TR_ret#94378128, CASE WHEN ((IR_ret#94377989 = NA) OR (IR_ret#94377989 = null)) THEN null ELSE cast(IR_ret#94377989 as float) END AS IR_ret#94378129, CASE WHEN ((annual_resret#94377990 = NA) OR (annual_resret#94377990 = null)) THEN null ELSE cast(annual_resret#94377990 as float) END AS annual_resret#94378130, CASE WHEN ((std_resret#94377991 = NA) OR (std_resret#94377991 = null)) THEN null ELSE cast(std_resret#94377991 as float) END AS std_resret#94378131, CASE WHEN ((Sharpe_resret#94377992 = NA) OR (Sharpe_resret#94377992 = null)) THEN null ELSE cast(Sharpe_resret#94377992 as float) END AS Sharpe_resret#94378132, CASE WHEN ((PctPos_resret#94377993 = NA) OR (PctPos_resret#94377993 = null)) THEN null ELSE cast(PctPos_resret#94377993 as float) END AS PctPos_resret#94378133, CASE WHEN ((TR_resret#94377994 = NA) OR (TR_resret#94377994 = null)) THEN null ELSE cast(TR_resret#94377994 as float) END AS TR_resret#94378134, CASE WHEN ((IR_resret#94377995 = NA) OR (IR_resret#94377995 = null)) THEN null ELSE cast(IR_resret#94377995 as float) END AS IR_resret#94378135, CASE WHEN ((annual_retnet#94377996 = NA) OR (annual_retnet#94377996 = null)) THEN null ELSE cast(annual_retnet#94377996 as float) END AS annual_retnet#94378136, CASE WHEN ((std_retnet#94377997 = NA) OR (std_retnet#94377997 = null)) THEN null ELSE cast(std_retnet#94377997 as float) END AS std_retnet#94378137, CASE WHEN ((Sharpe_retnet#94377998 = NA) OR (Sharpe_retnet#94377998 = null)) THEN null ELSE cast(Sharpe_retnet#94377998 as float) END AS Sharpe_retnet#94378138, CASE WHEN ((PctPos_retnet#94377999 = NA) OR (PctPos_retnet#94377999 = null)) THEN null ELSE cast(PctPos_retnet#94377999 as float) END AS PctPos_retnet#94378139, CASE WHEN ((TR_retnet#94378000 = NA) OR (TR_retnet#94378000 = null)) THEN null ELSE cast(TR_retnet#94378000 as float) END AS TR_retnet#94378140, CASE WHEN ((IR_retnet#94378001 = NA) OR (IR_retnet#94378001 = null)) THEN null ELSE cast(IR_retnet#94378001 as float) END AS IR_retnet#94378251, CASE WHEN ((retIC#94378002 = NA) OR (retIC#94378002 = null)) THEN null ELSE cast(retIC#94378002 as float) END AS retIC#94378252, CASE WHEN ((resretIC#94378003 = NA) OR (resretIC#94378003 = null)) THEN null ELSE cast(resretIC#94378003 as float) END AS resretIC#94378275, CASE WHEN ((turnover#94378004 = NA) OR (turnover#94378004 = null)) THEN null ELSE cast(turnover#94378004 as float) END AS turnover#94378276] +- FileScan csv [group#94377982,annual_bmret#94377983,annual_ret#94377984,std_ret#94377985,Sharpe_ret#94377986,PctPos_ret#94377987,TR_ret#94377988,IR_ret#94377989,annual_resret#94377990,std_resret#94377991,Sharpe_resret#94377992,PctPos_resret#94377993,TR_resret#94377994,IR_resret#94377995,annual_retnet#94377996,std_retnet#94377997,Sharpe_retnet#94377998,PctPos_retnet#94377999,TR_retnet#94378000,IR_retnet#94378001,retIC#94378002,resretIC#94378003,turnover#94378004] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/leverage/..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos... ,None) (5) Scan csv Output [23]: [group#94377982, annual_bmret#94377983, annual_ret#94377984, std_ret#94377985, Sharpe_ret#94377986, PctPos_ret#94377987, TR_ret#94377988, IR_ret#94377989, annual_resret#94377990, std_resret#94377991, Sharpe_resret#94377992, PctPos_resret#94377993, TR_resret#94377994, IR_resret#94377995, annual_retnet#94377996, std_retnet#94377997, Sharpe_retnet#94377998, PctPos_retnet#94377999, TR_retnet#94378000, IR_retnet#94378001, retIC#94378002, resretIC#94378003, turnover#94378004] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/output/risk_factors/leverage/REPORT_stats.csv] ReadSchema: struct<group:string,annual_bmret:string,annual_ret:string,std_ret:string,Sharpe_ret:string,PctPos_ret:string,TR_ret:string,IR_ret:string,annual_resret:string,std_resret:string,Sharpe_resret:string,PctPos_resret:string,TR_resret:string,IR_resret:string,annual_retnet:string,std_retnet:string,Sharpe_retnet:string,PctPos_retnet:string,TR_retnet:string,IR_retnet:string,retIC:string,resretIC:string,turnover:string> (6) Project [codegen id : 1] Output [23]: [CASE WHEN (group#94377982 = null) THEN null ELSE group#94377982 END AS group#94378122, CASE WHEN ((annual_bmret#94377983 = NA) OR (annual_bmret#94377983 = null)) THEN null ELSE cast(annual_bmret#94377983 as float) END AS annual_bmret#94378123, CASE WHEN ((annual_ret#94377984 = NA) OR (annual_ret#94377984 = null)) THEN null ELSE cast(annual_ret#94377984 as float) END AS annual_ret#94378124, CASE WHEN ((std_ret#94377985 = NA) OR (std_ret#94377985 = null)) THEN null ELSE cast(std_ret#94377985 as float) END AS std_ret#94378125, CASE WHEN ((Sharpe_ret#94377986 = NA) OR (Sharpe_ret#94377986 = null)) THEN null ELSE cast(Sharpe_ret#94377986 as float) END AS Sharpe_ret#94378126, CASE WHEN ((PctPos_ret#94377987 = NA) OR (PctPos_ret#94377987 = null)) THEN null ELSE cast(PctPos_ret#94377987 as float) END AS PctPos_ret#94378127, CASE WHEN ((TR_ret#94377988 = NA) OR (TR_ret#94377988 = null)) THEN null ELSE cast(TR_ret#94377988 as float) END AS TR_ret#94378128, CASE WHEN ((IR_ret#94377989 = NA) OR (IR_ret#94377989 = null)) THEN null ELSE cast(IR_ret#94377989 as float) END AS IR_ret#94378129, CASE WHEN ((annual_resret#94377990 = NA) OR (annual_resret#94377990 = null)) THEN null ELSE cast(annual_resret#94377990 as float) END AS annual_resret#94378130, CASE WHEN ((std_resret#94377991 = NA) OR (std_resret#94377991 = null)) THEN null ELSE cast(std_resret#94377991 as float) END AS std_resret#94378131, CASE WHEN ((Sharpe_resret#94377992 = NA) OR (Sharpe_resret#94377992 = null)) THEN null ELSE cast(Sharpe_resret#94377992 as float) END AS Sharpe_resret#94378132, CASE WHEN ((PctPos_resret#94377993 = NA) OR (PctPos_resret#94377993 = null)) THEN null ELSE cast(PctPos_resret#94377993 as float) END AS PctPos_resret#94378133, CASE WHEN ((TR_resret#94377994 = NA) OR (TR_resret#94377994 = null)) THEN null ELSE cast(TR_resret#94377994 as float) END AS TR_resret#94378134, CASE WHEN ((IR_resret#94377995 = NA) OR (IR_resret#94377995 = null)) THEN null ELSE cast(IR_resret#94377995 as float) END AS IR_resret#94378135, CASE WHEN ((annual_retnet#94377996 = NA) OR (annual_retnet#94377996 = null)) THEN null ELSE cast(annual_retnet#94377996 as float) END AS annual_retnet#94378136, CASE WHEN ((std_retnet#94377997 = NA) OR (std_retnet#94377997 = null)) THEN null ELSE cast(std_retnet#94377997 as float) END AS std_retnet#94378137, CASE WHEN ((Sharpe_retnet#94377998 = NA) OR (Sharpe_retnet#94377998 = null)) THEN null ELSE cast(Sharpe_retnet#94377998 as float) END AS Sharpe_retnet#94378138, CASE WHEN ((PctPos_retnet#94377999 = NA) OR (PctPos_retnet#94377999 = null)) THEN null ELSE cast(PctPos_retnet#94377999 as float) END AS PctPos_retnet#94378139, CASE WHEN ((TR_retnet#94378000 = NA) OR (TR_retnet#94378000 = null)) THEN null ELSE cast(TR_retnet#94378000 as float) END AS TR_retnet#94378140, CASE WHEN ((IR_retnet#94378001 = NA) OR (IR_retnet#94378001 = null)) THEN null ELSE cast(IR_retnet#94378001 as float) END AS IR_retnet#94378251, CASE WHEN ((retIC#94378002 = NA) OR (retIC#94378002 = null)) THEN null ELSE cast(retIC#94378002 as float) END AS retIC#94378252, CASE WHEN ((resretIC#94378003 = NA) OR (resretIC#94378003 = null)) THEN null ELSE cast(resretIC#94378003 as float) END AS resretIC#94378275, CASE WHEN ((turnover#94378004 = NA) OR (turnover#94378004 = null)) THEN null ELSE cast(turnover#94378004 as float) END AS turnover#94378276] Input [23]: [group#94377982, annual_bmret#94377983, annual_ret#94377984, std_ret#94377985, Sharpe_ret#94377986, PctPos_ret#94377987, TR_ret#94377988, IR_ret#94377989, annual_resret#94377990, std_resret#94377991, Sharpe_resret#94377992, PctPos_resret#94377993, TR_resret#94377994, IR_resret#94377995, annual_retnet#94377996, std_retnet#94377997, Sharpe_retnet#94377998, PctPos_retnet#94377999, TR_retnet#94378000, IR_retnet#94378001, retIC#94378002, resretIC#94378003, turnover#94378004] (7) Filter [codegen id : 2] Input [10]: [group#94378122, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] Condition : isnotnull(group#94378122) (8) InMemoryTableScan Output [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: [group#94152529, Category#94152530, Label#94152531], [isnotnull(group#94152529)] (9) InMemoryRelation Arguments: [group#94152529, Category#94152530, Label#94152531], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] +- FileScan csv [group#94152498,Category#94152499,Label#94152500] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/common/map_stats.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<group:string,Category:string,Label:string> ,None) (10) Scan csv Output [3]: [group#94152498, Category#94152499, Label#94152500] Batched: false Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/common/map_stats.csv] ReadSchema: struct<group:string,Category:string,Label:string> (11) Project [codegen id : 1] Output [3]: [CASE WHEN (group#94152498 = null) THEN null ELSE group#94152498 END AS group#94152510, CASE WHEN (Category#94152499 = null) THEN null ELSE Category#94152499 END AS Category#94152511, CASE WHEN (Label#94152500 = null) THEN null ELSE Label#94152500 END AS Label#94152512] Input [3]: [group#94152498, Category#94152499, Label#94152500] (12) Filter [codegen id : 1] Input [3]: [group#94152529, Category#94152530, Label#94152531] Condition : isnotnull(group#94152529) (13) BroadcastExchange Input [3]: [group#94152529, Category#94152530, Label#94152531] Arguments: HashedRelationBroadcastMode(List(input[0, string, false]),false), [id=#7535436] (14) BroadcastHashJoin [codegen id : 2] Left keys [1]: [group#94378122] Right keys [1]: [group#94152529] Join condition: None (15) Project [codegen id : 2] Output [11]: [Category#94152530, Label#94152531, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] Input [13]: [group#94378122, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139, group#94152529, Category#94152530, Label#94152531] (16) CollectLimit Input [11]: [Category#94152530, Label#94152531, annual_ret#94378124, Sharpe_ret#94378126, PctPos_ret#94378127, annual_resret#94378130, Sharpe_resret#94378132, PctPos_resret#94378133, annual_retnet#94378136, Sharpe_retnet#94378138, PctPos_retnet#94378139] Arguments: 1000000