== Physical Plan ==
CollectLimit (7)
+- * ColumnarToRow (6)
+- InMemoryTableScan (1)
+- InMemoryRelation (2)
+- * Project (5)
+- * Filter (4)
+- Scan csv (3)
(1) InMemoryTableScan
Output [2]: [turnover#94812215, days_hold#94812278]
Arguments: [turnover#94812215, days_hold#94812278]
(2) InMemoryRelation
Arguments: [turnover#94812215, days_hold#94812278], CachedRDDBuilder(org.apache.spark.sql.execution.columnar.DefaultCachedBatchSerializer@208e3fd9,StorageLevel(disk, memory, deserialized, 1 replicas),*(1) Project [CASE WHEN ((turnover#94812008 = NA) OR (turnover#94812008 = null)) THEN null ELSE cast(turnover#94812008 as float) END AS turnover#94812215, CASE WHEN ((turnover#94812008 = NA) OR (turnover#94812008 = null)) THEN null ELSE (1.0 / cast(cast(turnover#94812008 as float) as double)) END AS days_hold#94812278]
+- *(1) Filter ((isnotnull(cap#94811977) AND NOT coalesce(((cap#94811977 = NA) OR (cap#94811977 = null)), false)) AND (cast(cap#94811977 as float) = 0.0))
+- FileScan csv [cap#94811977,turnover#94812008] Batched: false, DataFilters: [isnotnull(cap#94811977), NOT coalesce(((cap#94811977 = NA) OR (cap#94811977 = null)), false), (c..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/estimize_signal_histor..., PartitionFilters: [], PushedFilters: [IsNotNull(cap)], ReadSchema: struct<cap:string,turnover:string>
,None)
(3) Scan csv
Output [2]: [cap#94811977, turnover#94812008]
Batched: false
Location: InMemoryFileIndex [file:/srv/plusamp/data/default/ea-market/output/estimize_signal_history/estimizesignal_preearnings/stats_overall.csv]
PushedFilters: [IsNotNull(cap)]
ReadSchema: struct<cap:string,turnover:string>
(4) Filter [codegen id : 1]
Input [2]: [cap#94811977, turnover#94812008]
Condition : ((isnotnull(cap#94811977) AND NOT coalesce(((cap#94811977 = NA) OR (cap#94811977 = null)), false)) AND (cast(cap#94811977 as float) = 0.0))
(5) Project [codegen id : 1]
Output [2]: [CASE WHEN ((turnover#94812008 = NA) OR (turnover#94812008 = null)) THEN null ELSE cast(turnover#94812008 as float) END AS turnover#94812215, CASE WHEN ((turnover#94812008 = NA) OR (turnover#94812008 = null)) THEN null ELSE (1.0 / cast(cast(turnover#94812008 as float) as double)) END AS days_hold#94812278]
Input [2]: [cap#94811977, turnover#94812008]
(6) ColumnarToRow [codegen id : 1]
Input [2]: [turnover#94812215, days_hold#94812278]
(7) CollectLimit
Input [2]: [turnover#94812215, days_hold#94812278]
Arguments: 1000000