RDD Storage Info for *(1) Project [CASE WHEN ((turnover#94385315 = NA) OR (turnover#94385315 = null)) THEN null ELSE cast(turnover#94385315 as float) END AS turnover#94385572, CASE WHEN ((turnover#94385315 = NA) OR (turnover#94385315 = null)) THEN null ELSE (1.0 / cast(cast(turnover#94385315 as float) as double)) END AS days_hold#94385607] +- *(1) Filter ((isnotnull(cap#94385284) AND NOT coalesce(((cap#94385284 = NA) OR (cap#94385284 = null)), false)) AND (cast(cap#94385284 as float) = 0.0)) +- FileScan csv [cap#94385284,turnover#94385315] Batched: false, DataFilters: [isnotnull(cap#94385284), NOT coalesce(((cap#94385284 = NA) OR (cap#94385284 = null)), false), (c..., Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/output/risk_factors/leverage/..., PartitionFilters: [], PushedFilters: [IsNotNull(cap)], ReadSchema: struct<cap:string,turnover:string>

  • Storage Level: Disk Memory Deserialized 1x Replicated
  • Cached Partitions: 1
  • Total Partitions: 1
  • Memory Size: 368.0 B
  • Disk Size: 0.0 B

Data Distribution on 1 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
167.71.162.247:37891 368.0 B (3.4 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

1 Partitions

Page:
Block Name Storage Level Size in Memory ▴ Size on Disk Executors
rdd_3624784_0 Memory Deserialized 1x Replicated 368.0 B 0.0 B 167.71.162.247:37891
Page: