RDD Storage Info for *(1) Project [CASE WHEN ((sector_id#94160398 = NA) OR (sector_id#94160398 = null)) THEN null ELSE cast(sector_id#94160398 as int) END AS sector_id#94160418, CASE WHEN (sort#94160399 = null) THEN null ELSE sort#94160399 END AS sort#94160419, CASE WHEN (description#94160400 = null) THEN null ELSE description#94160400 END AS description#94160423, CASE WHEN ((universe#94160401 = NA) OR (universe#94160401 = null)) THEN null ELSE cast(universe#94160401 as int) END AS universe#94160424] +- FileScan csv [sector_id#94160398,sort#94160399,description#94160400,universe#94160401] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(1 paths)[file:/srv/plusamp/data/default/ea-market/curate/curate_sector.csv], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<sector_id:string,sort:string,description:string,universe:string>

  • Storage Level: Disk Memory Deserialized 1x Replicated
  • Cached Partitions: 1
  • Total Partitions: 1
  • Memory Size: 896.0 B
  • Disk Size: 0.0 B

Data Distribution on 1 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
167.71.162.247:37891 896.0 B (3.4 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

1 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_3616126_0 Memory Deserialized 1x Replicated 896.0 B 0.0 B 167.71.162.247:37891
Page: