RDD Storage Info for Union :- *(1) ColumnarToRow : +- InMemoryTableScan [fractile#94391017, annual_ret#94391024, annual_resret#94391105, numcos#94391106] : +- InMemoryRelation [fractile#94391017, overall#94391018, annual_ret#94391024, annual_resret#94391105, numcos#94391106], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN ((fractile#94390930 = NA) OR (fractile#94390930 = null)) THEN null ELSE cast(fractile#94390930 as float) END AS fractile#94391017, CASE WHEN ((overall#94390931 = NA) OR (overall#94390931 = null)) THEN null ELSE cast(overall#94390931 as int) END AS overall#94391018, CASE WHEN ((annual_ret#94390932 = NA) OR (annual_ret#94390932 = null)) THEN null ELSE cast(annual_ret#94390932 as float) END AS annual_ret#94391024, CASE WHEN ((annual_resret#94390933 = NA) OR (annual_resret#94390933 = null)) THEN null ELSE cast(annual_resret#94390933 as float) END AS annual_resret#94391105, CASE WHEN ((numcos#94390934 = NA) OR (numcos#94390934 = null)) THEN null ELSE cast(num...

  • Storage Level: Disk Memory Deserialized 1x Replicated
  • Cached Partitions: 2
  • Total Partitions: 2
  • Memory Size: 648.0 B
  • Disk Size: 0.0 B

Data Distribution on 1 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
167.71.162.247:37891 648.0 B (3.4 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

2 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_3625119_1 Memory Deserialized 1x Replicated 16.0 B 0.0 B 167.71.162.247:37891
rdd_3625119_0 Memory Deserialized 1x Replicated 632.0 B 0.0 B 167.71.162.247:37891
Page: