RDD Storage Info for Union :- *(1) ColumnarToRow : +- InMemoryTableScan [fractile#94334079, annual_ret#94334107, annual_resret#94334108, numcos#94334109] : +- InMemoryRelation [fractile#94334079, overall#94334106, annual_ret#94334107, annual_resret#94334108, numcos#94334109], StorageLevel(disk, memory, deserialized, 1 replicas) : +- *(1) Project [CASE WHEN ((fractile#94333959 = NA) OR (fractile#94333959 = null)) THEN null ELSE cast(fractile#94333959 as float) END AS fractile#94334079, CASE WHEN ((overall#94333960 = NA) OR (overall#94333960 = null)) THEN null ELSE cast(overall#94333960 as int) END AS overall#94334106, CASE WHEN ((annual_ret#94333961 = NA) OR (annual_ret#94333961 = null)) THEN null ELSE cast(annual_ret#94333961 as float) END AS annual_ret#94334107, CASE WHEN ((annual_resret#94333962 = NA) OR (annual_resret#94333962 = null)) THEN null ELSE cast(annual_resret#94333962 as float) END AS annual_resret#94334108, CASE WHEN ((numcos#94333963 = NA) OR (numcos#94333963 = null)) THEN null ELSE cast(num...

  • Storage Level: Disk Memory Deserialized 1x Replicated
  • Cached Partitions: 2
  • Total Partitions: 2
  • Memory Size: 648.0 B
  • Disk Size: 0.0 B

Data Distribution on 1 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
167.71.162.247:37891 648.0 B (3.4 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

2 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_3622959_1 Memory Deserialized 1x Replicated 16.0 B 0.0 B 167.71.162.247:37891
rdd_3622959_0 Memory Deserialized 1x Replicated 632.0 B 0.0 B 167.71.162.247:37891
Page: