Skip to content

Allow to deactivate the masking of invalid values when loading a source

Simon Conseil requested to merge optim-source into master

This part (self.masked_invalid()) takes ~40% of the total load time for sources with a lot of tables and columns. And for many cases it is useless to do this for every table. So the idea is:

  • add a mask_invalid param, True by default, which allow to deactivate the masking of invalid values.
  • allow to mask invalid values for specific tables afterwards, with src.masked_invalid(tables=[self.mag, ...])

cc @roland.bacon

Merge request reports