Skip to content

simplify NaN filling in FlashLoader and make it lazy

Muhammad Zain Sohail requested to merge flash-lazy into main

Created by: zain-sohail

After a few attempts with different options, I found that apparently (perhaps recently) multiple files can be loaded directly using read_parquet from dask so if I do that and just perform an ffill on the necessary channels, it works. dask seems to be handling the chunking etc. at least from the tests I did

Merge request reports

Loading