Access Kedro MemoryDataSet when running packaged Kedro pipeline in a script
I want to be able to access a MemoryDataSet results dataframe from a kedro pipeline that I've imported into a script after packaging the pipeline into a python package.
I have a kedro pipeline written and run using Kedro=0.18.9 that collects data, modifies it, then runs it against several anomaly detection algorithms. The pipeline loads from a database, saves all intermediate data (preprocessing, etc.) and results to CSVs at every step of the pipeline. It also returns the results of the...