Right now, my best guess as to how to do it with kedro is to have some kind of DirectoryDataset. When used as an output of a node (the _save() function), it will look into that directory, and transfer its content (using fsspec) to whatever is configured in the catalog. When used as an input, it will take the content of whatever is configured in the catalog, copy it into a temporary directory (using the _load() function), and return a path to that directory