KEDRO - How to specify an arbitrary binary file in catalog.yml?
I'm currently working on a datascience project using LLMs (Large language models). Weights for models usually come in different formats, most frequently .bin or .gguf, and I'd like to keep it that way.
However the only way to store binary files I know is to use type: pickle.PickleDataset like so
test_model: # simple example without compression
type: pickle.PickleDataSet
filepath: data/07_model_output/test_model.pkl
backend: pickle
I'm not okay with that as I want my model files to be...