https://kedro.org/ logo
#questions
Title
# questions
g

Galen Seilis

12/22/2023, 4:40 PM
I have a use case where a particular data set will not always be available. I came up with three ideas to tackle this. A manual solution is to change the catalog each time its availability changes. Another idea is to have a special type of data set in the catalog that tolerates being missing. It doesn't sound like that is supported: https://stackoverflow.com/questions/76557758/is-there-a-way-to-have-files-in-the-kedro-catalog-that-are-missing A third idea is always have the data set file there but sometimes it will be empty and control flow will handle that, but when it is not empty then it will be processed as normal. Anyway, those were my ideas. What is considered the current state on how to deal with this case?
1
👀 1