Hi Kedro team I have a scenario where I need to load a file

Question

Hi Kedro team I have a scenario where I need to load a file from multiple environments and aggregate them What is the best practice for doing so Should I create a custom dataset or are there better ways of doing it

datajoely · Answer

When you say multiple environments want do you mean

saeed choobani · Answer

So i have multiple data catalogs and I have multiple `envs` to access them

datajoely · Answer

ah and you want to bring them together

datajoely · Answer

it s not straight forward

saeed choobani · Answer

a handpicked list of them amp aggregate them in to a single input to my node

datajoely · Answer

intentionally so it s been designed in a way where they are isolated in accordance with the <https 12factor net config|12factor app principles>

datajoely · Answer

I think creating an `aggregate` environment with that sort of thing is the best way to do it

datajoely · Answer

If you want to do this dynamically I think the `after context created` hook you could dynamically play around with things before the catalog is created with the `env` logic applied but it s a bit complicated

saeed choobani · Answer

Thanks for your suggestions I ll look into them raised hands