Lukas Innig
10/09/2023, 1:34 PMDeepyaman Datta
10/09/2023, 1:40 PMPartitionedDataset
? If not, can you provide a bit more context on what you need to do?Lukas Innig
10/09/2023, 3:49 PMDeepyaman Datta
10/09/2023, 3:53 PMPartitionedDataSet
is not right here.
I understand what you're asking now, and it's a fairly common ask (we've lumped it under the name "dynamic pipelines". I think somebody may be looking to share should more fleshed-out thoughts on this soon, but right now there's no "official" best practice on how to do this. Let me ping some part of the maintainer team, to see if anybody can/wants to jump in. 🙂Lukas Innig
10/09/2023, 3:54 PMmarrrcin
10/10/2023, 7:23 AM