Hello all! I was wondering if it’s possible to use Kedro with an audio dataset where the files are located in several folders. Can these folders be located outside the 1_raw folder?
i
inco
08/05/2024, 2:34 PM
Maybe try symlinks?
y
Yury Fedotov
08/05/2024, 3:18 PM
• "where the files are located in several folders" - check out partitioned datasets
• "can they be located outside the 1_raw folder" - yes absolutely, you can specify any path. This 01_raw, 03_primary... is just a default template Kedro generates, but in catalog you can specify any path
👍 1
a
Antonio Oliveira
08/05/2024, 3:26 PM
If i read correctly, in partitioned datasets, all files are in the same folder.
y
Yury Fedotov
08/06/2024, 1:03 PM
@Antonio Oliveira yeah you are right. I'm not sure if there's an existing dataset handling files across multiple folders. But if there is, it would probably be partitioned dataset again, with some more complex path and inner dataset type specification.