command to import datasets from a path into my data directory in the project? Thanks!
01/19/2023, 12:57 PM
it’s possible to do via hooks, but we believe this pattern is a blocker to reproducibility
01/19/2023, 1:50 PM
what about something that copies the files to
and creates some basic config files? (I think this is more in line with what @Juan Marin had in mind, correct me if I'm wrong Juan)
01/19/2023, 2:10 PM
Yeah, my idea was a command which you give a path for a certain file (eg reviews.csv in my downloads folder) and it will add it to your catalog.yml with its corresponding type and a specified filepath (eg: data/01_raw) where the data will also be added