Carlos Bermejo
08/07/2024, 9:50 PMkedro catalog resolve > output_file.yaml
? I want to incorporate it in a function. Thanks!Ravi Kumar Pilla
08/07/2024, 10:01 PMCarlos Bermejo
08/07/2024, 10:07 PMNok Lam Chan
08/08/2024, 10:53 AMCarlos Bermejo
08/08/2024, 6:12 PMfilepaths = [
catalog._get_dataset(dataset_name)._describe()["filepath"]
for dataset_name in datasets
]
catalog_filepath_dict = dict(zip(datasets, filepaths))
This gives me the Posix path. Now the clients can now where to look at when running their tests.Carlos Bermejo
08/08/2024, 6:14 PMdef print_paths(catalog_filepath_dict, file_type: str = "inputs"):
print(f"{len(catalog_filepath_dict)} {file_type.capitalize()} for this pipeline ")
print("")
for file_name, file_path in catalog_filepath_dict.items():
display(file_name)
display(file_path)
print()
It gets run for "inputs" and "outputs"Nok Lam Chan
08/09/2024, 9:49 PMCarlos Bermejo
08/10/2024, 12:41 AM