Hey all,
Is there any way to run the kedro pipeli...
# questionsc
Chandan Malla
09/12/2023, 1:03 PMHey all,
Is there any way to run the kedro pipeline from CLI without being inside the project path. Or change the project path itself?
d
datajoely
09/12/2023, 1:14 PM Copy code
(cd SOME_PATH && kedro run)c
Chandan Malla
09/12/2023, 1:16 PMWhile this works, but does not achieve the objective , as it first goes to project directory and then runs kedro run
Chandan Malla
09/12/2023, 1:19 PMI have defined file path in catalog.yml from particular path let's say
data:
Filepath: API/kedro_model/data/01_raw_input/xyz.csv
Absolute path would be D:/API/kedro_model/data/01_raw_input/xyz.csv
Now I want to run kedro run from D:/API , and not from D:/API/kedro_model
d
datajoely
09/12/2023, 1:21 PMcan you not provide an absolute path in your catalog?
c
Chandan Malla
09/12/2023, 1:21 PMOr if it is possiblle if i can programmatically change my catalog.yml filepath
Chandan Malla
09/12/2023, 1:23 PMSo this is running in production and I am using kedrosession to run my pipelines, and kedrosession is defined outside of kedro project path.
d
datajoely
09/12/2023, 1:36 PMso you can do this with templating
datajoely
09/12/2023, 1:36 PMand switch out the templates based on the environment
datajoely
09/12/2023, 1:39 PMyou could for example do
/${_root_path}/API/...globals.ymlenvsc
Chandan Malla
09/12/2023, 1:40 PMThanks, I have read about it, for the time being I am using kedrosession in a python file as a workaround to run the pipeline as a workaround
Chandan Malla
09/12/2023, 1:41 PMI didn't know about different envs, let me take a look on this also
Chandan Malla
09/12/2023, 1:42 PMGot the env part, this seems more simple. Thanks a lot 🙂🙂
d
datajoely
09/12/2023, 1:42 PM👌
datajoely
09/12/2023, 1:43 PMall of our principles of config stem from the 12factor app