Season Yang
04/27/2023, 4:03 PMipython
and would love to get help from the team. Under the same release 0.18.7 for both kedro and kedro-starter with python 3.8, kedro provides ipython~=8.1
(https://github.com/kedro-org/kedro/blob/main/test_requirements.txt#L22) while kedro-starter’s pyspark restrict ipython>=7.31.1, <8.0
(https://github.com/kedro-org/kedro-starters/blob/main/pyspark/%7B%7B%20cookiecutter.repo_name%20%7D%7D/src/requirements.txt#L3)
Would really appreciate any help on this! Thank you in advance!Juan Luis
04/27/2023, 4:13 PMSeason Yang
04/27/2023, 4:18 PMNok Lam Chan
04/28/2023, 9:20 AMtest_requirements
so kedro shouldn’t complain anything about IPython version.
Once you have created the starter, you are free to change the dependencies as the project evolves.
The CI is running properly, so I don’t expect any thing will fail if you do
kedro new -s pyspark-iris
pip install -r src/requirements.txt
kedro run
``````kedro
, as this is due to a security patch
https://github.com/kedro-org/kedro/pull/2314
Thoughts? I can go ahead to create a ticket for this if there is no disagreement.
Cc: @MerelJuan Luis
04/28/2023, 10:19 AMNok Lam Chan
04/28/2023, 10:36 AMipython~=8.10
-> ipython >= 8.10
? The latest version is 8.12 so practically it doesn’t make any difference at the moment.Juan Luis
04/28/2023, 10:40 AMSeason Yang
04/28/2023, 1:47 PMipython
versions and multiple other external packages we are using in the CI as ipython>=7.31.1, <8.0
is relatively outdated.
In the meantime i also look into the kedro requirements and noticed this discrepancy hence wanted to raise this error and hope we can bump the ipython
in the starterNok Lam Chan
04/28/2023, 3:06 PMSeason Yang
04/28/2023, 5:28 PM