Hey all. I'm trying to use the kedro-sagemaker package and to get a better understanding of it just follow the steps outlined in the tutorial where they run the kedro tutorial spaceflights on AWS sagemaker. But I'm getting the below error. Has anyone else encountered this issue before? It looks to me like it's reading in the parameters specified under local instead of base which is weird but have not done anything different from the tutorial. Thanks! Kedro Sagemaker Error:

ValidationError: 1 validation error for KedroSageMakerPluginConfig

__root__

KedroSageMakerPluginConfig expected dict not NoneType (type=type_error)

Someone will reply to you shortly. In the meantime, this might help:

Would you be able to help with this @Artur Dobrogowski or @marrrcin ?

Honestly I haven't touched this plugin, but I'll take a look in the evening

Looks like the config is missing

I think it's a known issue. https://github.com/getindata/kedro-sagemaker/issues/16 I think kedro >= 0.18.4 uses the OmegaConfigLoader which is not compatible with kedro-sagemaker == 0.3.0. But I don't think the kedro-sagemaker package was ever updated to deal with this issue

Yes, it's lagging behind in updates

Yeah annoying as it's a super useful plugin. Will have to play around with the package and can see if I can make it work for newer versions of kedro.

Sorry it has been an annoying experience. We're currently discussing how to best maintain the plugins. There's a big number of them and there's a stretch on capacity from the core team as well as the original creators. Any contributions you can add are very much appreciated 🙏 (cc: @Juan Luis for visibility)

Go ahead Zubin, I'll review & merge it for you if you make it

Sounds good. To be clear the changes I think I would make would be to the plug-in (kedro-sagemaker) not to the Kedro package as that seems like the more logical thing to do to me. Unsure if you guys are across that as well as appreciate it's not a kedro-org repository.

@Zubin Roy Artur is part of Get In Data, the team who built the plugin 🙂 I'm part of the core Kedro team, but happy to help where I can!

Hey @Artur Dobrogowski. Do you know does the kedro-sagemaker plugin support the creation of multi-architecture Docker images or does it default to whatever your local machine is using?

As far as I remember it does not include docker image, we relied on custom dockerfiles or kickstarting with kedro-docker. In general I wanted a sample docker img that would have multi stage build, one for dependencies only & download code from github via git and another one with code embedded.

Hey @Artur Dobrogowski. HNY! I've made a PR which resolves the above issue and should make the plugin work for kedro > 0.18.4 onwards. I would appreciate if you're able to review it and let me know if any changes need to be made. I could not add you directly as a reviewer to the PR for some reason but here's a link to it > https://github.com/getindata/kedro-sagemaker/pull/22 Hopefully will enable this cool plugin to carry on being used by people 🙂

Yay 🥳 I'll try to get to it by the end of the week

No worries at all!