Kedro is an open-sourced Python framework for creating maintainable and modular data science code.

Kedro

Hi Kedro team,
I’m wondering if it is possible to run the kedro commands in combination with something like <https://github.com/plasma-umass/scalene|scalene> or <https://pypi.org/project/memory-profiler/>
since both kedro and those packages are run with `python -m &lt;module&gt;`?

I guess this depends on what you want to do but you can use `memory-profiler` to track memory profiling in Kedro, using Hooks: <https://docs.kedro.org/en/stable/hooks/examples.html#add-memory-consumption-tracking>

<@U05726Q4PLK> can you try `python -m scalene -m kedro run`?

for the record, I just tested `python -m scalene -m kedro run` and it gave a "program did not run long enough to profile", and `mprof run kedro run` gave a "process no longer exists". it would be good for us to document how to integrate Kedro with these profiling tools. <@U05726Q4PLK> would you like to open an issue in our repository?

Absolutely! Would be great to see such tools be supported with Kedro :+1:

I also got the same results when running it locally initially, so great to see that it occurs on other machines as well