Higor Carmanini
02/19/2024, 10:23 PMJuan Luis
02/19/2024, 10:29 PMJuan Luis
02/19/2024, 10:30 PMJuan Luis
02/19/2024, 10:36 PMDataCatalog would be nice, but without OmegaConfigLoader it wouldn’t support dataset factories, custom resolvers etc.Higor Carmanini
02/19/2024, 10:38 PMJuan Luis
02/20/2024, 7:15 AMJuan Luis
02/20/2024, 7:15 AMNok Lam Chan
02/20/2024, 12:49 PMFor our use case, only the DataCatalog part is relevant - nothing about the nodes, pipelines or orchestration. So I'm thinking this might help us avoid additional dependencies.
For some reason, some clients also don't like and/or accept Kedro as well 🤔Would having
kedro[catalog] helps in this case? This is the core dependency of kedro and there is not much heavy dependencies. Maybe dynaconf, omegaconf (if you don't need config loader), and toposort are not required with data catalog.
dependencies = [
"attrs>=21.3",
"build>=0.7.0",
"cachetools>=4.1",
"click>=4.0",
"cookiecutter>=2.1.1,<3.0",
"dynaconf>=3.1.2,<4.0",
"fsspec>=2021.4",
"gitpython>=3.0",
"importlib-metadata>=3.6,<8.0; python_version >= '3.8'",
"importlib_resources>=1.3,<7.0", # The `files()` API was introduced in `importlib_resources` 1.3 and Python 3.9.
"jmespath>=0.9.5",
"more_itertools>=8.14.0",
"omegaconf>=2.1.1",
"parse>=1.19.0",
"pluggy>=1.0, <1.4.0",
"pre-commit-hooks",
"PyYAML>=4.2,<7.0",
"rich>=12.0,<14.0",
"rope>=0.21,<2.0", # subject to LGPLv3 license
"toml>=0.10.0",
"toposort>=1.5", # Needs to be at least 1.5 to be able to raise CircularDependencyError
]