hello, what is the best way to i access credential...
# questionso
Olivier Ho
04/05/2023, 1:22 PMhello, what is the best way to i access credentials during a node run? i saw https://github.com/kedro-org/kedro/issues/575 but
get_current_sessionOlivier Ho
04/05/2023, 1:27 PMi tried to use local parameters with some success
Olivier Ho
04/05/2023, 1:28 PMbut it broke kedro viz (characters length issues), since kedro viz reads the parameters
Olivier Ho
04/05/2023, 1:38 PMok, nvm, i'll use a config loader
d
datajoely
04/05/2023, 1:51 PMso
datajoely
04/05/2023, 1:51 PMwe intentionally make this difficult
datajoely
04/05/2023, 1:51 PMthe Nodes should be pure python functions with no knowledge of IO
datajoely
04/05/2023, 1:52 PMcredentials should be used in datasets and if you really want context and hooks
datajoely
04/05/2023, 1:52 PMwhat are you trying to achieve?
o
Olivier Ho
04/05/2023, 1:53 PMhum, if the nodes should have pure python function then I have some issues
Olivier Ho
04/05/2023, 1:53 PMi have to send some data to an endpoint and get the result resulting in IO
d
datajoely
04/05/2023, 1:53 PMa custom dataset would be the right way to do that
datajoely
04/05/2023, 1:53 PMI think
o
Olivier Ho
04/05/2023, 1:54 PMhum, say for example, i have to send an image to an online processing platform
Olivier Ho
04/05/2023, 1:55 PMi fail to see how to implement such a dataset
d
datajoely
04/05/2023, 1:55 PMhmmm good question
datajoely
04/05/2023, 1:56 PMand that works by doing a
<http://requests.post|requests.post>o
Olivier Ho
04/05/2023, 1:56 PMyes
Olivier Ho
04/05/2023, 1:56 PMthough, it's less complicated since there are python clients that simplies formatting
d
datajoely
04/05/2023, 1:57 PMso that doesn’t fit nicely into our load/save abstraction for our datasets
datajoely
04/05/2023, 1:57 PMI think your current way may be best
datajoely
04/05/2023, 1:57 PMBUT
datajoely
04/05/2023, 1:57 PMwhat I’d do is a
before_pipeline_rundatajoely
04/05/2023, 1:58 PMand then I’d use that env var as the way to pick up the credentials
datajoely
04/05/2023, 1:58 PMfeels neater than loading the config loader
o
Olivier Ho
04/05/2023, 1:58 PMohhhhhhhhhhhhh
Olivier Ho
04/05/2023, 1:58 PMyes
Olivier Ho
04/05/2023, 1:58 PMyou've opened my eyes
Olivier Ho
04/05/2023, 1:58 PMit's indeed more clean
Olivier Ho
04/05/2023, 1:59 PMthank you
d
datajoely
04/05/2023, 2:09 PMkedroid