Aspen Olszewska
03/21/2024, 2:47 PMs3fs
(s3_additional_kwargs
, specifically ServerSideEncryption
and SSEKMSKeyId
). I can't figure out where in a Data Catalog entry that should go: save_args
, fs_args
or as s3_additional_kwargs
directly? Does anyone know the proper format? There's no information about it in the docs.datajoely
03/21/2024, 2:51 PMfs_sargs
We have some docs here, but it could be clearer
https://docs.kedro.org/en/stable/data/data_catalog.html#load-and-save-argumentsAspen Olszewska
03/21/2024, 2:51 PMdatajoely
03/21/2024, 2:54 PMdatajoely
03/21/2024, 2:54 PMdatajoely
03/21/2024, 2:54 PMmy_dataset:
type: pandas.CSVDataSet
filepath: s3:/xxxxx.csv
versioned: false
load_args:
engine: c
fs_args:
s3_additional_kwargs:
ServerSideEncryption: "aws:kms"
sse-kms-key-id: ${credentials.sse-kms-key-id}
datajoely
03/21/2024, 2:55 PMAspen Olszewska
03/21/2024, 2:56 PM