Gary McCormack
04/05/2023, 10:44 AMNok Lam Chan
04/05/2023, 10:51 AMGary McCormack
04/05/2023, 10:54 AMmarrrcin
04/05/2023, 10:55 AMGary McCormack
04/05/2023, 10:56 AMNok Lam Chan
04/05/2023, 10:56 AMmarrrcin
04/05/2023, 10:58 AMuser_id
as keys and data as value. Then in catalog, when you use PartitionedDataSet, each key from the returned dict will be saved to a separate fileGary McCormack
04/05/2023, 11:00 AMmarrrcin
04/05/2023, 11:02 AMmultiprocessing.Pool
or concurrent.futures
within the nodeGary McCormack
04/05/2023, 11:02 AM