Toni
10/25/2022, 10:35 AMnode(
func = some_function,
inputs = "some_input",
outputs = "the_output",
name = "node",
),
the_output:
type: pandas.CSVDataSet
filepath: data/output_csv.csv
the_output:
type: pandas.ParquetDataSet
filepath: data/output_parquet.parquet
Hamza
10/25/2022, 10:37 AMToni
10/25/2022, 10:39 AMnode(
func = some_function,
inputs = "some_input",
outputs = "the_output@csv" or "the_output@parquet",
name = "node",
),
SQLTableDataSet
) and into an S3 bucket (using the CSVDataSet
, without having to create additional nodes.FlorianGD
10/25/2022, 11:57 AMToni
10/25/2022, 12:00 PMoutput
and output@parquet
)