Small question, is there any dataset that is glob compatible? For example, if I have a folder of images.

There sure is! https://docs.kedro.org/en/stable/kedro.io.PartitionedDataSet.html

thanks! I forgot about the partioned dataset!

it was built with this usecase in mind