Pushing files to the s3 bucket before starting a job currently happens serially and cause a long delay, especially when there are more than 10 files to upload.
The tool would be more pleasant to use if uploading files from the input directory happened in parallel
Pushing files to the s3 bucket before starting a job currently happens serially and cause a long delay, especially when there are more than 10 files to upload.
The tool would be more pleasant to use if uploading files from the input directory happened in parallel