s3 write speed is too slow - is there a way to speed it up?

66 Views Asked by At

We are moving from NFS to S3 but I am not happy with the write performance.

How can I speed it up ? Are there any configurations to use while moving large files?

Now it's around ~10MB/s vs our regular NFS filesystem 200MB/s ie 20 times slower.

I am curious about the general write performance you guys see on your system.

My observations using s3cmd version 2.1.0:

Put a 4gb tar file on s3 storage shows 8.45 MB/s

upload: '' -> 's3://yetest/backups/si106-251/si106-251.20221219202432.tgz' [part 299, 15MB] 15728640 of 15728640 100% in 1s 8.45 MB/s done

upload: '' -> 's3://yetest/backups/si106-251/si106-251.20221219202432.tgz' [part 299, 15MB] 15728640 of 15728640 100% in 1s 8.45 MB/s done <------ 8.45MB/s

0

There are 0 best solutions below