S3 cloud storage enhancements

After spending a few hours to successfully run S3 cloud replication, I have a few enhancement proposal :

 

- make use of HTTP 301 response code

I have a bucket defined in a specific region (eu-west-3).

While I had easily access to my list of buckets, I couldn't list folders or ever create a new one.

While, some errors were shown on the UI, there was no trace in the log UI.

The error codes provided by the UI weren't helpful.

 

Luckily, I find theses logs with journalctl :

Dec 31 12:25:17 NAS libngcsd[2782]: Encountered S3Error
                                    PermanentRedirect
                                    The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.
Dec 31 12:25:17 NAS readynasd[2782]: E1231 12:25:17.337843 17386 S3ErrorMarshaller.cpp:69] Encountered S3Error
Dec 31 12:25:17 NAS readynasd[2782]: PermanentRedirect
Dec 31 12:25:17 NAS readynasd[2782]: The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.
Dec 31 12:25:17 NAS readynasd[2782]: E1231 12:25:17.342111 17386 libngcsd_s3.cpp:188] { Error type: 318, Exception: PermanentRedirect, Message: The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint., HttpResponseCode: 301, Retryable: 1 }
Dec 31 12:25:17 NAS libngcsd[2782]: { Error type: 318, Exception: PermanentRedirect, Message: The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint., HttpResponseCode: 301, Retryable: 1 }

 

Then, I used custom URL to force new endpoint.

 

- Authorized Symbolic links resolution for synchronisation

My use case is to have a personal folder for each users, being transparently backup in the cloud.

While I effectively created symbolic links, links are not resolves, so files are not replicated.

 

- add all storageClasses in the UI

I wanted ONEZONE_IA, so I had to modify /etc/frontview/cloudstorage/s3.conf file to do it.

 

- add other Amazon regions in the UI