backup failure to S3

Submitted by nicbaxter on Thu, 11/10/2011 - 22:48 Pro Licensee

I have been using s3cmd to backup to a S3 bucket without any problems. When I use the Virtualmin backup utility will the same credentials (access key id & secret access key) I get

Copying Procmail and SpamAssassin configuration files .. .. done

Creating incremental TAR file of home directory .. .. done

Uploading archive to Amazon's S3 service .. .. upload failed! Upload failed : HTTP/1.1 403 Forbidden

Any ideas?

Cheers

Nic

Status: 
Closed (fixed)

Comments

Submitted by JamieCameron on Fri, 11/11/2011 - 12:51

Are you uploading to a bucket that is owned by you? Do you get the same error if you upload to a different randomly-named bucket?

It seems from that error that the cause may be S3 permissions..

Submitted by nicbaxter on Fri, 11/11/2011 - 21:01 Pro Licensee

Hi Jamie

new bucket same thing. It works fine with the AWS console and also with Cloudberry S3 explorer using the same id and yes I am the owner of the buckets. Is it possible to change the logging level for the backup?

In /var/webmin/miniserv.error all I get is

Failed to initialize SSL connection Failed to initialize SSL connection Failed to initialize SSL connection Failed to initialize SSL connection Failed to initialize SSL connection Failed to initialize SSL connection

Should I look somewhere is?

Cheers

Nic

Submitted by JamieCameron on Sat, 11/12/2011 - 00:22

There isn't really any additional logging you can enable for S3 in Virtualmin, sorry.

Could you perhaps post a screenshot of what you are entering on the backup form in Virtualmin?

Submitted by nicbaxter on Tue, 11/22/2011 - 18:01 Pro Licensee

I've found the issue. If I use strftime style time substitutions on file or directory name I get the error. If not it works well. So for the moment I will do with out it but I like the auto-delete. I would appreciate it if you could look at it. Could it be something to do with escaping the % ?

Cheers

Nic

Submitted by JamieCameron on Tue, 11/22/2011 - 18:17

Ok, that could explain it. Does your bucket name or S3 login or password contain a % ?

Submitted by nicbaxter on Tue, 11/22/2011 - 18:32 Pro Licensee

My secret does have several special characters in it but they are handled OK. Since the only thing I changed was strtime then it strongly suggests the virtualmin code escapes those properly but doesn't escape characters in file or folder names? My buckets have no special characters.

Nic.

Submitted by JamieCameron on Wed, 11/23/2011 - 00:32

Does your secret perhaps have % in it? That could trigger the problem, as % is the special strftime character..

Submitted by nicbaxter on Wed, 11/23/2011 - 00:53 Pro Licensee

Jamie I think we are speaking at cross purposes. My secret does have special characters and your code must escape them or nothing would work. I think all secrets have special characters. I'm suggesting that the code that generates file or folder names does not escape the special characters. Cheers Nic

Submitted by JamieCameron on Wed, 11/23/2011 - 10:57

Yes, there is a bug that causes codes like %s in the secret to be converted when strftime substitution is enabled - this will be fixed in the next release. I just wanted to check if % was used in your secret..

Submitted by nicbaxter on Mon, 02/06/2012 - 18:41 Pro Licensee

Any update on this issue?

Cheers

Nic

Submitted by JamieCameron on Tue, 02/07/2012 - 00:17

The just-released Virtualmin 3.90 version has a fix for this bug.

Submitted by Issues on Tue, 02/21/2012 - 00:34

Automatically closed -- issue fixed for 2 weeks with no activity.