Submitted by hescominsoon on Wed, 03/13/2019 - 21:03 Pro Licensee
I have been using BackBlaze B2 to store backups of my non virt servers and it rocks. I request virt add B2 support as a backup destination. They ahve an API, and they are much cheaper than any of your other listed cloud storage providers. If you'd like i can find the api...but i am not a developer..:)
Status:
Fixed (pending)
Comments
Submitted by hescominsoon on Wed, 03/13/2019 - 21:11 Pro Licensee Comment #1
btw for ubuntu operating systems you could leverage Duplicati 2.0 which is already present in the base packages of the distros IIRC.
Submitted by JamieCameron on Sat, 03/16/2019 - 15:03 Comment #2
Do they have a command-line tool as well, or just a published HTTP API?
Submitted by hescominsoon on Sat, 03/16/2019 - 16:55 Pro Licensee Comment #3
https://www.backblaze.com/b2/docs/quick_command_line.html
Submitted by hescominsoon on Sat, 03/16/2019 - 16:56 Pro Licensee Comment #4
https://www.backblaze.com/b2/docs/versions.html
Submitted by JamieCameron on Sat, 03/16/2019 - 20:32 Comment #5
I'll look into this - it's certainly possible to implement.
Submitted by hescominsoon on Wed, 06/05/2019 - 06:55 Pro Licensee Comment #6
has this been implemented?
Submitted by JamieCameron on Wed, 06/05/2019 - 17:31 Comment #7
Not yet, sorry.
Submitted by hescominsoon on Fri, 06/07/2019 - 06:43 Pro Licensee Comment #8
Any timetable?
Submitted by andreychek on Fri, 06/07/2019 - 08:50 Comment #9
Sorry, we unfortunately don't have an ETA.
I was just about to provide an example of how to use Duplicity in the meantime until we're able to add feature into Virtualmin, but reading your comments above it sounds like you're already quite familiar with that.
That would be my recommendation for now, to use Duplicity from cron until that feature is completed.
Submitted by hescominsoon on Sun, 06/23/2019 - 07:57 Pro Licensee Comment #10
no worries. I have a workaround in place that doesn't involve going outside of virt(experience has taught me going outside of virt leads to bad things with virt). I make heavy use of the current backup feature so I found a different way. However once B2 is directly implemented it will allow me to greatly reduce my complexity in the hosting backend..:)
I just use rclone to copy the entire contents of the backup directory to Backblaze as a post-backup command (using the Virtualmin backup GUI). It hasn't failed yet.
Submitted by hescominsoon on Thu, 08/01/2019 - 14:42 Pro Licensee Comment #12
TECHNICALLY i already am. however it would be nice for virt to be able to do it directly. However the system i have setup gives me my three layer backup system for my webhosting clients so it's not a huge priority for me at the moment..:)
I think I have seven-day retention set up on that bucket. I forget offhand. It's so cheap, it doesn't pay NOT to be redundant about it.
Submitted by christefano on Fri, 02/21/2020 - 14:29 Pro Licensee Comment #14
I’d love to see support in Virtualmin for other S3 API-compatible storage services like B2, SwiftStack, Eucalyptus, Scality, Wasabi, etc..
This has been requested in other posts, e.g.:
VirtualminPro BackBlaze B2 Cloud Storage
https://www.virtualmin.com/node/67311
Add Support for Backblaze B2 Cloud Storage
https://www.virtualmin.com/node/52481
Amazon S3 Compatible Alternative
https://www.virtualmin.com/node/22964
Submitted by JamieCameron on Fri, 02/21/2020 - 23:07 Comment #15
Virtualmin should work with S3-compatible APIs already.
Submitted by andreychek on Fri, 02/21/2020 - 23:15 Comment #16
To use an S3 compatible backup, you can go into Backup and Restore -> Cloud Storage Providers -> Amazon S3, and there, select the "S3-compatible server hostname", and add in the correct hostname offered by your provider.
That being said, I didn't think Backblaze was S3 compatible.
However, you can use the above with any service offering S3 compatible backups.
Backblaze B2 isn't S3 compatible. They have their own API, and there are many third-party software packages that can interface with it. I find rclone to be the fastest and easiest to implement if one has a passing acquaintance with the terminal, but there are others.
I run rclone as a post-backup command and it's been working flawlessly for seven months. Running it as a post-backup command also means that Webmin waits until the remote transfer is completed before sending the confirmation email and reports the total time rather than just the local backup time, which is good because I know that the entire job has completed successfully.
The big advantage to Backblaze for server backup is that uploads are inexpensive. Downloads, not so much; but they're not so expensive that you have to worry about taking out a loan if you ever need to use one. They're also reliable, which is why I can't comment on their support (I've never needed it). They're pretty ideal for server backup because you can store absurd numbers of versions quite inexpensively.
In summary, yes, I think Backblaze would be a worthy addition to the Webmin remote destination options. If my Perl didn't suck so much, I might just code it myself. But rclone is an easy-to-use, free alternative that also works well and takes about five minutes to install and configure. But B2 is not S3 compatible.
Maybe someone who actually knows what they're doing in Perl can start with rclone and write a GUI wrapper specific to Backblaze B2, and there would be your integration.
Richard
Submitted by christefano on Sat, 02/22/2020 - 17:22 Pro Licensee Comment #18
Thanks for the writeup, Richard! I’m glad to know B2 isn’t S3-compatible. I guess I just assumed that.
andreychek, I had no idea I could change the hostname under
Backup and Restore->Cloud Storage Providers! Thanks for the info.Submitted by christefano on Tue, 05/05/2020 - 13:45 Pro Licensee Comment #19
FYI, Backblaze now has S3-compatible cloud storage:
https://www.backblaze.com/b2/cloud-storage.html
Submitted by hescominsoon on Wed, 05/20/2020 - 17:56 Pro Licensee Comment #20
Submitted by hescominsoon on Wed, 05/20/2020 - 17:57 Pro Licensee Comment #21
backblaze now has S# api for itself.
Submitted by rpereyra on Fri, 05/29/2020 - 15:52 Comment #22
Hi
Good news !
https://www.backblaze.com/blog/backblaze-b2-s3-compatible-api/
Please add B2 support !!
thanks
roberto
I've been using rclone to back up to B2, and because it works fine, I'll probably leave it that way until it no longer does. This is still a good thing, though. It's easier to set up an S3 connection than to set up rclone.
https://www.virtualmin.com/comment/822987#comment-822987
Submitted by sgrayban on Wed, 09/02/2020 - 02:15 Comment #25
Starting backup of 1 domains to Amazon S3 bucket virtualmin-backups ..
Failed to list S3 buckets : The V2 signature authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256
This is what I get when I try the custom url for backblaze....
That's a bit bizarre. I believe that's the error one would get when trying to use the AWS V2 signature version to access a bucket in an endpoint that only supports V4. I have no idea why you'd get it trying to access Backblaze unless they're trying to emulate AWS region-per-region.
Richard
Submitted by hescominsoon on Wed, 09/02/2020 - 07:55 Pro Licensee Comment #27
Backblaze only supports v4 of the api. https://help.backblaze.com/hc/en-us/articles/360047425453-Getting-Starte...
Ah, okay. That makes sense.
I don't see that option in the Virtualmin > Backup and Restore > Cloud Storage Providers > Amazon S3 dialogue. Is V4 the default?
Just curious, mind you. I'm still happily using rclone sync.
Richard
Submitted by hescominsoon on Wed, 09/02/2020 - 08:11 Pro Licensee Comment #29
no idea..i have virt sending its backups to an offsite FreeNAS machine that then uploads to B2...:)
Nice!
Submitted by sgrayban on Wed, 09/02/2020 - 14:26 Comment #31
This is so disappointing.... wish they would add B2 to its backup sources.
Submitted by JamieCameron on Fri, 09/04/2020 - 12:50 Comment #32
How would you feel if the backblaze backups were done by Virtualmin calling their shell command : https://www.backblaze.com/b2/docs/quick_command_line.html
Submitted by sgrayban on Fri, 09/04/2020 - 13:05 Comment #33
If it works that's fine Jamie.
Submitted by JamieCameron on Sat, 09/05/2020 - 14:29 Comment #34
Ok - support for backups to backblaze is in progress
Submitted by sgrayban on Sat, 09/05/2020 - 14:43 Comment #35
Awesome!! Thanks so much Jamie :)
Submitted by sgrayban on Sat, 09/05/2020 - 14:45 Comment #36
Changed status to active
Submitted by JamieCameron on Sat, 09/12/2020 - 00:09 Comment #37
Ok, after several days of hacking this is done for inclusion in the next release.
If anyone wants to beta test it now, please let me know.
Submitted by sgrayban on Sat, 09/12/2020 - 02:18 Comment #38
I would
Submitted by JamieCameron on Sat, 09/12/2020 - 14:54 Comment #39
Ok - which Linux distro are you running there?
Submitted by sgrayban on Sat, 09/12/2020 - 17:53 Comment #40
Debian
Submitted by JamieCameron on Sun, 09/13/2020 - 20:00 Comment #41
Ok, I send a module debian package to you via email
Submitted by sgrayban on Sun, 09/13/2020 - 21:19 Comment #42
Shoot -- you have the virtualmin GPL verson with this or is it going to be a Pro option only?
Looks like you missing the Endpoint setting which BackBlaze requires.
Submitted by JamieCameron on Mon, 09/14/2020 - 00:17 Comment #43
Likely pro-only for now.
What Endpoint setting are you referring to?
Submitted by sgrayban on Mon, 09/14/2020 - 01:33 Comment #44
Damn... I installed this on a GPL install...
When you create a bucket BB also gives you the S3 Endpoint to use EG; S3 Endpoint: s3.us-west-002.backblazeb2.com
Submitted by websitemaster on Mon, 10/12/2020 - 08:40 Pro Licensee Comment #45
@JamieCameron: i would be very happy if i could have the beta test for backblaze b2.
You can do it by updating the following files and restarting Webmin.
https://raw.githubusercontent.com/virtualmin/virtualmin-gpl/master/cloud... https://raw.githubusercontent.com/virtualmin/virtualmin-gpl/master/backu...