Large backups fail

Submitted by soydemadrid on Tue, 03/08/2016 - 13:50 Pro Licensee

Hi I think this may be a bug.

When doing a full (non-incremental) backup with Virtualmin or Webmin over ftp or ssh, the backup fails.

It seems to be when a backup is very big and takes over 1 or 2 days to complete. When this is the case I think the next (incremental backup) must run the next night or before the full one finishes and possibly deletes the files that are being transferred from tmp as the gzip etc over ssh to the backup box??

Here is a thread about this and other user's comments. Thanks for any help.

https://www.virtualmin.com/node/8659

Status: 
Active

Comments

Submitted by andreychek on Tue, 03/08/2016 - 13:59

Howdy -- a few questions about the issue you're seeing... what Webmin and Virtualmin version are you using?

Can you paste in the full backup output that you're receiving?

And lastly, how large is the Virtual Server that you're attempting to backup?

Submitted by JamieCameron on Tue, 03/08/2016 - 19:42

Virtualmin should prevent two backups from running at the same time on the same domain.

However, a backup that takes > 24 hours might be vulnerable to having any temp files that it creates under /tmp/.webmin automatically cleaned up.

Submitted by soydemadrid on Wed, 03/09/2016 - 06:25 Pro Licensee

Hi thanks for the reply. It may be that my temp is getting cleared by an incremental backup before the full one finishes, but it would be better if virtualmin didn't clear the temp until backups completed fully?

On a server such as cloud storage or used by several users the amount of data on a virtual server can change significantly and then backups would keep tripping up without constant monitoring that they can complete which takes the automation out of it quite a lot...

any advice to overcome this? or can a feature be added to not wipe the temp until there are no other backups running?

here is my full output:

Backup failed! See the progress output above for the reason why. Total backup time was 2 days, 2 hours, 42:43 minutes.

Virtual servers that failed :
    domain10
Sent by Virtualmin at: https://svr.server.name:10000

Creating backup for virtual server domain1.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. none defined.

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain1 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 2 minutes, 52 seconds

Creating backup for virtual server domain2.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. done

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying SSL Apache virtual host configuration and certificate ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain2 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 43 seconds

Creating backup for virtual server domain3.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. done

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying SSL Apache virtual host configuration and certificate ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain3 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 25 seconds

Creating backup for virtual server domain4.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. done

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain4 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 1 minutes, 17 seconds

Creating backup for virtual server domain5.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. none defined.

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain5 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 23 seconds

Creating backup for virtual server domain6.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. none defined.

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain6 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 18 seconds

Creating backup for virtual server domain7.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. none defined.

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain7 ..
    .. done

    Backing up Webmin ACL files ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 14 seconds

Creating backup for virtual server domain8.co.uk ..
    Copying virtual server configuration ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying SSL Apache virtual host configuration and certificate ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain8 ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 33 seconds

Creating backup for virtual server domain9.co.uk ..
    Copying virtual server configuration ..
    .. done

    Backing up Cron jobs ..
    .. none defined.

    Copying records in DNS domain ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain9 ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. done

.. completed in 22 seconds

Creating backup for virtual server domain10.co.uk ..
    Copying virtual server configuration ..
    .. done

    Saving mail aliases ..
    .. done

    Saving mail and FTP users ..
    .. done

    Backing up mail and FTP user Cron jobs ..
    .. none to backup

    Copying Apache virtual host configuration ..
    .. done

    Copying Apache log files ..
    .. done

    Copying SSL Apache virtual host configuration and certificate ..
    .. done

    Copying Logrotate configuration ..
    .. done

    Dumping MySQL database domain10 ..
    .. done

    Creating TAR file of home directory ..
    .. done

    Uploading archive to SSH server 192.168.0.2 ..
    .. upload failed! root@192.168.0.2's password:
/home/webmintemp/426161_12111_39_backup.pl: No such file or directory


.. completed in 2 days, 2 hours, 35:18 minutes


    Saving Virtualmin configuration ..
    .. done

    Saving templates and plans ..
    .. done

    Saving email templates ..
    .. done

    Saving custom fields, links, categories and shells ..
    .. done

    Saving custom script installers ..
    .. done

    Saving scheduled backups ..
    .. done

    Saving DKIM settings ..
    .. done

    Saving greylisting settings ..
    .. not installed

    Save mail rate limiting configuration ..
    .. not installed

    Saving mail server configuration ..
    .. done

.. done

thanks again for any help to get this fixed as I could really do to have constant full backups at least 1 per week. Much appreciated.

Submitted by JamieCameron on Wed, 03/09/2016 - 21:31

You can try increasing the temp file deletion threshold, at Webmin -> Webmin Configuration -> Advanced Options.

Submitted by soydemadrid on Thu, 03/10/2016 - 04:18 Pro Licensee

hi thanks for the reply.

ah ok so as my Webmin Options temp file deletion threshold was set to 2 days, possibly this is the cause? I've increased it to 5 days to see if my backups will now complete.

A good option would be that once a backup completes it deletes its own temp files. then we could just have that deletion threshold also on a much longer date like 30 days etc to just clean up bits and bobs that are left over?

Submitted by andreychek on Thu, 03/10/2016 - 09:51

Great, let us know if setting it to 5 days help with the issue.

While the backup process does use /tmp for creating backup archives, it should indeed clean up it's files afterwards.

So what you're describing should work well -- setting a longer date such as 30 days should be no problem.

Submitted by soydemadrid on Mon, 03/14/2016 - 15:04 Pro Licensee

Thank you! I've now put the longer 30 days and this is working well and fixed all my problems! Thanks again.