Error on backup deletion

5 servers backed up successfully, 0 had errors.

Deleting backups from / backup/ds_2sql /% Y_% m_% d on FTP server 213.186.127.197 older than 2 days ..
     Deleting FTP file / backup/ds_2sql/2012_09_12, which is two days old ..
     .. deleted 42.88 MB.

     Deleting FTP file / backup/ds_2sql/2012_09_12.dom, which is two days old ..
     .. FTP deletion failed: DELE / backup/ds_2sql/2012_09_12.dom failed: / backup/ds_2sql/2012_09_12.dom: No such file or directory

     Deleting FTP file / backup/ds_2sql/2012_09_12.info, which is two days old ..
     .. FTP deletion failed: DELE / backup/ds_2sql/2012_09_12.info failed: / backup/ds_2sql/2012_09_12.info: No such file or directory

.. deleted one old backups
================

for now files locATEd at ftp is

2012_09_14.info
2012_09_14.dom
2012_09_14

Status: 
Active

Comments

So does that file / backup/ds_2sql/2012_09_12.dom actually exist on the backup FTP server?

yes all files like
2012_09_14.info
2012_09_14.dom
2012_09_14
all time exist

but when system try to delete them, so this errors happens
(it is repeating errors for 3 month)

===========
backup settings
FTP server ....
File on server /backup/ds_2sql/%Y_%m_%d
Delete old backups Yes, after 2 days

*Do strftime-style time substitutions on file or directory name
*Transfer each virtual server after it is backed up
*Single archive file
* Create destination directory?

Is this a Linux FTP server, or some other operating system?

Also, if you connect using the standard Linux ftp command and then run dir /backup/ds_2sql , what exactly does it output? I am interested to see the FTP directory listing format..

it is debian FTP server with Russian locale

Also , why file names 2012_09_14 but not 2012_09_14.tar.zg (example) ?

============
this is example of ftp connect from debian to debian ftp
============================
Remote system type is UNIX.
Using binary mode to transfer files.
ftp> dir /backup/ds_2sql
200 Команда PORT успешно обработана
150 Открываю режим BINARY данных для file list
-rw-rw-r-- 1 s5backup www-data 45025280 Sep 14 19:55 2012_09_14
-rw-rw-r-- 1 s5backup www-data 29077 Sep 14 19:55 2012_09_14.dom
-rw-rw-r-- 1 s5backup www-data 256 Sep 14 19:55 2012_09_14.info
-rw-rw-r-- 1 s5backup www-data 45056000 Sep 15 17:56 2012_09_15
-rw-rw-r-- 1 s5backup www-data 29077 Sep 15 17:56 2012_09_15.dom
-rw-rw-r-- 1 s5backup www-data 256 Sep 15 17:56 2012_09_15.info
226 Передача завершена
ftp>

The filename doesn't have tar.gz at the end, as you didn't enter that as the backup destination.

However,I have found the underlying cause of this error, and will fix it in the next Virtualmin release. Thanks for your bug report!

Automatically closed -- issue fixed for 2 weeks with no activity.

today installed new virtualmin version
and
that same error
did I need to correct "/backup/ds_2sql/%Y_%m_%d_%H_%M" or this error will be disappeared later ?

5 servers backed up successfully, 0 had errors.

Deleting backups from /backup/ds_2sql/%Y_%m_%d_%H_%M on FTP server 213.186.127.197 older than 2 days ..
Deleting FTP file /backup/ds_2sql/2012_11_04_17_55, which is 2 days old ..
.. deleted 44.47 MB.

Deleting FTP file /backup/ds_2sql/2012_11_04_17_55.dom, which is 2 days old ..
.. FTP deletion failed : DELE /backup/ds_2sql/2012_11_04_17_55.dom failed : /backup/ds_2sql/2012_11_04_17_55.dom: Нет такого файла или каталога

Deleting FTP file /backup/ds_2sql/2012_11_04_17_55.info, which is 2 days old ..
.. FTP deletion failed : DELE /backup/ds_2sql/2012_11_04_17_55.info failed : /backup/ds_2sql/2012_11_04_17_55.info: Нет такого файла или каталога

.. deleted 1 old backups

Are you running Virtualmin 3.95 on the new system?

Virtualmin version 3.94.gpl GPL

We've released version 3.95 just yesterday - you should try upgrading.

released / yes
but there is no updates in virtualmin interface
some days ago there is only I am install update of 3.94 version
how can I check why there is no update for debian ?

On the command line, try typing this command:

apt-get update && apt-get upgrade

After doing that, does it offer to upgrade Virtualmin?

apt-cache show virtualmin-base
Package: virtualmin-base
Priority: optional
Section: misc
Installed-Size: 72
Maintainer: Joe Cooper
Architecture: all
Version: 1.0-30
Depends: webmin (>= 1.534), usermin, webmin-virtual-server, webmin-virtual-server-theme, webmin-virtualmin-dav, webmin-virtualmin-svn, webmin-virtualmin-awstats, webmin-virtualmin-mailman, webmin-virtualmin-htpasswd, usermin-virtual-server-theme, procmail-wrapper, webmin-security-updates, webmin-virtual-server-mobile, usermin-virtual-server-mobile
Filename: dists/virtualmin-squeeze/main/binary-amd64/virtualmin-base_1.0-30_all.deb
Size: 13018
MD5sum: 14bbb89ac9650fead23467dee5965012
SHA1: 828b267310938590b90973c70c2b791b2cc11aed
SHA256: 9d4ed52b696a6a481158cbaf0f15af0655e0606f3c7f9a81ab6ea43570813969
Description: Meta-package that depends on all of the appropriate packages for hosting with Virtualmin.

Package: virtualmin-base
Priority: optional
Section: misc
Installed-Size: 72
Maintainer: Joe Cooper
Architecture: all
Version: 1.0-29
Depends: bind9, spamassassin, spamc, procmail, libnet-ssleay-perl, libpg-perl, libdbd-pg-perl, libdbd-mysql-perl, quota, iptables, openssl, python, mailman, subversion, ruby, irb, rdoc, ri, mysql-server, mysql-client, mysql-common, postgresql, postgresql-client, awstats, webalizer, dovecot-common, dovecot-imapd, dovecot-pop3d, proftpd, webmin (>= 1.346), usermin, webmin-virtual-server, libcrypt-ssleay-perl, webmin-virtual-server-theme, webmin-virtualmin-dav, webmin-virtualmin-svn, webmin-virtualmin-awstats, webmin-virtualmin-mailman, webmin-virtualmin-htpasswd, clamav-base, clamav-daemon, clamav, clamav-data, clamav-freshclam, clamav-docs, clamav-testfiles, libapache2-mod-fcgid, apache2-suexec-custom, scponly, apache2, apache2-doc, libapache2-svn, libsasl2-2, libsasl2-modules, sasl2-bin, usermin-virtual-server-theme, procmail-wrapper, php-pear, php5, php5-cgi, webmin-security-updates, libgd2-xpm, libapache2-mod-php5
Filename: dists/virtualmin-universal/main/binary-amd64/virtualmin-base_1.0-29_all.deb
Size: 13238
MD5sum: fc433d121f6399564cace681bdddfbd6
SHA1: 96ae77e2a21144e5c35591e8db97d2ccb1d984e8
SHA256: 838b33c0fcae388399214aee528b723e5e55b99348d84925cda4050252b7e753
Description: Meta-package that depends on all of the appropriate packages for hosting with Virtualmin.

What is the output of these two commands:

unama -a
grep virtualmin /etc/apt/sources.list

now done manually update through webmin modules
==
but there is that same situation on another server (this problem can be learned)
==
Downloading http://download.webmin.com/download/virtualmin/virtual-server-3.95.gpl.w... (1.78 MB) ..
Received 1024 bytes (0 %)
Received 183 kB (10 %)
Received 366 kB (20 %)
Received 548 kB (30 %)
Received 731 kB (40 %)
Received 913 kB (50 %)
Received 1.07 MB (60 %)
Received 1.25 MB (70 %)
Received 1.43 MB (80 %)
Received 1.61 MB (90 %)
Received 1.78 MB (100 %)
.. download complete.
The following modules have been successfully installed and added to your access control list :

Virtualmin Virtual Servers (GPL) in /usr/share/webmin/virtual-server (12704 kB) under category Servers

<- Return to modules form | Return to Webmin configuration

How did you perform your initial Virtualmin installation -- did you install it using the install.sh script? Or had you performed a manual installation, installing the Virtualmin .wbm module?

instalation done from (approx year ago ) install.sh

Hello,

same problem here: using 4.04.gpl the old backups from Ftp are not being deleted. In addition, no backup logs can be shown.

Settings are the following:

backups/%Y-%m-%d on FTP server server09.storage.hosteurope.de All virtual servers Yes, every day at 0:45 Full Backup

Servers to save All virtual servers

Features to backup Backup all features

Virtualmin settings to also backup all selected

Backup destinations FTP server

FTP server server09.storage.hosteurope.de

File on server backups/%Y-%m-%d

Login as user xxx

with password yyy

Delete old backups Yes, after days 7

Additional destination options

Do strftime-style time substitutions on file or directory name Yes

Transfer each virtual server after it is backed up

Backup format One file per server

Create destination directory? Yes

Action on error Continue with other features and servers

Backup level Full (all files)

Complex Schedule: Every day at 0:45

Thanx for your help! Falko

lulatsch66 - can you post the output from a backup which had purging enabled, but nothing was deleted?

well - I would, if there were backup logs, but none are shown. Where does virtualmin search for the backup logs (in filesystem)?

Perhaps I have to wait overnight for the next scheduled backup and see if a log is written somewhere.

on ftp server, every night a directory with the vhost-Backups is created, in the form 2014-mm-dd, but no deletion after 7 days.

I attach the backup settings file. What means "backup_opts_dir=dirnologs=1,dirnohomes=" ?

Many thanks, Falko

lulatsch66 - did you get an email when the backup completed?

No, there was no mail. The checkbox "only on failure" was set.

What about at Backup and Restore -> Backup Logs?

Nothing - that's why I asked for: Where does virtualmin search for the backup logs (in filesystem)?

I've searched the whole file system - no log file found using

find / -mtime -1

But the vhosts are stored on ftp - old backups are not deleted - and again, no mail.

I could give you access to the host, if you send me public ssh key.

Many thanx, Falko

Looking on another server, I've found that the logs are in

/etc/webmin/virtual-server/backuplogs/

But stopped on Nov 24, 2013. I think this was the date when I checked "Only send email on failure", but I'm not sure. This is now unchecked again, but no mails and no logs.

Remote access would be useful. My SSH public key is :

ssh-dss AAAAB3NzaC1kc3MAAACBALPtrQgus8wMeTrxiQREVKNGK1b8S9MLcsVngXsaNL2IpzHzajjDxEhkxARlpREFdvhPB9XEMa8IYVRmScyYaAMoespibzq1A24kcBQ3iLDrgoTb/UiRxv7c84WhQud1YpbteKpcpfG582wste+3FqkzvQ6pbNcI0Kkuruhb0s+HAAAAFQDDRVRFXdmNFNR+N3D/XwkIAb7hhQAAAIB0GN+AIuA9OonKbJpgoKz3TKhWNf6DAm39y8Zb//zMaK8/Lc1FMpOsNI/R4Y6LPvCJeAyDXuf/5OT3+613xu70bSSUi2g4UXA6RM/PlSUhdEH4XmG8SoB9abaIObU2AkH84Dkf25qVlSRAL/5aU/R7InXk7jJYFD+cz7vau/4jKAAAAIA1keU19UdRAzUKpbHFotBso8UnQzurcoFWNq8YtjkV9x32sjHuatab+mSXvjjSV9VDZ1Ru+6h5q/Vf6tr4yUuAYIo9s9LGA/MQgOVl7k+Dsn6N9UCta8/yoDXPMBbYQoiUJ2sOQ0pCaPeYXH6WTbB9edgxRow8WFQjGW26t6cF5Q== dsa-key-20031024

If there are no backup logs, either the backup still hasn't completed, or it was killed in the middle.

Thank you, instructions sent by mail.

Thanks - I am trying a test backup now.

Ok, I found the issue here - the backup failed due to lack of space on /tmp to dump a copy of one domain's MySQL database.

It looks like /tmp is an in-memory filesystem of some kind that only has 1 GB of space. To avoid this problem, you should configure Virtualmin to use a different directory for temp files, like /var/tmp/.webmin . This can be done at Webmin -> Webmin Configuration -> Advanced Options. Make sure you enter a directory that doesn't exist yet, as it will be used exclusively by Webmin.

Oh well, locking at "advanced options" I see, that I did input a new directory "/var/tmp/backup/" for that - but then forgot, as I didn't know, which module "Backup and Restore" belongs to, see attachment.

So, perhaps "Virtualmin virtual server" will be the right module here? I'll try.

But nethertheless, it seems really strange to me, that in such a case no log is anywhere. I remember, on other servers, the log was written (or sent by mail), and it was clear that there was not enough memory.

thank you very much for your efforts!

Falko

You can select 'Virtualmin Virtual Servers' as the module.

There is a bug in Virtualmin here though - the restore shouldn't silently fail like this, even when you are out of quota. I will fix that in the next release.

Many thanx for your great work, now backup and deletion of old backups work as expected.

Hello Jamie,

deletion of old backups is working now, but not really as expected - read: I'm not really satisfied with it.

Situation is:

  • we have some 10GB of ftp space

  • quota is notifying us at 97%, i.e. 9,87 GB

ATM wie have 2,7 GB for each backup, which means 3 backups are ok.

So I've set "delete old backups after 3 days".

This does not work - why:

  • absolute time of 24 hours is used?

  • deletion of complete backup folder on ftp takes place after successful backup of all vhosts

Let me explain:

My folders are: 2014-01-12 12. Jan 01:18 2014-01-13 13. Jan 01:20 2014-01-14 14. Jan 01:09 2014-01-15 15. Jan 01:09

Why is this? At 15.Jan 01:09, the fourth folder was not older than 3 days, isn't it? So, perhaps the number of folders should be used, or folder name with date variables, to determine the number of old backups.

We don't have soft quota, which would allow storing of full folder and deletion afterwards.

But with hard quota, I'd like to have a possibility (maybe option) to have the oldest backup of a vhost in the oldest folder removed, when it's new backup in the newest folder has been successfully created.

IMHO this shouldn't be much effort, but would allow to store one more day of backups in restricted environments.

Thanx again, Falko

You may want to lower the deletion time to 2 days (or 2.5 days). The reason you are seeing the current behavior is that Virtualmin compares the directory age with the start time of the current backup, and since backups take some time to complete the age of the directory is newer than 3 days ago.

Well, you are right - but then, the possible space can't be really used. If the deletion takes place after the full backup, the space for this full backup is empty and one - normally possible - backup is missing.

So, I've changed to the following workaround: Use %A instead of full date for folder names. E.g. using three days backups - tuesday, friday, saturday, but without deletion - the oldest backup of each vhost is overwritten, and I can have three backups, space is fully used.

Of course, there is another, daily offline backup, but sometimes it would make sense to have a full vhost backup from webmin available instead of only file based backup as usual.