Virtualmin Webmin keeps failing - stops with error Centos 7 - no restart

5 posts / 0 new
Last post
#1 Wed, 06/26/2019 - 12:12
calderwood
calderwood's picture

Virtualmin Webmin keeps failing - stops with error Centos 7 - no restart

I have an new server with Centos 7. Migrated sites from an older Centos 6 server. All is working except Webmin keeps stopping. When it is stopped YUM is also not working. (If I reboot it comes up but stops after a few minutes.) If I restart webmin I get this error:

# /etc/init.d/webmin status
Webmin is stopped
# /etc/init.d/webmin start
/etc/init.d/webmin: line 28: 13198 Segmentation fault      $START > /dev/null 2>&1 < /dev/null

If I run dmesg

# dmesg | tail -30
[19993578.972678] VE265134: no allowed mount options found for device 182:183713

Not sure what this means. Somethings not mounted?

]# /etc/init.d/webmin start
/etc/init.d/webmin: line 28: 15111 Segmentation fault      $START > /dev/null 2>&1 < /dev/null
# /etc/webmin/start
Starting Webmin server in /usr/libexec/webmin
Segmentation fault

If I try a Yum update

#yum update
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Traceback (most recent call last):
  File "/bin/yum", line 29, in <module>
    yummain.user_main(sys.argv[1:], exit_code=True)
  File "/usr/share/yum-cli/yummain.py", line 375, in user_main
    errcode = main(args)
  File "/usr/share/yum-cli/yummain.py", line 184, in main
    result, resultmsgs = base.doCommands()
  File "/usr/share/yum-cli/cli.py", line 585, in doCommands
    return self.yum_cli_commands[self.basecmd].doCommand(self, self.basecmd, self.extcmds)
  File "/usr/share/yum-cli/yumcommands.py", line 505, in doCommand
    ret = base.updatePkgs(extcmds, update_to=(basecmd == 'update-to'))
  File "/usr/share/yum-cli/cli.py", line 1069, in updatePkgs
    self.update()
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 5152, in update
    updates = self.up.getUpdatesTuples()
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 1094, in <lambda>
    up = property(fget=lambda self: self._getUpdates(),
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 838, in _getUpdates
    self._up = rpmUtils.updates.Updates(self.rpmdb.simplePkgList(), self.pkgSack.simplePkgList())
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 1075, in <lambda>
    pkgSack = property(fget=lambda self: self._getSacks(),
  File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 778, in _getSacks
    self.repos.populateSack(which=repos)
  File "/usr/lib/python2.7/site-packages/yum/repos.py", line 347, in populateSack
    self.doSetup()
  File "/usr/lib/python2.7/site-packages/yum/repos.py", line 122, in doSetup
    self.ayum.plugins.run('prereposetup')
  File "/usr/lib/python2.7/site-packages/yum/plugins.py", line 188, in run
    func(conduitcls(self, self.base, conf, **kwargs))
  File "/usr/lib/yum-plugins/fastestmirror.py", line 202, in prereposetup_hook
    all_urls = FastestMirror(all_urls).get_mirrorlist()
  File "/usr/lib/yum-plugins/fastestmirror.py", line 369, in get_mirrorlist
    self._poll_mirrors()
  File "/usr/lib/yum-plugins/fastestmirror.py", line 413, in _poll_mirrors
    pollThread.start()
  File "/usr/lib64/python2.7/threading.py", line 747, in start
    _start_new_thread(self.__bootstrap, ())
thread.error: can't start new thread
Thu, 06/27/2019 - 09:08
calderwood
calderwood's picture

I got rid of the Segmentation message but Webmin still won't start. I run ps auxw | grep miniserv | grep webmin and nothing is running. I run

# /etc/init.d/webmin start
[~]# /etc/init.d/webmin status
Webmin is stopped

Nothing. The server is running and httpd is good. Did I mention the this is a Centos 7 on an OpenVZ server.

David Calderwood - Euro-Pacific Digital Media

Thu, 06/27/2019 - 11:26
calderwood
calderwood's picture

Strange log settings:

# tail /var/webmin/webmin.debug
tail: cannot open ‘/var/webmin/webmin.debug’ for reading: No such file or directory
[ ~]# tail /var/webmin/miniserv.error
[27/Jun/2019:10:06:12 -0400] Using SHA512 module Crypt::SHA
[27/Jun/2019:10:06:12 -0400] Perl module Authen::PAM needed for PAM is not installed : Can't locate Authen/PAM.pm in @INC (@INC contains: /usr/libexec/webmin /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at (eval 14) line 1.
BEGIN failed--compilation aborted at (eval 14) line 1.

[27/Jun/2019:12:22:12 -0400] miniserv.pl started
[27/Jun/2019:12:22:12 -0400] Using MD5 module Digest::MD5
[27/Jun/2019:12:22:12 -0400] Using SHA512 module Crypt::SHA
[27/Jun/2019:12:22:12 -0400] Perl module Authen::PAM needed for PAM is not installed : Can't locate Authen/PAM.pm in @INC (@INC contains: /usr/libexec/webmin /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at (eval 14) line 1.
BEGIN failed--compilation aborted at (eval 14) line 1.

This is in the webmin logs

# tail /var/webmin/webmin.log
1561630803.1732.0 [27/Jun/2019 06:20:03] - - - webmincron webmincron.pl "run" "webmincron" "15612450796253" active='1' arg0='collectinfo.pl' days='*' func='run_cron_script' hours='*' id='15612450796253' mins='0,5,10,15,20,25,30,35,40,45,50,55' module='virtual-server' months='*' user='root' weekdays='*'
1561630873.1769.0 [27/Jun/2019 06:21:13] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561631103.1884.0 [27/Jun/2019 06:25:03] - - - webmincron webmincron.pl "run" "webmincron" "15612450796253" active='1' arg0='collectinfo.pl' days='*' func='run_cron_script' hours='*' id='15612450796253' mins='0,5,10,15,20,25,30,35,40,45,50,55' module='virtual-server' months='*' user='root' weekdays='*'
1561634479.3806.0 [27/Jun/2019 07:21:19] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561644046.10041.0 [27/Jun/2019 10:00:46] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561644054.10054.0 [27/Jun/2019 10:00:54] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561644104.10126.0 [27/Jun/2019 10:01:44] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561644118.10137.0 [27/Jun/2019 10:01:58] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561644372.10303.0 [27/Jun/2019 10:06:12] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'
1561652532.16000.0 [27/Jun/2019 12:22:12] - - - webmincron webmincron.pl "run" "webmincron" "15612450745801" func='cleanup_temp_files' id='15612450745801' interval='3600' module='cron'

David Calderwood - Euro-Pacific Digital Media

Thu, 06/27/2019 - 11:55
calderwood
calderwood's picture

I take it back - segmentation error is back. Unable to get Webmin to start. It is dead as a rock.

# /etc/init.d/webmin start
/etc/init.d/webmin: line 28: 17222 Segmentation fault      $START > /dev/null 2>&1 < /dev/null

David Calderwood - Euro-Pacific Digital Media

Thu, 06/27/2019 - 12:43
andreychek

Howdy,

Segmentation faults like that are usually a sign of something very wrong on the system... some sort of hardware issue, corrupt files, or in the case of a VPS, it could happen due to some sort of resource restriction that's been exceeded... we've seen that with OpenVZ from time to time.

They can be tricky to diagnose, but I might start by verifying that if you're using a VPS, you aren't exceeding the available resources. And then from there, validate the files on the filesystem to ensure nothing is corrupted. If it's a dedicated server, maybe check the RAM, and run some sort of hard drive scan as well.

-Eric

Topic locked