Submitted by sespit on Mon, 08/01/2016 - 11:55
Hello,
For some reason, our web server is no longer accepting request on port 80. However, if i specify https, the sites seem to work. I don't know how this happened, but I think it occurred when I removed a website after someone filed a helpdesk ticket that she was receiving an internal error page when she tried to access a site that redirects.
This is really bad as we have about 50 sites hosted on the server!
http://adamlab.sesp.northwestern.edu vs https://adamlab.sesp.northwestern.edu as an example.
Please help!
- Ryan
Status:
Active
Comments
Submitted by sespit on Mon, 08/01/2016 - 11:56 Comment #1
Submitted by andreychek on Mon, 08/01/2016 - 12:33 Comment #2
Howdy -- hmm, it appears to be accepting requests, but it's throwing a 404 error. That suggests that the wrong domain may be responding to requests for that website. That may be due to an Apache configuration issue.
You could try taking a look at the troubleshooting document here, which should help identify what is going wrong there:
https://www.virtualmin.com/documentation/web/troubleshooting#toc-the-wro...
Submitted by sespit on Mon, 08/01/2016 - 12:50 Comment #3
Thanks for the quick response. Per those instructions, somehow Apache is now listening for 80 requests on *.80. Is there a way to change this for all of them?
/etc/apache2/sites-enabled/000-default.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/bestpractices.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.geode.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvaslab.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvasresearchproject.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/conceptual-dynamics.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/covis.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/ct-stem.northwestern.edu.conf: /etc/apache2/sites-enabled/destinlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/ecocasting.northwestern.edu.conf: /etc/apache2/sites-enabled/edtech.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/istar.northwestern.edu.conf: /etc/apache2/sites-enabled/knowledgelens.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/myworldgis.org.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/stevenslab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/wiki.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf:
Submitted by andreychek on Mon, 08/01/2016 - 13:22 Comment #4
Not an easy one unfortunately... it may be easier to change things (at least temporarily) so that they're all using *.80.
What is the output of this command:
grep -i '<virtualhost' /etc/apache2/sites-enabled/*.confSubmitted by sespit on Mon, 08/01/2016 - 13:44 Comment #5
In the interest of time, I went through and changed all of them. I'm not sure how this happened. Where do I change this so that future sites are properly configured?
/etc/apache2/sites-enabled/000-default.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/0-hosting.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/adamlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/analytics.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/arthur.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/artofturningthesoul.northwestern.edu.conf: /etc/apache2/sites-enabled/bestpractices.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.geode.northwestern.edu.conf: /etc/apache2/sites-enabled/calendar.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvaslab.northwestern.edu.conf: /etc/apache2/sites-enabled/colyvasresearchproject.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/conceptual-dynamics.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/covis.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/crm.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/ct-stem.northwestern.edu.conf: /etc/apache2/sites-enabled/destinlab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/distributedleadership.com.conf: /etc/apache2/sites-enabled/ecocasting.northwestern.edu.conf: /etc/apache2/sites-enabled/edtech.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/excite.ctd.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/forms.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/haaselab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk-sesp.apps.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/helpdesk.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/istar.northwestern.edu.conf: /etc/apache2/sites-enabled/knowledgelens.msloc.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/litl.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/mah555.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/models.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/more.northwestern.edu.conf: /etc/apache2/sites-enabled/myworldgis.org.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nextcloud.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/njs199.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/nubio.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/parentingproject.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/pbi.northwestern.edu.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/principalpolicyresearch.org.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/printing.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/rapplab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/redemptiveself.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rlg532.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/rtn361.cloudapps.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/scientificpractices.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/sesdlab.northwestern.edu.conf: /etc/apache2/sites-enabled/stevenslab.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/stream.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/thundarr.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/tqn.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/unixbooks.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/wiki.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf: /etc/apache2/sites-enabled/www-staging.sesp.northwestern.edu.conf:
Submitted by andreychek on Mon, 08/01/2016 - 14:28 Comment #6
Oh my apologies, you did share that output above, but Drupal mangled it, so I didn't realize that's what you pasted in there.
Let's start here before we get into what might have caused that -- did that solve your problem?
Submitted by sespit on Mon, 08/01/2016 - 14:56 Comment #7
It did, thanks. All the websites are responding on 80 and 443. I feel like this might have happened when I was migrating one of the last sites from our old Virtualmin instance on CentOS 7 to our new instance on Ubuntu 16.
Submitted by sespit on Mon, 08/01/2016 - 19:39 Comment #8
So how do I change Virtualmin to ensure that websites are put on the correct IP address and not the wild cart *.80?
Submitted by andreychek on Mon, 08/01/2016 - 20:07 Comment #9
I've been reviewing your output above to try and figure out why this happened in the first place.
Normally, Virtualmin would look at the first (default) domain you have there, and use it to determine how to add the additional domains.
But so far as I can tell, all but one of the domains was using *:80, and the one that didn't have that wasn't the default domain. However, I suppose it's possible that somehow that one was where the requests were being directed to.
Having them all using *:80 can work, they would just all need to be set that way.
Now that all the domains have been corrected, and use the same format, all new domains would be added with that same format.
What I'm curious about is how things got mixed up though... were any domains recently imported?
In particular, I'm curious about the "colyvasresearchproject.sesp.northwestern.edu" domain. Is that a newly added one?
Submitted by sespit on Tue, 08/02/2016 - 06:59 Comment #10
Yes, I feel like someone that domain was the culprit! Because all port 80 domain requests defaulted to the URL, which was the very last domain to migrated from our old Virtualmin instance. I used the Virtualmin backup function on the previous server to send all the domains over to the new one, a few at a time.
Submitted by andreychek on Tue, 08/02/2016 - 09:21 Comment #11
Were your other domains migrated in a similar way, all around the same time?
Also, have you completed migrating domains to Virtualmin?
Submitted by sespit on Tue, 08/02/2016 - 09:39 Comment #12
I migrated all of them in chunks using the ssh backup function in Virtualmin. The scp'd the tar file over to /tmp/sitenames.tgz as an example. All of the websites have now been migrated from Centos 7 to Ubuntu 16. Could that have caused the issue?
Submitted by andreychek on Tue, 08/02/2016 - 10:10 Comment #13
Jamie, this is all working now, but just a quick question --
sespit had migrated all his domains, by importing backups from another server to this one.
All were using a VirtualHost format of *:80 in the Apache config, except for the last one to be imported, which instead used x.x.x.x:80.
Do you have any thoughts as to what might have triggered that one domain to use a different VirtualHost format?
Submitted by JamieCameron on Tue, 08/02/2016 - 23:26 Comment #14
That is odd ... unless it was on a different IP from the other domains (or a private IP) ?