after upgrade 5.5

Submitted by akovach on Fri, 05/27/2011 - 01:03 Pro Licensee

After upgrade to 5.5, the system seems to have dropped off the face of the earth. no ssh nothing on port 10000. if i could not use private IP to ssh i would be up a creek.

Any other reports?

Status: 
Closed (fixed)

Comments

Submitted by JamieCameron on Fri, 05/27/2011 - 01:31

I haven't seen any other reports like this, and Cloudmin shouldn't ever touch the network configuration on the master system anyway.

Which variant are you running? GPL, full or physical systems?

Submitted by akovach on Sun, 05/29/2011 - 08:28 Pro Licensee

Full. The only change was 5.5 and now there is no routing at all any ideas on where to look?

Submitted by JamieCameron on Sun, 05/29/2011 - 21:02

What does netstat -rn output on your system?

Also, what does /etc/sysconfig/network-scripts/ifcfg-eth0 contain? It sounds like it may be missing a GATEWAY line..

Submitted by akovach on Wed, 06/01/2011 - 08:40 Pro Licensee

netstat produces all private network

eth0 does not contain a gateway line it is in /etc/sysconfig/network

I have three Identical dell servers all running 5.6 x64 and the now latest kernel 2.6.18-238.9.1.el5xen. so the patch level is the same. The server that runs cloudmin is the only one that has suddenly dropped all outside networking. I see the eth0 interface come up it pings for about 30 seconds and then drops off the face of the earth. Nothing is logged anywhere that I have found. I even have xenbr0 and vif0.x; just no peth0 and no eth0; (if memory servers now that i have been booting in and out of the xen kernel oddly enough ifconfig -a shows all interfaces WOW.

Seems that it has lost its bridge or configuration but at this point I am at a bit of a loss.

Any ideas or further direction would be appreciated.

Submitted by JamieCameron on Wed, 06/01/2011 - 11:38

You might want to try disabling all Xen instances at boot time, just in case one of them is breaking networking somehow when it comes up.

Also, are you running the Xen kernel and tools that come with CentOS 5.6, or packages from another source?

Submitted by akovach on Fri, 06/03/2011 - 15:21 Pro Licensee

disabled all vms all standard kernel and sources Thankfully "xen" instances on this server were in house and non production.

Could not find anything log wise etc purely coincidental that the network dropped off the face of the earth within hours of my updating to CM 5.5. Finally found a single odd log entry:

bnx2: fw sync timeout, reset code = 1030009 which leads me to believe there is some ODD MSI issue with the card that when the bridge is created it just fails and does not log the error.

Finally found a difference in Firmware version on the nics on the troubled machine vs the working xen servers updated the nic firmware and all is happy. Gotta love what we do :P

Please close and Thanks for the help\direction\moral support :)

Submitted by JamieCameron on Fri, 06/03/2011 - 16:14

A network card issue certainly sounds like a possible cause .. I will close this ticket then.