Recent Updates & Network Notifications


 

cpanel04 Reboot

posted February 6 2012 10:57 am EST
cPanel server cpanel04 is rebooting now as it has just become unresponsive; thanks for your patience. We expect to have this server back online shortly.

Update 12pm: This server is requesting a filesystem check to confirm the integrity of all data; we are performing this check now and expect to have the server back online within the hour. Thanks for your continued patience.

Update 12:22pm: The filesystem check is complete and the server is booting up now. Thanks again for your patience and we do not expect any further issues with this server.

Update 12:30pm: The server is now fully back online. Thanks!

Sphera VDS Power issues

posted February 1 2012 02:42 pm EST
We are currently working on issues with the power distribution unit that supplies some of the backend storage for our Sphera VDS servers. During this time you may experience periods where the servers are not accessible. We are working to ensure that this interruption in service will be as short as possible.

Update 4:09pm: We have resolved this unexpected power issue and are bringing up all Sphera backend storage servers now; these servers will be back online shortly. Thanks for your patience.

Update 4:33pm: All servers are now back online. Thanks again for your patience; we do not expect any further issues.

Update 4:56pm: One of the backend storage machines (used to serve sd06 through sd11) is reporting filesystem errors; we are quickly rebooting this machine to perform a filesystem check - we appreciate your patience.

Update 6pm: Intensive filesystem checks are still running; once these complete, all VDS accounts will be back online. Thanks for your patience and we expect the sites to be back online within the next 30 minutes.

Update 7pm: VDS accounts are starting now. Thanks!

Update 10pm: We've encountered another filesystem error on this server and are going to perform a replacement and quick filesystem check as a pre-emptive measure. We apologize for the extended downtime but rest assured we are working on this issue, and the continued performance of the server, as our top priority.

Update 2:30am: The VDS accounts are starting now. Thank you!

cp50 Reboot

posted February 1 2012 04:48 am EST
At this time cPanel server cp50 is going down for a reboot as it has become unresponsive.

UPDATE 5:52AM: The server is now back up and online. 
UPDATE 9:00AM: We are bringing this server back down for emergency maintenance. We are working to bring this back up as soon as possible.
UPDATE 10:00AM: All integrity checks are complete and service is restored.

cpanel02 Maintenance

posted January 30 2012 10:22 am EST
We are currently performing emergency maintenance on cPanel server cpanel02; the server is being rebooted for a quick filesystem check and should be back online in a few minutes. Thanks for your patience.

Update 11:40 The server is now back online.

cpanel04 network issues

posted January 29 2012 08:29 pm EST
cPanel server cpanel04 is currently experiencing extreme latency and packet drops causing service interruption. Diagnosis is ongoing; we apologise for the inconvenience.
Update 11:30 EST: The machine went fully unresponsive and had to be rebooted. The machine is back up and we are monitoring it closely. Thank you for your patience.

PS06 Mail Downtime

posted January 28 2012 10:35 am EST
We are currently rebuilding the mail database on this server which can take some time but should resolve any outstanding mail issues. During this time, we have stopped the flow of mail so that messages will queue up on the sending server (instead of possibly bouncing back). This means that all mail should be delivered but you may notice a mail delay or issues sending while the process is running. Thank you for your patience.

Update 12:56PM: Mail service has now returned to normal.

cpanel05 Reboot

posted January 27 2012 08:53 am EST
At this time we are performing a quick reboot of cPanel server cpanel05 to run a check on it's onboard RAID controller; we expect this to take about 15 minutes. Thanks for your patience!

Update 10:15am: This server is back online. Thanks!

Update 1:40pm: Disk IO on this server remains unusually high; we are going to perform a quick filesystem check which should resolve this. Thanks for your patience.

Update 2:00pm: The filesystem check is in progress now and should be completed within the hour. Thanks for your continued patience as we work to restore full performance to this server.

Update 2:45pm: At this time all services have been restored and everything appears to be functioning properly.  We appreciate your patience in this matter!

Update 4:30pm: We are now experiencing IO performance degradation again. At this time we are shutting the server down and will be moving its drives to a replacement server to remedy any hardware-related issues. We apologize for the long delays and feel confident that this final maintenance will resolve this issue permanently. Thank you for your continued patience.

Update 5:30pm: The server is coming back online now in a brand new chassis with a new RAID controller and all sites should be back online shortly. Thanks again for your patience.

Update 6:10pm: We have been watching this server for the past 40 minutes and not seen any unusual issues - load has stayed low and disk I/O is normal. This issue is now resolved. Thank you!

Nameserver Interruption

posted January 25 2012 08:27 am EST
At approximately 8am and lasting for a few minutes we experienced an interruption in our UDP traffic to our nameservers. This interruption could have caused longer than normal delays in resolving DNS queries. This issue was resolved quickly but we are working with our upstream providers to verify that no further issues arise. Thanks for your patience and please do not hesitate to submit a support ticket if you note any unusual DNS related issues.

sd48-52 Emergency Maintenance

posted January 21 2012 09:47 pm EST
At this time we are experiencing issues with the shared storage backend for Sphera servers 48-52. We are working to have this issue resolved as soon as possible and appreciate your patience. Thank you.

Update 11:39pm EST: At this time all service should be restored.

CP45 Reboot

posted January 21 2012 09:09 am EST
At this time cPanel server cp45 is going down for a reboot as it has become unresponsive.

Update 10:31AM: The server is currently processing a file system check. We expect this to take around 30 minutes to complete.
Update 11:19AM: All services have returned to normal!