ey01 maintenance – complete

We’ve completed checks of all slices and environments effected by the emergency maintenance on ey01-n01.  If you notice anything amiss, please lodge a support ticket at http://support.engineyard.com/, drop by our IRC channel #engineyard on irc.freenode.net, or call our support line at +1-866-518-9275.

ey01 maintenance – update

Slices are booting now, and are being checked by our app support team as they come up.

ey01 maintenance – update

The node has been checked over and we are booting it now.  Once that is done we will start slices.

ey01 maintenance

We are starting a maintenance on ey01-n01 to clear some node disk corruption.  This node hosts mysql50-1-replica and mysql50-4-master.  The maintenance window is 2 hours, however we will try to keep actual downtime to a minimum.  We will update as the maintenance progresses.

ey01 Emergency Node Reboot Rescheduled

Engineers have stabilized the node and believe there is no risk in waiting until midnight (pdt) to reboot the node.  We will notify you if there is cause to reboot the node sooner.  Thanks.

Emergency Node Reboot ey01 Node 1

Cluster Engineers have observed file system issues with Cluster ey01 Node 1, and will be rebooting the node to check the filesystem immediately.  Database Administrators, Application Engineers, and Cluster Engineers are all on hand.  We apologize for the inconvenience.  We’ll update again once this reboot is completed.

All Clusters – Nagios IO wait check broken

We’ve encountered some packaging issues related to some new Nagios changes that were pushed.  Regrettably these issues did not appear during testing.

During the next 24 hours we will be without this check as we resolve the packaging issue and test the new package(s).  All other Nagios checks appear to be working as intended.

We will update here when everything is resolved.  Thanks for your patience and understanding.

Gateway on EY00 — Resolved

All affected slices have been checked and are verified as being online.

Gateway on EY00

This issue has been resolved. All affected are in the process of being checked to ensure they no longer have an issues.

Gateway on EY00

At this time there appears to be an issue with one of the gateways on ey00. We are working to resolve the issue.