Information Regarding Outage from Provider

“Hello,
We are still investigating this issue with Equinix. We have Escalated to our NOC Management and Senior Engineers. Equinix is trying to locate if this was caused by their maintenance at the X, Y, and Z facilities. We are located at the C facility so should not have been effected.
As these circuits have been stable for some time now we are not confident that the issue is resolved with out determining the root cause. We will provide further updates as we gather more information.”

“Hello,
We have learned through extensive conversation with Equinix engineers that this was indeed the result of their Maintenance mentioned below. NOC Management is aware of this situation and will distribute an official RFO within 10 business days.
We apologize for the delays in discovering this information. And do not expect further incidents as the maintenance window closed at 04:00 EDT.”

(Engine Yard redacted locations above for safety reasons.)

ey03 and ey04 network issue #2 over

We apologise for the second outage within the hour. We experienced the same issue with our network provider having a problem upstream.

We are looking into this issue and will update you as soon as we can.

ey03 and ey04 network issue reoccurence

We seem to be experiencing a network issue again for ey03 and ey04.

We’ll update you as soon as we have more information.

We apologise for the inconvenience and downtime caused.

ey03 and ey04 network issue resolved

We believe the issue is now resolved. We believe an upstream provider had an issue and we’re investigating it further.

If you were affected by the downtime we apologise. You should expect an email in the coming day with regards to the brief outage.

ey03 and ey04 network issues

We’re currently experiencing what we believe to be network issues with ey03 and ey04.

We hope to update you shortly with the cause.

Possible Network Issues (Resolved)

We received confirmation from our CA data center that XO Communications was experiencing numerous peering issues across the US.  During this time, those of you who had traffic routed through the XO network may have experienced connectivity problems to not only our CA data center, but any other destination routed through XO between 2pm and 3:30pm PDT.

For reference we are including the text from XO:

“We had a peering issue at multiple points in the XO network causing traffic to stop passing between networks from 5:15pm EST until our engineers were able to clear the issue at around 6:20pm EST.”

Helpserve (Ticketing) Version Upgrade

Please be aware that we will be upgrading our helpserve (ticketing) system on September 29th, Monday, at 12:01 am PDT (GMT -8).

During the upgrade, our system will be unavailable for 30 minutes.

If you have any questions or need assistance during our downtime, please contact us via our IRC channel (#engineyard on irc.freenode.net) or call us on our support line +1-866-518-9275.

We apologize for any inconvenience.

Possible Network Issues (Update)

Contacted our Data Center, no known issues there, they are checking with their providers. In the mean time it appears the issue has been resolved. The connectivity problems appear to be the result of a routing problem somewhere between the east coast and our Sacramento facility.

Possible Network Issues

We believe there may be a network issue at the data center hosting ey00, ey01, ey02, xc88, sa00, za00 and hc00.  The issue does not seem to affect everyone and we are currently investigating it.

Mailtrust’s Emergency Maintenance

Dear Mailtrust Customer,

Please know that Engineers will be performing maintenance each evening this week, on Tuesday, Wednesday, Thursday, and Friday night, beginning at 10:00 PM and concluding by 11:59 PM Central Time.

None of the work should result in down time.

The work is ensure previous issues which caused many users who check mail on the Noteworthy platform to have intermittent connection issues and some users on both the Noteworthy and Hosted Exchange 2007 platforms to have internal mails delayed.

The maintenance will greatly enhance the ability of the load balancing servers to scale load amongst additional firewall servers.

During the week, our Engineers also continue to carefully monitor the system and have made changes which reduce the chances of any connectivity issues recurring before the maintenance is completed.

While no down time is expected, we did want to send this notification to make you aware and to let you know that immediate work is being done to address the recent intermittent connection and internal mail delivery delay issue.