We've added Chicago and New York to our list of active monitors. After the long lasting DNS outage that has occured on the West Coast of the USA today, more monitoring was necessary to get a better picture of the wider internet availability of the service.
View the full report links to see how the service has performed since April of 2008.
Thursday, January 22, 2009
Unplanned DNS Outage at 12:10 Pacific
XPLive and its related web sites experienced an unplanned DNS outage that apparently started at 12:10 PM Pacific. Our San Francisco monitor was triggered at that time and our support staff started to diagnose the problem. It appeared to take about 20 minutes for the error to unroll and the planner was again available by 12:30 PM Pacific.
This did not trigger our London monitor, so it appeared to be a US West Coast anomaly related to DNS. We were able to remotely log into the literal IP addresses of the domains without any problems during the outage.
You may experience some slow load times on the login page. This is the result of the SSL Site Seal from Network Solutions loading slowly. We are working to remove that site seal from the login page.
[Update] 1:30 PM Pacific: It appears as though the AT&T network is experiencing some problems with routing packets through their US West Coast presence. Users outside of the USA appear to be unaffected, while users on the West Coast of the USA are experiencing intermittent timeouts caused by packet delay.
This did not trigger our London monitor, so it appeared to be a US West Coast anomaly related to DNS. We were able to remotely log into the literal IP addresses of the domains without any problems during the outage.
You may experience some slow load times on the login page. This is the result of the SSL Site Seal from Network Solutions loading slowly. We are working to remove that site seal from the login page.
[Update] 1:30 PM Pacific: It appears as though the AT&T network is experiencing some problems with routing packets through their US West Coast presence. Users outside of the USA appear to be unaffected, while users on the West Coast of the USA are experiencing intermittent timeouts caused by packet delay.
Wednesday, July 2, 2008
UTF8 Encoding Fix
We have updated the planner to support UTF-8 encoding properly. This appears to have been broken since we added a display tag filter to our filter chain a few months ago. Our customers using Arabic characters reported that their display characters were not being preserved correctly, and thus the need for this update.
With the release from today, this appears to be fixed. Yet, if you have any display issues with your localized language, please let us know by sending email to support@extremeplannerlive.com.
With the release from today, this appears to be fixed. Yet, if you have any display issues with your localized language, please let us know by sending email to support@extremeplannerlive.com.
Thursday, June 26, 2008
Updated SSL Certificates
We updated our SSL certificates as part of our yearly renewal. The new certificates should continue to work with all browsers. If there are any problems with SSL or identity verification, please contact support@extremeplannerlive.com. The SSL certificate update affected the planner site as well as the commerce site.
Friday, June 6, 2008
60 Minute Outage
Today we updated the kernel on our load balancer and attempted a warm reset of the system. That, unfortunately, did not work well, and the load balancer did not recover nicely. What should have been a five minute reset turned into 60 minutes because we had to physically reset the load balancer (cold reset) to make it recover.
Lesson learned and we'll be doing kernel updates with warm resets on-site rather than remotely.
Lesson learned and we'll be doing kernel updates with warm resets on-site rather than remotely.
Monday, June 2, 2008
Maintenance Window June 7th
On June 7th between 00:00 and 02:00 Pacific time (GMT-8), we will be making changes to the primary routing infrastructure of our network. During this time there may be periods of higher latency and possible service loss. We recommend that all users make sure that this time period is not critical for their workflow. Please accept our apologies in advance of any inconveniences caused by this planned maintenance. Know that these changes are designed to improve the upstream capacity and speed of the network.
Saturday, May 31, 2008
Uptime Report
As of May 31st, 2008, we've been actively monitoring the XPLive system from two continental locations (USA and Great Britain). This constitutes about 61 days of active monitoring of the service since the last major outage.
The uptime report shows that it is running at:
99.969%, or 27.23 minutes of down time total (commerce site)
99.988%, or 10.54 minutes of down time total (planner)
99.981%, or 16.69 minutes of down time total (planner)
Our average amount of down time is 18.15 minutes, which is about 18 seconds per day, relative to the source of the monitoring.
This monitoring doesn't take into account network issues that occur between the monitoring system and our servers. We have tried to black-out planned maintenance windows so that those outages do not skew the uptime reports.
The uptime report shows that it is running at:
99.969%, or 27.23 minutes of down time total (commerce site)
99.988%, or 10.54 minutes of down time total (planner)
99.981%, or 16.69 minutes of down time total (planner)
Our average amount of down time is 18.15 minutes, which is about 18 seconds per day, relative to the source of the monitoring.
This monitoring doesn't take into account network issues that occur between the monitoring system and our servers. We have tried to black-out planned maintenance windows so that those outages do not skew the uptime reports.
Subscribe to:
Posts (Atom)