More data center preparation work this week and next.
Data Center and Network Uptime
Data Center and Network Up Time from 7/31/09 5PM to 8/7/09 5PM was 99.4%.
There was a 1hr05Min outage on some portions of the network on 7/31 at approximately 10PM. This outage was the result of a human error that was made while a routine routing change was being made on a border router in Leominster. The script that was modified contained several routing statements that ensured that certain routes were inserted into the BGP routing table. During the updating of the script several lines were omitted. Although our monitoring systems did alert us to the issue another issue upstream occurred at the same time and it was assumed that the issue was related to the upstream event. All of our testing of the impacted systems suggested that all was well. As a result our staff was under the impression that all was well. Once calls started coming into the call center a closer inspection revealed the issue. The issue was then isolated and corrected within approximately 5 minutes of our becoming aware of the issue.
