http://status.modwest.comHosting System Statusen-usFri, 17 Feb 2012 23:10:01 -0700Copyright: (C) Modwest, Inc15On Saturday, February 18 at 8am-4pm MST, Modwest engineers will be performing important security upgrades on VPS hardware. As we work on each server during this time, all services on those containers will be temporarily offline. Because reboots will be required and some filesystems are scheduled for filesystem checks, some sites may be offline for an hour or more. During this maintenance window we will be updating the Virtuozzo service with necessary security and functionality updates provided by our vendor. We are scheduling this maintenance on the weekend to better serve the majority of our customers who operate during typical M-F business hours. Please note that this maintenance only affects VPS and Managed VPS customers. It will NOT affect customers on the Grid (Yep and other shared hosting) or managed, dedicated servers. http://status.modwest.com/index.phtml?id=565http://status.modwest.com/index.phtml?id=565Wed, 15 Feb 2012 14:10:12 -0700We believe we have identified the source of the network disruption and quarantined the suspected servers from the rest of the network. The number of affected customers should now be very few, but please contact us if you are still experiencing trouble accessing your website or email.http://status.modwest.com/index.phtml?id=564http://status.modwest.com/index.phtml?id=564Thu, 09 Feb 2012 12:58:34 -0700Modwest Engineers are investigating a network event that is affecting part of the Modwest Network. Some Managed Server customers are affected. We'll update this page with additional information as it becomes available.http://status.modwest.com/index.phtml?id=563http://status.modwest.com/index.phtml?id=563Thu, 09 Feb 2012 12:38:56 -0700Maintenance of listmail.modwest.com and mailman.modwest.com is complete. Mail is being delivered.http://status.modwest.com/index.phtml?id=562http://status.modwest.com/index.phtml?id=562Thu, 02 Feb 2012 11:49:29 -0700Today, at 10:30MST, we will be taking listmail.modwest.com and mailman.modwest.com offline for hardware upgrades. Technical Info: The server is handling customer-generated mailing list traffic beyond the capabilities of its hardware. As new mail comes in, the server is falling further behind, causing longer delays. A hardware upgrade is required to resolve the issue. Downtime Caused? Approximately 15-30 minutes of interruption in SMTP delivery of mailing list traffic.http://status.modwest.com/index.phtml?id=561http://status.modwest.com/index.phtml?id=561Thu, 02 Feb 2012 09:54:14 -0700A backlog of outbound messages is creating delivery delays for mailing lists utilizing "listmail.modwest.com" as an SMTP relay. Messages are going out, but they may be delayed up to several hours, or possibly more in certain circumstances. Modwest engineers are monitoring and mitigating as feasible. Business/personal mail sent through "mail.modwest.com" is not affected.http://status.modwest.com/index.phtml?id=560http://status.modwest.com/index.phtml?id=560Wed, 01 Feb 2012 08:52:43 -0700One of our VPS hardware nodes crashed approximately eleven hours ago. Upon reboot, it required a deep filesystem check. The server is back up now, and VPS instances will come back online in the next thirty minutes or so. We apologize for the trouble and thank you for your patience.http://status.modwest.com/index.phtml?id=559http://status.modwest.com/index.phtml?id=559Tue, 31 Jan 2012 11:15:36 -0700One of our VPS hardware nodes is down, and currently undergoing a filesystem check. This may take several or more hours, after which affected VPSes will return to availability. We apologize for the trouble and thank you for your patience.http://status.modwest.com/index.phtml?id=558http://status.modwest.com/index.phtml?id=558Tue, 31 Jan 2012 01:45:11 -0700We have detected an issue with a hardware node that hosts a number of VPS instances. We are working on the issue and appreciate your patience. http://status.modwest.com/index.phtml?id=557http://status.modwest.com/index.phtml?id=557Mon, 30 Jan 2012 23:45:44 -0700On Sunday, January 29th, between 7AM and 10AM, Modwest engineers will perform required maintenance on multiple components of the Modwest Grid. Technical Info: Important security updates require this maintenance window. Downtime Caused? Various services are expected to be intermittently affected during the maintenance window, including mailbox password authentication, database connectivity, SSH and FTP access, mailing list delivery, and website connectivity/load time. Interruptions are expected to be brief, and we appreciate your patience as we perform this required maintenance. Modwest VPS services and managed servers will not be affected. UPDATE #1 (7:43a) - All maintenance to mail systems is complete. Maintenance to database servers is also complete, but we are noticing some databases appear to be in need of repair on db2.modwest.com. This may cause some SQL queries to fail. We will post more information as we acquire details. UPDATE #2 (8:47a) - The majority of database repairs are complete on db2.modwest.com. The only remaining maintenance will only affect websites, and is expected to only cause moments of slow loading. UPDATE #3 (9:30a) - Maintenance is complete. We will continue to check all databases on db2 to find any tables that need repair. http://status.modwest.com/index.phtml?id=556http://status.modwest.com/index.phtml?id=556Sat, 28 Jan 2012 10:08:15 -0700We have detected and mitigated a distributed denial of service attack (DDOS), and the issue that was causing occasional sluggish connections to the Modwest Grid webservers is resolved now. Thanks for your patience. http://status.modwest.com/index.phtml?id=555http://status.modwest.com/index.phtml?id=555Thu, 26 Jan 2012 12:56:19 -0700Occasional, brief slowdowns or connection failures to the Modwest Grid web cluster have been reported, and engineers are looking into the issue.http://status.modwest.com/index.phtml?id=554http://status.modwest.com/index.phtml?id=554Thu, 26 Jan 2012 08:39:26 -0700UPDATE 2:36PM: Maintenance is complete. On Sunday, January 22nd, at approximately 2PM Mountain Time, Modwest engineers will conduct maintenance on the storage subsystems of the Modwest Grid. Technical Info: Last week we migrated storage services for some accounts to a backup node to address a service issue. We need to migrate storage services back to the primary node for these accounts. Downtime Caused? Web services, FTP, SSH, and Cron services will be interrupted for some customers, for up to 20 minutes. Other customers may notice a slowdown or brief interruption. We anticipate any interruption will be brief, and engineers and support staff will be available to help with any issues that arise. Modwest Grid email services will not be affected, nor will this maintenance affect any VPS or managed server. http://status.modwest.com/index.phtml?id=553http://status.modwest.com/index.phtml?id=553Sat, 21 Jan 2012 09:43:55 -0700We successfully transferred services to a backup storage server and all systems are operational again. Thanks for your patience.http://status.modwest.com/index.phtml?id=552http://status.modwest.com/index.phtml?id=552Sat, 14 Jan 2012 01:23:36 -0700Engineers are investigating an issue that is making some websites on the Modwest Grid unavailable. UPDATE: A storage server issue is the cause of the current outage. We are working to resolve it as quickly as possible.http://status.modwest.com/index.phtml?id=551http://status.modwest.com/index.phtml?id=551Fri, 13 Jan 2012 23:20:46 -0700