Scott Posted December 9, 2012 Report Share Posted December 9, 2012 12/10/2012 6:30 PM ETAll customers are now back onto the normal high-end hardware at this time and this issue is considered resolved.------------------------------------------------- We have determined that emergency maintenance is required for the atlantis VPS node. We are temporarily relocating all VPS servers on this node to another server and will migrate them back when maintenance is complete. You may notice your VPS is offline for 5 to 10 minutes while it shuts down, is moved to the temporary server, and is brought back online. No other significant changes will be made, your IP addresses will not change, and overall this should have a very minimal impact on all VPS servers on this node. If you have any questions, feel free to ask here, or to contact our support department. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 9, 2012 Report Share Posted December 9, 2012 I'm seeing that the temporary node isn't handling the load as well as we expected, things may slow down a bit, however, hopefully this maintenance will be done within the next 18 hours (i.e during off-peak time). In the event that we're not done by Monday, we're going to see about having an additional temporary server racked up to help balance the load. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 We looked at bringing a secondary temporary server online but the time it would take to install and configure and then resume this process was longer than the remainder of time doing it the way we're doing. We're doing our best to keep from having to take anybody offline entirely. Once the transfers themselves stop things will become much more responsive as right now it's just the disks trying to keep up. Then when we start transferring them back out we're going to start with the smallest VPS first so that we get as many off as quickly as possible to lighten the overall load. Unfortunately this server isn't handling the load nearly at all like we had planned - so we're going to be drafting some new policies and procedures for this sort of maintenance should we ever have to do it again. Ideally the move to another server is nearly transparent and allows us to get the work done but it looks like our temporary server specifications weren't updated to match the specifications of the current production server. Let a little thing slip by and eventually it'll cause problems and that's exactly the case here. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 We've been moving people over to the new hardware most of the night, this is still in process. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 It looks like we're going to have to stop all VPS on the temporary server while we finish up the transfers as it's bogging down entirely too much and will drag the slowness out for easily 18+ hours. The transfers will take substantially less time than that. It's a decision I hate to make, but this is simply taking way too long as we can't have things this slow for this long. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 This shouldn't take very much longer with all VPS left on the temporary server in the offline mode. We'll update this thread once it's completed or if we run into any other issues. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 I am starting up VPS that remain on the temporary server (i.e. not yet copied) one at a time. The temporary server can't handle all of them starting up at once, but I'm working on getting them started slowly as the transfer progresses. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 Only a few VPS are left to transfer back to normal hardware - they are the largest VPS (some storing as much as a 200 gb or so) so they will take a while. Those already on the normal hardware shouldn't notice any impact from this. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted December 10, 2012 Report Share Posted December 10, 2012 Everybody is back onto the high-end hardware. We've shut down the temporary VPS node as there were no more accounts on it. I'll try and have an RFO available within the next 48 hours. Right now I'm going to get some sleep, it's been a long day+night+day. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.