Michael D. Posted March 23, 2012 Report Share Posted March 23, 2012 Hello, A client's VPS crashed the Boreas node a short bit ago, and locked the server up to the point that we were forced to issue a reset. We tried to avoid the reset, but we were not even able to log into the system directly using a keyboard and mouse at the physical system itself. Due to the unclean reset, a file system check is being forced by the OS which can take anywhere from 10 minutes to 120 minutes. We will update this thread with progress as we work on this. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 File system check is 30% completed. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 File system check is 50% completed. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 65% Completed Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 70% Quote Link to comment Share on other sites More sharing options...
frankacter Posted March 23, 2012 Report Share Posted March 23, 2012 Thanks for the updates. Looks like it is leaning more towards the 40 minutes schedule, or is this one of those non-linear checks that can stay stuck at 80% for 2 hours? Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 It actually restarted on it's own, and is back up to 15%. http://www.screen-shot.net/fsck-boreas-03-22-12.png Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 20% Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 40% Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 45% Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 50% Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 60% Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 It's making another pass, however, this pass does not have a progress status so I will not be updating this thread until it provides status updates again. Quote Link to comment Share on other sites More sharing options...
frankacter Posted March 23, 2012 Report Share Posted March 23, 2012 Is it normal for these kinds of checks to have additional passes like this that do not provide status or does this signify a bigger issue? Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 Is it normal for these kinds of checks to have additional passes like this that do not provide status or does this signify a bigger issue?I won't be able to answer those questions until all is said and done. Absolute worst case is that we do have recent backups, but ideally we would like to bring the server back online without having to restore from backups. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 The server is back online, we're going to do a little more checking before bringing the VPS back online, including updating the kernel version while we're at it as it will only take a few minutes to accomplish. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 Ok, we're bringing up VPS one at a time and watching for issues. The core OS itself is intact, but there is the possibility there are a few file errors/corrupted files in individual VMs. If anybody happens across a corrupted/missing file - we will be happy to restore it from our backup system. Quote Link to comment Share on other sites More sharing options...
frankacter Posted March 23, 2012 Report Share Posted March 23, 2012 Thanks to the team. Another example of amazing support from the staff at MDD. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 There are only a couple of VPS that are not online at this point, each is taking a bit longer to come online due to rebuilding quotas and such. If you have any specific issues with your specific VPS it is best to open a ticket. . Quote Link to comment Share on other sites More sharing options...
George Appiah Posted March 23, 2012 Report Share Posted March 23, 2012 There are only a couple of VPS that are not online at this point, each is taking a bit longer to come online due to rebuilding quotas and such. If you have any specific issues with your specific VPS it is best to open a ticket. . Looks like my VPS is one of those few still struggling to get back online. Opened ticket #894695. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted March 23, 2012 Author Report Share Posted March 23, 2012 Looks like my VPS is one of those few still struggling to get back online. Opened ticket #894695.Yep, your quota rebuild is taking longer than the rest. We've got our eyes on it. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.