Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 160 of 309 GBs restored. ETA 58 minutes. Quote Link to comment Share on other sites More sharing options...
nestito Posted May 29, 2011 Report Share Posted May 29, 2011 Well, this stinks...I was about to heap praise on this company for its reliability to some friends. Doh. Any idea what caused a relatively recently deployed, low occupancy server to suddenly 'blow up'? I noticed that I couldn't reach any of my websites tonight so I decided to first check Server Status and Twitter to see if there was something going on globally. Sure nuff, there was and MDD was handling it. MDD is reliable. This sort of thing can happen to any host. What sets a good host apart from from other in a time like this is there customer service and the staff is doing a good job. They are doing good by keeping us updated on what's going on with Gemini. Let them do their thing and fix the issue :-) Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 Indeed, we're at 200 of 309 GB restored so it shouldn't be much longer. We don't anticipate any issues booting up the server once the restoration is completed but we're keeping extra staff on hand just in case. 1 Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 225 of 309 GB Restored. ETA 32 Minutes. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 245 of 309 GB restored. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 280 of 309 GBs restored, the system says around 11 Minute ETA. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 The server is booting up now. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 The server has fully booted up and all services are fully operational at this time. If you have any issues at all do please open a support ticket. Quote Link to comment Share on other sites More sharing options...
rowanhippy Posted May 29, 2011 Report Share Posted May 29, 2011 Thanks very much Mike and the team for keeping us fully updated with what was going on and rectifying the problem. Its very much appreciated. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 Thanks very much Mike and the team for keeping us fully updated with what was going on and rectifying the problem. Its very much appreciated.Absolutely - we identified the cause of the failure as a raid controller and we swapped the controller out prior to restoring the data. We're going to have LSI (the manufacturer) analyze the card to see if they can identify the cause as all the rest of the hardware checked out OK. Quote Link to comment Share on other sites More sharing options...
nbaintel Posted May 29, 2011 Report Share Posted May 29, 2011 While it's good that you were able to recover files from last night. Many customers, including myself, lost several hours of work which is quite depressing. The up time for May is now down to 99.45% which is below your guaranteed 99.9%. I believe you should compensate those who are effected. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 29, 2011 Author Report Share Posted May 29, 2011 Losing hours of work is better than losing all work (i.e. all data). I'm not saying that things worked out how we wanted them to or that we're happy about it - but the current resolution is better than many providers would have been able to offer. I do apologize for the trouble, however, we have no control over hardware failure unfortunately. It will inevitably happen no matter what provider you are with or what kind of systems they are running. We're operating an expensive backup infrastructure just for this specific type of instance and it's paid off in this situation. If you have any specific questions, do please open a ticket. Quote Link to comment Share on other sites More sharing options...
Al Stewart Posted May 29, 2011 Report Share Posted May 29, 2011 I just signed up with MDDhosting and this thread has dropped my jaw! I left enotch.com because they have been down 3 days and not one word was sent explaining the outage or the ETA of the fix. Even their own web sites went away! Wow! Talk about keeping customers informed! Quote Link to comment Share on other sites More sharing options...
Charles Posted May 30, 2011 Report Share Posted May 30, 2011 Mike has went above and beyond to keep everyone informed of what was going on along with the status of the restore. Not many hosts would provide updates as often as Mike has. There are even some hosts that claim to have backups but when it comes right down to it, they have backups that are over 2 weeks old or none at all!!! Mike thanks for keeping everyone updated and for having backups like you do. Quote Link to comment Share on other sites More sharing options...
Michael D. Posted May 30, 2011 Author Report Share Posted May 30, 2011 We are very sorry for anybody who has lost any data - we wish we could bring it back and we did our absolute best to keep it before going to the last resort which is a full server restoration. Quote Link to comment Share on other sites More sharing options...
jersnav Posted May 30, 2011 Report Share Posted May 30, 2011 Thank you Mike! I agree 110%. I did lose about 30 minutes of work, BUT that is nothing compared to losing the whole thing.I am so very impressed at the honesty and frequency of the updates today. My old host had frequent problems and never bothered to say a word. Also, we as customers are free to make our own more frequent backups ourselves if we are not happy with a once a day backup. The monthly price we pay to MDD is unbelievably low for the amount of services and quality received.Thank you again! Jeremy Quote Link to comment Share on other sites More sharing options...
XTremo Posted May 30, 2011 Report Share Posted May 30, 2011 The only way you ever find out how good a provider is, is when something goes wrong. I've seen numerous companies over the years who've built up a good reputation, they've been "flavour of the month" with a substantial following of enthusiastic clients. But when their back has been up against the wall they've fallen apart....simply because they didn't have the systems in place to deal with it. Essentially there was no substance behind the style. In this particular case, Mike and his team came through with KH levels of precision. Mike knows what I mean by that and it's no small compliment. 1 Quote Link to comment Share on other sites More sharing options...
mologer Posted May 31, 2011 Report Share Posted May 31, 2011 of course it would be very down that loses some data.but this topic shows your guys had done your best to protect the customers.anyway.i still trust you and hope these kinda issues never happen again. Quote Link to comment Share on other sites More sharing options...
008Rohit Posted May 31, 2011 Report Share Posted May 31, 2011 Glad I moved my sites a day later. I appreciate those honest words, Mike! Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.