Jump to content
MDDHosting Forums

[Completed] Fresco Server - Restoration Completed - File System Check Competed


Recommended Posts

The file system check left the server in an inoperable condition and, as such, we're going to be performing a full restoration of the server back to around 1:30 AM GMT-5. We'll update this thread as soon as the restoration ETA is known which should be within 30 minutes.
Link to comment
Share on other sites

The restore is in progress and the ETA provided by the system is right at 7 hours. This can increase or decrease as it runs so keep in mind it's an estimated time of completion.

 

http://www.screen-shot.net/2011-06-20_1416_234234.png

Link to comment
Share on other sites

The restore is in progress and the ETA provided by the system is right at 7 hours. This can increase or decrease as it runs so keep in mind it's an estimated time of completion.

 

<removed image from quote due to redundancy>

 

 

Are websites going to be restored during this time or not until this is all done? I can not afford to lose a day of business. Honestly, I just can't.

Edited by MikeDVB
Link to comment
Share on other sites

Are websites going to be restored during this time or not until this is all done? I can not afford to lose a day of business. Honestly, I just can't.

It's a restoration of the entire server and all data (a fresh server install does not have 470 GB of data, more like 3 GB). Once this restoration is done everything should come back online without issue.
Link to comment
Share on other sites

MDD have been fantastic over the past year for me....but today this is extreme! Its hurting business :( :(

 

MDD have been brilliant for me also - and several hours of downtime isn't the end of the world as a result of such a big DDOS attack. What's really important is no loss of data and prompt restoration.

 

For those who complain of a lack of updates I know Mike won't take a break until everything is up and running again - and I would rather he was working on restoring services than constantly posting updates.

 

As someone who has experience with half a dozen hosts - I am happy in the knowledge that MDD continues to deliver the best service around - and when attacks like this happen (which they inevitably do) - they are promptly resolved.

Link to comment
Share on other sites

I was wondering what steps can I as a customer take in the future to ensure I don't lose an entire day. Mainly I am concerned about email. If we cannot get or send email our customers move on (yes... they are that impatient) & take their project with them. Not having our website up also hurts our business immensely. :(

 

I saw you mentioned name servers earlier in the thread. Would purchasing private name servers through you (or using a service like CloudFlare) keep our email going during a DDoS attack like today's and the unfortunate crashing of the server? If yes, how much is it?

 

BTW - thanks for keeping everyone updated!

Link to comment
Share on other sites

I was wondering what steps can I as a customer take in the future to ensure I don't lose an entire day. Mainly I am concerned about email. If we cannot get or send email our customers move on (yes... they are that impatient) & take their project with them. Not having our website up also hurts our business immensely. :(

Not having your website online hurts us immensely as well, as we have more than just a few offline unfortunately. If email is absolutely critical to your business I'd personally suggest using something like the free edition of Google Apps, although, I'm not sure about POP3/SMTP with that - I do believe you may have to have the paid version for that.

 

I saw you mentioned name servers earlier in the thread. Would purchasing private name servers through you (or using a service like CloudFlare) keep our email going during a DDoS attack like today's and the unfortunate crashing of the server? If yes, how much is it?
No, your email is hosted on-server. The nameserver message was specific to the specific client and really doesn't even belong in this thread as it's not exactly related.

 

BTW - thanks for keeping everyone updated!

Sure thing, I wish we didn't have to do this at all but that's unfortunately not something we have control over at this point.

 

Current Progress: 25.7 GB / 470 GB

Link to comment
Share on other sites

Not having your website online hurts us immensely as well, as we have more than just a few offline unfortunately. If email is absolutely critical to your business I'd personally suggest using something like the free edition of Google Apps, although, I'm not sure about POP3/SMTP with that - I do believe you may have to have the paid version for that.

 

No, your email is hosted on-server. The nameserver message was specific to the specific client and really doesn't even belong in this thread as it's not exactly related.

 

Sure thing, I wish we didn't have to do this at all but that's unfortunately not something we have control over at this point.

 

Current Progress: 25.7 GB / 470 GB

 

Thanks for the answer. It seemed too easy :)

Link to comment
Share on other sites

Ouch. I was hoping to come back from lunch and find that our site was up and running. Looks like an entire day is shot at this point.

It could be worse - we could be like a lot of providers out there and not have backups at all... Thankfully we're not like most. We're still investigating the original cause of the data corruption but I am not sure when we'll have those details. We are doing this restore to fresh, yet identical, hardware just in case it was hardware failure that caused the issue.

 

Either way, I do apologize deeply to anybody who is experiencing this issue.

 

Current progress: 53.4 GB / 470 GB

Link to comment
Share on other sites

It could be worse - we could be like a lot of providers out there and not have backups at all... Thankfully we're not like most. We're still investigating the original cause of the data corruption but I am not sure when we'll have those details. We are doing this restore to fresh, yet identical, hardware just in case it was hardware failure that caused the issue.

 

Either way, I do apologize deeply to anybody who is experiencing this issue.

 

Current progress: 53.4 GB / 470 GB

I'm thankful for your backups, no doubt. Do you have any idea of the target of the DDoS?

Link to comment
Share on other sites

I'm thankful for your backups, no doubt. Do you have any idea of the target of the DDoS?

Unfortunately, no. We were working to ascertain that when the server went offline due to the file system issues. From the looks of it, however, the attack subsided a few hours ago. We're still able to see network traffic targeting the IPs on the server although the server is not serving web content at this time.
Link to comment
Share on other sites

Mike,

 

I'm going back and reading this forum for my own knowledge - it looks like this is the 3rd(?) time Fresco has been DDoS'd in the last month. Any change of plans for the future?

Short of not putting customers on the server, there is no way to prevent ddos attacks. The root cause for the current downtime is however file system corruption which is why I changed the thread title and edited the original post with an update.

 

Current progress is 160 gb of 470 gb. It's going slower than expected.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...