Jump to content


Photo

[Completed] Fresco Server - Restoration Completed - File System Check Competed


  • Please log in to reply
218 replies to this topic

#61 shanz

shanz

    Newbie

  • Members
  • Pip
  • 6 posts

Posted 20 June 2011 - 07:06 PM

Mike do you have any idea now how much longer?
  • 0

#62 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 07:08 PM

Mike do you have any idea now how much longer?

The backup system says this (but again, it's just an estimation): Time Remaining: 1h 19m 52s
Progress: 385.1 GB / 470 GB
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#63 shanz

shanz

    Newbie

  • Members
  • Pip
  • 6 posts

Posted 20 June 2011 - 07:09 PM

Thank you
  • 0

#64 Software

Software

    Newbie

  • Members
  • Pip
  • 16 posts

Posted 20 June 2011 - 07:10 PM

Is this going to be it then? Or will there be other stuff to do once it reaches 470 GB?
  • 0

#65 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 07:13 PM

Is this going to be it then? Or will there be other stuff to do once it reaches 470 GB?

Once it reaches 470 GB we will restart the server and it should boot up without issues. Those who were on the IP that was under attack from the original DDoS may still show offline for a short while after as we update DNS across our cluster due to the changes that were happening when the server crashed.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#66 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 07:30 PM

Current Progress: 419.4 GB / 470 GB
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#67 abigun2005

abigun2005

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 20 June 2011 - 07:30 PM

Still waiting for a good news. :)
  • 0

#68 FloridaClay

FloridaClay

    Newbie

  • Members
  • Pip
  • 5 posts

Posted 20 June 2011 - 07:39 PM

Mike,

Thanks for all of your hard work on this issue. I, for one, am extremely thankful that you performed backups as you advertised. It wasn't too long ago that another hosting provider claimed that they performed backups; when their server(s) went down, no backups to be had.

In light of the comment that this has happened a few times recently, Moving forward, isn't there a way to determine what site is under attack? If so, can't you ban that site (unless it is my site :unsure: , pleeaaaseee, don't let it be my site (fingers- crossed)?
  • 0

#69 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 07:43 PM

All in all this has been a very bad day. First Fresco gets hit by DDoS, then it has file system corruption, followed by the biggest hail I've ever seen falling for about 15 minutes which did a ton of damage to the family vehicles. You can see some pictures at http://forums.mddhos...hailstorm-uggh/ if you wish.

I'll be happy to go to sleep tonight and wake up to a fresh day, to say the least.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#70 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 07:44 PM

In light of the comment that this has happened a few times recently, Moving forward, isn't there a way to determine what site is under attack? If so, can't you ban that site (unless it is my site :unsure: , pleeaaaseee, don't let it be my site (fingers- crossed)?

If the attack is a SYN attack, GET attack, POST attack, then it's easy to identify the target (it would be the domain with a TON of requests/second) but the attack from last night was just garbage packets to port 80 on the IP. You can look at it like calling an 800 number and dialing an extension hundreds of times (easy to identify the target) versus calling an 800 number hundreds of times and never choosing an extension.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#71 techshots

techshots

    Newbie

  • Members
  • Pip
  • 2 posts

Posted 20 June 2011 - 07:55 PM

I swear , there's always been some sort of DDOS attack since I've been with you guys. For goodness sakes, isn't there a way to prevent this?

Or at least have some sort of backups running while the servers are being tended to?

And yes, I am frustrated, you'd think there'd be a prevention plan already in place for this kind of attack already?
  • 0

#72 Software

Software

    Newbie

  • Members
  • Pip
  • 16 posts

Posted 20 June 2011 - 07:55 PM

Hit 450 yet? :)
  • 0

#73 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 08:02 PM

It's finished, we're pulling the CD out of the server and rebooting it now.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#74 jack

jack

    Newbie

  • Members
  • Pip
  • 12 posts

Posted 20 June 2011 - 08:06 PM

It's finished, we're pulling the CD out of the server and rebooting it now.


I may as well start writing the email then :D
  • 0

#75 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 08:06 PM

I swear , there's always been some sort of DDOS attack since I've been with you guys. For goodness sakes, isn't there a way to prevent this?

When you find a way to prevent DDoS attacks, do let us know. That's just the same as asking if there is a way to prevent somebody running a red light and totaling your car... Nobody wants that to happen but it happens every day.

Or at least have some sort of backups running while the servers are being tended to?

I'm sorry, I don't understand your question.

And yes, I am frustrated, you'd think there'd be a prevention plan already in place for this kind of attack already?

There is no good way to prevent a DDoS attack, I wish there were.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#76 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 08:11 PM

Unfortunately the news is not good. We're going to have to conduct another restoration to one day back into the past. The restoration time is likely to take about the same amount of time (approximately 7 hours). I'll keep this thread updated.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#77 jack

jack

    Newbie

  • Members
  • Pip
  • 12 posts

Posted 20 June 2011 - 08:14 PM

Unfortunately the news is not good. We're going to have to conduct another restoration to one day back into the past. The restoration time is likely to take about the same amount of time (approximately 7 hours). I'll keep this thread updated.


What was the problem with the first restoration?
  • 0

#78 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,902 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 June 2011 - 08:16 PM

What was the problem with the first restoration?

The file system is reporting issues even after a restoration, we're going to go one more day back and do another restoration. If the file system comes back corrupted on a day further back that means that we're going to need to go about doing the restorations manually which is an extremely labor intensive and time intensive process. I'll keep the thread updated.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#79 jian

jian

    Newbie

  • Members
  • Pip
  • 2 posts

Posted 20 June 2011 - 08:17 PM

Mike first of all thanks for the updates.

You mentioned that you have to do another restore, can you shed some light as to why?

Has the restore on the identical new hardware also failed as well for this restore? What happens if this restore fails again?

Thanks, keep up the fight!
  • 0

#80 Themeltingclock

Themeltingclock

    Newbie

  • Members
  • Pip
  • 13 posts

Posted 20 June 2011 - 08:22 PM

Unfortunately the news is not good. We're going to have to conduct another restoration to one day back into the past. The restoration time is likely to take about the same amount of time (approximately 7 hours). I'll keep this thread updated.

:/
  • 0




1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users