[MikeDVB]

Themeltingclock, on 21 June 2011 - 10:19 AM, said:

Where do you stand, alphabetically, on the DNS restoration?

duo*

We actually just made a change to the process we set up to handle this that is making it go about 8 times faster than it was.

[MikeDVB]

MikeDVB, on 21 June 2011 - 10:19 AM, said:

duo*

Now on ea*

[MikeDVB]

I'm going to have to go to to sleep as I'm so tired that my eyes are starting to un-focus on their own meaning I'm having to concentrate really hard to be able to even see. Anybody still seeing a "cPanel Default" page will have this resolved shortly. We set up a script to go through and detect+fix this issue on all accounts affected but it does take some time per account (around 45 to 60 seconds or so).

Keep in mind your incoming/outgoing email will still function even if you are seeing the cPanel default page for your site.

[HADNow]

Just so that all know... if you see @pingdom status - its down as well for the last couple of hours... a web monitoring site down!

hence, you can show your clients that even "bigger" sites can go down.

[Themeltingclock]

HADNow, on 21 June 2011 - 11:14 AM, said:

Just so that all know... if you see @pingdom status - its down as well for the last couple of hours... a web monitoring site down!

hence, you can show your clients that even "bigger" sites can go down.

Okay, now I'm starting to get frustrated. Our domain is "La*" and we're still down. I know Mike has gone to bed at this point - is anyone from MDD keeping an eye on this thread that wants to chime in with an update?

[jack]

Themeltingclock, on 21 June 2011 - 11:23 AM, said:

Okay, now I'm starting to get frustrated. Our domain is "La*" and we're still down. I know Mike has gone to bed at this point - is anyone from MDD keeping an eye on this thread that wants to chime in with an update?

Are you seeing the default cPanel page? If so I believe Mike mentioned running a script which will fix this.

I can confirm that to my knowledge all of my client's sites are back online.

[MikeDVB]

Themeltingclock, on 21 June 2011 - 11:23 AM, said:

Okay, now I'm starting to get frustrated. Our domain is "La*" and we're still down. I know Mike has gone to bed at this point - is anyone from MDD keeping an eye on this thread that wants to chime in with an update?

It's on ha* now, so la* will be very soon.

[Themeltingclock]

MikeDVB, on 21 June 2011 - 11:26 AM, said:

It's on ha* now, so la* will be very soon.

Still no bueno...

[MikeDVB]

Themeltingclock, on 21 June 2011 - 12:36 PM, said:

Still no bueno...

As I said before, once the DNS change is made it may take 1 to 2 hours after that before the domain works if you've been trying to visit it. You would want to try something like hidemyass.com to see if it's loading OK for others.

[Software]

My site is still down. I opened a support ticket and about 5 hours ago someone told me it should be working- still nothing! www.dolphincadcamusa.com

[jack]

Software, on 21 June 2011 - 01:48 PM, said:

My site is still down. I opened a support ticket and about 5 hours ago someone told me it should be working- still nothing! www.dolphincadcamusa.com

I'm able to view your site (UK), it must be that DNS is still updating.

[Software]

jack, on 21 June 2011 - 01:50 PM, said:

I'm able to view your site (UK), it must be that DNS is still updating.

Hmm.. Wonder how long it takes for the DNS to update...

[Saulius]

Software, on 21 June 2011 - 01:58 PM, said:

Hmm.. Wonder how long it takes for the DNS to update...

use http://host-tracker.com/

[Spiral]

My site's still down and I'm not getting any answers via email. Could someone please provide some sort of status update?

[Janzzon]

My site is working fine but I can't login to cPanel.

[mediadave]

I just wanted to say thank you to Mike for dealing this situation promptly and professionally.

It was a very difficult situation and he couldn't have handled it any better.

[MikeDVB]

Software, on 21 June 2011 - 01:48 PM, said:

My site is still down. I opened a support ticket and about 5 hours ago someone told me it should be working- still nothing! www.dolphincadcamusa.com

Your site loads fine for me (and was loading fine for me when I updated your ticket). Due to the nature of DNS it could take your ISP a few hours to update or it could be near instant. As I advised you in the ticket - anybody who hasn't visited your site within the last few hours prior to me telling you it was back online would see the site without issues instantly. I do believe I also advised you to use a proxy such as one from proxy.org to see that the site was online for others.

Software, on 21 June 2011 - 01:58 PM, said:

Hmm.. Wonder how long it takes for the DNS to update...

That depends on your ISP and your local network configuration - it's not something we have control over.

Spiral, on 21 June 2011 - 04:36 PM, said:

My site's still down and I'm not getting any answers via email. Could someone please provide some sort of status update?

PM me your ticket ID and I'll take a look. I know that the DNS updates across all accounts did take until around 9 PM GMT-5 (a lot longer than anticipated) but it happened as fast as possible. By 9 PM everybody had their DNS updated where as by about 2 PM around half of the accounts were fixed.

Janzzon, on 21 June 2011 - 06:31 PM, said:

My site is working fine but I can't login to cPanel.

You'll need to open a ticket if you have not already. PM me the ticket number if you have one.

[MikeDVB]

For those who may be curious, here you can see the data restoration from R1Soft, the period during which the file system checks were run, and then the point at which normal services were resumed:


Due to this being monitored at our switch (and not at the server) "in" (or green) is actually data being sent out to the internet where as "out" (or blue) is actually data coming in to the server (be it from the backup system, or the internet).

[jack]

Very interesting

I would love to see the DDoS attack graph but I think the last one was worse in terms of packets per second.