Jump to content


Photo

Major Outage - 09/21/18+ - Client Discussion


  • Please log in to reply
419 replies to this topic

#261 bmolnar

bmolnar

    Newbie

  • Members
  • Pip
  • 7 posts

Posted 24 September 2018 - 10:29 PM

Mike, is it safe for me to assume my Cpanel login on S3 won't work the server restore is complete?  Just want to make sure it's not a bad password.  Guess it's just luck of the draw being a client for 8 years but being on a newer server  :unsure:   Oh well, just means it's less busy I suppose.   Thanks!


  • 0

#262 alpachinco

alpachinco

    Newbie

  • Members
  • Pip
  • 1 posts
  • Gender:Male
  • Location:Tokyo, Japan

Posted 24 September 2018 - 10:35 PM

Hi, I am on the P1 server which seems to be done, thank you, Mike and team, for all your hard work.

 

I have a few questions:

1. Do I need to change my email settings? The cPanel settings show incoming & outgoing servers listed as mail.mydomain, the previous settings were p1.supportedns.com. Which is correct?

2. Will the emails that people sent to me during the outage reach me eventually or are those completely gone?

3. My website is still reading a "404 File Not Found" error message. As the P1 server is up and running how do I get my site back online? Can specific instructions be sent, please?

 

Thank you MDD team.


  • 0

#263 mdduser

mdduser

    Newbie

  • Members
  • Pip
  • 1 posts

Posted 24 September 2018 - 10:37 PM

I would also like to know if I need to open a ticket for an invalid WHM password on S2. I just want to hit the ground running when my clients' accounts get back online. Thank you.
  • 0

#264 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,889 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 24 September 2018 - 10:38 PM

Yes, if you don't have WHM access you need a ticket.  It's a quick fix when brought to our attention.  We're trying to repair it proactively as well.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#265 Nitish

Nitish

    Newbie

  • Members
  • Pip
  • 2 posts

Posted 24 September 2018 - 11:16 PM

Hi Michael,

If a website starts loading all the pages and I can login successfully into the cPanel, does this mean that it is alright to resume working on it or should I wait a couple of days.

Human errors happen every now and then. I appreciate the way MDD hosting handled this issue with full transparency. :)

Just a couple of requests. Once everything goes back to normal, could you please write a post on the forum or send an email about the steps that you are taking to

1. Make sure something like this does not happen again.
2. If it does happen, the data can be restored as quickly as possible?

Thanks.


  • 0

#266 KevinD872

KevinD872

    Member

  • Members
  • PipPip
  • 25 posts
  • Gender:Male
  • Location:NW Indiana
  • Interests:Drums & music, motorcycles, computers, programming and gadgets.

Posted 24 September 2018 - 11:17 PM

Hi, I am on the P1 server which seems to be done, thank you, Mike and team, for all your hard work.

 

I have a few questions:

1. Do I need to change my email settings? The cPanel settings show incoming & outgoing servers listed as mail.mydomain, the previous settings were p1.supportedns.com. Which is correct?

2. Will the emails that people sent to me during the outage reach me eventually or are those completely gone?

3. My website is still reading a "404 File Not Found" error message. As the P1 server is up and running how do I get my site back online? Can specific instructions be sent, please?

 

Thank you MDD team.

 

Until you get a more proper response, I will throw my 2 cents in:

 

1 - I don't think it matters which server you use, as in the end, it is the same server.  I have used both interchangeably and it works just the same.  I would guess that perhaps the xx.supportedns.com may be the best option as using your domain name would just add one more link in the chain but I don't really know that for sure.  Even so, the speed impact would be negligible.

 

2 - The sending server will keep trying to send any emails to you, but they all give up eventually.  Either way, the sender would generally get a "bounce back" email saying that the message could not be delivered.  After that, it would be up to them if they want to try sending it again.  I think it's safe to say that for as long as this outage has lasted, everyone will be losing at least some messages, unless they had a personal backup that they had MDD apply to their account via a support ticket very early on before any sending servers would have completely given up on trying to send the email.

 

3 - You could try clearing your browser cache (or try an alternate browser such as IE, Chrome, Firefox, etc. to see if it goes away) or perhaps someone else may have a better answer.


  • 0

#267 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,889 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 24 September 2018 - 11:17 PM

Already planning on that.  That said it shouldn't be possible to happen again but we'll detail how when we have more time to write the official document.

 

We're also making big change in our backup strategies to make sure restorations are fast if we ever have to resort to them again.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#268 NiKEUS

NiKEUS

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 25 September 2018 - 01:14 AM

Is there a reasonably priced backup provider of whm/cpanel that's automated etc that anyone has stumbled across?
  • 0

#269 cziv

cziv

    Member

  • Members
  • PipPip
  • 52 posts
  • Gender:Male

Posted 25 September 2018 - 01:15 AM

 

I'm running a SEO agency for over 10 years, so I may share some details on this: It's pure luck how fast Google de-indexes a site if it's offline since it depends on when the site was last crawled and how fast Google processes the data to the live index. Can happen in a few hours, can take weeks till Google recognizes the site is gone. De-indexing is no penalty (although some penalties can cause de-indexing, but that's a diffent topic and doesn't matter here), Google simply doesn't want to show people an error page since that's a bad user experience.

 

The good news: Once the site is back online, it will return to/in the old positions. How fast depends on the same factors as de-indexing, the more popular the site, the better it's linked from external sites, the more often it gets crawled, the faster it will re-appear in the SERPs. Worst case downtime and a new IP may trigger a re-evaluation with a ranking rollercoaster ride for a few weeks till it settles in the old positions. Best case, the site instantly ranks like before. So, there is no permanent damage due to the downtime, but you may experience some ranking anomalies for a short period of time. Impossible to predict, but at least you can be sure there won't be any negative longer term effects.

 

Again: Nothing happens if you have a solid website with good reputation.

 

My sites are crawled daily by google, and i'm still indexed all-right, just with some 404 increased notices.

 

Still, if you stay offline for a week or more, then i don't know.


  • 0

#270 SarisIsop

SarisIsop

    Advancing Member

  • Members
  • PipPipPip
  • 154 posts
  • Gender:Not Telling

Posted 25 September 2018 - 03:34 AM

Front page I put up on temporary cPanel is now showing the default error again.

 

Tried clearing cache and tried other browsers but no luck.

 

The file is still there in the temp cPanel.

 

If anyone has any ideas I would be grateful, but I don't want to waste a Ticket as it's not a problem to bother MDD with.


  • 0

#271 SarisIsop

SarisIsop

    Advancing Member

  • Members
  • PipPipPip
  • 154 posts
  • Gender:Not Telling

Posted 25 September 2018 - 04:27 AM


Perhaps we can start a thread for discussion of backup plans/strategies...

 

 

 

I have started one away from this thread in Off Topic, if anyone want's to help please do so here:

 

https://forums.mddho...ans-strategies/


  • 0

#272 vask7

vask7

    Newbie

  • Members
  • Pip
  • 2 posts

Posted 25 September 2018 - 05:23 AM

Anyone else having SMTP Auth errors on R1 ?

 

Have opened a ticket, but not resolved yet.


  • 0

#273 djMot

djMot

    Newbie

  • Members
  • Pip
  • 11 posts
  • Gender:Male

Posted 25 September 2018 - 06:29 AM

I am on S2 and this morning ~6:00am central I find I'm back up. 

 

Email is showing a curious backtracking with some email from quite a long time ago re-arriving.  I use Outlook in POP3 mode so nothing is supposed to be left on the server once fetched.  Other than that, there's the expected lack of new mail.  The hardest part of this will now be verifying that bonafide senders that have me on a list haven't dropped me for around 72 hours of undeliverability. 

 

Thanks for getting me back up and running.


  • 0

#274 glennk

glennk

    Newbie

  • Members
  • Pip
  • 5 posts

Posted 25 September 2018 - 06:32 AM

Just want to throw out there I am on R1 with around 15 sites and everything looks good after restoration. I need to check a bit deeper but so far so good! 


  • 0

#275 cziv

cziv

    Member

  • Members
  • PipPip
  • 52 posts
  • Gender:Male

Posted 25 September 2018 - 06:39 AM

It seems that my 1st plan on S2 is ok, i don't see any (obvious) problems.

 

www and email all ok.


  • 0

#276 SarisIsop

SarisIsop

    Advancing Member

  • Members
  • PipPipPip
  • 154 posts
  • Gender:Not Telling

Posted 25 September 2018 - 06:41 AM

I am on S2 and this morning ~6:00am central I find I'm back up. 

 

Email is showing a curious backtracking with some email from quite a long time ago re-arriving.  I use Outlook in POP3 mode so nothing is supposed to be left on the server once fetched.  Other than that, there's the expected lack of new mail.  The hardest part of this will now be verifying that bonafide senders that have me on a list haven't dropped me for around 72 hours of undeliverability. 

 

Thanks for getting me back up and running.

 

 

Just want to throw out there I am on R1 with around 15 sites and everything looks good after restoration. I need to check a bit deeper but so far so good! 

 

 

It seems that my 1st plan on S2 is ok, i don't see any (obvious) problems.

 

www and email all ok.

 

This is comforting to hear for those of us waiting last on the list.

 

Thank you.


  • 0

#277 Randy A

Randy A

    Newbie

  • Members
  • Pip
  • 2 posts
  • Gender:Male

Posted 25 September 2018 - 06:44 AM

Michael & MDD Gang,

 

Appreciate your hard work in getting us back online. I've been with you folks for many years and even the smallest (usually user errors) issues have always been addressed quickly and professionally. While this was a bit painful for me (and all of us), I know it will make you a better company and I'll be a customer after this is all behind us. 


  • 1

#278 mikeofmandan

mikeofmandan

    Newbie

  • Members
  • Pip
  • 2 posts

Posted 25 September 2018 - 07:24 AM

Hello all,

This community and forum have been really helpful during the outage.

 

I see r4 is restored.  Most of my sites are working except a few where the IP has changed.  Aside from that, I had two sites that I was developing on http://r4.temporary-...ss.com/~example, which don't seem to be working. 

Any idea why that would be?  Anyone else experience this?


  • 0

#279 sf2099

sf2099

    Newbie

  • Members
  • Pip
  • 6 posts

Posted 25 September 2018 - 07:44 AM

my sites with s2 server are up, though it looks like the server ip address was changed from 173.248.187.43 to xxx.xxx.xxx.16

 

all my email account passwords are not working so i will need to check on those to see why.

 

although I have the urge to do a full cpanel and site backups, I am going to wait so that I don't negatively impact the server.

 

good luck everyone


  • 0

#280 cziv

cziv

    Member

  • Members
  • PipPip
  • 52 posts
  • Gender:Male

Posted 25 September 2018 - 07:53 AM

my sites with s2 server are up, though it looks like the server ip address was changed from 173.248.187.43 to xxx.xxx.xxx.16

 

all my email account passwords are not working so i will need to check on those to see why.

 

although I have the urge to do a full cpanel and site backups, I am going to wait so that I don't negatively impact the server.

 

good luck everyone

 

 

 

I'm on S2 also.

 

S2 was on 173.248.191.166 if i'm not mistaken. And it on 173.248.187.16 now.


  • 0




2 user(s) are reading this topic

0 members, 2 guests, 0 anonymous users