44 replies to this topic

[Scott]

During emergency maintenance to our jasmine server, we updated to a newer kernel that is not vulnerable to the current zero-day exploit. Unfortunately Jasmine did not reboot as expected and we are still investigating why. We will update this thread with information specific to Jasmine as we have new information for you.

Update:
10:00pm - Marking this topic resolved.

Edited by Scott S, 14 May 2013 - 09:00 PM.
Resolved

[jtslater]

Assuming you mean it did not reboot as expected?

[Scott]

Assuming you mean it did not reboot as expected?

 

Yes, thank you. I've fixed the typo. I am using voice transcription to help with typing because my hand is currently in a brace for carpel tunnel. With the flood of tickets I did not double check the text as carefully as I should have.

[Scott]

I don't have any new updates at this time, but we are still working on this and will update this thread as soon as we have more information for you.

[Flix]

I wouldn't want to be Scott, Mike, or any other MDD admin right now.

[Scott]

Jasmine is currently online, temporarily. We will be rebooting it again to reactivate CloudLinux. You may notice it rebooting several times as we continue to work on the issue and restore it to normal service.

[samborac]

Wow. Hope this gets fixed ASAP, we have a back log of emails and are currently stuck at the office, because Time critical reports and exports need to be sent out before. Do have there is some means of compensation already APPROVED!

[Scott]

Wow. Hope this gets fixed ASAP

We are working on it and want to see everything back to normal ASAP as well.

we have a back log of emails and are currently stuck at the office, because Time critical reports and exports need to be sent out before. Do have there is some means of compensation already APPROVED!

 
With the server temporarily online, you may be able to get these sent out right now. Hit your send/recieve button, attempt to resend the messages, or do whatever your email client requires when email is queued for sending.

[Vman]

Is it correct to assume that the server is not back up yet? Our site is not loading and so I want to make sure it's not site specific.

 

Thanks

[ashkir]

Thanks for the updates. . I notified the non-profit offices I have on my hosting plan to not send sensitive documents right now and the fact that the mail server might be down. What will happen to emails being sent to something on my reseller? We're constantly sent mail with sensitive information. 

[Scott]

Is it correct to assume that the server is not back up yet? Our site is not loading and so I want to make sure it's not site specific.
 
Thanks

The site may be online sporadically while we continue to work on this. When service has been returned to normal (It hasn't yet), we will definiately make it clear that it is back online.

[Scott]

Thanks for the updates. . I notified the non-profit offices I have on my hosting plan to not send sensitive documents right now and the fact that the mail server might be down. What will happen to emails being sent to something on my reseller? We're constantly sent mail with sensitive information.

Someone on twitter beat you to this question:

The messages should come through when everything is back online.

https://twitter.com/...443298531975168
"Email servers will attempt to resend messages, typically for up to 72 hours, if they cannot connect to the receiving server."

[Ryan]

Any update? The sites on this server still seem to be down...

[FirestormIS]

Thanks for keeping us updated guys. Do you think we can expect it to be back up before midnight (CST)?

[salty]

Is it correct to assume that the server is not back up yet? Our site is not loading and so I want to make sure it's not site specific.

 

Thanks

This will show the server status:

https://www.mddhosti...erverstatus.php

 

Scott, I really do appreciate all the updates. While having a site go down sucks, it happens, but knowing exactly what's going on and why goes a long way to stem off any frustration. Great job.

[Flix]

The bright side is that we now have a lot of new members on the forum! Viral marketing at its best.

[Scott]

Any update? The sites on this server still seem to be down...

I don't have any new information at this time.
 

Thanks for keeping us updated guys. Do you think we can expect it to be back up before midnight (CST)?

I hope so, but can't promise anything due to the nature of the issue. We could have this resolved in 10 minutes, or we could still be working in the morning. We are doing everything we can to get things back to normal ASAP. Bottom line: Still no ETA. (Sorry )

[FirestormIS]

I don't have any new information at this time.
 

I hope so, but can't promise anything due to the nature of the issue. We could have this resolved in 10 minutes, or we could still be working in the morning. We are doing everything we can to get things back to normal ASAP. Bottom line: Still no ETA. (Sorry )

 

I figured that was probably the case. Good luck!

[Scott]

This will show the server status:
https://www.mddhosti...erverstatus.php

Good tip
 

Scott, I really do appreciate all the updates. While having a site go down sucks, it happens, but knowing exactly what's going on and why goes a long way to stem off any frustration. Great job.

Thank you.
 
 

The bright side is that we now have a lot of new members on the forum! Viral marketing at its best.

This is definitely not my preference for marketing... but I suppose I would be remiss to not point out our twitter and facebook pages:
twitter.com/mddhosting, twitter.com/mddscott, and facebook.com/mddhosting -- Of course, you will always get more information, faster, by using our forums.

[MikeDVB]

Hello everybody,

 

I as well as two other administrators have been working to diagnose the issues with the Jasmine server and we've not been able to get the server to function properly.  Everything is indicating hardware failure - it looks like processor failure.  We're working as hard as we can to get service restored.