Jump to content


Photo

Emergency Atlantis kernel update status

Resolved Atlantis

  • Please log in to reply
22 replies to this topic

#1 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 05:33 PM

During emergency maintenance to our atlantis server, we updated to a newer kernel that is not vulnerable to the current zero-day exploit. Unfortunately we found a seperate hardware issue affecting atlantis that prevented us from bringing it back online. We are currently testing and replacing affected hardware in this server.
 
We will post any updates regarding this hardware issue with atlantis in this forum thread.

Update:
9:56pm - This issue is now resolved.

Edited by Scott S, 14 May 2013 - 08:56 PM.
Resolved

  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#2 scottcocoabeach

scottcocoabeach

    Newbie

  • Members
  • Pip
  • 4 posts

Posted 14 May 2013 - 05:53 PM

Is data expected to be affected? Can you provide a estimated time frame to be up and running if you know one. Thanks.
  • 0

#3 zeratul

zeratul

    Newbie

  • Members
  • Pip
  • 1 posts

Posted 14 May 2013 - 05:57 PM

Same here. I need an ETA please, my clients are calling...

 

Thanks.


  • 0

#4 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 06:00 PM

Is data expected to be affected? Can you provide a estimated time frame to be up and running if you know one. Thanks.

 

We have no reason to expect there will be any data loss. Additionally all VPS servers are back up nightly in our R1Soft backup system, so you are protected either way (but there is no reason to think that we will need to restore backups at this time).

 

Same here. I need an ETA please, my clients are calling...

 

Thanks.

 

Are technicians and administrators are still working at this time, but unfortunately we do not have an ETA.


  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#5 le.gentleman

le.gentleman

    Newbie

  • Members
  • Pip
  • 5 posts

Posted 14 May 2013 - 06:45 PM

What exactly is the hardware issue?


  • 0

#6 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 06:48 PM

What exactly is the hardware issue?

 

I don't currently have any details on the specific hardware issue to provide. We are still conducting tests on the server and its hardware.


  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#7 Flix

Flix

    Newbie

  • Members
  • Pip
  • 14 posts

Posted 14 May 2013 - 06:52 PM

What exactly is the hardware issue?

Hard to tell when you're 900 miles from the actual hardware...  :wacko:


  • 0

#8 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 06:53 PM

Hard to tell when you're 900 miles from the actual hardware...  :wacko:


We have people on site and working with our hardware as we speak.
  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#9 cvos

cvos

    Newbie

  • Members
  • Pip
  • 20 posts
  • Gender:Not Telling

Posted 14 May 2013 - 07:43 PM

Is there an eta on Atlantis.
  • 0

#10 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 07:46 PM

Is there an eta on Atlantis.


Not at this time. As soon as we have it, you you will have it (posted here).
  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#11 frankacter

frankacter

    Member

  • Clients
  • PipPip
  • 46 posts
  • Gender:Male

Posted 14 May 2013 - 08:05 PM

Are there any contingencies being considered and a timeline for when that would be considered (ie. restoring to different hardware, etc)


  • 0

#12 Julia

Julia

    Newbie

  • Members
  • Pip
  • 3 posts

Posted 14 May 2013 - 08:15 PM

Any further updates on this?


  • 0

#13 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 08:16 PM

Are there any contingencies being considered and a timeline for when that would be considered (ie. restoring to different hardware, etc)


Due to the amount of data, it would take a long while to fully restore the VPS server to new hardware. We may begin discussing it soon, but we are still trying to isolate the hardware failure in the server and swap out the faulty hardware instead.
  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#14 frankacter

frankacter

    Member

  • Clients
  • PipPip
  • 46 posts
  • Gender:Male

Posted 14 May 2013 - 08:17 PM

Thanks Scott. Let me know when I need to send pizza and caffeine care packages :ph34r:


  • 0

#15 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 14 May 2013 - 08:19 PM

Data is intact, we're not restoring data to new hardware. The processors in the server have failed and we're swapping them both now as I type this.

The server should be back online in 10 to 15 minutes [rough ETA].
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#16 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 14 May 2013 - 08:40 PM

Atlantis is booting up with new processors perfectly. VPS are starting up one at a time [that's how OpenVZ does it to keep from overloading the node and crashing it out on boot].

As soon as all are started up I'll update this thread. Bear in mind after your VPS is online it may take 5~15 minutes for everything to 'level out' and get back to normal.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#17 le.gentleman

le.gentleman

    Newbie

  • Members
  • Pip
  • 5 posts

Posted 14 May 2013 - 08:40 PM

Excellent, let us know once it is actually up and running, thanks.


  • 0

#18 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 08:45 PM

Excellent, let us know once it is actually up and running, thanks.


Everything should be booting up now, and likely finished within a minute or two. After that, the server may need 5-10 minutes to catch up from the mountain of requests that hit it while booting up.
  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#19 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 08:55 PM

I spoke a bit too soon. Some individual VPSs are still booting up. About 80% are finished at this time and the rest should be up and running shortly.
  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#20 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 14 May 2013 - 09:15 PM

Excellent, let us know once it is actually up and running, thanks.


Everything is up and running. (Or should be... Open a support ticket if you're having issues)


  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/





2 user(s) are reading this topic

0 members, 2 guests, 0 anonymous users