Jump to content


Photo

Echo Server - File System Check Required, Scheduled for Sunday, Jan 12, 2014 at 2 AM ET. Estimated maintenance window is 2 hours.

Completed

  • Please log in to reply
7 replies to this topic

#1 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 09 January 2014 - 07:14 PM

This maintenance has been completed successfully and the server is back online at this time.

 

Hello,
 
Unfortunately we believe the file system mounted on the root partition of the server has some issues.  While the server functions fine for serving data, MySQL, web server, email, etc... We are unable to perform our normal block-level backups.  Due to this issue potentially getting worse we are scheduling a preventative file system check to clean up any inconsistencies on Sunday, January 12, 2014 at 2 AM ET.
 
We do not expect the file system check to take more than 2 hours and anticipate it taking approximately 30 minutes, however, we are scheduling 2 hours just in case.
 
It is possible that the file system will go read-only between now and the scheduled time which will force our hand - we will have to perform a file system check immediately if this occurs.
 
If you have any questiosn regarding this scheduled maintenance let us know.  This is a newer server with higher end hardware and we anticipate the check to complete fairly quickly.  We have taken cPanel backups of every account on the server and have stored them off-server so, worst case, we can get everybody back online on a new server relatively quickly.
 
 
 

Jan  9 18:57:27 echo kernel: [5527748.437705] EXT4-fs (hcp2): ext4_check_descriptors: Checksum for group 256 failed (7226!=0)
Jan  9 18:57:27 echo kernel: [5527748.437847] EXT4-fs (hcp2): group descriptors corrupted!


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#2 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 01:07 AM

This maintenance will begin in just under 1 hour.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#3 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 02:00 AM

This maintenance will be beginning within the next few minutes.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#4 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 02:43 AM

Unfortunately this is taking longer than expected. We may end up having to do a fresh install and restore backups.

We'll keep this thread updated as we have information to provide.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#5 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 02:51 AM

The file system check is now in progress - we experienced some issues getting the server to boot into a state where the file system check could be performed.

We will keep this thread updated.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#6 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 03:31 AM

The file system check finished. We ran it a second time just to make sure and are attempting to boot the server now.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#7 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 03:33 AM

The server is booting successfully and will be back online within the next few minutes.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#8 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 12 January 2014 - 03:37 AM

The server is online and confirmed operational at this time.

We apologize for any trouble this may have caused you and we appreciate your understanding during this scheduled maintenance.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/





1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users