Jump to content


Photo

Echo Server - Silent Data Corruption - Migrations Pending

Resolved

  • Please log in to reply
27 replies to this topic

#21 kix766

kix766

    Newbie

  • Members
  • Pip
  • 12 posts

Posted 20 January 2014 - 01:51 AM

hi mike, 

 

finding various pages empty on atomonline.com (these are the ones that have been updated lately)

 

downloading backup as we type

 

re emails, can you confirm all will be changed to kobold or will everything remain on echo ?


  • 0

#22 kix766

kix766

    Newbie

  • Members
  • Pip
  • 12 posts

Posted 20 January 2014 - 02:39 AM

first attempt to download full backup failed... trying it again


  • 0

#23 kix766

kix766

    Newbie

  • Members
  • Pip
  • 12 posts

Posted 20 January 2014 - 04:23 AM

backups downloaded ok. still waiting for a reply for confirmation if server will change from ECHO to KOBOLD 

 

Please advise


  • 0

#24 Tim

Tim

    Member

  • Staff
  • PipPip
  • 70 posts
  • Gender:Male

Posted 20 January 2014 - 09:08 AM

backups downloaded ok. still waiting for a reply for confirmation if server will change from ECHO to KOBOLD 

 

Please advise

 

You should remain on the ECHO server now. It appears the issue is resolved. We will update this thread if anything changes.


  • 0

#25 Tim

Tim

    Member

  • Staff
  • PipPip
  • 70 posts
  • Gender:Male

Posted 20 January 2014 - 09:09 AM

Is it safe to make changes to our files now?

Yes, it should be fine to make changes now.


  • 0

#26 kix766

kix766

    Newbie

  • Members
  • Pip
  • 12 posts

Posted 20 January 2014 - 11:28 AM

yes please keep it on ECHO ! so many issues if we are switched to another server again...


  • 0

#27 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 20 January 2014 - 07:05 PM

yes please keep it on ECHO ! so many issues if we are switched to another server again...

kix,

 

We have two options:

1. Try to bring accounts back online on another server, even if it's older data, to keep sites from being fully offline.

2. Simply let everybody on the server be offline while we work on it.

 

If the temporary server solution was an issue you could always have logged in and disabled your site on the temporary server [i.e. a maintenance page or something of the sort] where as if we didn't temporarily restore accounts to another server you would have no power to do anything but wait.

 

I wish there was a better way to handle this that didn't affect our customers but at the end of the day we try to keep everybody online as much as possible.  It's better to be online with slightly outdated data and possible slowness than to be offline entirely although we'd like to avoid both situations whenever possible.

 

I do apologize for the trouble this may have caused you and I do appreciate your understanding in the matter.

 

If you do have any corrupted data on your account [i.e. file that isn't working, content is garbled] open a ticket with technical support as soon as possible and we can restore the latest valid and non-corrupted copy of that data that we have.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#28 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 26 January 2014 - 07:35 PM

We identified the bad drive and removed it and are using the other SSD for read cache  We enabled the read cache at 5 PM today ET [17:00] and it is apparent by our I/O graph below.  It does take some time for the cache to initialize and populate which is the reason for the 2 hour delay on the I/O improvement.

2014-01-26_19-30-26.png

 

Anything under 10% is acceptable and anything under 5% is excellent.

 

Currently the server has 240GB of SSD based read-cache.  Once we have the replacement drive on-hand we'll be upping it to 480GB of read cache.

 

We're going to formally be marking this issue as 'resolved.'


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/





1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users