Jump to content


Photo

Infrastructure Upgrades - Storage and Servers


  • Please log in to reply
55 replies to this topic

#41 ericr

ericr

    Staff

  • Staff Administrator
  • PipPipPip
  • 224 posts
  • Gender:Male

Posted 08 September 2017 - 10:54 PM

We have only one rsync thread running on /usr


  • 0

#42 ericr

ericr

    Staff

  • Staff Administrator
  • PipPipPip
  • 224 posts
  • Gender:Male

Posted 08 September 2017 - 11:21 PM

R3 is online and happy on the new cluster.  Thank you very much for your patience during this work.


  • 0

#43 Jeroen

Jeroen

    Newbie

  • Members
  • Pip
  • 6 posts

Posted 08 September 2017 - 11:25 PM

Wow that went well. Good job guys!


  • 0

#44 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 09 September 2017 - 12:24 AM

We do not expect any issues as a result of this migration as the Operating System, Control Panel, Files, Daemons, everything are exactly the same as they were.  In the event that you do run into anything odd do please reach out to support.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#45 cziv

cziv

    Member

  • Members
  • PipPip
  • 52 posts
  • Gender:Male

Posted 09 September 2017 - 05:46 AM

So, what is next ? Only 6 days left until 15 of September for the rest of us, as your email initially was about.


  • 0

#46 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 09 September 2017 - 10:20 AM

So, what is next ? Only 6 days left until 15 of September for the rest of us, as your email initially was about.

Due to the overwhelming success of this latest migration we'll be reaching out on Monday to clients to schedule the rest of the transfers.  It is possible that we may have to push some transfers past September 15 in order to avoid trying to move too much data too fast and choking our former storage platform but we're going to get everybody moved as soon as possible.  We definitely do not want to go past the end of September otherwise we're going to be paying for both the old storage platform and the new one for an additional month.

 

I'm providing some graphs that show disk i/o latency both before and after.  Keeping in mind that these are logarithmic these are pretty massive improvements in addition to the stability of the graphs after the upgrade

 

SDA is the "/" folder on the server - basically everything besides MySQL and the "/home" folder which stores user data.

SDB is the "/home" folder on the server - which stores your home directory, account data, php files, emails, etc.

SDC is the MySQL folder on the server.

 

2017-09-09_11-14-24.png

This graph is for the root folder of the server, "/", and the green spikes do not affect the performance of client sites in any way.  They are from scheduled tasks that run on the server that are very I/O intensive such as accounting, bandwidth tracking, etc.

 

2017-09-09_11-16-31.png

This graph for SDA, the root "/" folder, shows the average latency on reads and writes have gone down as well as the I/O wait time - again this chart is logarithmic so it's a pretty large improvement.

 

2017-09-09_11-17-14.png

This graph for SDB is for the "/home" folder - the blue line for IO wait is much lower and everything is substantially lower beyond the write IO wait time.  This is to be expected as we are replicating 3 copies of the data on every write for redundancy against failure.  Reads are substantially faster and more consistent.

 

2017-09-09_11-18-43.png

This graph for SDC is for MySQL and it is plainly obvious that all of the metrics are lower [lower is better] as well as more consistent.  MySQL actually has one of the largest impacts on the performance of dynamic sites like WordPress, Joomla, Drupal, Magento, etc...  This is a massive improvement in both consistency as well as speed.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#47 Jeroen

Jeroen

    Newbie

  • Members
  • Pip
  • 6 posts

Posted 09 September 2017 - 05:55 PM

Just to be sure, I can post and make changes to my sites like I normally do until the offline sync of data, right?


  • 0

#48 Scott

Scott

    MDDHosting Staff

  • Staff Administrator
  • PipPipPipPip
  • 421 posts
  • Gender:Male

Posted 09 September 2017 - 06:32 PM

Just to be sure, I can post and make changes to my sites like I normally do until the offline sync of data, right?


As a general rule: Yes.

To be safe, I'd suggest to save your work and disconnect a few minutes before the shut down. Imagine you are writing a blog post, and need to press save. You're writing and everything is going swell, but we do the shut down a few minutes before you finish. You hit the save button and...... you get a connection error. Depending on when you last saved, some work could be lost.
  • 0
Scott S - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#49 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 11 September 2017 - 03:33 PM

After some time has passed on the new platform here's an updated graph showing this weekend as well as most of today on the R3 server as compared to the old storage:

2017-09-11_16-31-43.png

2017-09-11_16-37-52.png\

 

Lower is obviously better - the top 3 lines in the second graph are the writes to disk.  The bottom 3 lines are reads from the storage.  Writes will be slower than reads due to the data duplication for redundancy but even with this - the overall performance is very much improved.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#50 Rhody401

Rhody401

    Newbie

  • Members
  • Pip
  • 12 posts
  • Gender:Male
  • Location:Providence, RI USA
  • Interests:Consultant, Contractor, Beta Tester, IT Director.

Posted 15 September 2017 - 02:42 PM

Very impressive.  Is R1 still scheduled for tonight? (9/15/17)


  • 0

#51 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 15 September 2017 - 02:44 PM

Very impressive.  Is R1 still scheduled for tonight? (9/15/17)

R1 is tentatively scheduled for September 23, 2017 at 10 PM ET [GMT-4].  We're taking a bit more time to do this - to make sure everything goes smoothly.


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#52 ericr

ericr

    Staff

  • Staff Administrator
  • PipPipPip
  • 224 posts
  • Gender:Male

Posted 15 September 2017 - 02:47 PM

I do want to clarify it is R2 that is scheduled for tonight 9/15.  I am already started the prework for that and it will be going offline at 10PM as scheduled.


  • 0

#53 Rhody401

Rhody401

    Newbie

  • Members
  • Pip
  • 12 posts
  • Gender:Male
  • Location:Providence, RI USA
  • Interests:Consultant, Contractor, Beta Tester, IT Director.

Posted 15 September 2017 - 02:56 PM

Thanks for all that your team does. I've never experienced such great support before, from ANY provider.  Keep up the great work!

 

Hope R2 goes smoothly tonight and i'll be ready on the 23rd for the R1 xfer.


  • 0

#54 forumite

forumite

    Newbie

  • Members
  • Pip
  • 6 posts

Posted 15 September 2017 - 06:50 PM

Just curious what the migration plan/schedule is for S1. Apologies if it's been answered elsewhere.


  • 0

#55 ericr

ericr

    Staff

  • Staff Administrator
  • PipPipPip
  • 224 posts
  • Gender:Male

Posted 15 September 2017 - 07:23 PM

We are hoping for the 24th for s1.  However, that will not be officially planned until all three transfers succeed this weekend.


  • 0

#56 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,900 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 16 September 2017 - 02:06 AM

The R2 server transfer was successful.  That makes 2 servers migrated so far - R2 and R3.  S2 is tonight [Saturday] and S3 is tomorrow [Sunday].


  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users