Jump to content


ericr

Member Since 12 Apr 2014
Offline Last Active May 21 2019 02:00 PM

#7540 Network Outage 1/17/2019 - 5:56 AM to 6:54 AM

Posted by ericr on 17 January 2019 - 07:59 AM

We received notifications at 5:56 AM that everything had gone offline.  We reached out to our facility and they were already aware and working to resolve the issue.

 

For clarity this was an issue upstream from us - our network and servers were online and operational but lost connectivity to the internet when the facility as a whole experienced a disruption.

 

The network came back online after 58 minutes and we are awaiting a Root Cause Analysis [RCA] from our facility regarding the network outage.  As soon as we have the cause of the outage we will make it available here.

 

This thread will be updated when we know more.


  • 1


#7339 Major Outage - 09/21/18 - 09/24/2018

Posted by ericr on 25 September 2018 - 04:07 PM

We are now starting the restore of R3

 

s1    Completed    
p1    Completed    
r1    Completed    
p2    Completed    
s2    Completed    
r2    Completed    
s3    In Progress    
r3    In Progress    
s4    Wednesday, September 26, 2018 at 5:00:00 AM    EDT
r4    Completed    
s5    Wednesday, September 26, 2018 at 11:00:00 AM    EDT
s0    Wednesday, September 26, 2018 at 11:00:00 AM    EDT

  • 1


#7317 Major Outage - 09/21/18 - 09/24/2018

Posted by ericr on 25 September 2018 - 01:29 PM

We are 72% of the way copying R3 off of the backup servver to the transfer ssd's

 

There are 249 accounts left to restore on S3


  • 1


#7260 Major Outage - 09/21/18 - 09/24/2018

Posted by ericr on 25 September 2018 - 04:44 AM

We are currently restoring S2 and R2.

 

s1 Completed
p1 Completed
r1 Completed
p2 Completed
s2 In Progress
r2 In Progress
s3 Wednesday, September 26, 2018 at 12:00:00 AM EDT
r3 Wednesday, September 26, 2018 at 8:00:00 AM EDT
s4 Wednesday, September 26, 2018 at 12:00:00 PM EDT
r4 Completed
s5 Wednesday, September 26, 2018 at 5:00:00 PM EDT
s0 Wednesday, September 26, 2018 at 5:00:00 PM EDT

 

 


  • 1


#6945 Major Outage - 09/21/18 - 09/24/2018

Posted by ericr on 22 September 2018 - 04:37 PM

I want to provide a side update.  we have been able to locate the cause of sites redirecting unexpectedly to other sites.  We have a script that runs to ensure that all ip's have a default site attached that is not a customers.  Due to a unexpected formatting change of ifconfig, this script was no longer getting IP's and leaving the section blank.  We have corrected the file and the redirection failures should permanently cease.


  • 1


#6817 Is there any disadvantage (or advantage) to not put add-on domain folders ins...

Posted by ericr on 11 July 2018 - 06:45 PM

It is currently the cPanel default to have the addon domains added outside of public_html to prevent issues with .htaccess inheritance and better isolate the sites.  So what you are doing is just fine.


  • 1


#6712 Meltdown and Spectre server updates Starting at 10PM EST

Posted by ericr on 05 January 2018 - 07:04 PM

We will be starting our work on implementing the updates implemented by our upstream provider on all of our systems.  The reboots will be short starting with s1 at 10PM EST.


  • 1


#5783 S1 / R1 Servers - Network Device Updates - ~9 PM ET Jan 12, 2016.

Posted by ericr on 18 January 2016 - 01:20 PM

I am working on fixing sites with missing content while continuing to search for the source of the restarts.  at this time the restarts have slowed down significantly. I do have multiple debug sessions open watching different aspects of the server.


  • 1


#5745 User level filter. Subject contains "***SPAM***". How do I trap?

Posted by ericr on 08 January 2016 - 12:05 AM

What you will want to do is go to Apache SpamAssassin and turn on auto-delete.  You can set the threshold higher or lower at this location as well.


  • 1


#5734 Isn't an SSL certificate impossible for a site on a shared server?

Posted by ericr on 17 December 2015 - 05:33 PM

-  The certification required for basic ssl is only that you are who you say you are and that you own the domain.
-  SSL certificates can be expensive depending on what you choose.  Our certificates start at $35 a year.  However, there are other sources that you can purchase a certificate from that you can use.  As long as you can add the certificate using the SSL/TLS wizard in cPanel you can use it.
-  SNI was added to the ssl specification quite a few years ago.  SNI provides the ability to have a unlimited number of SSL sites on the same IP.  So it is a myth that it is impossible or requires a dedicated IP on modern servers.

 

If you desire you can even take a simpler route.  Just put your site behind cloudflare. Then you can let cloudflare do all the work on getting the basic SSL needs met.  You can find details on how they handle SSL here: https://blog.cloudfl...-universal-ssl/


  • 1


#5609 May I control how long access statistics are kept?

Posted by ericr on 23 June 2015 - 08:51 PM

It is a default of 24 hours.  It is only held longer if you request it under cPanel > raw Access Logs.  You can also turn of awstats which is by default on by removing all the check-marks under cPanel > Choose Log Programs.


  • 1


#5563 User-level filter using "matches regex": case insensitive. Need training

Posted by ericr on 14 May 2015 - 07:31 PM

there is a forum post hete showing an example that would work. http://www.gossamer-...s/138688#138688


  • 1