4 replies to this topic

[MikeDVB]

The S4 server ran into an out-of-memory condition at an extremely fast pace before we could react to it [in a matter of minutes].

 

We're restarting the server gracefully to avoid any data corruption or database repairs which will take some time.  Once it's back we will be shutting it down temporarily to apply more RAM to the system.

 

We will provide updates here.

[MikeDVB]

The server did gracefully shut down - we are adding more RAM now.

[MikeDVB]

The server is booting back up.  We've added an additional 16G of ram.

[MikeDVB]

The server is back online .

 

Sorry for any trouble - we're watching the server closely to catch any additional issues.  As we were able to gracefully shut down and boot back up there will be no data corruption or any issues related to this.

[MikeDVB]

As it turns out our internal monitoring had failed a bit ago - but things have been stable enough that there haven't been issues it missed and we didn't notice.

 

We're in the process of setting up monitoring for our monitoring so we can know if our monitoring is not working.  I guess it's a good things when things are stable to the point that we don't notice our monitoring isn't working

 

I am very sorry for any problems this may have caused our customers on the S4 server.  If you have any questions or need anything please feel free to reach out to technical support.