Jump to content


Highest Reputation Content


#4992 Facility-Wide Disruption of Connectivity

Posted by MikeDVB on 28 February 2014 - 11:34 AM

THANK YOU EVERYBODY THAT SENT IN A TRACEROUTE.

 

We were able to identify the issue down to the Hurricane Electric and Telia transit providers.  We turned off those providers and all traffic is now routing over alternate unaffected routes - i.e. everybody should be back online at this point.

 

Understand due to the nature of this issue it is possible there will be further downtime/connectivity issues as there is no way for me to predict what changes have to be made to fully resolve the issue.  Turning off these transit providers is a band-aid over the symptoms and not a solution to the problem.  The goal was to bring everybody back online as quickly as possible.

 

We couldn't have isolated this issue without the traceroutes - thank you.

 

That said - if you are still experiencing connectivity issues do please email maintenance@ with a traceroute.


  • 3


#5546 SR1, SD1, VPS1 Outage

Posted by MikeDVB on 22 April 2015 - 05:50 PM

Yup - servers coming online.

 

It looks like a critical piece of software wasn't properly licensed.  I do believe I can place the fault for this matter squarely on my shoulders as it looks like I didn't install the licenses properly.  I do personally apologize for that.  Thankfully the process is well documented now and will not recur.

 

Due to the nature of the issue the servers were shut down gracefully so no data loss or damage is expected.  It would be as though it were simply a long reboot.


  • 2


#4412 Jasmine Emergency Kernel Update Status

Posted by MikeDVB on 14 May 2013 - 08:20 PM

Jasmine is online, it's playing catch-up to the monumental pile of requests it's facing due to being offline. I estimate 5~10 minutes before things normalize.
  • 2


#2751 [Completed] Fresco Server - Restoration Completed - File System Check Competed

Posted by MikeDVB on 21 June 2011 - 09:50 AM

I'd like to see a real back up plan in place.

We have a "real" backup plan. I'm not sure what makes you think otherwise.

-Fresco goes down due to whatever.
-You have one machine on the ready to restore all accounts from backups
-Done!

This is exactly what we did.

Congratulations for all the hard work you do is not enough for me, I think you do have a responsibility to put more effort into a back up plan to keep everyone's accounts up and running. You may say that yes u're not responsible for DDos attacks, but others I'm sure have lost clients due to something not their fault as well.

Ok, well nobody is forcing you to stay - if you wish to leave, by all means do what you feel is best.

So we just have to endure this again and again?

DDoS attacks - there's nothing we can do to stop/prevent those all we can do is mitigate them when they happen. As far as file system issues - this is only the second time we've ever had to run file system checks in over three and a half years in business. If that is "again and again" then I'm sorry. Beyond that, when the file system is corrupted, we don't have a choice but to run a file system check.

I'm not blaming you, but more should be put into finding a solution for these situations.

DDoS - We mitigate it. File System Corruption - we repair the file system. This is exactly what we've done.

If I were there, I surely would be heading up a project to do so. Nothing is impossible.

Heading up a project to do what? If you know a way to prevent DDoS attacks then you could very easily make yourself a millionaire selling whatever product/solution you come up with to prevent such attacks. And beyond that - if you come up with a way to prevent file system corruption on a kernel panic or other unexpected issue where disk caches may not be fully flushed to the disks - you should patent it.

I understand you are upset and/or frustrated but to be honest you really don't seem to have a solid grasp as to what exactly happened and what we did to bring everything back online. By all means, if you feel the grass is greener on the other side of the fence - feel free to find a new provider. This could happen to any provider on any server at any time - what is important about it is how that provider handles the issue. If there is something more you feel we should have done, by all means, do let me know what you think we should have done.

Nobody is perfect and we don't claim to be - we just do our absolute best to provide the best service and to resolve issues as quickly and efficiently as possible. We're not above and beyond taking constructive criticism and advice but if you're going to give advice, make sure you know what you're talking about before you do so. So I'm all ears, let me know what you think should have been done differently.
  • 2


#2601 [Completed] Fresco Server - Restoration Completed - File System Check Competed

Posted by mk88 on 20 June 2011 - 05:29 PM

for all you guys that say you can't afford to lose one day of business etc, you need to use dns failover.

We started using dnsmadeeasy. Just use their DNS service and for each site that you need online at all times, you setup failover service. So it pings your site every 5 minutes. If it goes down, it will automatically change the DNS to point to another server that you have the site mirrored on.

For example, i use two reseller accounts. This one and another with just copies of our important sites. When everything is down like now, my DNS points to the IP that is online, and everything is good. Using this setup i have had virtually no downtime for a long time.
  • 2


#2337 [Resolved] Fresco Outage - DDoS Attack Mitigated

Posted by SnakEyez on 05 May 2011 - 06:48 PM

The total downtime from this incident was 12 minutes from start to finish.


I have to admit these updates are nice. But let's be serious, I own a Playstation 3, I laugh at 12 minutes of downtime.
  • 2


#1673 New Backup Node Online! More Restoration Points

Posted by TotalZen on 07 December 2010 - 09:18 PM

Here's a php script that will perform automated backups of your database(s) and email them to you.

What I did was set up a separate Gmail account for it, and then filter all the emails/attachments to the Trash folder so the account doesn't max out. The trash can automatically deletes emails after 20 days, so the whole thing is on auto-pilot with zero maintenance.

Simply run the script nightly as a cron job...

/usr/bin/php / /home/...(your path goes here).../cron_backup.php

<?php

$datestamp = date("Y-m-d");      // Current date to append to filename of backup file in format of YYYY-MM-DD

/* CONFIGURE THE FOLLOWING SEVEN VARIABLES TO MATCH YOUR SETUP */

$dbuser = "database_user";            // Database username
$dbpwd = "database_pass";            // Database password
$dbname = "database_name";            // Database name. Use --all-databases if you have more than one
$filename= "dump_filename-$datestamp.gz";   // The name (and optionally path) of the dump file
$to = "email_address";      // Email address to send dump file to
$from = "mysql_backup@domain.com";      // Email address message will show as coming from.
$subject = "domain.com MySql Backup For: $datestamp";      // Subject of email

/* CONFIGURATION END */

$command = "mysqldump --opt --quick --skip-extended-insert -u $dbuser --password=$dbpwd $dbname | gzip > $filename";
$result = passthru($command);

$attachmentname = array_pop(explode("/", $filename));   // If a path was included, strip it out for the attachment name

$message = "Compressed database backup file $attachmentname attached.";
$mime_boundary = "<<<:" . md5(time());
$data = chunk_split(base64_encode(implode("", file($filename))));

$headers = "From: $from\r\n";
$headers .= "MIME-Version: 1.0\r\n";
$headers .= "Content-type: multipart/mixed;\r\n";
$headers .= " boundary=\"".$mime_boundary."\"\r\n";

$content = "This is a multi-part message in MIME format.\r\n\r\n";
$content.= "--".$mime_boundary."\r\n";
$content.= "Content-Type: text/plain; charset=\"iso-8859-1\"\r\n";
$content.= "Content-Transfer-Encoding: 7bit\r\n\r\n";
$content.= $message."\r\n";
$content.= "--".$mime_boundary."\r\n";
$content.= "Content-Disposition: attachment;\r\n";
$content.= "Content-Type: application/x-gzip; name=\"$attachmentname\"\r\n";
$content.= "Content-Transfer-Encoding: base64\r\n\r\n";
$content.= $data."\r\n";
$content.= "--" . $mime_boundary . "\r\n";

mail($to, $subject, $content, $headers,"-f $from");

unlink($filename);   // Delete the backup file from the server (optional)

?>

  • 2


#6190 Google Says Let's Encrypt Certificated

Posted by ep3150 on 15 July 2016 - 07:52 AM

It looks like the issue is lack of SNI support in older browsers/OS combinations.

 

I ran the SSL server test from https://www.ssllabs.com/ssltest/. The overall rating is A, but includes the message "This site works only in browsers with SNI support". However, this affects only Android 2, IE 6 and IE 8 (Windows XP) and Java 6u45, so it seems there would be relatively few real issues.

 


  • 1


#5549 SR1, SD1, VPS1 Outage

Posted by AMC4x4 on 22 April 2015 - 07:05 PM

First here as well. And how refreshing that we know what happened and someone took responsibility for it.

 

Love the service to date. Very happy I switched so far.

Cheers.


  • 1


#4961 Configuring SpamAssassin rules?

Posted by cnywrestling on 27 February 2014 - 03:08 PM

I don't have the answer, but I too would like to point out the huge rise in spam email over the last couple of weeks. I started configuring spamassassin in cPanel, but I don't have a thorough enough understanding of it to make it effective. I'm hopeful that the support staff can recommend some settings to get the spam problem under control.

Thanks.


  • 1


#4371 Jasmine Emergency Kernel Update Status

Posted by Flix on 14 May 2013 - 06:29 PM

I wouldn't want to be Scott, Mike, or any other MDD admin right now.


  • 1


#3032 Connection Reset Error on Fresco

Posted by Scott on 26 August 2011 - 11:02 AM

There are a lot of possible causes for this. I would suggest opening a tech support ticket so we can see your account's history and identify what is going on.
  • 1


#1877 PHP 5.3?

Posted by fshagan on 03 February 2011 - 09:35 PM

I'll be a dissenting voice; already, the 5.2.16 version of PHP 'breaks' scripts using certain deprecated functions like ereg and eregi. And not all the script authors have responded to that yet (and 5.2 has been out since 2009 or something).

I'm on a VPS so I think I have more control of when its updated, but barring security issues, I'm in no hurry to be on the "bleeding edge".

Of course, I'm not anticipating using new features not available in 5.2 either! That would make a difference.
  • 1


#1729 Paypal Debit card and my paypal experience

Posted by MikeDVB on 29 December 2010 - 12:50 PM

I've never had the pull from the bank account work properly, so I don't rely on it.
  • 1


#1130 MDDHosting.com Forum Software Update

Posted by bunnykins on 01 April 2010 - 04:24 PM

did not seem slow to begin with so not really seeing a difference.
I mean it was fast before and still fast.
  • 1


#1118 MDDHosting.com Forum Software Update

Posted by MikeDVB on 31 March 2010 - 04:11 PM

Good good was wondering. I like it. It looks so much nicer.

I like it as well... Looks like a *lot* of work to integrate into our current design so I'm hoping to have that done in the next few days.
  • 1


#6024 Brief Network Outage affecting all Services

Posted by SarisIsop on 29 March 2016 - 02:28 PM

Thank you for posting this notification Mike. I did notice a brief outage, but it passed quickly.

 

It's always reassuring to see these types of posts which I subscribe to, and saves me thinking about troubling you with a ticket.


  • 1