Jump to content


Photo

[Completed] Gemini full restoration from backup system.


  • Please log in to reply
43 replies to this topic

#1 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 01:53 PM

The file system on the Gemini server has gone Read-Only and we're rebooting the server and investigating the cause at the moment.

Update:

The file system was irreparably damaged and we're restoring the server from our backup system.

Update 2 (6:09 PM EST (GMT-5)):

The server has been fully restored - the restoration process took approximately 1 hour and 41 minutes. The server is back online and will be sluggish for 5 to 10 minutes as it catches up to missed requests and email. If you have any issues do please open a support ticket.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#2 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 01:57 PM

The file system on the server appears to be severely damaged. We do have backups from last night however restoring from those backups is going to be a last resort. We will update this thread as we know more.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#3 nbaintel

nbaintel

    Newbie

  • Members
  • Pip
  • 17 posts

Posted 29 May 2011 - 02:04 PM

Does that mean that we might lose our data from last night till now?
  • 0

#4 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 02:19 PM

Does that mean that we might lose our data from last night till now?

That is a possibility, yes. We'll need to see if we can repair the file system or if we need to go right into a restoration. Our team is working on this now.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#5 nbaintel

nbaintel

    Newbie

  • Members
  • Pip
  • 17 posts

Posted 29 May 2011 - 02:23 PM

That is a possibility, yes. We'll need to see if we can repair the file system or if we need to go right into a restoration. Our team is working on this now.

Well, I hope you guys are able to save all the data.

Thanks.
  • 0

#6 SFDigital

SFDigital

    Newbie

  • Members
  • Pip
  • 5 posts

Posted 29 May 2011 - 02:54 PM

Does the possibility exist that we will lose ALL data, ie, the entire site? Or, worse case scenario, just the data from last night?
  • 0

#7 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 02:58 PM

Worst case should be restoring to the backup from last night. We take backups every night of every server.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#8 SFDigital

SFDigital

    Newbie

  • Members
  • Pip
  • 5 posts

Posted 29 May 2011 - 03:01 PM

Thanks, Mike. Of course, this is the week all the PR for our site begins. Argh. ETA when you have it would be much appreciated. Glad you guys are working on it!
  • 0

#9 Patrick.B

Patrick.B

    Newbie

  • Members
  • Pip
  • 3 posts

Posted 29 May 2011 - 03:04 PM

So... I just purchased my plan today, and was working on setting up my forum when this happened.

Will I loose everything I had done up to this point?

What about my account, and domain name registrations?
  • 0

#10 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:08 PM

So... I just purchased my plan today, and was working on setting up my forum when this happened.
Will I loose everything I had done up to this point?

If we're unable to recover the data directly from the server, then yes, anything created today will be gone.

What about my account, and domain name registrations?

Your domain registration will be fine - if you wish - I can go ahead and create a new account for you on another server since you've just registered so you can get back to work. Just open a support ticket.

An ETA will be posted here as soon as we have one.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#11 Patrick.B

Patrick.B

    Newbie

  • Members
  • Pip
  • 3 posts

Posted 29 May 2011 - 03:13 PM

Is it 100% positive you will have to use your backup or not?

I would not be able to work on it for another couple hours due to other stuff I need to get finished.
  • 0

#12 ReneB

ReneB

    Newbie

  • Members
  • Pip
  • 1 posts

Posted 29 May 2011 - 03:20 PM

I really really hope you get the filesystem fixed. i have done so much work the last 24 hours :/
  • 0

#13 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:20 PM

Is it 100% positive you will have to use your backup or not?

I would not be able to work on it for another couple hours due to other stuff I need to get finished.

If your account was created today, then it wouldn't matter because the backup was created before your account was created.

We're restoring the server now as the file system repairs left the file system in a state where there was simply too much data loss. It will need to run for a short bit before we will have an ETA.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#14 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:22 PM

5.1 GB of 309 GB have been restored so far. The system ETA says 2.5 hours however this can fluctuate. We'll update this thread with any updates.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#15 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:24 PM

11 GB Restored.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#16 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:31 PM

All accounts created on the server today by direct customers have been recreated on another server and account details dispatched. We are restoring the server to our backup from last night which has an ETA of approximately 2.5 hours according to the system. 25.1 GB of 309 GB have been restored so far.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#17 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:34 PM

35 of 309 GB Restored.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/

#18 nbaintel

nbaintel

    Newbie

  • Members
  • Pip
  • 17 posts

Posted 29 May 2011 - 03:41 PM

Mike, are you restoring the files from last night?
  • 0

#19 XTremo

XTremo

    Newbie

  • Members
  • Pip
  • 2 posts

Posted 29 May 2011 - 03:44 PM

Appreciate the updates and quick response Mike.
  • 0

#20 MikeDVB

MikeDVB

    Forum Administrator

  • Staff Administrator
  • PipPipPipPipPip
  • 2,893 posts
  • Gender:Male
  • Location:Central Indiana, USA

Posted 29 May 2011 - 03:49 PM

Mike, are you restoring the files from last night?

Yes, we are as the file system was beyond repair.

Appreciate the updates and quick response Mike.

Absolutely.

58.5 of 309 GBs restored.
  • 0
Michael Denney - MDDHosting LLC - Providing Hosting since 2007
Scalable shared hosting plans in the cloud! Check them out!
Highly Available Cloud Shared, Reseller, and VPS
http://www.mddhosting.com/




2 user(s) are reading this topic

0 members, 2 guests, 0 anonymous users