So here I am, 5 months later.. I still get regular traffic to this blog, so there must be at least a few people interested in what's happened..
In my last post, I mentioned that the server I was running on started having an occasional hiccup on the raid controller. After nursing it along for about 3 weeks and actually putting a replacement raid controller in, something gave and the whole thing went south fast. The server crashed in late January and wouldn't boot back up. The server crashed late at night during a massive snow storm. I braved the storm and drove downtown to the colo center and started to work on the server. After a couple hours, it became clear that whatever the resolution was, it wasn't going to be quick. I put a maintenance page up on one of my other servers and sent all traffic there while I figured out what to do and got some sleep. The next day, I woke up and started looking at the server. I was trying to recover it to the point that it would boot. I was unable to do so. I made the tough decision to roll back to the old site that was on my other old server. I did that while I put together a plan. I had hours and hours of work that was lost on this "new to me" server. I had to recover the data if at all possible. I purchased some
data recovery software on the net,
built a bootdisk with all the drivers I needed and loaded it up. I had to go buy an external usb drive to copy the files onto. I hooked everything up, fired up the bootdisk and after a day of trying different options and configurations, voila! There were all my files from DNN, the database and everything! Almost all the files were in tact. There were a few DNN core files that were corrupted, and then a good number of the user files that were corrupt. All in all, nothing that was irreplaceable was lost. I put together a virtual server in MS virtual server and proceeded to rebuild the site. It took a few days, but I got it up and running. I copied the VM up to my 3rd server that runs MS virtual server and brought the new DNN based site back online.
It was clear that I needed some brand new hardware with a warranty and everything. If I have this much riding on a website, I need to put it on decent hardware. I was able to procure, through a member of my site, a factory re certified HP DL360 G5.. It's a really nice server. I loaded it up with memory and hard disk space. I'll be able to run on this guy for years.
Once I got that server online, I scheduled a night to move the VM over to the new server. I scheduled a backup job to run each night that backs up the database and the DNN install directory to the portable USB drive every night. I have tested a restore in my developement server and it works great, so I am now satisfied that if something went horribly wrong, I could recover a lot easier. The hope is however, that nothing ever goes that wrong again..