You’re probably an idiot. A lot of people are, me included. When did you last do a backup? You don’t have one? Well, neither did I. If you have ever visited my virtually never updated blog you’ll probably see some posts missing. Not that there actually were a lot to look at anyway. Three posts, and two of them were mostly uninteresting, to be honest. My SVN repositories are gone as well, but I had the ones I cared about checked out on my computer anyway. Of course I’ll lose the revision log and rollback capability, but at least I have the latest revision available. Another loss was my folder of funny and witty pictures. That folder was nothing short of pure awesomeness. I can probably just rip them off someone again. They weren’t “mine” anyway.
How did this happen? My VPS provider ran some control panel management software of some sort called HyperVM developed by some company called LxLabs. Apparently this piece is software is a piece of shit and had numerous fatal security vulnerabilities. Someone found it incredibly amusing to exploit one of these holes and wipe hundreds and thousands of VEs resulting considerate downtime on quite a lot of websites having complete data loss, and even more being down for a long time. My stuff was mostly personal crap, but other people, fellow idiots, actually had important data and had customers’ data. All gone, forever and entirely irreversible. While following the situation I saw some people getting increasingly frustrated. Customers complaining, demanding refunds, etc. Customers calling to ask “where the fuck is my shit?” These are of course bigger idiots than I am. They lost important, “mission critical” crap, I lost private and largely unimportant crap.
It’s actually something I see a lot. Many people seem to put blind faith in the integrity of their data, even if it’s very important and valuable data. Of course their shit won’t get lost/burnt/broken/stolen/whatever — only the neighbor’s will. Sometimes it turns out to be different. I’ve seen people lose USB sticks with allegedly super important data. Some were fortunate enough to find it again, others weren’t.
I suppose the lesson is hope for the best, plan for the worst. Don’t be an idiot, backup your data!
Sorry to hear about the bad luck Daniel. What a nightmare. Did the hosting company refund anyone? They probably went down after that.
I do cron a backup using duplicity which does gpg’d incremental backups to an offsite location. Works nice. Of course I run the occassional test recover of backups.
I hope you get your new vm backup and running.
They gave 1 month free for people who had a downtime of over 24 hours and 2 months free for people who had data loss. The company was acquired by a larger firm, so I suppose you can say they did go down.
What’s funny is that the day before it happened I was going to take a backup to rebuild my VPS because I had some issues with coreutils I couldn’t resolve. I decided to postpone it until the next day, but next day my VPS was gone.
I guess I just learned that I should do backups the hard way. Actually, I don’t have any backups for this VPS yet, but there is not much besides this blog on it anyway.
Hey Dan. I know exactly what you are talking about. I think we must be using the same company, but I did not lose my data. This same company also seems to have a lot of downtime problems. I guess I have another server on my node that is always crapping out the CPU. I’m waiting to roll over to the new KVM based system. If I still experience problems after the switch, I’ll be switching to another provider.