FSD Database Rolled Back by One Day

Hello Fighters,

Sadly, today at 11 AM (GMT -4) the Free Step Dodge database (the thing that contains all of our user names, posts, and information) became corrupted. Fortunately, I keep back-ups of the database in the event something like it happens. Unfortunately, the May 6th backup did not complete before the corruption occurred. So the database has been fixed by restoring from the May 5th backup. That means that any accounts, posts, likes, threads, private conversations, etc. that were made or performed since May 5th at 4 AM (GMT -4) were lost.

I apologize for any inconvenience. If you encounter any errors with re-creating lost information please be sure to make a post about it in the Issues board, or if the information is private feel free to start a conversation with me.

Thank you for your understanding,
Matt Ponton

 

Why are people LIKING the first post wtf?

I was able to restore one of my posts through Google Cache, but that was luck.
Just search this on Google: cache:yourlink.com
Alternatively you can paste the link into the Internet Archive: https://archive.org/web/

 

Why are people LIKING the first post wtf?

Personally cause this line: "Fortunately, I keep back-ups of the database in the event something like it happens."

 

Why are people LIKING the first post wtf?

Mainly because it's nice to see that Sorwah is giving some explanations about what happened and how he fixed it. I'm pretty sure that if he just would stay quiet about the loss of data, you could read a lot of "Where are my posts? Who deleted them? [insert conspiracy theory here]" from people, either on their profile, or his own.

 

something is wrong with the submit youtube media, when is it going to be fixed? tnx

 

Why are people LIKING the first post

to echo what others have said... or

because he actually got it fixed right away and explained it...

something is wrong with the submit youtube media, when is it going to be fixed? tnx

Patience, Grasshopper

 

something is wrong with the submit youtube media, when is it going to be fixed? tnx

wasn't aware. Will look into it later tonight.

What exactly is wrong? And please remember:

If you encounter any errors with re-creating lost information please be sure to make a post about it in the Issues board, or if the information is private feel free to start a conversation with me.

 

I just registered yesterday. No wonder I couldn't log-in. My account did not exist. haha Thanks for the heads up.

 

something is wrong with the submit youtube media, when is it going to be fixed? tnx

This is on YouTube's end. Sadly, the current version of the Media library can't handle such a modification to resolve it. I'd need to upgrade the feature which costs $50. I've put it up as a donation option if enough people want me to purchase it. Right now it just looks like it's not importing the data correctly (Title and Thumbnail). However it appears to be working fine upon viewing post submission and the submitter just needs to edit the submission.

 

What happened exactly?

 

What happened exactly?

Don't know. Database got corrupted some how. My logs don't show anything out of the ordinary being done until the error occurred.

 

Sadly, the current version of the Media library can't handle such a modification to resolve it. I'd need to upgrade the feature which costs $50.

Damn why did you pick a paid forum software in the first place while there are plenty of free&open source alternatives?

 

Damn why did you pick a paid forum software in the first place while there are plenty of free&open source alternatives?

I weighed my options and went with the software I feel was the best fit. This forum was vBulletin at one point before that too. I did not care for the open source bulletin boards.

 

I weighed my options and went with the software I feel was the best fit. This forum was vBulletin at one point before that too. I did not care for the open source bulletin boards.

I'm curious what you didn't like about them. The whole point of open source is that you can get exactly what you need without building something yourself from scratch.

Don't know. Database got corrupted some how. My logs don't show anything out of the ordinary being done until the error occurred.

I noticed there was no response via HTTP from the server that day as well, earlier in the day. That could've been you fixing it and i got my days messed up (in which case i'd wonder why there wasn't some kind of splash but it's not that big of a deal). Is there evidence of a power outage or something? If so, i would consider moving the database to a linux computer since their file systems are designed to deal with power outages and things like that.

 

Apparently the issue was caused by the Stream software. I've had to re-install the feature to the site which also cleared any of the submitted streams.

 

Apparently the issue was caused by the Stream software. I've had to re-install the feature to the site which also cleared any of the submitted streams.

Odd that they would be using the same DB.

 

Odd that they would be using the same DB.

You misunderstand. I was referring to the Stream settings/information/channels in the FSD database. Not the Twitch/Youtube/Ustream databases.

 

You misunderstand. I was referring to the Stream settings/information/channels in the FSD database. Not the Twitch/Youtube/Ustream databases.

No, that much is obvious. It just seems strange to me that the plugins would be using the same database and such (they should at least be using separate tables). Or is that just the way the forum software demands plugins behave? I mean, that kind of practice is exactly what lead to the problem you had. Worse yet, such a thing makes it harder to trace. From a design standpoint, you want to isolate everything to it's own section, so if a section breaks, only that section breaks. Also, the site shouldn't stumble if a plugin fails in it's own private table if they are using separate tables.

 

Yes, they have their own tables. And I agree that a modular design is best.

 

I've finally found the culprit.

The Streams application would be writing data and content to the storage host, and the host was at critical disk usage spaces. We had another instance of it this morning.

Looking at the leading culprits, Attachments are the primary data hog. I'm running the numbers right now to see how much of my data storage they are taking up. Preliminary numbers show an expectation of 30-50% of my total storage on the site. I of course acknowledge that I was being very generous by allowing people to upload a maximum single file size of 10mb. Looking at the logs, some users were uploading the same heavy data file (animated gifs / high-res photos) in numerous posts but as separate duplicate file uploads.

For the time being, since the recent corruption only corrupted the Streams section, I've disabled the Streams section until I can restore it later today, and uploading an attachment has only been reserved as a premium donator permission.

I'll also have to find time to manually go through the uploaded attachments and deem whether the attachment can be deleted at this time (outdated post or image is not relevant to post/topic).

 

If it's of some help I can delete all my recent uploads in the "modding photo thread" replacing the pictures with images hosted on imgur or similar.