FSD Database Rolled Back by One Day

Hello Fighters,

Sadly, today at 11 AM (GMT -4) the Free Step Dodge database (the thing that contains all of our user names, posts, and information) became corrupted. Fortunately, I keep back-ups of the database in the event something like it happens. Unfortunately, the May 6th backup did not complete before the corruption occurred. So the database has been fixed by restoring from the May 5th backup. That means that any accounts, posts, likes, threads, private conversations, etc. that were made or performed since May 5th at 4 AM (GMT -4) were lost.

I apologize for any inconvenience. If you encounter any errors with re-creating lost information please be sure to make a post about it in the Issues board, or if the information is private feel free to start a conversation with me.

Thank you for your understanding,
Matt Ponton

 

If it's of some help I can delete all my recent uploads in the "modding photo thread" replacing the pictures with images hosted on imgur or similar.

Sure.

 

@Mr. Wah apparently I can't eliminate the attachments or there is a way that I don't know. I tried to edit the very OP of that thread replacing the picture with an hosted version, but again in the end the post link me to the attached image.

http://www.freestepdodge.com/threads/the-last-round-modding-photography-thread.5596/

I suspect that I lack of the needed permissions for doing it but even so, if you or other mods don't care for deleting the attachments in a second time by yourself, I can anyway go further copy/paste all the hosted versions of the pictures.

 

@Mr. Wah apparently I can't eliminate the attachments or there is a way that I don't know. I tried to edit the very OP of that thread replacing the picture with an hosted version, but again in the end the post link me to the attached image.

http://www.freestepdodge.com/threads/the-last-round-modding-photography-thread.5596/

I suspect that I lack of the needed permissions for doing it but even so, if you or other mods don't care for deleting the attachments in a second time by yourself, I can anyway go further copy/paste all the hosted versions of the pictures.

Yeah, as I mentioned I made uploading an attachment a Premium Donator permission. That includes editing existing attachments. I'll be clearing out many of the attachments manually I'm sure, so if you want to just edit out any posts where you are using an attachmet with a image reference to an external site that would be fine too.

 

Yeah, as I mentioned I made uploading an attachment a Premium Donator permission. That includes editing existing attachments. I'll be clearing out many of the attachments manually I'm sure, so if you want to just edit out any posts where you are using an attachmet with a image reference to an external site that would be fine too.

Very well, I will edit all my posts of that thread with hosted images and later you will eliminate the attachement version left =)

 

I've finally found the culprit.

The Streams application would be writing data and content to the storage host, and the host was at critical disk usage spaces. We had another instance of it this morning.

Looking at the leading culprits, Attachments are the primary data hog. I'm running the numbers right now to see how much of my data storage they are taking up. Preliminary numbers show an expectation of 30-50% of my total storage on the site. I of course acknowledge that I was being very generous by allowing people to upload a maximum single file size of 10mb. Looking at the logs, some users were uploading the same heavy data file (animated gifs / high-res photos) in numerous posts but as separate duplicate file uploads.

For the time being, since the recent corruption only corrupted the Streams section, I've disabled the Streams section until I can restore it later today, and uploading an attachment has only been reserved as a premium donator permission.

I'll also have to find time to manually go through the uploaded attachments and deem whether the attachment can be deleted at this time (outdated post or image is not relevant to post/topic).

Donator only feature will cut down a little, but i would imagine the donators are the ones doing the most uploading, since they would expectantly post the most, and thus would post the most images. Short term solution, but with all the free web hosting solutions out there right now, we should be able to externally host images no problem. The problem with deleting images is that they ultimately must be looked upon at a case by case basis (even old posts hold important things, and we may end up regretting loosing old posts [add drama to the equation as well, let alone some things' relevance not being immediately recognizable]). Given the daily post count, that's quite a task. Anything you do in the way of deleting things will be a short term solution.

So really, we gotta try to figure out where the images can go. How much space are we looking at to move (moving is alot easier than it sounds)?

EDIT:

The idea of moving is as simple as pulling files out by their resource ID or whatever the forum post IDs them as, then sticking them on the other server, while also editing the post to reflect the URL change. Sure, there's going to be alot of space waste, but space is less valuable than time, and if a script can be tested and proven to work (and since you say you do backups anyway) this can then be run via script to do all the dirty work.

 

.

donate money to FSD
get your money back by using all the FSD bandwidth

no problem detected here

 

It doesn't matter. I've made some adjustments to where we shouldn't have to worry about it again. The permission has been restored to all registered members.

 

It doesn't matter. I've made some adjustments to where we shouldn't have to worry about it again. The permission has been restored to all registered members.

We go from specified adjustments to unspecified adjustments. I'm not worried, but i'll deal with it. XD