Page 1 of 1
Data processing halted
Posted: Wed Jan 21, 2009 8:16 pm
by Rollie
Well, I think the database is a bit tuckered out. I am halting updates for the moment while I work out my next move be it database maintenance or hardware move.
Long time visitors will know that we seem to go through this every couple of years as the data grows and grows and I am reluctant to let a lot of the older data go.
I will likely increase my culling efforts and start removing all characters below level 50 that have not been seen in the last 18 months.
Posted: Wed Jan 21, 2009 10:25 pm
by Dromic
Rollie would you like us to just do one upload per day till the database is back up? Or store the data on our side and upload when it is back.
________
Ford GT40
Posted: Wed Jan 21, 2009 11:54 pm
by DM.
Thats still alot of history, esp Vanilla WoW history that will be lost....
But something has to give.
Can't wait until it starts back!
Posted: Thu Jan 22, 2009 9:08 am
by enke
In my job we track historical data of spam for clients (2GB of data per day for some clients).
I don't know how your data is setup, but what we do normally is roll the data up. Summarize the parts you can (into daily / monthly whatever) so your overall data for calculations is smaller. But we don't destroy the original data just in case we ever need to go back to it.
Posted: Thu Jan 22, 2009 9:54 am
by uigrad
Is the data actually going to be lost, or just saved to disk for archival?
I'm sure that at some point in the future, you'll want to add it back in. Computers are still getting faster, and bandwidth is still improving. I really don't imagine to know how your database works, but do you think that the data can be restored if you want later?
If I have a character that I haven't logged in for more than 2+ years (and by the way, I do), I suppose that when I do log in and am caught by a census, then it will start over with fresh history, right?
My very first toon:
http://www.warcraftrealms.com/charsheet/566821
Posted: Fri Jan 23, 2009 11:07 am
by Rollie
I have it archived off. It will mainly remove that data from the main tables so that the main processing of the site is allowed to speed up.
There are over 50M character rows and over 500M character entry row (a character entry being a level and/or guild entry).