Data processing halted

General Discussion Area
Post Reply
User avatar
Rollie
Site Admin
Posts: 4783
Joined: Sun Nov 28, 2004 11:52 am
Location: Austin, TX
Contact:

Data processing halted

Post by Rollie »

Well, I think the database is a bit tuckered out. I am halting updates for the moment while I work out my next move be it database maintenance or hardware move.

Long time visitors will know that we seem to go through this every couple of years as the data grows and grows and I am reluctant to let a lot of the older data go.

I will likely increase my culling efforts and start removing all characters below level 50 that have not been seen in the last 18 months.
phpbb:phpinfo()

Dromic
Posts: 126
Joined: Tue Jul 17, 2007 11:07 am
Location: 3rd Rock from the Sun
Contact:

Post by Dromic »

Rollie would you like us to just do one upload per day till the database is back up? Or store the data on our side and upload when it is back.
________
Ford GT40
Last edited by Dromic on Fri Feb 04, 2011 12:00 pm, edited 1 time in total.

User avatar
DM.
Census Taker
Posts: 1130
Joined: Mon Oct 03, 2005 12:27 pm
Location: Toronto, Canada

Post by DM. »

Thats still alot of history, esp Vanilla WoW history that will be lost....
But something has to give.


Can't wait until it starts back!
Image
Click my sig

enke
Posts: 1
Joined: Mon Jan 19, 2009 8:37 pm

Post by enke »

In my job we track historical data of spam for clients (2GB of data per day for some clients).

I don't know how your data is setup, but what we do normally is roll the data up. Summarize the parts you can (into daily / monthly whatever) so your overall data for calculations is smaller. But we don't destroy the original data just in case we ever need to go back to it.

uigrad
Posts: 108
Joined: Tue Dec 20, 2005 12:26 am
Location: Illinois

Post by uigrad »

Is the data actually going to be lost, or just saved to disk for archival?

I'm sure that at some point in the future, you'll want to add it back in. Computers are still getting faster, and bandwidth is still improving. I really don't imagine to know how your database works, but do you think that the data can be restored if you want later?

If I have a character that I haven't logged in for more than 2+ years (and by the way, I do), I suppose that when I do log in and am caught by a census, then it will start over with fresh history, right?

My very first toon:
http://www.warcraftrealms.com/charsheet/566821

User avatar
Rollie
Site Admin
Posts: 4783
Joined: Sun Nov 28, 2004 11:52 am
Location: Austin, TX
Contact:

Post by Rollie »

I have it archived off. It will mainly remove that data from the main tables so that the main processing of the site is allowed to speed up.

There are over 50M character rows and over 500M character entry row (a character entry being a level and/or guild entry).
phpbb:phpinfo()

Post Reply