), to allow it to catch up on that week's uploads? If people know it'll be down the same day each week they'll probably get used to it fairly soon, and you can always bring it up early if it catches up fully during the downtime. Could be the best way to let it catch up and stay caught up, at least until any more permanent solution can be found.Pause allowing submissions?
Hmm that could be an idea, how about pausing it one day every week, kinda like Blizz maintenance (heck, even do it on maintenance day! ), to allow it to catch up on that week's uploads? If people know it'll be down the same day each week they'll probably get used to it fairly soon, and you can always bring it up early if it catches up fully during the downtime. Could be the best way to let it catch up and stay caught up, at least until any more permanent solution can be found.
), to allow it to catch up on that week's uploads? If people know it'll be down the same day each week they'll probably get used to it fairly soon, and you can always bring it up early if it catches up fully during the downtime. Could be the best way to let it catch up and stay caught up, at least until any more permanent solution can be found.um... yhea. that was what i wrote. thanks for writing it twice thoBalgair wrote:Hmm that could be an idea, how about pausing it one day every week, kinda like Blizz maintenance (heck, even do it on maintenance day!
In my 2 cents worth...
I think it would be a bad idea to stop submissions for any length of time... it would stop the momentum you have going...
However, I would not think that one day a week would be a bad idea, such as already been suggested - patch day, that submissions would halt. It would give the system a chance to catch up a bit, if behind. And has been suggested, it could always be started up again if there is no backlog.
I think it would be a bad idea to stop submissions for any length of time... it would stop the momentum you have going...
However, I would not think that one day a week would be a bad idea, such as already been suggested - patch day, that submissions would halt. It would give the system a chance to catch up a bit, if behind. And has been suggested, it could always be started up again if there is no backlog.
<img src='http://www.mysigspace.com/wrsig/42016588.jpg'> <img src='http://www.mysigspace.com/wrsig/44894524.jpg'>
Hehe, well given the timezone difference, Tuesday based on USA times would cover about as much of our downtime as Wednesday would anywaySkyfire wrote:Actually, we can't play for half the day on Tuesdays anyway... not being able to submit for another 12 hours probably wouldn't kill most of us (Balgair is excluded from that statement).
I dont think Tuesday's is really a good idea... I do alot of trolling here on tuesday's and thats when I also upload my data that I have regret to upload over the weekend. I also go to alot of WoW related sites. Mostly warcraftmovies.com, but more recently its been addon sites like cosmosui.org, curse-gaming, wowinterface, wowace, and more....
Or maybe over night might be an idea. Like a couple of days a week where the database takes a break and doesn't accept anything to allow it to catch up overnight. I know there have been many times where I can't connect at all to the database when trolling really late at night.
But if you go with Tuesdays I suppose just not allowing the updates, and allowing everything else to work should be fine. It will just force people to upload it another time.
Or maybe over night might be an idea. Like a couple of days a week where the database takes a break and doesn't accept anything to allow it to catch up overnight. I know there have been many times where I can't connect at all to the database when trolling really late at night.
But if you go with Tuesdays I suppose just not allowing the updates, and allowing everything else to work should be fine. It will just force people to upload it another time.
Click my sig
Perhaps I am missing something, but.....
How will not accepting submissions for a day speed anything up? People will continue to run census and then just upload larger files when allowed to submit again.
I believe you mentioned somewhere that it's not the file size that slows things down, but the actual comparing of the incoming data to the existing data.
Unless the process itself can be sped up, the only way I see for the system to catch up is to have less data to process. This means that people need to census less, which is not a good thing...
Will the system crunch data significantly faster if it were off line for a day? Fast enough to catch up on several days of data? If so, then I am all for having a day of down time...
<img src='http://www.mysigspace.com/wrsig/37440512.jpg'>
How will not accepting submissions for a day speed anything up? People will continue to run census and then just upload larger files when allowed to submit again.
I believe you mentioned somewhere that it's not the file size that slows things down, but the actual comparing of the incoming data to the existing data.
Unless the process itself can be sped up, the only way I see for the system to catch up is to have less data to process. This means that people need to census less, which is not a good thing...
Will the system crunch data significantly faster if it were off line for a day? Fast enough to catch up on several days of data? If so, then I am all for having a day of down time...
<img src='http://www.mysigspace.com/wrsig/37440512.jpg'>
Why not limit inbound?
Would limiting the inbound help? I mean I think I understand that if I submit 4 times in an hour, only the last one is taken... But the last one contains all the data of the previous 4, right?
So if you limited me to once every 24 hours (or overwrite the existing). You are still getting all my data and would let the DB catch up since it would processing a lot less data.
Is that correct?
So if you limited me to once every 24 hours (or overwrite the existing). You are still getting all my data and would let the DB catch up since it would processing a lot less data.
Is that correct?
Yes, you would be correct. I wouldn't want to set it to 24 hours, but I might not be adverse to increasing that time limit. I will do some checks to see just how many entries I am getting in rapid succession.
On another note, I am working with a MySQL expert to work on possible optimizations and will likely not do anything until after he has had a chance to give some ideas on ways to improve things.
On another note, I am working with a MySQL expert to work on possible optimizations and will likely not do anything until after he has had a chance to give some ideas on ways to improve things.
phpbb:phpinfo()
Well after holding off for the past 2 weeks without submitting... I just uploaded a file. As of posting its on December 9th and it seems to be moving right along. Perhaps there isn't as many submissions to go through since people have been reading the forums about the database issues and held back from uploading. Or maybe the database guru fixed whatever the problem was
Curious what you have planned for the BG's tho... since you seem to be tracking data about the battlegrounds.... What are you up to..........................
and in other news, I ditched Cosmos in favor of Ace2 mods so manual updates of CensusPlus ftw
Curious what you have planned for the BG's tho... since you seem to be tracking data about the battlegrounds.... What are you up to..........................
and in other news, I ditched Cosmos in favor of Ace2 mods so manual updates of CensusPlus ftw
Click my sig
