WarcraftRealms.com

OK, I am sure with the new census plus addon there are some bugs, however my uploads are not being counted.

Nov 25, 10 09:34:57 0 0 N
Nov 24, 10 17:55:47 0 0 N
Nov 24, 10 16:52:08 0 0 N
Nov 24, 10 13:00:10 0 0 N
Nov 24, 10 10:18:48 0 0 N
Nov 22, 10 16:10:27 0 0 N


I figured I would wait a couple of days before complaining...

/RollieSignal

(Oh yeah and I am back playing again LOL)

We have a 100+ hours delay right now

Thanks for the reply!

Well, I am pretty sure the site has stalled... still no updates proccessed.

Nov 26, 10 10:52:58 0 0 N
Nov 25, 10 22:35:55 0 0 N
Nov 25, 10 16:53:22 0 0 N
Nov 25, 10 11:18:40 0 0 N
Nov 25, 10 09:34:57 0 0 N
Nov 24, 10 17:55:47 0 0 N
Nov 24, 10 16:52:08 0 0 N
Nov 24, 10 13:00:10 0 0 N
Nov 24, 10 10:18:48 0 0 N
Nov 22, 10 16:10:27 0 0 N


/ROLLIESIGNAL

It has indeed stalled, been sitting at the same date last processed for about 2 days now - Rollie made some changes a couple of days back to try and fix the backlog but it seems it's died entirely for the moment

Yep, it's borked, I"m looking into it, was out a couple days for Thanksgiving

It should resume processing now, obviously will take some time to catch up, help me keep an eye on it to be sure it's actually catching up and not falling further behind =x

Rollie wrote:It should resume processing now, obviously will take some time to catch up, help me keep an eye on it to be sure it's actually catching up and not falling further behind =x

Rollie! How are things?

Will keep an eye on it!

It's moving forward now at least =)

Although it is only running at about 10 processed files per hour right now, which is waaaaay too slow. I will be watching to see how/if it speeds up as the cull process runs to reduce the size of the characters table.

Rollie wrote:Although it is only running at about 10 processed files per hour right now, which is waaaaay too slow. I will be watching to see how/if it speeds up as the cull process runs to reduce the size of the characters table.

How goes the battle?

Is it moving faster?

Rollie might be able to supply a more comprehensive answer, but to me, it seems we are slowly weathering this storm as well. Queue seems to have shrunk from about 6 days 4+ hours to 5 days 17 hours. If I recall correctly, last time there was a major problem, it took more than 4 days after Rollie's repairs before the situation started to truely normalize.

So I would say: Early days, but looking good again.

Where Are you seeing the Queue numbers at and etc?

http://www.warcraftrealms.com/dbstats.php

There you go.

Nice, Thanks!

Last processed file was uploaded on 2010-11-26 09:45:05.
Current server time is 2010-11-30 20:25:11

From:
http://www.warcraftrealms.com/dbstats.php

on pace to be caught up in about 12 days by my math
in the past 30 hours, it's caught up about 11 hours.. 30/11*(current delay of 107 hours) = 291 hours = about 12 days

pencey wrote:on pace to be caught up in about 12 days by my math
in the past 30 hours, it's caught up about 11 hours.. 30/11*(current delay of 107 hours) = 291 hours = about 12 days

Is that 12 days only if there are no newer uploads? Just curious

As far as I can reverse the math, Pencey was assuming the rate of catchup to be constant, which unfortunately isn't true as it depends on the amount and size of unprocessed submissions.

In other words, if submissions stopped completely, the time would be cut down, if the amount and size of submissions remained steady, the time would be fairly accurate and if there were a lot more and / or bigger files, the time would go up.

1974ER wrote:As far as I can reverse the math, Pencey was assuming the rate of catchup to be constant, which unfortunately isn't true as it depends on the amount and size of unprocessed submissions.

In other words, if submissions stopped completely, the time would be cut down, if the amount and size of submissions remained steady, the time would be fairly accurate and if there were a lot more and / or bigger files, the time would go up.

correct. and i was hoping that over time, the fact that the rate of updates isn't constant wouldn't matter much (since it'd start to average out)

unfortunately, relative when I started keeping track (2010-11-29 15:02:30), we are now going negative, haven fallen from 117 hours behind to 121 hours behind.

this is due to the big stall last night, and the fact that it is currently processing the 'busy time' uploads for 2010-11-26 (~6pm when everyone is home playing and censusing). once it gets over this 'busy time' hump and into the nighttime updates, it'll catch up a bit..

anyway, it looks like, on a good day, it can catch up around 8 hours, so if it were 80 hours behind, it'd take roughly 10 days to catch up. we're looking at around 15 days right now... but maybe with the slowdown, people have been submitting less often, allowing it to catch up faster..

on the other hand.. with the release of cataclysm in a few days, there will be an explosion of low-level characters, which could slow the db down more (adding a new chars to the db will probably slow it down more than updating an existing char).. plus maybe people will come back to the game and start uploading censuses again, increasing load on the site..

so really i have no idea when it'll be caught up again could be 10 days if all goes well.. or could be significantly longer.

rollie could put some sort of 'efficiency of upload' measure for files, dividing the number of new char updates the file generated by the time it took to process the file. if the efficiency number is low, the person uploading could see that they need to do something to make their uploads more efficient, such as perhaps pruning/purging more, or avoiding certain realms that are already well-censused. if the site detected that the currently processing file had an abnormally low efficiency after looking at x characters in the file, it could just stop processing the file and move on to the next one.