Site updated for MoP - Censusplus v6.0 download link

Padanfain · Post by **Padanfain** » Sat Dec 22, 2012 12:53 am

The current DB stats page hiccup is about 5 hours old so far. I'm certain, if it
is a file process, that it is not mine or 1974ER's. Not complaining, I'm still
taking census and uploading but I am curious about the details.

BTW so far the most lopsided realm I've taken a look at is Mug'thol.
800~1000 Horde to 50~70 Alliance every time I drop by. Brutal for
defending Stormwind LOL. Sorry. LOL.

Balgair · Post by **Balgair** » Sat Dec 22, 2012 6:27 am

I can't check anonymous submissions, only Rollie has that access; I've got the same data you guys do otherwise.

Btw Rollie says he was flooded with work last week, is hoping for better this week but if all else fails he'll have time over the holidays to have a look... hopefully!

Rowilco · Post by **Rowilco** » Sat Dec 22, 2012 10:37 am

I am new here , but pretty sure this isnt good ?
No updates processed after 8 dec up till 22 dec, some 120 files still in queu.

Dec 10, 12 05:53:44 0 0 N
Dec 10, 12 04:07:05 0 0 N
Dec 10, 12 03:01:01 0 0 N
Dec 10, 12 02:47:47 0 0 N
Dec 09, 12 17:09:52 0 0 N
Dec 09, 12 16:09:23 0 0 N
Dec 09, 12 14:05:23 0 0 N
Dec 09, 12 13:02:30 0 0 N
Dec 09, 12 12:16:20 0 0 N
Dec 09, 12 11:02:03 0 0 N
Dec 09, 12 09:41:51 0 0 N
Dec 09, 12 08:16:37 0 0 N
Dec 09, 12 06:10:18 0 0 N
Dec 09, 12 05:30:37 0 0 N
Dec 09, 12 05:08:48 0 0 N
Dec 09, 12 03:36:09 0 0 N
Dec 08, 12 19:23:55 0 0 N
Dec 08, 12 14:37:38 0 0 N
Dec 08, 12 03:53:04 18 85 Y
Dec 08, 12 03:13:07 45 200 Y

1974ER · Post by **1974ER** » Wed Dec 26, 2012 2:32 am

Welcome Rowilco,

DB queue is still crawling onwards, current status is:

Last processed file was uploaded on 2012-12-09 10:05:24.
Current server time is 2012-12-26 02:25:53

Rowilco · Post by **Rowilco** » Thu Dec 27, 2012 3:59 am

Oke thx

Korwynd · Post by **Korwynd** » Fri Dec 28, 2012 6:21 pm

Right now I got:

Dec 25, 12 20:30:35 0 0 N
Dec 25, 12 18:34:12 0 0 N
Dec 21, 12 21:47:05 0 0 N
Dec 21, 12 07:02:55 0 0 N
Dec 19, 12 22:26:11 0 0 N
Dec 19, 12 20:58:20 0 0 N
Dec 19, 12 08:02:25 0 0 N
Dec 18, 12 22:22:20 0 0 N
Dec 18, 12 21:44:53 0 0 N
Dec 18, 12 06:57:26 0 0 N
Dec 17, 12 22:54:26 0 0 N
Dec 16, 12 22:12:13 0 0 N
Dec 16, 12 11:05:25 0 0 N
Dec 15, 12 23:56:23 0 0 N
Dec 15, 12 21:22:46 0 0 N
Dec 15, 12 18:24:47 0 0 N
Dec 15, 12 09:01:32 0 0 N
Dec 13, 12 22:33:53 0 0 N
Dec 13, 12 21:01:30 0 0 N
Dec 13, 12 18:55:40 0 0 N
Dec 11, 12 22:35:54 0 0 N
Dec 11, 12 22:16:12 0 0 N
Dec 11, 12 18:52:47 0 0 N
Dec 11, 12 18:35:17 0 0 N
Dec 04, 12 22:03:25 513 1285 Y

will they ever catch up?

Padanfain · Post by **Padanfain** » Fri Dec 28, 2012 7:22 pm

On the 21st it was 13 days behind and now a week later it is 18 days behind so not looking so good.

Post by **bringoutyourdead** » Sat Dec 29, 2012 12:52 pm

I sent an email a few days ago to Rollie to see if I could get some clarification of the issue at hand, as of this time I haven't received a reply.

The site outage we saw from around 2am on the 24th thru 4pm on the 25th was caused by the servers being offline.. maybe power loss, maybe maintenance.

When the mySQL database is shutdown like that, proper start up requires a check of the database table for corruption issues. Depending on number of tables etc the background check can take awhile and slow down active transaction processing.

Another possibility (I hope, I hope) is that Rollie has added newer faster and larger drives and is doing an online mirror of the data from the one active drive set to the new one, this will also slow down processing for now with improved performance later after he finishes any upgrades.

We may never know what has been happening this week.. unless Rollie decides to respond the our outstanding queries.

Padanfain · Post by **Padanfain** » Sat Dec 29, 2012 11:17 pm

Thanks bringoutyourdead, I hope he can find the time to keep the site cooking data.

Wondered about the site being down. I have my fingers crossed it was a mirror/backup preceding a
hardware swap. That would be great.

Post by **bringoutyourdead** » Sun Dec 30, 2012 1:52 pm

As of some time yesterday... the almost no processing speed ended and we seem to be processing at a much faster rate.. but I have not check to see if it is faster then real time clock .. i.e. are we finally catching up with the queue?

1974ER · Post by **1974ER** » Sun Dec 30, 2012 3:16 pm

The speed seems to be fluctuating a lot... which is what it used to be like, long ago... So I am hoping things are improving. I'll copy the current situation here and take another look either late tomorrow or some time Tuesday.

Last processed file was uploaded on 2012-12-10 21:42:47.
Current server time is 2012-12-30 15:11:38

Also, due to personal reasons and since there have been no further errors, I am resuming uploads, though I'll try to keep a minimum 10 minutes interval while reducing my stockpile.

Padanfain · Post by **Padanfain** » Sun Dec 30, 2012 7:17 pm

It does feel like it is picking up a bit though I am still seeing errors

Dec 10, 12 22:55:17 763 2661 Y
Dec 10, 12 21:45:51 3694 11938 Y
Dec 10, 12 20:09:45 0 0 E
Dec 10, 12 01:39:38 0 0 E
Dec 10, 12 00:47:06 0 0 E
Dec 09, 12 23:15:34 2124 7455 Y
Dec 09, 12 22:00:21 0 0 E
Dec 09, 12 20:12:31 795 3229 Y
Dec 09, 12 01:52:12 164 426 Y
Dec 09, 12 01:05:49 4365 10398 Y

The 9th was when I started pruning over a day old. File sizes were about
4~6 MB if I remember correctly and by the 11th or 12th I started purging
after each submission which rarely hit 1 MB.

Hopefully experimenting with purging smooths out that E/Y column.

Post by **bringoutyourdead** » Sun Dec 30, 2012 9:10 pm

It will be interesting to see what happens with my uploads.. after every upload I do a
/census serverprune on a low population server.

I'm doing about 20 servers both sides.. and I'm seeing locally around 16 - 20k on every serverprune.

Padanfain · Post by **Padanfain** » Sun Dec 30, 2012 10:34 pm

Hopefully you won't see a replay of last Junes submissions. /FingersCrossed

Each of my submissions is both sides of 5 realms, upload, purge then rinse
and repeat 6 times. The 30 realms are a variety of low, medium and high
population realms and are PVE, PVP and RP and run between 5~9k per
group of 5.

The consistent lopsided population of play types is interesting.

A curiosity... Will the single toon submission from a cross realm sighting give
an update toward the 100 updates per 30 days needed to make that realm
census 'reliable data?'

1974ER · Post by **1974ER** » Sun Dec 30, 2012 11:56 pm

Padanfain, I am sorry that you are still seeing errors. I have luckily had none since December 1st and my latest 20 look like this:

Dec 30, 12 23:38:25 0 0 N
Dec 30, 12 21:55:33 0 0 N
Dec 30, 12 17:46:15 0 0 N
Dec 30, 12 17:27:48 0 0 N
Dec 30, 12 17:11:30 0 0 N
Dec 30, 12 16:57:12 0 0 N
Dec 30, 12 16:44:30 0 0 N
Dec 30, 12 16:31:41 0 0 N
Dec 30, 12 16:17:58 0 0 N
Dec 30, 12 15:44:19 0 0 N
Dec 30, 12 15:21:45 0 0 N
Dec 11, 12 17:50:43 0 0 N
Dec 11, 12 10:19:01 0 0 N
Dec 10, 12 19:43:08 824 4078 Y
Dec 10, 12 14:34:48 1382 5632 Y
Dec 10, 12 08:33:21 860 3483 Y
Dec 10, 12 05:10:33 293 1293 Y
Dec 09, 12 21:53:30 89 436 Y
Dec 09, 12 15:34:55 354 884 Y
Dec 09, 12 14:00:40 1419 5250 Y

Which means the pre-pause files are almost done and I have a rather long wait ahead of me to see, how the next stockpile will do...

Padanfain · Post by **Padanfain** » Mon Dec 31, 2012 12:55 am

So close to that 20 million update mark, I hope you don't have any more errors.

After Balgair mentioned that you and I were the only members with errors I
started taking census on a second computer, one with a WoW install from
around BC release and the other install was just before the Wrath release. It
may be a couple weeks to see if a trend emerges from that.

Besides I need about 20 more errors to catch up with you on that stat

lol.

1974ER · Post by **1974ER** » Mon Dec 31, 2012 2:07 am

Close is somewhat relative... with the data lost to the errors and so on... If there are absolutely no further errors, end of February / early March looks reasonable for breaking the 20 million updates barrier as I am about 680k short of that goal and have been getting somewhere around 250k per month (on average, November balancing out October during which I only gathered data due to the site problems) lately.

About that curiosity question you posted... as far as I know, no. Only fully completed censuses count and only for the faction you are online with. CRZ data only updates individual characters seen.

Padanfain · Post by **Padanfain** » Mon Dec 31, 2012 2:35 am

Real close compared to where you were at that first update or that first
million.

Glass is half full kind philosophy here.

Was just peeking through a recent single realm census of both factions and I
believe you are right. Under one heading it lists the date and time census
was taken on that realm for both sides and in another heading was a realm
with a single toon. So it looks like only the realms in the one heading gets
an update credit.

1974ER · Post by **1974ER** » Mon Dec 31, 2012 4:07 am

Hehehe... with that philosophy the "glass" is about 97% full (if my estimate on stockpile results holds and there are no processing errors). It's just that each remaining 1% takes about 3 weeks.

And when I started... I don't think anyone expected to see 20 million updates on the top of the all time board. Even now, over four years later, 10 million has not been broken by anyone else, though I expect Balgair will eventually get there. 5 million has been achieved by four people, 3 million by 8 (and Bringoutyourdead is very close to making that 9). In fact, due to the backlog, he probably already has, because he is currently only 28 005 short and has 26 unprocessed entries.

Balgair · Post by **Balgair** » Mon Dec 31, 2012 6:47 am

20 million is just insane, back in the day we all thought 1 million was a crazy goal lol

I can see myself reaching 10 million given another year or two, but 20... nope. It's taken me over seven years to get to still some way short of 9 million so, 20? Will WoW/WCR even still exist in the 10+ years that's gonna take me?