7M updates
7M updates
It's now time for the next xM thread, as 7M updates marker breaks today.
Yep, it's updated now, finally made it! 
Next target: beating my personal best censuses in a month (which I believe may also be the WCR highest total, will have to check that out 
)
Edit: yep, my updates per month best of 837,062 is a WCR record, Kerebo holds the new ones record of 145,482. Some nice targets for me before Cataclysm hits and I barely leave my home server for a while
Next target: beating my personal best censuses in a month (which I believe may also be the WCR highest total, will have to check that out )Edit: yep, my updates per month best of 837,062 is a WCR record, Kerebo holds the new ones record of 145,482. Some nice targets for me before Cataclysm hits and I barely leave my home server for a while
Actually... If I am reading the Census database data correctly... you are getting so many updates and new ones because YOU are doing a lot... but overall... we are losing results. Unless I am badly mistaken... we are down over 400k entries in past 7 days and that loss has happened in less than 3 days. 
That's the catch... it's working on processed values, at least for some things. Because, otherwise, the number of factions updated in the past 24 hours would be 0 for both Horde and Alliance... and both of those values are close to 300. Which in turn means that in the past 24 hours, approximately 600+ censuses have processed. I say 600+, because it's a fact that some factions have gotten more than one update in that time period as I, you and several other people have made more than one submission within the last 24 hours that have been processed.
If the same applies to the number seen... it has dropped by about 400k in the last about 3 days (actual, not processed). And if it actually uses days... the problem is even worse... you see, I took a quick count and made a rough estimate based on certain rule of thumb I have found fairly accurate in the past. Provided I didn't make any major mistakes... you and I, between just the two of us... are resposible for approximately 740k characters seen in the past 7 (excluding the unprocesssed files) out of the roughly 1,3 million that have been seen.
That would mean that the two of us would have handled more than 50% (actually almost 60%) of all incoming info that has already been processed after November 7th. That, to me, seems a tad high, don't you think?
The "joke" is... even if I dropped to the value of new + updated, we two would still be looking at almost 370k entries total (and we both know that we produce a lot of data that is neither new nor an update, but would still count as seen). 370k still equals almost 30% of 1,3M. And yes, I did already realise that we have certainly updated some characters more than once even in just a few days... but it's still a huge chunk of the total.
Which in turn means that in the past 24 hours, approximately 600+ censuses have processed. I say 600+, because it's a fact that some factions have gotten more than one update in that time period as I, you and several other people have made more than one submission within the last 24 hours that have been processed.If the same applies to the number seen... it has dropped by about 400k in the last about 3 days (actual, not processed). And if it actually uses days... the problem is even worse... you see, I took a quick count and made a rough estimate based on certain rule of thumb I have found fairly accurate in the past. Provided I didn't make any major mistakes... you and I, between just the two of us... are resposible for approximately 740k characters seen in the past 7 (excluding the unprocesssed files) out of the roughly 1,3 million that have been seen.
That would mean that the two of us would have handled more than 50% (actually almost 60%) of all incoming info that has already been processed after November 7th. That, to me, seems a tad high, don't you think?
The "joke" is... even if I dropped to the value of new + updated, we two would still be looking at almost 370k entries total (and we both know that we produce a lot of data that is neither new nor an update, but would still count as seen). 370k still equals almost 30% of 1,3M. And yes, I did already realise that we have certainly updated some characters more than once even in just a few days... but it's still a huge chunk of the total.
Eek, yeah, hmm, sounds a bit strange, I know we update more than anyone else but... ouch! That said, I think something's a bit off with that, given Anonymous has 952,046 updates and 237,400 new ones this month, which would have to be only the first 13 days of the month, looking at where the database has got up to so far - halving that for an average would suggest Anonymous alone has equalled/outcensused the two of us, and there's plenty of logged-in users as well! Would seem to me as though perhaps the last 24 hours goes on last 24 hours of processed data, but 7 days might be realtime 7 days, of which only 5 days has been processed?
That pretty much has to be the reason... as... if my memory isn't utterly wrong... compared to late yesterday evening, the total number of characters in the database has grown by less than 9000, while the number seen has dropped by about an additional 100k and the number created by about 50k.
Additionally, the queue is now almost 43 hours behind, up from about 34 hours of backlog yesterday.
Also, on the montly scale... We two have 154 581 new ones and 634 342 updates so far, giving us about 3/5 of anonymous figure on new ones and almost exactly 2/3 of anonymous updates figure.
Given some of my earlier calculations: I am predicting roughly following total spread:
45% anonymous
30% you and I (you with a bit over 20%, me around 8-9%)
16-18% rest of the top 10s
7-9% everyone else combined
I fully admit that my calculations could be badly off... but here are a couple of interesting facts: You have more new characters so far than ENTIRE REST of the top 10 combined (myself included)... and on the updates list... it takes me and FIVE other people to roughly match your figure.
Additionally, the queue is now almost 43 hours behind, up from about 34 hours of backlog yesterday.
Also, on the montly scale... We two have 154 581 new ones and 634 342 updates so far, giving us about 3/5 of anonymous figure on new ones and almost exactly 2/3 of anonymous updates figure.
Given some of my earlier calculations: I am predicting roughly following total spread:
45% anonymous
30% you and I (you with a bit over 20%, me around 8-9%)
16-18% rest of the top 10s
7-9% everyone else combined
I fully admit that my calculations could be badly off... but here are a couple of interesting facts: You have more new characters so far than ENTIRE REST of the top 10 combined (myself included)... and on the updates list... it takes me and FIVE other people to roughly match your figure.
Lol wow, I hadn't added up the new ones, though I knew I was fairly well ahead If only I could keep up this level of censusing forever we'd have a lot less issues with lack of accuracy, but... it's too intense really, I'm only managing as much as I am because I'm playing WoW a lot less (taking a break before Cataclysm, since I know I'll play nonstop from release until I go away for Xmas holidays ), and it won't last! Oh well, at least it should help things a little in the meantime 
If only I could keep up this level of censusing forever we'd have a lot less issues with lack of accuracy, but... it's too intense really, I'm only managing as much as I am because I'm playing WoW a lot less (taking a break before Cataclysm, since I know I'll play nonstop from release until I go away for Xmas holidays ), and it won't last! Oh well, at least it should help things a little in the meantime 146,659 new onesBalgair wrote:Edit: yep, my updates per month best of 837,062 is a WCR record, Kerebo holds the new ones record of 145,482.
Still not sure if I'll make the updates one, it's so far behind it's really quite hard to tell where I actually am, but it's probably still on target... I think? 147,827 for you at the moment I started typing this. Also, you are already at 556,359 updates, with seven submission currently fully unprocessed... at a steady pace, that would result in excess of 834,500 updates, meaning almost exact draw with you current record of 837,062. Considering that there are multiple unprocessed submissions and the 20th has barely began in the EU, I would say you still have a very good chance to bypass your previous record.
Also, you are already at 556,359 updates, with seven submission currently fully unprocessed... at a steady pace, that would result in excess of 834,500 updates, meaning almost exact draw with you current record of 837,062. Considering that there are multiple unprocessed submissions and the 20th has barely began in the EU, I would say you still have a very good chance to bypass your previous record.Hehe I hope so but we'll see, I'm slowing down a bit atm because I'm playing my main server again, what with elemental invasions and needing to do a few things before they're gone Hoping I can make it though, we'll see! I still say with enough dedication, 1 million in a month is possible... I'm just not sure that this month is the month
Hoping I can make it though, we'll see! I still say with enough dedication, 1 million in a month is possible... I'm just not sure that this month is the month