Site updated for MoP - Censusplus v6.0 download link

Latest news about WarcraftRealms.com and World of Warcraft
Locked
SannaSK
Posts: 69
Joined: Wed Sep 07, 2005 4:53 pm

Post by SannaSK »

I also had a file fail, uploaded on the 12th...
Dec 12, 12 21:59:15 0 0 E

So, nub-Sanna is level nub... is it better to not be uploading files? I still run censuses (censii?) but I haven't uploaded since the 21st of Dec, and today I pruned-7... am I piling straw on a poor camel's back by giving the server more files to deal with? Or is this a thing where the server will get to some point and then speed up and catch up and things will be fine again? Or do we not know? X D Well, the main question is, should I hold off on uploading files till things are fixed?
Censusing: Mostly Bronzebeard, Aggramar, Elune; sometimes Alleria, Icecrown, Scilla, Kel'Thuzad, Mal'Ganis, Draka, Staghelm, Nathrezim, Stonemaul.

Linxa

Post by Linxa »

Add me to the failure list and I was doing such a good job.

Balgair
Araiceil
Posts: 1716
Joined: Fri Sep 30, 2005 11:47 am
Location: UK

Post by Balgair »

It's mighty interesting how many fail which were uploaded at a similar time, from different users.

1974ER:
Dec 11, 12 17:50:43 0 0 E

Padanfain:
Dec 11, 12 17:51:06 0 0 E

Rowilco (found him on the top contributors list):
Dec 11, 12 18:07:18 0 0 E

Korwynd:
Dec 11, 12 18:52:47 0 0 E
Dec 11, 12 18:35:17 0 0 E

I'm so far failing to find any that actually succeeded in that timeframe (granted I've no idea who's active outside those who made the top 10 for December or have posted here so it's a small sample). I'm wondering if this may actually be completely unrelated to the contents of the files?

Although in that case, I'm baffled how it's hitting some more than others: it may of course be that Padanfain and ER are more prolific and so have a higher chance of being in the wrong place at the wrong time... but Rowilco I linked to above seems to upload many times every day and only has one error out of dozens of submissions; I think he submits more often than anyone.

Edit: Hmm, missed the new page and extra posts, ok:

SannaSK:
Dec 12, 12 21:59:15 0 0 E

Linxa:
Dec 12, 12 21:15:58 0 0 E

Padanfain:
Dec 13, 12 00:23:25 0 0 E
Dec 12, 12 23:27:26 0 0 E
Dec 12, 12 21:32:09 0 0 E
Dec 12, 12 20:14:03 0 0 E

Fett:
Dec 12, 12 21:55:11 0 0 E

Again, no successful uploads in that timeframe which I can find from known active users (last beforehand was Rowilco at 18:11:03, next one was Rowilco again at 02:34:49 on the 13th). Time to mail Rollie again, maybe the patterns might help (else he can look and tell me there's one I'm not seeing which worked fine :P)

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

Oh, damn.. I've just had my 2 first failed files..
And it seems one of them landed right on top of the times Belgair stated:

Dec 12, 12 15:00:12 28 174 Y
Dec 12, 12 22:51:51 0 0 E
Dec 13, 12 14:47:52 24 215 Y
Dec 13, 12 22:47:50 0 0 E
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

Korwynd
Superior Census Taker
Posts: 25
Joined: Thu Oct 22, 2009 11:04 pm
Location: Brooklyn, NY, USA

Post by Korwynd »

Okay it seems everything from 12/11 failed

Dec 13, 12 18:55:40 540 2333 Y
Dec 11, 12 22:35:54 0 0 E
Dec 11, 12 22:16:12 0 0 E
Dec 11, 12 18:52:47 0 0 E
Dec 11, 12 18:35:17 0 0 E
Dec 04, 12 22:03:25 513 1285 Y

Balgair
Araiceil
Posts: 1716
Joined: Fri Sep 30, 2005 11:47 am
Location: UK

Post by Balgair »

Rollie says he's working on a new processing system which may improve things, and is hoping to have it live by the end of the weekend. He reckons it really needs new hardware, but it'll just cost too much; the site is barely breaking even with costs as it is, so the extra expense would be hard to manage, he's hoping his changes will help but isn't too sure as yet. He also says he'll rerun all failed submissions once it's sorted, so hopefully not too much will be lost.

piratejenny

Post by piratejenny »

Just to chime in: I haven't had any submission failures, but my submissions are being processed v-e-r-y s-l-o-w-l-y, like everyone else's. The last one of mine that got processed was from December 14th. My files aren't very big, since I'm currently mainly doing just my home realm; not sure if that makes a difference when it comes to errors.

1974ER
Epic Censi
Posts: 762
Joined: Fri Nov 07, 2008 3:30 am

Post by 1974ER »

Thank you Jenny. Well, the queue is shared so it's the same for everyone. Interestingly enough... as of right now, it seems to have picked up some speed and the backlog has been a fairly steady about 22 days for over a day... Right now it seems that it MAY have started to actually catch up... Not sure about that. I'll copy paste current state here so I / we can keep an eye on it:

Last processed file was uploaded on 2012-12-15 04:03:49.
Current server time is 2013-01-06 02:24:20

Balgair, thank you for keeping Rollie up-to-date. I wish I had extra money to lend a helping hand. Though I like the idea of reruns, but considering the chronological function of the site... Unless he forces a complete rollback to a state near November 20th or so, most of the lost data will stay that way. Rollback to December 11th around 15 o'clock might be more feasible, but I am not sure how high accuracy is even possible. It's not likely that massively huge database is backed up every hour... or even every day. Almost 100 million characters is simply huge. And it's that much despite restrictions, purges and the fact that we don't catch everyone to begin with.

PJEckenheim

Post by PJEckenheim »

Last processed file was uploaded on 2012-12-15 04:03:49.
Current server time is 2013-01-06 05:17:50

I think we got a candidate for the examination of a critical error with the file right after the one uploaded on 2012-12-15 04:03:49, which as of now is "in process" for almost 3 hours.

Balgair
Araiceil
Posts: 1716
Joined: Fri Sep 30, 2005 11:47 am
Location: UK

Post by Balgair »

Whee, I've joined the error club, wondered how long it'd take :P

Dec 14, 12 22:01:52 0 0 E

Others from the evening of the 14th:

Padanfain:
Dec 14, 12 23:18:46 0 0 E
Dec 14, 12 22:18:24 0 0 E
Dec 14, 12 21:02:57 0 0 E

FuxieDK:
Dec 14, 12 18:16:31 0 0 E

Fett:
Dec 14, 12 17:33:02 0 0 E

Rowilco:
Dec 14, 12 17:47:06 0 0 E
Dec 14, 12 17:24:22 0 0 E

Linxa:
Dec 15, 12 00:01:25 0 0 E

Definitely seeing these coming in waves of failures now.

Korwynd
Superior Census Taker
Posts: 25
Joined: Thu Oct 22, 2009 11:04 pm
Location: Brooklyn, NY, USA

Post by Korwynd »

Let's see now

Dec 17, 12 22:54:26 0 0 N
Dec 16, 12 22:12:13 0 0 N
Dec 16, 12 11:05:25 0 0 N
Dec 15, 12 23:56:23 0 0 N
Dec 15, 12 21:22:46 0 0 N
Dec 15, 12 18:24:47 0 0 N
Dec 15, 12 09:01:32 0 0 N
Dec 13, 12 22:33:53 0 0 E
Dec 13, 12 21:01:30 0 0 E
Dec 13, 12 18:55:40 540 2333 Y
Dec 11, 12 22:35:54 0 0 E
Dec 11, 12 22:16:12 0 0 E
Dec 11, 12 18:52:47 0 0 E
Dec 11, 12 18:35:17 0 0 E

Everything from Dec 11 failed, 2 fails out of 3 on Dec 15 and it just drags along.

:(

PJEckenheim

Post by PJEckenheim »

Last processed file was uploaded on 2012-12-15 08:32:05.
Current server time is 2013-01-06 13:46:22

-> In about 11 hours of server running time, we've had 4:20ish hours of progress with data processing.

SannaSK
Posts: 69
Joined: Wed Sep 07, 2005 4:53 pm

Post by SannaSK »

If a person had a couple extra dollars to spare, is there a method of donating those couple dollars, and would said donation help? :|
Censusing: Mostly Bronzebeard, Aggramar, Elune; sometimes Alleria, Icecrown, Scilla, Kel'Thuzad, Mal'Ganis, Draka, Staghelm, Nathrezim, Stonemaul.

Balgair
Araiceil
Posts: 1716
Joined: Fri Sep 30, 2005 11:47 am
Location: UK

Post by Balgair »

Took a minute to find lol, it's not obvious - http://www.warcraftrealms.com/donate.php - that's a Paypal donations link.

I can't tell you how much it'll help, if at all though, one-off donations will likely help a bit but I think it's sustained income the site needs to move onto bigger and better hardware, and that's tougher, since that needs more regular traffic seeing the ads, and the problems lately are likely to mean less traffic, not more. (Note that this paragraph is entirely my own speculation, and not Rollie's take, he may well find it more useful than I'm guessing, but I just don't know :))

mtgirl1979
Posts: 3
Joined: Sat Jul 28, 2007 10:01 am
Location: Havre, Montana

Post by mtgirl1979 »

It might help too if we post on our realm forums about this website, and help advertise lightly to increase traffic. :wink:

SannaSK
Posts: 69
Joined: Wed Sep 07, 2005 4:53 pm

Post by SannaSK »

I am rather failing at the 'find information on the website' game these days, aren't I >_>.

Does a user clicking ads generate more revenue for him than just a user seeing ads?

User avatar
bringoutyourdead
Forums Admin & general flunky
Posts: 1432
Joined: Fri Nov 07, 2008 1:11 pm
Location: Texas, USA

Post by bringoutyourdead »

YES

1974ER
Epic Censi
Posts: 762
Joined: Fri Nov 07, 2008 3:30 am

Post by 1974ER »

Last processed file was uploaded on 2012-12-16 10:23:02.
Current server time is 2013-01-08 01:41:42

Almost 48 hours have passed since my last comment, queue has moved forward about 30 hours, 20 minutes. So it's still falling behind, despite there being no files from me at the moment. *calculates* At current speed, if nothing can be done, site will "permanently" break on roughly January 28th at which point the processed data is directly discarded as outdated.

I hope whatever improvements Rollie is working on get done soonish...

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

1974ER wrote:January 28th at which point the processed data is directly discarded as outdated.
You paint a grimmer picture than it is..

The data *I* use, is the character history, and that NEVER outdate or discarded.

Yea, it's sub-optimal, that we're almost a month behind on processing, but since *MY* needs are met over time, it's not realy a problem for me.
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

FuxieDK wrote:Oh, damn.. I've just had my 2 first failed files..
And it seems one of them landed right on top of the times Belgair stated:

Dec 12, 12 15:00:12 28 174 Y
Dec 12, 12 22:51:51 0 0 E
Dec 13, 12 14:47:52 24 215 Y
Dec 13, 12 22:47:50 0 0 E
MEH.. Getting worse for me...
Dec 16, 12 22:52:25 0 0 E
Dec 16, 12 15:32:07 0 0 E
Dec 15, 12 19:55:12 0 0 E
Dec 15, 12 08:46:42 126 632 Y
Dec 14, 12 18:16:31 0 0 E
Dec 13, 12 22:47:50 0 0 E
Dec 13, 12 14:47:52 24 215 Y
Dec 12, 12 22:51:51 0 0 E
Dec 12, 12 15:00:12 28 174 Y

6 failed so far..
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

Locked