Site updated for MoP - Censusplus v6.0 download link

Post by **Rollie** » Mon Nov 19, 2012 10:21 pm

DB updates are in progress. Hopefully everything will be fully operational within 12 hours or so!

Balgair · Post by **Balgair** » Tue Nov 20, 2012 7:04 am

Thank goodness for that, here's hoping it'll all work fine when it's up!

Post by **Rollie** » Tue Nov 20, 2012 7:10 am

DB backup ran late into the night so I went to bed. Backup complete, table rebuilds in process.

Fett · Post by **Fett** » Tue Nov 20, 2012 9:33 am

Great to see you back!

So, when it completes and comes back up, do we immediately hammer the site as hard as we can with uploads, or should we be gentle with it at first?

Post by **Rollie** » Tue Nov 20, 2012 11:34 am

Nah, just unload on it =) I'll relax all the timing constraints so that older data will get processed/updated

FuxieDK · Post by **FuxieDK** » Wed Nov 21, 2012 12:14 am

WOOT...

I can't wait to get home, and upload my 108 files.."

Raindance · Post by **Raindance** » Thu Nov 22, 2012 3:58 pm

Very thankful now I am keep uploading now

1974ER · Post by **1974ER** » Mon Nov 26, 2012 1:05 pm

Due to something going wrong, I kept getting sent back to the "tempdown" page. Apparently the site has actually already been up a rather long while... *deep sigh, another of relief*

I will be starting to dump files from my father's computer shortly... 700 MB exceeded and almost 140 files in total to go from two different computers... *another deep sigh* This will take a while...

Thank you for getting the site back on its feet Rollie! Three cheers!

Post by **bringoutyourdead** » Mon Nov 26, 2012 2:38 pm

There might be an issue with manual uploads... and file size... as another message noted that at 6MB it failed.. and that file was later uploaded without issue using Uniuploader.

1974ER · Post by **1974ER** » Mon Nov 26, 2012 4:04 pm

Confirming the problem. Manual upload fails at 6+ MB. Which in turn means that I will not be submitting more data until this problem is corrected as I will NOT be manually altering 135+ files. Fix needed ASAP!

FuxieDK · Post by **FuxieDK** » Mon Nov 26, 2012 10:51 pm

1974ER wrote:Confirming the problem. Manual upload fails at 6+ MB. Which in turn means that I will not be submitting more data until this problem is corrected as I will NOT be manually altering 135+ files. Fix needed ASAP!

I understand you won't manually edit 100+ files, and a fix is required..

However, you could use Uniupload to upload files, even the stock piles ones.. You just have to change what file it uploads for each upload..

It's not a fix, but a work-around..

1974ER · Post by **1974ER** » Tue Nov 27, 2012 12:46 am

Unfortunately, that option is not available for me due to the current circumstances. I need the fix, before I can resume uploads.

Balgair · Post by **Balgair** » Tue Nov 27, 2012 2:58 am

Not sure how often Rollie can check the forum so I've mailed him to let him know about the filesize issue and also that the processing seems to be way behind - hopefully he'll take a look soon.

Balgair · Post by **Balgair** » Tue Nov 27, 2012 9:12 am

Rollie says:

Max file upload size should be 10M now. Anything larger and I'm afraid it'll bugger up the process.

Hopefully that'll fix your issues ER

He also says regarding the processing issues:

Looks like there are some UniUploaded files that are choking up the process. Each time the file that is choking it up is a UniUpload file from the same IPAddr, but not someone who is submitting username and password so I am unable to contact them. One thing to note is that each of those files is over 10M so it could be the general filesize.

I have removed the other files they have submitted so we'll see if that helps.

If anyone here recognises themselves (giant files via UU, while not logged in), try and tone down your filesizes a bit please

Thortok2000 · Post by **Thortok2000** » Tue Nov 27, 2012 9:20 am

Balgair wrote:Rollie says:

Max file upload size should be 10M now. Anything larger and I'm afraid it'll bugger up the process.
Hopefully that'll fix your issues ER

He also says regarding the processing issues:

Looks like there are some UniUploaded files that are choking up the process. Each time the file that is choking it up is a UniUpload file from the same IPAddr, but not someone who is submitting username and password so I am unable to contact them. One thing to note is that each of those files is over 10M so it could be the general filesize.

I have removed the other files they have submitted so we'll see if that helps.
If anyone here recognises themselves (giant files via UU, while not logged in), try and tone down your filesizes a bit please

This is why I put auto-prune in my census+ addon.

I would often play on several servers and have like 6-7 realms of data to upload. Then when I stuck to just one server, every upload was huge every time I logged out of the game because of all that past data.

I now auto-prune at 7 days. I just set it up to run the prune function every time it displays the results of a scan. I personally never use the data in-game, I view it on the website, so theoretically I could even set it to prune at 1-2 days and I'd be fine.

But this was based on my never pruning it at all (I'm a "set it and forget it" type of person, that's why I use uni uploader) and I actually got contacted by Rollie saying that I was making the database clog up. So, now I autoprune.

I'm thinking an autoprune of at least 30 days should be a default part of the addon anyway. If you haven't seen someone online in 30 days, do you really care about that person anymore? Does data that's over 30 days old really need to be uploaded?

What's going on now is a special case because the site has been down, but when the site is up and you're using uni uploader to upload every time you log out of WoW, do you really need to upload over 30 days of data every time you log out of WoW? (Especially if you log out several times a day, like I do when developing addons of my own, or take breaks and do something else and come back.)

Balgair · Post by **Balgair** » Tue Nov 27, 2012 9:25 am

I like the idea of autoprune, maybe something Rollie/Bringoutyourdead can consider adding for future addon updates, at least as an option. I usually remember to prune mine regularly, but occasionally it does stack up a bit, so an automated one for times when I forget would be very useful indeed.

1974ER · Post by **1974ER** » Tue Nov 27, 2012 11:33 am

I'll look on father's computer when I have a chance to, but I am sure Rollie fixed the problem so I can resume uploads later tonight.

As for me and prunes and purges. My current .lua is less than 30 HOURS old and has already exceeded 3 MB. Also, to be honest, I did NOT expect to be unable to upload for two months nor to lose two computers within less than three weeks... nor the latter spending a total of almost 6 weeks in repair shop and in transit back and forth.

Also, in the grand scheme, as far as I can tell, a significant number of users census so little they basically never need to purge and prune happens maybe every 4 or 6 months. Long ago, when I was censusing a slightly larger number of factions, I partially in joke noted that I would require a /censusprunehours X type of command. Now things are no longer quite that extreme, but data still stacks up pretty fast.

In any case, thank yous and good luck to all!

Busy Epic Censi, signing off for a little bit.

FuxieDK · Post by **FuxieDK** » Tue Nov 27, 2012 3:24 pm

Balgair wrote:I like the idea of autoprune, maybe something Rollie/Bringoutyourdead can consider adding for future addon updates, at least as an option. I usually remember to prune mine regularly, but occasionally it does stack up a bit, so an automated one for times when I forget would be very useful indeed.

Auto-prune is not always good..

Some people use CensusPlus to keep track of data on their own server(s), and never upload.
Prune the data, and you kill their leisure..

Balgair · Post by **Balgair** » Tue Nov 27, 2012 4:06 pm

FuxieDK wrote:
Balgair wrote:I like the idea of autoprune, maybe something Rollie/Bringoutyourdead can consider adding for future addon updates, at least as an option. I usually remember to prune mine regularly, but occasionally it does stack up a bit, so an automated one for times when I forget would be very useful indeed.
Auto-prune is not always good..

Some people use CensusPlus to keep track of data on their own server(s), and never upload.
Prune the data, and you kill their leisure..

I did say "as an option" - this way, those who want it, can enable it, those who don't, can keep their full set of data

1974ER · Post by **1974ER** » Wed Nov 28, 2012 4:20 am

Well, three first of my "post-hard drive destruction" .luas have been processed successfully. So far, so good. Three down, over 140 to go, from which about 50 still wait for me to get around to uploading them. Since there is a massive backlog, I am going to give the queue some time to catch up... already uploaded about 80 files this morning, leaving all that is on my own computer as still to do...

After those three files, I am now at about 10% of Balgair's figures on the monthly top 10 lists. It will be really interesting to see how things turn out by the time the month ends.