Files not processing properly

Found a bug with the site? Let me know!
asmodai
Posts: 42
Joined: Tue Jan 31, 2006 5:03 pm
Location: Netherlands

Post by asmodai »

Are we back on track or playing catchup?

Right now I see files from the 23rd are still not processed on my page update page.

Also, is the graph at the bottom of your WR updates supposed to update? Looks like it stopped at the end of July.

User avatar
Rollie
Site Admin
Posts: 4783
Joined: Sun Nov 28, 2004 11:52 am
Location: Austin, TX
Contact:

Post by Rollie »

I'm looking into it to see what's up.

As for the graph, that's prob bugged and I'll look into it as well.
phpbb:phpinfo()

asmodai
Posts: 42
Joined: Tue Jan 31, 2006 5:03 pm
Location: Netherlands

Post by asmodai »

Thanks Rollie. Wish I could help (being a programmer myself), but I can at least point out what I am seeing. :)

User avatar
bringoutyourdead
Forums Admin & general flunky
Posts: 1432
Joined: Fri Nov 07, 2008 1:11 pm
Location: Texas, USA

What is the current max size for census upload files?

Post by bringoutyourdead »

I know that around 10MB the web upload process starts to fail accepting.
It now appears that around 15MB uniuploaded files fail to get the data extracted.

The Gzipped file uploads fine (at much less then 15MB!) and then the file gets marked Y processed but with no actual updates.

Pruning my data back and resending will get updates to actually show up.

I'm now having to prune back to under a week.

The joy of being a big census taker and swapping out well counted servers for those that are blinky red under counted.

I know I could just delete/restart my data file when I do server swaps... but I want to retain my counts for the servers I actually play on.

User avatar
Rollie
Site Admin
Posts: 4783
Joined: Sun Nov 28, 2004 11:52 am
Location: Austin, TX
Contact:

Post by Rollie »

I'll have to look at the specific file in question, but my guess is that the really big files are timing out during parsing, something I added not too long ago to prevent singular files from hanging the entire process.
phpbb:phpinfo()

User avatar
bringoutyourdead
Forums Admin & general flunky
Posts: 1432
Joined: Fri Nov 07, 2008 1:11 pm
Location: Texas, USA

Post by bringoutyourdead »

Yikes!! I was afraid of that.
My 08/16:14:08 file was marked Y processed with zero data.
The interesting thing was that the DB stats page was showing 16:10:xx as the last processed file. (Mixed signals)

I would suggest that you place in faq or sticky that top contributors limit the data file to 10-12 MB, as that seems to be handled ok.

For myself.. I'm going to play the rename game..
I'll keep two sets of CensusPlus data files..
The 1st set will be for the servers I actually play on.. so I can keep longer data on my client.
The 2nd set will be for the servers I just hit for census.. and I'll prune those down to last known good processed date (+1 day, I think, just in case)

That way I don't need to keep resending data you already have, and you don't have to take time to handle my edge condition... the last thing you or I want for your Holiday times.

Post Reply