When is data posted?
When is data posted?
I've submit data, but go to graphs and view my realm, and nothing. There are 0's where I had collected data, so...idk
-
bringoutyourdead
- Forums Admin & general flunky
- Posts: 1432
- Joined: Fri Nov 07, 2008 1:11 pm
- Location: Texas, USA
The processing of uploaded data is done in batches by various background jobs that trigger on different time intervals.
That was a big sentence that didn't tell you much.
Your upload files are processed starting about :22 minutes after the hour.. i.e. 24 times a day
You will see this by looking at your upload history, for example
http://www.warcraftrealms.com/usersheet ... =67442&c=u
The daily graphs and charts are created once a day... after some fixed time processing in the early morning hours between Midnight and oh 3am server time.
I don't remember exactly when.. that is a Metalbeast area of responsibility and not mine.
This will populate all the tables in the database.
The weekly graphs are updated once a week.. and I don't remember what day that cron job is set to trigger on either.
and oh.. I need to fix the text on those.. as they are obviously no longer in maintenance mode and are working again.
Then the charts and graphs you see are actually created on the fly by the first person who asked to view the data after the above process is done.
The those charts and graphs are stored and presented to anyone else who ask to view them until the next daily/weekly cycle.
The create once and present many times improves web performance by orders of magnitude.
A side effect is if for some strange reason a graph or chart isn't requested by anyone that day.. the item never is created for that day.
Not that anyone cares... or they would have asked for it in the first place.
That was a big sentence that didn't tell you much.
Your upload files are processed starting about :22 minutes after the hour.. i.e. 24 times a day
You will see this by looking at your upload history, for example
http://www.warcraftrealms.com/usersheet ... =67442&c=u
The daily graphs and charts are created once a day... after some fixed time processing in the early morning hours between Midnight and oh 3am server time.
I don't remember exactly when.. that is a Metalbeast area of responsibility and not mine.
This will populate all the tables in the database.
The weekly graphs are updated once a week.. and I don't remember what day that cron job is set to trigger on either.
and oh.. I need to fix the text on those.. as they are obviously no longer in maintenance mode and are working again.
Then the charts and graphs you see are actually created on the fly by the first person who asked to view the data after the above process is done.
The those charts and graphs are stored and presented to anyone else who ask to view them until the next daily/weekly cycle.
The create once and present many times improves web performance by orders of magnitude.
A side effect is if for some strange reason a graph or chart isn't requested by anyone that day.. the item never is created for that day.
Not that anyone cares... or they would have asked for it in the first place.
-
bringoutyourdead
- Forums Admin & general flunky
- Posts: 1432
- Joined: Fri Nov 07, 2008 1:11 pm
- Location: Texas, USA
That is the current version of the Addon.
You MAY need to delete your data file.. but hold off on that
I want to see if I can spot any upload activity from your IP
If I were a betting person.. I would expect that your data file has gotten too big.
The standard web upload process can only handle files up to around 8MB in size...
anything larger and the webserver will fail to accept the upload.
That is why some people use the third party UniUpload program... since it compresses the data before uploading your local data file can grow to over 25MB of data before things stop working.
If you don't use Uniupload and your data file, typically found at
C:\Program Files\World of Warcraft\WTF\Account\%account%\SavedVariables\CensusPlus.lua
is near or over 8MB according to Windows or Mac file tools...
Your first action is to start pruning the data file size.
Log into a character in Wow.. and type the following in the chat window.
/census serverprune 30
this will generate a message tell you how many character were removed from the data tables
log out of the character and look at the file size
you can repeat this process.. using a smaller number (this represents the numbers of days of data to save), until the data file is small enough to get through the web server buffer size limit.
/Census serverprune is the command that says prune all realms excluding the one you are currently logged in on when the command is issued.
This allows you to save more data on the realm you are most active on... if you choose that realm to do the above commands.
If you only do census on ONE realm.. then the commend you need to use is
/Census prune numberofdays just like the above command.
You MAY need to delete your data file.. but hold off on that
I want to see if I can spot any upload activity from your IP
If I were a betting person.. I would expect that your data file has gotten too big.
The standard web upload process can only handle files up to around 8MB in size...
anything larger and the webserver will fail to accept the upload.
That is why some people use the third party UniUpload program... since it compresses the data before uploading your local data file can grow to over 25MB of data before things stop working.
If you don't use Uniupload and your data file, typically found at
C:\Program Files\World of Warcraft\WTF\Account\%account%\SavedVariables\CensusPlus.lua
is near or over 8MB according to Windows or Mac file tools...
Your first action is to start pruning the data file size.
Log into a character in Wow.. and type the following in the chat window.
/census serverprune 30
this will generate a message tell you how many character were removed from the data tables
log out of the character and look at the file size
you can repeat this process.. using a smaller number (this represents the numbers of days of data to save), until the data file is small enough to get through the web server buffer size limit.
/Census serverprune is the command that says prune all realms excluding the one you are currently logged in on when the command is issued.
This allows you to save more data on the realm you are most active on... if you choose that realm to do the above commands.
If you only do census on ONE realm.. then the commend you need to use is
/Census prune numberofdays just like the above command.
-
bringoutyourdead
- Forums Admin & general flunky
- Posts: 1432
- Joined: Fri Nov 07, 2008 1:11 pm
- Location: Texas, USA
Did the checking of raw database info and couldn't find anything since last November.
Though since you have a history of uploading from various IP addresses, I could have missed seeing the data.
Check your data file size.. and do the pruning if needed.
if your file is below the limit, check back with me...
send a PM to me.. as we will need to talk about information that others have no need to see
Though since you have a history of uploading from various IP addresses, I could have missed seeing the data.
Check your data file size.. and do the pruning if needed.
if your file is below the limit, check back with me...
send a PM to me.. as we will need to talk about information that others have no need to see
80% of all errors...user
I'm pretty sure it was me. I fixed (something), and resubmitted it. Wow. Could be a lot of data if I had it messed up for that long. 
I'll watch and see in 24 or 48 hrs.
I'll watch and see in 24 or 48 hrs.
-
bringoutyourdead
- Forums Admin & general flunky
- Posts: 1432
- Joined: Fri Nov 07, 2008 1:11 pm
- Location: Texas, USA
No need to wait that long..
Using the link I posted above..
I see that your 6:45am (EDT) upload resolved to 1329 new characters not seen by this site before and a total of 2337 updated characters.
Tomorrow you will see the realm data and activity charts showing updates.
While it is sad to know the lost potential updates that never made it to the site,
Don't think you are alone with this...
even our most prolific uploaders, sometimes forget to check if the upload really went through.
During a six month period we didn't get about one million updates, because the uploader didn't realize the site wasn't accepting his uploads.
Yes the site does tell you when it has accepted the upload... you just have to pay attention.
Using the link I posted above..
I see that your 6:45am (EDT) upload resolved to 1329 new characters not seen by this site before and a total of 2337 updated characters.
Tomorrow you will see the realm data and activity charts showing updates.
While it is sad to know the lost potential updates that never made it to the site,
Don't think you are alone with this...
even our most prolific uploaders, sometimes forget to check if the upload really went through.
During a six month period we didn't get about one million updates, because the uploader didn't realize the site wasn't accepting his uploads.
Yes the site does tell you when it has accepted the upload... you just have to pay attention.