Let the onslaught begin! aka upload version 6.0 files!

Post by **Rollie** » Tue Nov 20, 2012 3:54 pm

Bring on the new files!

Balgair · Post by **Balgair** » Tue Nov 20, 2012 4:06 pm

Awesome, my first 2 are up now, and I see no overwriting so no limits on time between uploads

I'll wait and see how those process but it's looking good so far!

Post by **Rollie** » Tue Nov 20, 2012 5:06 pm

Yep, no upload time limits for a few days.

Pennet · Post by **Pennet** » Tue Nov 20, 2012 8:47 pm

103 files uploaded, and I'm up to date. I wonder if the server is creaking under the strain yet.

Post by **Rollie** » Tue Nov 20, 2012 11:55 pm

The update process actually hasn't begun yet. Just noticed an issue with it. Correcting and kicking off test.

FuxieDK · Post by **FuxieDK** » Wed Nov 21, 2012 12:17 am

Pennet wrote:103 files uploaded, and I'm up to date. I wonder if the server is creaking under the strain yet.

In theory, 1 file in queue, or 5000 files in queue, shouldn't make a difference..
That's why it's a queue.. Only issue, I can think of, is diskspace where the queue is stored, but I'm pretty sure Rollie have thought of that..

108 files incomming in ~10 hours..

Thortok2000 · Post by **Thortok2000** » Wed Nov 21, 2012 12:49 am

Still not seeing any Pandas or Monks in the data...

Djambo · Post by **Djambo** » Wed Nov 21, 2012 2:40 am

66 files uploaded.

As it seems my first one is blocking the db. "Last processed file was uploaded on 2012-11-20 15:50:30."

FuxieDK · Post by **FuxieDK** » Wed Nov 21, 2012 5:25 am

Djambo wrote:As it seems my first one is blocking the db. "Last processed file was uploaded on 2012-11-20 15:50:30."

Files have always been processed in chunks..
A number of files are processed, then a pause for a few hours and then some more files are processed..

Balgair · Post by **Balgair** » Wed Nov 21, 2012 6:36 am

That time seems to coincide with the time the server came up initially (my first one is at 16.03), so I'm guessing it may still be a bit stuck, given Rollie said he was starting it off 6 hours ago. Hopefully it's just the usual doing it in chunks thing but hmm.