Page 10 of 15

Re: Stats not updating

Posted: Fri Aug 15, 2014 3:03 am
by sco01
Stats not updating again
01:10:35:WU01:FS00:0x17:*********************** Log Started 2014-08-15T01:10:35Z ***********************
01:11:00:WU00:FS00:Server responded WORK_ACK (400)
01:11:00:WU00:FS00:Final credit estimate, 79392.00 points

Re: Stats not updating

Posted: Fri Aug 15, 2014 3:52 am
by bruce
You should wait a little longer before complaining. It takes a bit of time before the stats are updated. You also should report the Project,Run,Clone,Gen of the WU if you want our help. This way we have to do some extra searching and a bit of guessing.

Hi sco01 (team 47191),
Your WU (P13001 R287 C4 G16) was added to the stats database on 2014-08-14 08:04:44 PDT for 79467.8 points of credit.

Re: Stats not updating

Posted: Fri Aug 15, 2014 3:55 am
by sco01

Code: Select all

4:08:09:WU00:FS00:0x17:*********************** Log Started 2014-08-14T14:08:09Z ***********************
14:08:09:WU00:FS00:0x17:Project: 13000 (Run 1300, Clone 0, Gen 51)
14:08:09:WU00:FS00:0x17:Unit: 0x00000062538b3db753110b067f499571
14:08:09:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
14:08:09:WU00:FS00:0x17:Machine: 0
14:08:09:WU00:FS00:0x17:Reading tar file state.xml
14:08:09:WU00:FS00:0x17:Reading tar file system.xml
14:08:10:WU00:FS00:0x17:Reading tar file integrator.xml
14:08:10:WU00:FS00:0x17:Reading tar file core.xml
14:08:10:WU00:FS00:0x17:Digital signatures verified
14:08:10:WU00:FS00:0x17:Folding@home GPU core17
14:08:10:WU00:FS00:0x17:Version 0.0.52
14:08:44:WU01:FS00:Upload complete
14:08:44:WU01:FS00:Server responded WORK_ACK (400)
14:08:44:WU01:FS00:Final credit estimate, 79465.00 points
14:08:44:WU01:FS00:Cleaning up
14:10:56:WU00:FS00:0x17:Completed 0 out of 5000000 steps (0%)
14:10:56:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:17:37:WU00:FS00:0x17:Completed 50000 out of 5000000 steps (1%)
14:24:05:WU00:FS00:0x17:Completed 100000 out of 5000000 steps (2%)
14:30:49:WU00:FS00:0x17:Completed 150000 out of 5000000 steps (3%)
14:37:18:WU00:FS00:0x17:Completed 200000 out of 5000000 steps (4%)

01:03:41:WU00:FS00:0x17:Completed 4950000 out of 5000000 steps (99%)
01:10:13:WU00:FS00:0x17:Completed 5000000 out of 5000000 steps (100%)
01:10:15:WU01:FS00:Connecting to 171.67.108.201:80
01:10:16:WU01:FS00:Assigned to work server 140.163.4.231
01:10:16:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GK110 [GeForce GTX 780] from 140.163.4.231
01:10:16:WU01:FS00:Connecting to 140.163.4.231:8080
01:10:16:WU01:FS00:Downloading 4.83MiB
01:10:22:WU01:FS00:Download 98.29%
01:10:22:WU01:FS00:Download complete
01:10:22:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:748 clone:0 gen:51 core:0x17 unit:0x0000006f538b3db753106ebb87057c06
01:10:29:WU00:FS00:0x17:Saving result file logfile_01.txt
01:10:29:WU00:FS00:0x17:Saving result file checkpointState.xml
01:10:31:WU00:FS00:0x17:Saving result file checkpt.crc
01:10:31:WU00:FS00:0x17:Saving result file log.txt
01:10:31:WU00:FS00:0x17:Saving result file positions.xtc
01:10:33:WU00:FS00:0x17:Folding@home Core Shutdown: FINISHED_UNIT
01:10:33:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:10:33:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13000 run:1300 clone:0 gen:51 core:0x17 unit:0x00000062538b3db753110b067f499571
01:10:33:WU00:FS00:Uploading 12.83MiB to 140.163.4.231
01:10:33:WU00:FS00:Connecting to 140.163.4.231:8080
01:10:33:WU01:FS00:Starting
01:10:33:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3944 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
01:10:34:WU01:FS00:Started FahCore on PID 5376
01:10:34:WU01:FS00:Core PID:7296
01:10:34:WU01:FS00:FahCore 0x17 started
01:10:35:WU01:FS00:0x17:*********************** Log Started 2014-08-15T01:10:35Z ***********************
01:10:35:WU01:FS00:0x17:Project: 13000 (Run 748, Clone 0, Gen 51)
01:10:35:WU01:FS00:0x17:Unit: 0x0000006f538b3db753106ebb87057c06
01:10:35:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:10:35:WU01:FS00:0x17:Machine: 0
01:10:35:WU01:FS00:0x17:Reading tar file state.xml
01:10:36:WU01:FS00:0x17:Reading tar file system.xml
01:10:36:WU01:FS00:0x17:Reading tar file integrator.xml
01:10:36:WU01:FS00:0x17:Reading tar file core.xml
01:10:36:WU01:FS00:0x17:Digital signatures verified
01:10:36:WU01:FS00:0x17:Folding@home GPU core17
01:10:36:WU01:FS00:0x17:Version 0.0.52
01:10:39:WU00:FS00:Upload 96.43%
01:11:00:WU00:FS00:Upload complete
Mod edit: added Code tags to logs

Re: Stats not updating

Posted: Fri Aug 15, 2014 3:59 am
by sco01

Code: Select all

15:11:32:WU01:FS00:FahCore 0x17 started
15:11:32:WU01:FS00:0x17:*********************** Log Started 2014-08-14T15:11:32Z ***********************
15:11:32:WU01:FS00:0x17:Project: 13001 (Run 217, Clone 0, Gen 54)
15:11:32:WU01:FS00:0x17:Unit: 0x0000006c538b3db753288d2d01decd47
15:11:32:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
15:11:32:WU01:FS00:0x17:Machine: 0
15:11:32:WU01:FS00:0x17:Reading tar file state.xml
15:11:33:WU01:FS00:0x17:Reading tar file system.xml
15:11:34:WU01:FS00:0x17:Reading tar file integrator.xml
15:11:34:WU01:FS00:0x17:Reading tar file core.xml
15:11:34:WU01:FS00:0x17:Digital signatures verified
15:11:34:WU01:FS00:0x17:Folding@home GPU core17
15:11:34:WU01:FS00:0x17:Version 0.0.52
15:11:38:WU00:FS00:Upload 8.70%
15:11:44:WU00:FS00:Upload 19.33%
15:11:50:WU00:FS00:Upload 26.57%
15:11:56:WU00:FS00:Upload 36.72%
15:12:02:WU00:FS00:Upload 45.90%
15:12:08:WU00:FS00:Upload 55.08%
15:12:14:WU00:FS00:Upload 65.23%
15:12:20:WU00:FS00:Upload 75.38%
15:12:26:WU00:FS00:Upload 85.52%
15:12:32:WU00:FS00:Upload 94.70%
15:12:46:WU00:FS00:Upload complete
15:12:46:WU00:FS00:Server responded WORK_ACK (400)
15:12:46:WU00:FS00:Final credit estimate, 81693.00 points
15:12:46:WU00:FS00:Cleaning up
15:15:39:WU01:FS00:0x17:Completed 0 out of 5000000 steps (0%)
15:15:39:WU01:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:22:00:WU01:FS00:0x17:Completed 50000 out of 5000000 steps (1%)
15:28:02:WU01:FS00:0x17:Completed 100000 out of 5000000 steps (2%)

01:10:30:WU01:FS00:0x17:Completed 4800000 out of 5000000 steps (96%)
******************************* Date: 2014-08-15 *******************************
01:16:34:WU01:FS00:0x17:Completed 4850000 out of 5000000 steps (97%)
01:22:58:WU01:FS00:0x17:Completed 4900000 out of 5000000 steps (98%)
01:29:00:WU01:FS00:0x17:Completed 4950000 out of 5000000 steps (99%)
01:35:02:WU01:FS00:0x17:Completed 5000000 out of 5000000 steps (100%)
01:35:04:WU00:FS00:Connecting to 171.67.108.201:80
01:35:05:WU00:FS00:Assigned to work server 140.163.4.231
01:35:05:WU00:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GK110 [GeForce GTX 780] from 140.163.4.231
01:35:05:WU00:FS00:Connecting to 140.163.4.231:8080
01:35:07:WU00:FS00:Downloading 4.83MiB
01:35:11:WU00:FS00:Download complete
01:35:11:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:1076 clone:1 gen:14 core:0x17 unit:0x00000020538b3db75310cb94dd38f339
01:35:24:WU01:FS00:0x17:Saving result file logfile_01.txt
01:35:24:WU01:FS00:0x17:Saving result file checkpointState.xml
01:35:27:WU01:FS00:0x17:Saving result file checkpt.crc
01:35:27:WU01:FS00:0x17:Saving result file log.txt
01:35:27:WU01:FS00:0x17:Saving result file positions.xtc
01:35:30:WU01:FS00:0x17:Folding@home Core Shutdown: FINISHED_UNIT
01:35:30:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:35:30:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:13001 run:217 clone:0 gen:54 core:0x17 unit:0x0000006c538b3db753288d2d01decd47
01:35:30:WU01:FS00:Uploading 12.83MiB to 140.163.4.231
01:35:30:WU00:FS00:Starting
01:35:30:WU01:FS00:Connecting to 140.163.4.231:8080
01:35:30:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 3032 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
01:35:30:WU00:FS00:Started FahCore on PID 5108
01:35:30:Started thread 235 on PID 3032
01:35:30:WU00:FS00:Core PID:5528
01:35:30:WU00:FS00:FahCore 0x17 started
01:35:31:WU00:FS00:0x17:*********************** Log Started 2014-08-15T01:35:30Z ***********************
01:35:31:WU00:FS00:0x17:Project: 13000 (Run 1076, Clone 1, Gen 14)
01:35:31:WU00:FS00:0x17:Unit: 0x00000020538b3db75310cb94dd38f339
01:35:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:35:31:WU00:FS00:0x17:Machine: 0
01:35:31:WU00:FS00:0x17:Reading tar file state.xml
01:35:31:WU00:FS00:0x17:Reading tar file system.xml
01:35:32:WU00:FS00:0x17:Reading tar file integrator.xml
01:35:32:WU00:FS00:0x17:Reading tar file core.xml
01:35:32:WU00:FS00:0x17:Digital signatures verified
01:35:32:WU00:FS00:0x17:Folding@home GPU core17
01:35:32:WU00:FS00:0x17:Version 0.0.52
01:35:36:WU01:FS00:Upload 6.82%
01:35:42:WU01:FS00:Upload 17.05%
01:35:48:WU01:FS00:Upload 25.81%
01:35:54:WU01:FS00:Upload 35.07%
01:36:00:WU01:FS00:Upload 44.81%
01:36:06:WU01:FS00:Upload 53.09%
01:36:12:WU01:FS00:Upload 62.34%
01:36:18:WU01:FS00:Upload 72.08%
01:36:24:WU01:FS00:Upload 81.33%
01:36:30:WU01:FS00:Upload 90.59%
01:36:36:WU01:FS00:Upload 100.00%
01:36:46:WU01:FS00:Upload complete
01:36:46:WU01:FS00:Server responded WORK_ACK (400)
01:36:46:WU01:FS00:Final credit estimate, 81734.00 points

Re: Stats not updating

Posted: Fri Aug 15, 2014 4:01 am
by sco01

Re: Stats not updating

Posted: Fri Aug 15, 2014 4:20 am
by P5-133XL
project:13000 run:1300 clone:0 gen:51 - No data
project:13001 run:217 clone:0 gen:54 - No data

Neither of those WU's have yet to be processed by the stat server.

Re: Stats not updating

Posted: Fri Aug 15, 2014 8:18 am
by davidcoton
There does seem to be a problem. Personally, three consecutive periods with no points on EOC or Kakao. Certainly some uploads in the last 9 hours!
Then look at Kakao All Donors. Sort by the 7 day score, so you see the top producing donors. Looking at one screenful (200 donors), less than 10% have any points on the last update. So stats aren't dead, but very sick.

Re: Stats not updating

Posted: Fri Aug 15, 2014 8:32 am
by billford
Definitely something amiss.

Since the last time I checked (approx 22:00Z on 14th) the stats have credited me with 7 WUs and less than 3,000 points, at the latest update timestamped at 06:00Z on 15th, taken at 08:30Z.

It should be more like 30 WUs and more than 100,000 points.

Apart from around a dozen NaCl WUs I can rummage around and get the PRCGs of the rest if necessary, but I think there's a more fundamental problem somewhere- it looks as though the stats server might have "updated" (ie the Last updated time was changed), but wasn't scanning around the WS's first and has now given up entirely, but that's just a guess.


edit- I've only had 2 zero entries (the latest ones) on Kakao and EOC, otherwise I concur with davidcoton.

Re: Stats not updating

Posted: Fri Aug 15, 2014 9:57 am
by bollix47
PG notified.

Re: Stats not updating

Posted: Fri Aug 15, 2014 10:13 am
by billford
davidcoton wrote:Then look at Kakao All Donors. Sort by the 7 day score...
I hadn't realised that the Kakao tables could be sorted by selected column... An inadvertent tip it may have been, but very useful- thank you :)

Re: Stats not updating

Posted: Fri Aug 15, 2014 2:22 pm
by VijayPande
We're on it.

Re: Stats not updating

Posted: Fri Aug 15, 2014 3:53 pm
by billford
Latest update (15:00Z) agrees well enough with my estimate, looks like we're back in business. For the moment, anyway :wink:

Thanks for the prompt fix.

Re: Stats not updating

Posted: Sun Aug 17, 2014 5:18 am
by Zagen30
I think the server's down again. The stats page says the last update was 3 pm PT on the 16th.

Re: Stats not updating

Posted: Sun Aug 17, 2014 6:09 am
by billford
Same here. The 19:00 (UTC) update didn't seem to run last night, but the next two were OK so I didn't bother to report it and went to bed.

Ah well… not much likely to happen until Stanford wake up on Monday I expect.

Re: Stats not updating

Posted: Sun Aug 17, 2014 6:47 am
by panthro1971-2
Same problem with updated stats here....Both Official FAH Stats and Kakao are down for me for the last 9 hours.... :(.... :shock: