Folding Forum

Community driven support forum for Folding@home
https://foldingforum.org/

Sending unit results: id:02 state:SEND error:DUMPED

https://foldingforum.org/viewtopic.php?t=30449

Page 1 of 1

Sending unit results: id:02 state:SEND error:DUMPED

Posted: Thu Nov 23, 2017 3:36 am
by fluke76
I have returned to folding after a long hiatus. Everything seemed to be going fine for the first week, but then I noticed that I did not get credit for a couple of WUs that should have been submitted yesterday (CPU and GPU). Somebody recommended that I post logs to to either the "Issues with Specific Server" or "Issues with a Specific WU" board. I looked through yesterday's log and it looks like there might be an issue with the GPU WUs being submitted. I have submitted a partial log from 11/19 which is when it appears the "DUMPED" error starts to appear. Hopefully somebody here can review it and tell me what is going on. I was at least 7,000 points short yesterday so I am wondering if there is something else going on with my FAH client...I am folding on both the CPU and a pretty old GPU. The GPU doesn't typically submit that many points in a day, so there might have been a CPU WU that wasn't credited as well. Sorry for rambling. If anybody can offer some assistance, or point me in the right direction, I would appreciated it!

Code: Select all

******************************* Date: 2017-11-19 *******************************
12:13:24:WU00:FS01:0xa7:Completed 345000 out of 500000 steps (69%)
12:15:06:WU02:FS00:0xa4:Completed 150000 out of 2500000 steps  (6%)
12:21:43:WU02:FS00:0xa4:Completed 175000 out of 2500000 steps  (7%)
12:22:46:WU00:FS01:0xa7:Completed 350000 out of 500000 steps (70%)
12:28:20:WU02:FS00:0xa4:Completed 200000 out of 2500000 steps  (8%)
12:32:10:WU00:FS01:0xa7:Completed 355000 out of 500000 steps (71%)
12:34:58:WU02:FS00:0xa4:Completed 225000 out of 2500000 steps  (9%)
12:41:33:WU00:FS01:0xa7:Completed 360000 out of 500000 steps (72%)
12:41:35:WU02:FS00:0xa4:Completed 250000 out of 2500000 steps  (10%)
12:48:13:WU02:FS00:0xa4:Completed 275000 out of 2500000 steps  (11%)
12:50:57:WU00:FS01:0xa7:Completed 365000 out of 500000 steps (73%)
12:54:52:WU02:FS00:0xa4:Completed 300000 out of 2500000 steps  (12%)
12:58:14:WARNING:WU00:FS01:FahCore returned an unknown error code which probably indicates that it crashed
12:58:14:WARNING:WU00:FS01:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
12:58:14:WU00:FS01:Starting
12:58:14:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
12:58:14:WU00:FS01:Started FahCore on PID 2624
12:58:14:WU00:FS01:Core PID:14512
12:58:14:WU00:FS01:FahCore 0xa7 started
12:58:14:WU00:FS01:0xa7:*********************** Log Started 2017-11-19T12:58:14Z ***********************
12:58:14:WU00:FS01:0xa7:************************** Gromacs Folding@home Core ***************************
12:58:14:WU00:FS01:0xa7:       Type: 0xa7
12:58:14:WU00:FS01:0xa7:       Core: Gromacs
12:58:14:WU00:FS01:0xa7:    Website: http://folding.stanford.edu/
12:58:14:WU00:FS01:0xa7:  Copyright: (c) 2009-2016 Stanford University
12:58:14:WU00:FS01:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:58:14:WU00:FS01:0xa7:       Args: -dir 00 -suffix 01 -version 704 -lifeline 2624 -checkpoint 15 -gpu
12:58:14:WU00:FS01:0xa7:             0
12:58:14:WU00:FS01:0xa7:     Config: <none>
12:58:14:WU00:FS01:0xa7:************************************ Build *************************************
12:58:14:WU00:FS01:0xa7:    Version: 0.0.16
12:58:14:WU00:FS01:0xa7:       Date: Oct 31 2017
12:58:14:WU00:FS01:0xa7:       Time: 14:04:33
12:58:14:WU00:FS01:0xa7: Repository: Git
12:58:14:WU00:FS01:0xa7:   Revision: 2f0a8a3d0b0698be48154fe99a0216f289060932
12:58:14:WU00:FS01:0xa7:     Branch: master
12:58:14:WU00:FS01:0xa7:   Compiler: Visual C++ 2008
12:58:14:WU00:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
12:58:14:WU00:FS01:0xa7:   Platform: win32 10
12:58:14:WU00:FS01:0xa7:       Bits: 64
12:58:14:WU00:FS01:0xa7:       Mode: Release
12:58:14:WU00:FS01:0xa7:       SIMD: avx_256
12:58:14:WU00:FS01:0xa7:************************************ System ************************************
12:58:14:WU00:FS01:0xa7:        CPU: Unknown
12:58:14:WU00:FS01:0xa7:     CPU ID: 
12:58:14:WU00:FS01:0xa7:       CPUs: 8
12:58:14:WU00:FS01:0xa7:     Memory: 7.94GiB
12:58:14:WU00:FS01:0xa7:Free Memory: 3.19GiB
12:58:14:WU00:FS01:0xa7:    Threads: WINDOWS_THREADS
12:58:14:WU00:FS01:0xa7: OS Version: 6.1
12:58:14:WU00:FS01:0xa7:Has Battery: false
12:58:14:WU00:FS01:0xa7: On Battery: false
12:58:14:WU00:FS01:0xa7: UTC Offset: -6
12:58:14:WU00:FS01:0xa7:        PID: 14512
12:58:14:WU00:FS01:0xa7:        CWD: C:\Users\Jeff\AppData\Roaming\FAHClient\work
12:58:14:WU00:FS01:0xa7:         OS: Windows 7 Ultimate Service Pack 1
12:58:14:WU00:FS01:0xa7:    OS Arch: AMD64
12:58:14:WU00:FS01:0xa7:********************************************************************************
12:58:14:WU00:FS01:0xa7:Project: 8219 (Run 4, Clone 89, Gen 85)
12:58:14:WU00:FS01:0xa7:Unit: 0x00000068868b340358ed3d758bee6b4c
12:58:14:WU00:FS01:0xa7:Digital signatures verified
12:58:14:WU00:FS01:0xa7:Calling: mdrun -cpo frame85.cpt -s frame85.tpr -x frame85.xtc -e frame85.edr -cpi frame85.cpt -cpt 15 -nt 1
12:58:15:WU00:FS01:0xa7:Steps: first=42500000 total=500000
12:58:23:WU00:FS01:0xa7:Completed 365241 out of 500000 steps (73%)
13:01:40:WU02:FS00:0xa4:Completed 325000 out of 2500000 steps  (13%)
13:07:23:WU00:FS01:0xa7:Completed 370000 out of 500000 steps (74%)
13:08:18:WU02:FS00:0xa4:Completed 350000 out of 2500000 steps  (14%)
13:15:00:WU02:FS00:0xa4:Completed 375000 out of 2500000 steps  (15%)
13:16:50:WU00:FS01:0xa7:Completed 375000 out of 500000 steps (75%)
13:21:38:WU02:FS00:0xa4:Completed 400000 out of 2500000 steps  (16%)
13:26:25:WU00:FS01:0xa7:Completed 380000 out of 500000 steps (76%)
13:28:26:WU02:FS00:0xa4:Completed 425000 out of 2500000 steps  (17%)
13:35:05:WU02:FS00:0xa4:Completed 450000 out of 2500000 steps  (18%)
13:36:01:WU00:FS01:0xa7:Completed 385000 out of 500000 steps (77%)
13:41:43:WU02:FS00:0xa4:Completed 475000 out of 2500000 steps  (19%)
13:45:28:WU00:FS01:0xa7:Completed 390000 out of 500000 steps (78%)
13:48:50:WU02:FS00:0xa4:Completed 500000 out of 2500000 steps  (20%)
13:55:05:WU00:FS01:0xa7:Completed 395000 out of 500000 steps (79%)
13:55:32:WU02:FS00:0xa4:Completed 525000 out of 2500000 steps  (21%)
14:02:12:WU02:FS00:0xa4:Completed 550000 out of 2500000 steps  (22%)
14:04:35:WU00:FS01:0xa7:Completed 400000 out of 500000 steps (80%)
14:08:49:WU02:FS00:0xa4:Completed 575000 out of 2500000 steps  (23%)
14:14:04:WU00:FS01:0xa7:Completed 405000 out of 500000 steps (81%)
14:15:27:WU02:FS00:0xa4:Completed 600000 out of 2500000 steps  (24%)
14:22:04:WU02:FS00:0xa4:Completed 625000 out of 2500000 steps  (25%)
14:23:31:WU00:FS01:0xa7:Completed 410000 out of 500000 steps (82%)
14:28:59:WU02:FS00:0xa4:Completed 650000 out of 2500000 steps  (26%)
14:33:22:WU00:FS01:0xa7:Completed 415000 out of 500000 steps (83%)
14:35:35:WU02:FS00:0xa4:Completed 675000 out of 2500000 steps  (27%)
14:42:11:WU02:FS00:0xa4:Completed 700000 out of 2500000 steps  (28%)
14:42:49:WU00:FS01:0xa7:Completed 420000 out of 500000 steps (84%)
14:48:47:WU02:FS00:0xa4:Completed 725000 out of 2500000 steps  (29%)
14:52:16:WU00:FS01:0xa7:Completed 425000 out of 500000 steps (85%)
14:55:23:WU02:FS00:0xa4:Completed 750000 out of 2500000 steps  (30%)
15:01:43:WU00:FS01:0xa7:Completed 430000 out of 500000 steps (86%)
15:01:59:WU02:FS00:0xa4:Completed 775000 out of 2500000 steps  (31%)
15:08:35:WU02:FS00:0xa4:Completed 800000 out of 2500000 steps  (32%)
15:11:10:WU00:FS01:0xa7:Completed 435000 out of 500000 steps (87%)
15:15:12:WU02:FS00:0xa4:Completed 825000 out of 2500000 steps  (33%)
15:20:38:WU00:FS01:0xa7:Completed 440000 out of 500000 steps (88%)
15:21:48:WU02:FS00:0xa4:Completed 850000 out of 2500000 steps  (34%)
15:28:44:WU02:FS00:0xa4:Completed 875000 out of 2500000 steps  (35%)
15:30:25:WU00:FS01:0xa7:Completed 445000 out of 500000 steps (89%)
15:35:21:WU02:FS00:0xa4:Completed 900000 out of 2500000 steps  (36%)
15:39:52:WU00:FS01:0xa7:Completed 450000 out of 500000 steps (90%)
15:41:57:WU02:FS00:0xa4:Completed 925000 out of 2500000 steps  (37%)
15:48:33:WU02:FS00:0xa4:Completed 950000 out of 2500000 steps  (38%)
15:49:20:WU00:FS01:0xa7:Completed 455000 out of 500000 steps (91%)
15:55:11:WU02:FS00:0xa4:Completed 975000 out of 2500000 steps  (39%)
15:58:48:WU00:FS01:0xa7:Completed 460000 out of 500000 steps (92%)
16:01:47:WU02:FS00:0xa4:Completed 1000000 out of 2500000 steps  (40%)
16:08:13:WU00:FS01:0xa7:Completed 465000 out of 500000 steps (93%)
16:08:24:WU02:FS00:0xa4:Completed 1025000 out of 2500000 steps  (41%)
16:15:06:WU02:FS00:0xa4:Completed 1050000 out of 2500000 steps  (42%)
16:17:42:WU00:FS01:0xa7:Completed 470000 out of 500000 steps (94%)
16:21:44:WU02:FS00:0xa4:Completed 1075000 out of 2500000 steps  (43%)
16:27:24:WU00:FS01:0xa7:Completed 475000 out of 500000 steps (95%)
16:28:37:WU02:FS00:0xa4:Completed 1100000 out of 2500000 steps  (44%)
16:35:16:WU02:FS00:0xa4:Completed 1125000 out of 2500000 steps  (45%)
16:36:58:WU00:FS01:0xa7:Completed 480000 out of 500000 steps (96%)
16:41:53:WU02:FS00:0xa4:Completed 1150000 out of 2500000 steps  (46%)
16:46:25:WU00:FS01:0xa7:Completed 485000 out of 500000 steps (97%)
16:48:31:WU02:FS00:0xa4:Completed 1175000 out of 2500000 steps  (47%)
16:55:09:WU02:FS00:0xa4:Completed 1200000 out of 2500000 steps  (48%)
16:55:52:WU00:FS01:0xa7:Completed 490000 out of 500000 steps (98%)
17:01:46:WU02:FS00:0xa4:Completed 1225000 out of 2500000 steps  (49%)
17:05:21:WU00:FS01:0xa7:Completed 495000 out of 500000 steps (99%)
17:05:21:WU01:FS01:Connecting to 171.67.108.45:80
17:05:21:WU01:FS01:Assigned to work server 171.67.108.158
17:05:21:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:G92 [GeForce GTS 250] from 171.67.108.158
17:05:21:WU01:FS01:Connecting to 171.67.108.158:8080
17:05:23:WU01:FS01:Downloading 807.32KiB
17:05:24:WU01:FS01:Download complete
17:05:24:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9036 run:349 clone:0 gen:1407 core:0xa4 unit:0x000005f1ab436c9e56982cef9f908836
17:08:23:WU02:FS00:0xa4:Completed 1250000 out of 2500000 steps  (50%)
17:14:48:WU00:FS01:0xa7:Completed 500000 out of 500000 steps (100%)
17:14:50:WU00:FS01:0xa7:Saving result file ..\logfile_01.txt
17:14:50:WU00:FS01:0xa7:Saving result file frame85.cpt
17:14:50:WU00:FS01:0xa7:Saving result file frame85.edr
17:14:50:WU00:FS01:0xa7:Saving result file frame85.xtc
17:14:50:WU00:FS01:0xa7:Saving result file frame85_prev.cpt
17:14:50:WU00:FS01:0xa7:Saving result file science.log
17:14:50:WU00:FS01:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
17:14:50:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
17:14:50:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:8219 run:4 clone:89 gen:85 core:0xa7 unit:0x00000068868b340358ed3d758bee6b4c
17:14:50:WU00:FS01:Uploading 6.15MiB to 134.139.52.3
17:14:50:WU00:FS01:Connecting to 134.139.52.3:8080
17:14:50:WU01:FS01:Starting
17:14:50:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:14:50:WU01:FS01:Started FahCore on PID 14872
17:14:51:WU01:FS01:Core PID:19052
17:14:51:WU01:FS01:FahCore 0xa4 started
17:14:51:WARNING:WU01:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
17:14:51:WARNING:WU01:FS01:Fatal error, dumping
17:14:51:WU01:FS01:Sending unit results: id:01 state:SEND error:DUMPED project:9036 run:349 clone:0 gen:1407 core:0xa4 unit:0x000005f1ab436c9e56982cef9f908836
17:14:51:WU01:FS01:Connecting to 171.67.108.158:8080
17:14:51:WU03:FS01:Connecting to 171.67.108.45:80
17:14:52:WU01:FS01:Server responded WORK_ACK (400)
17:14:52:WU01:FS01:Cleaning up
17:14:52:WU03:FS01:Assigned to work server 171.67.108.158
17:14:52:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 171.67.108.158
17:14:52:WU03:FS01:Connecting to 171.67.108.158:8080
17:14:54:WU03:FS01:Downloading 807.45KiB
17:14:55:WU03:FS01:Download complete
17:14:55:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9037 run:657 clone:1 gen:811 core:0xa4 unit:0x0000037bab436c9e56982adde3aa7f81
17:14:55:WU03:FS01:Starting
17:14:55:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:14:55:WU03:FS01:Started FahCore on PID 15436
17:14:55:WU03:FS01:Core PID:3524
17:14:55:WU03:FS01:FahCore 0xa4 started
17:14:55:WARNING:WU03:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
17:14:55:WARNING:WU03:FS01:Fatal error, dumping
17:14:55:WU03:FS01:Sending unit results: id:03 state:SEND error:DUMPED project:9037 run:657 clone:1 gen:811 core:0xa4 unit:0x0000037bab436c9e56982adde3aa7f81
17:14:55:WU03:FS01:Connecting to 171.67.108.158:8080
17:14:55:WU01:FS01:Connecting to 171.67.108.45:80
17:14:55:WU03:FS01:Server responded WORK_ACK (400)
17:14:55:WU03:FS01:Cleaning up
17:14:56:WU00:FS01:Upload 13.21%
17:14:56:WU01:FS01:Assigned to work server 155.247.166.219
17:14:56:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.219
17:14:56:WU01:FS01:Connecting to 155.247.166.219:8080
17:14:57:WU01:FS01:Downloading 858.39KiB
17:14:57:WU01:FS01:Download complete
17:14:57:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8636 run:4 clone:87 gen:31 core:0xa4 unit:0x000000250002894b582a2886ea2ff79f
17:14:57:WU01:FS01:Starting
17:14:57:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:14:57:WU01:FS01:Started FahCore on PID 22604
17:14:57:WU01:FS01:Core PID:13144
17:14:57:WU01:FS01:FahCore 0xa4 started
17:14:58:WARNING:WU01:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
17:14:58:WARNING:WU01:FS01:Fatal error, dumping
17:14:58:WU01:FS01:Sending unit results: id:01 state:SEND error:DUMPED project:8636 run:4 clone:87 gen:31 core:0xa4 unit:0x000000250002894b582a2886ea2ff79f
17:14:58:WU01:FS01:Connecting to 155.247.166.219:8080
17:14:58:WU01:FS01:Server responded WORK_ACK (400)
17:14:58:WU01:FS01:Cleaning up
17:14:58:WU03:FS01:Connecting to 171.67.108.45:80
17:14:58:WU03:FS01:Assigned to work server 155.247.166.220
17:14:58:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.220
17:14:58:WU03:FS01:Connecting to 155.247.166.220:8080
17:14:59:WU03:FS01:Downloading 723.02KiB
17:15:00:WU03:FS01:Download complete
17:15:00:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13773 run:0 clone:281 gen:3 core:0xa4 unit:0x000000040002894c59bb46b3c7c169d6
17:15:00:WU03:FS01:Starting
17:15:00:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:15:00:WU03:FS01:Started FahCore on PID 13028
17:15:00:WU03:FS01:Core PID:23952
17:15:00:WU03:FS01:FahCore 0xa4 started
17:15:00:WARNING:WU03:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
17:15:00:WARNING:WU03:FS01:Fatal error, dumping
17:15:00:WU03:FS01:Sending unit results: id:03 state:SEND error:DUMPED project:13773 run:0 clone:281 gen:3 core:0xa4 unit:0x000000040002894c59bb46b3c7c169d6
17:15:00:WU03:FS01:Connecting to 155.247.166.220:8080
17:15:01:WU03:FS01:Server responded WORK_ACK (400)
17:15:01:WU03:FS01:Cleaning up
17:15:01:WU01:FS01:Connecting to 171.67.108.45:80
17:15:01:WU01:FS01:Assigned to work server 155.247.166.219
17:15:01:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.219
17:15:01:WU01:FS01:Connecting to 155.247.166.219:8080
17:15:01:WU02:FS00:0xa4:Completed 1275000 out of 2500000 steps  (51%)
17:15:02:WU01:FS01:Downloading 859.05KiB
17:15:02:WU00:FS01:Upload 28.46%
17:15:02:WU01:FS01:Download complete
17:15:02:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8637 run:1 clone:28 gen:134 core:0xa4 unit:0x000000920002894b582b5277059dcf3a
17:15:02:WU01:FS01:Starting
17:15:02:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:15:02:WU01:FS01:Started FahCore on PID 18392
17:15:02:WU01:FS01:Core PID:8624
17:15:02:WU01:FS01:FahCore 0xa4 started
17:15:03:WARNING:WU01:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
17:15:03:WARNING:WU01:FS01:Fatal error, dumping
17:15:03:WU01:FS01:Sending unit results: id:01 state:SEND error:DUMPED project:8637 run:1 clone:28 gen:134 core:0xa4 unit:0x000000920002894b582b5277059dcf3a
17:15:03:WU01:FS01:Connecting to 155.247.166.219:8080
17:15:03:WU01:FS01:Server responded WORK_ACK (400)
17:15:03:WU01:FS01:Cleaning up
17:15:03:WU03:FS01:Connecting to 171.67.108.45:80
17:15:04:WU03:FS01:Assigned to work server 155.247.166.220
17:15:04:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.220
17:15:04:WU03:FS01:Connecting to 155.247.166.220:8080
17:15:04:WU03:FS01:Downloading 723.33KiB
17:15:05:WU03:FS01:Download complete
17:15:05:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:14021 run:0 clone:103 gen:14 core:0xa4 unit:0x0000000e0002894c59e4d469b0b7a08b
17:15:05:WU03:FS01:Starting
17:15:05:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:15:05:WU03:FS01:Started FahCore on PID 16480
17:15:05:WU03:FS01:Core PID:17340
17:15:05:WU03:FS01:FahCore 0xa4 started
17:15:06:WARNING:WU03:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
17:15:06:WARNING:WU03:FS01:Fatal error, dumping
17:15:06:WU03:FS01:Sending unit results: id:03 state:SEND error:DUMPED project:14021 run:0 clone:103 gen:14 core:0xa4 unit:0x0000000e0002894c59e4d469b0b7a08b
17:15:06:WU03:FS01:Connecting to 155.247.166.220:8080
17:15:06:WU03:FS01:Server responded WORK_ACK (400)
17:15:06:WU03:FS01:Cleaning up
17:15:06:WU01:FS01:Connecting to 171.67.108.45:80
17:15:06:WU01:FS01:Assigned to work server 155.247.166.219
17:15:06:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.219
17:15:06:WU01:FS01:Connecting to 155.247.166.219:8080
17:15:07:WU01:FS01:Downloading 178.44KiB
17:15:07:WU01:FS01:Download complete
17:15:07:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13742 run:186 clone:0 gen:49 core:0xa7 unit:0x000000330002894b59d5a5860a362629
17:15:07:WU01:FS01:Starting
17:15:07:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
17:15:07:WU01:FS01:Started FahCore on PID 24508
17:15:07:WU01:FS01:Core PID:16268
17:15:07:WU01:FS01:FahCore 0xa7 started
17:15:08:WU00:FS01:Upload 42.69%
17:15:08:WU01:FS01:0xa7:*********************** Log Started 2017-11-19T17:15:07Z ***********************
17:15:08:WU01:FS01:0xa7:************************** Gromacs Folding@home Core ***************************
17:15:08:WU01:FS01:0xa7:       Type: 0xa7
17:15:08:WU01:FS01:0xa7:       Core: Gromacs
17:15:08:WU01:FS01:0xa7:    Website: http://folding.stanford.edu/
17:15:08:WU01:FS01:0xa7:  Copyright: (c) 2009-2016 Stanford University
17:15:08:WU01:FS01:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:15:08:WU01:FS01:0xa7:       Args: -dir 01 -suffix 01 -version 704 -lifeline 24508 -checkpoint 15 -gpu
17:15:08:WU01:FS01:0xa7:             0
17:15:08:WU01:FS01:0xa7:     Config: <none>
17:15:08:WU01:FS01:0xa7:************************************ Build *************************************
17:15:08:WU01:FS01:0xa7:    Version: 0.0.16
17:15:08:WU01:FS01:0xa7:       Date: Oct 31 2017
17:15:08:WU01:FS01:0xa7:       Time: 14:04:33
17:15:08:WU01:FS01:0xa7: Repository: Git
17:15:08:WU01:FS01:0xa7:   Revision: 2f0a8a3d0b0698be48154fe99a0216f289060932
17:15:08:WU01:FS01:0xa7:     Branch: master
17:15:08:WU01:FS01:0xa7:   Compiler: Visual C++ 2008
17:15:08:WU01:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
17:15:08:WU01:FS01:0xa7:   Platform: win32 10
17:15:08:WU01:FS01:0xa7:       Bits: 64
17:15:08:WU01:FS01:0xa7:       Mode: Release
17:15:08:WU01:FS01:0xa7:       SIMD: avx_256
17:15:08:WU01:FS01:0xa7:************************************ System ************************************
17:15:08:WU01:FS01:0xa7:        CPU: Unknown
17:15:08:WU01:FS01:0xa7:     CPU ID: 
17:15:08:WU01:FS01:0xa7:       CPUs: 8
17:15:08:WU01:FS01:0xa7:     Memory: 7.94GiB
17:15:08:WU01:FS01:0xa7:Free Memory: 3.63GiB
17:15:08:WU01:FS01:0xa7:    Threads: WINDOWS_THREADS
17:15:08:WU01:FS01:0xa7: OS Version: 6.1
17:15:08:WU01:FS01:0xa7:Has Battery: false
17:15:08:WU01:FS01:0xa7: On Battery: false
17:15:08:WU01:FS01:0xa7: UTC Offset: -6
17:15:08:WU01:FS01:0xa7:        PID: 16268
17:15:08:WU01:FS01:0xa7:        CWD: C:\Users\Jeff\AppData\Roaming\FAHClient\work
17:15:08:WU01:FS01:0xa7:         OS: Windows 7 Ultimate Service Pack 1
17:15:08:WU01:FS01:0xa7:    OS Arch: AMD64
17:15:08:WU01:FS01:0xa7:********************************************************************************
17:15:08:WU01:FS01:0xa7:Project: 13742 (Run 186, Clone 0, Gen 49)
17:15:08:WU01:FS01:0xa7:Unit: 0x000000330002894b59d5a5860a362629
17:15:08:WU01:FS01:0xa7:Reading tar file core.xml
17:15:08:WU01:FS01:0xa7:Reading tar file frame49.tpr
17:15:08:WU01:FS01:0xa7:Digital signatures verified
17:15:08:WU01:FS01:0xa7:Calling: mdrun -s frame49.tpr -o frame49.trr -cpt 15 -nt 1
17:15:08:WU01:FS01:0xa7:Steps: first=122500000 total=2500000
17:15:08:WU01:FS01:0xa7:Completed 1 out of 2500000 steps (0%)
17:15:14:WU00:FS01:Upload 57.94%
17:15:20:WU00:FS01:Upload 72.17%
17:15:26:WU00:FS01:Upload 86.40%
17:15:31:WU00:FS01:Upload complete
17:15:31:WU00:FS01:Server responded WORK_ACK (400)
17:15:31:WU00:FS01:Final credit estimate, 2414.00 points
17:15:31:WU00:FS01:Cleaning up
17:18:59:WU01:FS01:0xa7:Completed 25000 out of 2500000 steps (1%)
17:21:37:WU02:FS00:0xa4:Completed 1300000 out of 2500000 steps  (52%)
17:22:52:WU01:FS01:0xa7:Completed 50000 out of 2500000 steps (2%)
17:26:57:WU01:FS01:0xa7:Completed 75000 out of 2500000 steps (3%)
17:28:30:WU02:FS00:0xa4:Completed 1325000 out of 2500000 steps  (53%)
17:30:54:WU01:FS01:0xa7:Completed 100000 out of 2500000 steps (4%)
17:34:46:WU01:FS01:0xa7:Completed 125000 out of 2500000 steps (5%)
17:35:08:WU02:FS00:0xa4:Completed 1350000 out of 2500000 steps  (54%)
17:38:38:WU01:FS01:0xa7:Completed 150000 out of 2500000 steps (6%)
17:41:45:WU02:FS00:0xa4:Completed 1375000 out of 2500000 steps  (55%)
17:42:30:WU01:FS01:0xa7:Completed 175000 out of 2500000 steps (7%)
17:46:22:WU01:FS01:0xa7:Completed 200000 out of 2500000 steps (8%)
17:48:21:WU02:FS00:0xa4:Completed 1400000 out of 2500000 steps  (56%)
17:50:14:WU01:FS01:0xa7:Completed 225000 out of 2500000 steps (9%)
17:54:06:WU01:FS01:0xa7:Completed 250000 out of 2500000 steps (10%)
17:54:57:WU02:FS00:0xa4:Completed 1425000 out of 2500000 steps  (57%)
17:57:58:WU01:FS01:0xa7:Completed 275000 out of 2500000 steps (11%)
18:01:33:WU02:FS00:0xa4:Completed 1450000 out of 2500000 steps  (58%)
18:01:51:WU01:FS01:0xa7:Completed 300000 out of 2500000 steps (12%)
18:05:43:WU01:FS01:0xa7:Completed 325000 out of 2500000 steps (13%)
18:08:09:WU02:FS00:0xa4:Completed 1475000 out of 2500000 steps  (59%)
18:09:35:WU01:FS01:0xa7:Completed 350000 out of 2500000 steps (14%)
******************************* Date: 2017-11-19 *******************************
18:13:27:WU01:FS01:0xa7:Completed 375000 out of 2500000 steps (15%)
18:14:46:WU02:FS00:0xa4:Completed 1500000 out of 2500000 steps  (60%)
18:17:19:WU01:FS01:0xa7:Completed 400000 out of 2500000 steps (16%)
18:21:12:WU01:FS01:0xa7:Completed 425000 out of 2500000 steps (17%)
18:21:22:WU02:FS00:0xa4:Completed 1525000 out of 2500000 steps  (61%)
18:25:08:WU01:FS01:0xa7:Completed 450000 out of 2500000 steps (18%)
18:28:18:WU02:FS00:0xa4:Completed 1550000 out of 2500000 steps  (62%)
18:29:14:WU01:FS01:0xa7:Completed 475000 out of 2500000 steps (19%)
18:33:05:WU01:FS01:0xa7:Completed 500000 out of 2500000 steps (20%)
18:34:58:WU02:FS00:0xa4:Completed 1575000 out of 2500000 steps  (63%)
18:36:57:WU01:FS01:0xa7:Completed 525000 out of 2500000 steps (21%)
18:40:49:WU01:FS01:0xa7:Completed 550000 out of 2500000 steps (22%)
18:41:34:WU02:FS00:0xa4:Completed 1600000 out of 2500000 steps  (64%)
18:44:41:WU01:FS01:0xa7:Completed 575000 out of 2500000 steps (23%)
18:48:10:WU02:FS00:0xa4:Completed 1625000 out of 2500000 steps  (65%)
18:48:33:WU01:FS01:0xa7:Completed 600000 out of 2500000 steps (24%)
18:52:26:WU01:FS01:0xa7:Completed 625000 out of 2500000 steps (25%)
18:54:49:WU02:FS00:0xa4:Completed 1650000 out of 2500000 steps  (66%)
18:56:27:WU01:FS01:0xa7:Completed 650000 out of 2500000 steps (26%)
19:00:28:WU01:FS01:0xa7:Completed 675000 out of 2500000 steps (27%)
19:01:43:WU02:FS00:0xa4:Completed 1675000 out of 2500000 steps  (67%)
19:04:21:WU01:FS01:0xa7:Completed 700000 out of 2500000 steps (28%)
19:08:14:WU01:FS01:0xa7:Completed 725000 out of 2500000 steps (29%)
19:08:18:WU02:FS00:0xa4:Completed 1700000 out of 2500000 steps  (68%)
19:12:05:WU01:FS01:0xa7:Completed 750000 out of 2500000 steps (30%)
19:14:55:WU02:FS00:0xa4:Completed 1725000 out of 2500000 steps  (69%)
19:15:58:WU01:FS01:0xa7:Completed 775000 out of 2500000 steps (31%)
19:19:49:WU01:FS01:0xa7:Completed 800000 out of 2500000 steps (32%)
19:21:30:WU02:FS00:0xa4:Completed 1750000 out of 2500000 steps  (70%)
19:23:42:WU01:FS01:0xa7:Completed 825000 out of 2500000 steps (33%)
19:27:34:WU01:FS01:0xa7:Completed 850000 out of 2500000 steps (34%)
19:28:07:WU02:FS00:0xa4:Completed 1775000 out of 2500000 steps  (71%)
19:31:26:WU01:FS01:0xa7:Completed 875000 out of 2500000 steps (35%)
19:34:43:WU02:FS00:0xa4:Completed 1800000 out of 2500000 steps  (72%)
19:35:19:WU01:FS01:0xa7:Completed 900000 out of 2500000 steps (36%)
19:39:11:WU01:FS01:0xa7:Completed 925000 out of 2500000 steps (37%)
19:41:18:WU02:FS00:0xa4:Completed 1825000 out of 2500000 steps  (73%)
19:43:02:WU01:FS01:0xa7:Completed 950000 out of 2500000 steps (38%)
19:46:53:WU01:FS01:0xa7:Completed 975000 out of 2500000 steps (39%)
19:47:55:WU02:FS00:0xa4:Completed 1850000 out of 2500000 steps  (74%)
19:50:45:WU01:FS01:0xa7:Completed 1000000 out of 2500000 steps (40%)
19:54:33:WU02:FS00:0xa4:Completed 1875000 out of 2500000 steps  (75%)
19:54:40:WU01:FS01:0xa7:Completed 1025000 out of 2500000 steps (41%)
19:58:41:WU01:FS01:0xa7:Completed 1050000 out of 2500000 steps (42%)
20:01:25:WU02:FS00:0xa4:Completed 1900000 out of 2500000 steps  (76%)
20:02:34:WU01:FS01:0xa7:Completed 1075000 out of 2500000 steps (43%)
20:06:26:WU01:FS01:0xa7:Completed 1100000 out of 2500000 steps (44%)
20:08:01:WU02:FS00:0xa4:Completed 1925000 out of 2500000 steps  (77%)
20:10:18:WU01:FS01:0xa7:Completed 1125000 out of 2500000 steps (45%)
20:14:11:WU01:FS01:0xa7:Completed 1150000 out of 2500000 steps (46%)
20:14:37:WU02:FS00:0xa4:Completed 1950000 out of 2500000 steps  (78%)
20:18:03:WU01:FS01:0xa7:Completed 1175000 out of 2500000 steps (47%)
20:21:14:WU02:FS00:0xa4:Completed 1975000 out of 2500000 steps  (79%)
20:21:55:WU01:FS01:0xa7:Completed 1200000 out of 2500000 steps (48%)
20:25:48:WU01:FS01:0xa7:Completed 1225000 out of 2500000 steps (49%)
20:27:50:WU02:FS00:0xa4:Completed 2000000 out of 2500000 steps  (80%)
20:29:39:WU01:FS01:0xa7:Completed 1250000 out of 2500000 steps (50%)
20:33:32:WU01:FS01:0xa7:Completed 1275000 out of 2500000 steps (51%)
20:34:27:WU02:FS00:0xa4:Completed 2025000 out of 2500000 steps  (81%)
20:37:24:WU01:FS01:0xa7:Completed 1300000 out of 2500000 steps (52%)
20:41:03:WU02:FS00:0xa4:Completed 2050000 out of 2500000 steps  (82%)
20:41:16:WU01:FS01:0xa7:Completed 1325000 out of 2500000 steps (53%)
20:45:08:WU01:FS01:0xa7:Completed 1350000 out of 2500000 steps (54%)
20:47:39:WU02:FS00:0xa4:Completed 2075000 out of 2500000 steps  (83%)
20:49:00:WU01:FS01:0xa7:Completed 1375000 out of 2500000 steps (55%)
20:52:53:WU01:FS01:0xa7:Completed 1400000 out of 2500000 steps (56%)
20:54:16:WU02:FS00:0xa4:Completed 2100000 out of 2500000 steps  (84%)
20:56:52:WU01:FS01:0xa7:Completed 1425000 out of 2500000 steps (57%)
21:00:51:WU01:FS01:0xa7:Completed 1450000 out of 2500000 steps (58%)
21:01:08:WU02:FS00:0xa4:Completed 2125000 out of 2500000 steps  (85%)
21:04:44:WU01:FS01:0xa7:Completed 1475000 out of 2500000 steps (59%)
21:07:47:WU02:FS00:0xa4:Completed 2150000 out of 2500000 steps  (86%)
21:08:37:WU01:FS01:0xa7:Completed 1500000 out of 2500000 steps (60%)
21:12:31:WU01:FS01:0xa7:Completed 1525000 out of 2500000 steps (61%)
21:14:34:WU02:FS00:0xa4:Completed 2175000 out of 2500000 steps  (87%)
21:16:26:WU01:FS01:0xa7:Completed 1550000 out of 2500000 steps (62%)
21:20:31:WU01:FS01:0xa7:Completed 1575000 out of 2500000 steps (63%)
21:21:36:WU02:FS00:0xa4:Completed 2200000 out of 2500000 steps  (88%)
21:24:32:WU01:FS01:0xa7:Completed 1600000 out of 2500000 steps (64%)
21:28:37:WU01:FS01:0xa7:Completed 1625000 out of 2500000 steps (65%)
21:29:01:WU02:FS00:0xa4:Completed 2225000 out of 2500000 steps  (89%)
21:32:45:WU01:FS01:0xa7:Completed 1650000 out of 2500000 steps (66%)
21:36:04:WU02:FS00:0xa4:Completed 2250000 out of 2500000 steps  (90%)
21:36:53:WU01:FS01:0xa7:Completed 1675000 out of 2500000 steps (67%)
21:40:45:WU01:FS01:0xa7:Completed 1700000 out of 2500000 steps (68%)
21:42:45:WU02:FS00:0xa4:Completed 2275000 out of 2500000 steps  (91%)
21:44:37:WU01:FS01:0xa7:Completed 1725000 out of 2500000 steps (69%)
21:48:30:WU01:FS01:0xa7:Completed 1750000 out of 2500000 steps (70%)
21:49:22:WU02:FS00:0xa4:Completed 2300000 out of 2500000 steps  (92%)
21:52:21:WU01:FS01:0xa7:Completed 1775000 out of 2500000 steps (71%)
21:56:00:WU02:FS00:0xa4:Completed 2325000 out of 2500000 steps  (93%)
21:56:14:WU01:FS01:0xa7:Completed 1800000 out of 2500000 steps (72%)
22:00:06:WU01:FS01:0xa7:Completed 1825000 out of 2500000 steps (73%)
22:02:37:WU02:FS00:0xa4:Completed 2350000 out of 2500000 steps  (94%)
22:03:59:WU01:FS01:0xa7:Completed 1850000 out of 2500000 steps (74%)
22:07:51:WU01:FS01:0xa7:Completed 1875000 out of 2500000 steps (75%)
22:09:15:WU02:FS00:0xa4:Completed 2375000 out of 2500000 steps  (95%)
22:11:42:WU01:FS01:0xa7:Completed 1900000 out of 2500000 steps (76%)
22:15:35:WU01:FS01:0xa7:Completed 1925000 out of 2500000 steps (77%)
22:15:52:WU02:FS00:0xa4:Completed 2400000 out of 2500000 steps  (96%)
22:19:28:WU01:FS01:0xa7:Completed 1950000 out of 2500000 steps (78%)
22:22:31:WU02:FS00:0xa4:Completed 2425000 out of 2500000 steps  (97%)
22:23:21:WU01:FS01:0xa7:Completed 1975000 out of 2500000 steps (79%)
22:27:26:WU01:FS01:0xa7:Completed 2000000 out of 2500000 steps (80%)
22:29:26:WU02:FS00:0xa4:Completed 2450000 out of 2500000 steps  (98%)
22:31:22:WU01:FS01:0xa7:Completed 2025000 out of 2500000 steps (81%)
22:35:16:WU01:FS01:0xa7:Completed 2050000 out of 2500000 steps (82%)
22:36:03:WU02:FS00:0xa4:Completed 2475000 out of 2500000 steps  (99%)
22:36:04:WU00:FS00:Connecting to 171.67.108.45:8080
22:36:05:WU00:FS00:Assigned to work server 171.67.108.158
22:36:05:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:6 from 171.67.108.158
22:36:05:WU00:FS00:Connecting to 171.67.108.158:8080
22:36:06:WU00:FS00:Downloading 807.26KiB
22:36:06:WU00:FS00:Download complete
22:36:07:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9035 run:877 clone:2 gen:830 core:0xa4 unit:0x0000039cab436c9e56982d9b093cbdae
22:39:08:WU01:FS01:0xa7:Completed 2075000 out of 2500000 steps (83%)
22:42:47:WU02:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
22:42:47:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
22:42:56:WU01:FS01:0xa7:Completed 2100000 out of 2500000 steps (84%)
22:42:57:WU02:FS00:0xa4:
22:42:57:WU02:FS00:0xa4:Finished Work Unit:
22:42:57:WU02:FS00:0xa4:- Reading up to 4510080 from "02/wudata_01.trr": Read 4510080
22:42:57:WU02:FS00:0xa4:trr file hash check passed.
22:42:57:WU02:FS00:0xa4:- Reading up to 512080 from "02/wudata_01.xtc": Read 512080
22:42:57:WU02:FS00:0xa4:xtc file hash check passed.
22:42:57:WU02:FS00:0xa4:edr file hash check passed.
22:42:57:WU02:FS00:0xa4:logfile size: 57909
22:42:57:WU02:FS00:0xa4:Leaving Run
22:42:59:WU02:FS00:0xa4:- Writing 5117773 bytes of core data to disk...
22:43:00:WU02:FS00:0xa4:Done: 5117261 -> 4352544 (compressed to 85.0 percent)
22:43:00:WU02:FS00:0xa4:  ... Done.
22:43:00:WU02:FS00:0xa4:- Shutting down core
22:43:00:WU02:FS00:0xa4:
22:43:00:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
22:43:01:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
22:43:01:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:14006 run:0 clone:103 gen:4 core:0xa4 unit:0x000000040002894c59e4d061d61e5e75
22:43:01:WU02:FS00:Uploading 4.15MiB to 155.247.166.220
22:43:01:WU02:FS00:Connecting to 155.247.166.220:8080
22:43:01:WU00:FS00:Starting
22:43:01:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -np 6
22:43:01:WU00:FS00:Started FahCore on PID 8032
22:43:01:WU00:FS00:Core PID:7540
22:43:01:WU00:FS00:FahCore 0xa4 started
22:43:01:WU00:FS00:0xa4:
22:43:01:WU00:FS00:0xa4:*------------------------------*
22:43:01:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
22:43:01:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
22:43:01:WU00:FS00:0xa4:
22:43:01:WU00:FS00:0xa4:Preparing to commence simulation
22:43:01:WU00:FS00:0xa4:- Looking at optimizations...
22:43:01:WU00:FS00:0xa4:- Created dyn
22:43:01:WU00:FS00:0xa4:- Files status OK
22:43:01:WU00:FS00:0xa4:- Expanded 826126 -> 1402156 (decompressed 169.7 percent)
22:43:01:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826126 data_size=1402156, decompressed_data_size=1402156 diff=0
22:43:01:WU00:FS00:0xa4:- Digital signature verified
22:43:01:WU00:FS00:0xa4:
22:43:01:WU00:FS00:0xa4:Project: 9035 (Run 877, Clone 2, Gen 830)
22:43:01:WU00:FS00:0xa4:
22:43:01:WU00:FS00:0xa4:Assembly optimizations on if available.
22:43:01:WU00:FS00:0xa4:Entering M.D.
22:43:07:WU02:FS00:Upload 36.13%
22:43:07:WU00:FS00:0xa4:Mapping NT from 6 to 6 
22:43:07:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
22:43:13:WU02:FS00:Upload 72.26%
22:43:18:WU02:FS00:Upload complete
22:43:18:WU02:FS00:Server responded WORK_ACK (400)
22:43:18:WU02:FS00:Final credit estimate, 7592.00 points
22:43:18:WU02:FS00:Cleaning up
22:44:33:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
22:46:00:WU00:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
22:46:41:WU01:FS01:0xa7:Completed 2125000 out of 2500000 steps (85%)
22:47:25:WU00:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
22:48:51:WU00:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
22:50:17:WU00:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
22:50:32:WU01:FS01:0xa7:Completed 2150000 out of 2500000 steps (86%)
22:51:44:WU00:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
22:53:09:WU00:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
22:54:23:WU01:FS01:0xa7:Completed 2175000 out of 2500000 steps (87%)
22:54:43:WU00:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
22:56:13:WU00:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
22:57:41:WU00:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
22:58:28:WU01:FS01:0xa7:Completed 2200000 out of 2500000 steps (88%)
22:59:10:WU00:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
23:00:35:WU00:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
23:02:06:WU00:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
23:02:21:WU01:FS01:0xa7:Completed 2225000 out of 2500000 steps (89%)
23:04:17:WU00:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
23:05:43:WU00:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
23:06:35:WU01:FS01:0xa7:Completed 2250000 out of 2500000 steps (90%)
23:07:08:WU00:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
23:09:17:WU00:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
23:11:00:WU01:FS01:0xa7:Completed 2275000 out of 2500000 steps (91%)
23:11:37:WU00:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
23:13:58:WU00:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
23:15:38:WU01:FS01:0xa7:Completed 2300000 out of 2500000 steps (92%)
23:16:00:WU00:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
23:18:05:WU00:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
23:20:08:WU01:FS01:0xa7:Completed 2325000 out of 2500000 steps (93%)
23:20:14:WU00:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
23:22:35:WU00:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
23:24:37:WU01:FS01:0xa7:Completed 2350000 out of 2500000 steps (94%)
23:24:39:WU00:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
23:26:12:WU00:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
23:28:02:WU00:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
23:28:47:WU01:FS01:0xa7:Completed 2375000 out of 2500000 steps (95%)
23:31:04:WU00:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
23:33:28:WU01:FS01:0xa7:Completed 2400000 out of 2500000 steps (96%)
23:34:09:WU00:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
23:36:54:WU00:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
23:38:34:WU01:FS01:0xa7:Completed 2425000 out of 2500000 steps (97%)
23:40:01:WU00:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
23:42:30:WU00:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
23:42:59:WU01:FS01:0xa7:Completed 2450000 out of 2500000 steps (98%)
23:43:58:WU00:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
23:45:40:WU00:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
23:47:03:WU01:FS01:0xa7:Completed 2475000 out of 2500000 steps (99%)
23:47:03:WU02:FS01:Connecting to 171.67.108.45:80
23:47:04:WU02:FS01:Assigned to work server 171.67.108.158
23:47:04:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:G92 [GeForce GTS 250] from 171.67.108.158
23:47:04:WU02:FS01:Connecting to 171.67.108.158:8080
23:47:05:WU02:FS01:Downloading 807.20KiB
23:47:06:WU02:FS01:Download complete
23:47:06:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9035 run:419 clone:0 gen:1339 core:0xa4 unit:0x000005a8ab436c9e56982e5f98236353
23:47:11:WU00:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
23:48:38:WU00:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
23:50:05:WU00:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
23:50:54:WU01:FS01:0xa7:Completed 2500000 out of 2500000 steps (100%)
23:50:54:WU01:FS01:0xa7:Saving result file ..\logfile_01.txt
23:50:54:WU01:FS01:0xa7:Saving result file frame49.trr
23:50:54:WU01:FS01:0xa7:Saving result file md.log
23:50:54:WU01:FS01:0xa7:Saving result file science.log
23:50:54:WU01:FS01:0xa7:Saving result file traj_comp.xtc
23:50:54:WU01:FS01:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
23:50:54:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:50:54:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:13742 run:186 clone:0 gen:49 core:0xa7 unit:0x000000330002894b59d5a5860a362629
23:50:54:WU01:FS01:Uploading 1.66MiB to 155.247.166.219
23:50:54:WU01:FS01:Connecting to 155.247.166.219:8080
23:50:55:WU02:FS01:Starting
23:50:55:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
23:50:55:WU02:FS01:Started FahCore on PID 1904
23:50:55:WU02:FS01:Core PID:20536
23:50:55:WU02:FS01:FahCore 0xa4 started
23:50:55:WARNING:WU02:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
23:50:55:WARNING:WU02:FS01:Fatal error, dumping
23:50:55:WU02:FS01:Sending unit results: id:02 state:SEND error:DUMPED project:9035 run:419 clone:0 gen:1339 core:0xa4 unit:0x000005a8ab436c9e56982e5f98236353
23:50:55:WU02:FS01:Connecting to 171.67.108.158:8080
23:50:56:WU02:FS01:Server responded WORK_ACK (400)
23:50:56:WU02:FS01:Cleaning up
23:50:56:WU03:FS01:Connecting to 171.67.108.45:80
23:50:56:WU03:FS01:Assigned to work server 155.247.166.220
23:50:56:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.220
23:50:56:WU03:FS01:Connecting to 155.247.166.220:8080
23:50:56:WU03:FS01:Downloading 334.27KiB
23:50:57:WU03:FS01:Download complete
23:50:57:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:8654 run:1122 clone:0 gen:16 core:0xa4 unit:0x000000130002894c57f7f70162037456
23:50:57:WU03:FS01:Starting
23:50:57:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
23:50:57:WU03:FS01:Started FahCore on PID 3284
23:50:57:WU03:FS01:Core PID:20084
23:50:57:WU03:FS01:FahCore 0xa4 started
23:50:57:WARNING:WU03:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
23:50:57:WARNING:WU03:FS01:Fatal error, dumping
23:50:57:WU03:FS01:Sending unit results: id:03 state:SEND error:DUMPED project:8654 run:1122 clone:0 gen:16 core:0xa4 unit:0x000000130002894c57f7f70162037456
23:50:57:WU03:FS01:Connecting to 155.247.166.220:8080
23:50:57:WU03:FS01:Server responded WORK_ACK (400)
23:50:57:WU03:FS01:Cleaning up
23:50:57:WU02:FS01:Connecting to 171.67.108.45:80
23:50:58:WU02:FS01:Assigned to work server 155.247.166.220
23:50:58:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 155.247.166.220
23:50:58:WU02:FS01:Connecting to 155.247.166.220:8080
23:50:58:WU02:FS01:Downloading 723.72KiB
23:50:59:WU02:FS01:Download complete
23:50:59:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:14006 run:0 clone:267 gen:4 core:0xa4 unit:0x000000040002894c59e4d06cc86e5e3f
23:50:59:WU02:FS01:Starting
23:50:59:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
23:50:59:WU02:FS01:Started FahCore on PID 12592
23:50:59:WU02:FS01:Core PID:17312
23:50:59:WU02:FS01:FahCore 0xa4 started
23:51:00:WARNING:WU02:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
23:51:00:WARNING:WU02:FS01:Fatal error, dumping
23:51:00:WU02:FS01:Sending unit results: id:02 state:SEND error:DUMPED project:14006 run:0 clone:267 gen:4 core:0xa4 unit:0x000000040002894c59e4d06cc86e5e3f
23:51:00:WU02:FS01:Connecting to 155.247.166.220:8080
23:51:00:WU02:FS01:Server responded WORK_ACK (400)
23:51:00:WU02:FS01:Cleaning up
23:51:00:WU03:FS01:Connecting to 171.67.108.45:80
23:51:00:WU01:FS01:Upload 79.10%
23:51:00:WU03:FS01:Assigned to work server 171.67.108.158
23:51:00:WU03:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 171.67.108.158
23:51:00:WU03:FS01:Connecting to 171.67.108.158:8080
23:51:01:WU01:FS01:Upload complete
23:51:02:WU01:FS01:Server responded WORK_ACK (400)
23:51:02:WU01:FS01:Final credit estimate, 776.00 points
23:51:02:WU01:FS01:Cleaning up
23:51:02:WU03:FS01:Downloading 806.75KiB
23:51:03:WU03:FS01:Download complete
23:51:04:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9033 run:509 clone:2 gen:937 core:0xa4 unit:0x00000402ab436c9e5698315232574825
23:51:04:WU03:FS01:Starting
23:51:04:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
23:51:04:WU03:FS01:Started FahCore on PID 22088
23:51:04:WU03:FS01:Core PID:1128
23:51:04:WU03:FS01:FahCore 0xa4 started
23:51:04:WARNING:WU03:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
23:51:04:WARNING:WU03:FS01:Fatal error, dumping
23:51:04:WU03:FS01:Sending unit results: id:03 state:SEND error:DUMPED project:9033 run:509 clone:2 gen:937 core:0xa4 unit:0x00000402ab436c9e5698315232574825
23:51:04:WU03:FS01:Connecting to 171.67.108.158:8080
23:51:04:WU03:FS01:Server responded WORK_ACK (400)
23:51:04:WU03:FS01:Cleaning up
23:51:04:WU01:FS01:Connecting to 171.67.108.45:80
23:51:05:WU01:FS01:Assigned to work server 171.67.108.158
23:51:05:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 171.67.108.158
23:51:05:WU01:FS01:Connecting to 171.67.108.158:8080
23:51:06:WU01:FS01:Downloading 807.59KiB
23:51:07:WU01:FS01:Download complete
23:51:07:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9040 run:233 clone:0 gen:1257 core:0xa4 unit:0x00000550ab436c9e56e9d9420802599d
23:51:07:WU01:FS01:Starting
23:51:07:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Jeff/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 7200 -checkpoint 15 -gpu 0
23:51:07:WU01:FS01:Started FahCore on PID 22692
23:51:07:WU01:FS01:Core PID:13252
23:51:07:WU01:FS01:FahCore 0xa4 started
23:51:07:WARNING:WU01:FS01:FahCore returned: FILE_IO_ERROR (117 = 0x75)
23:51:07:WARNING:WU01:FS01:Fatal error, dumping
23:51:07:WU01:FS01:Sending unit results: id:01 state:SEND error:DUMPED project:9040 run:233 clone:0 gen:1257 core:0xa4 unit:0x00000550ab436c9e56e9d9420802599d
23:51:07:WU01:FS01:Connecting to 171.67.108.158:8080
23:51:08:WU01:FS01:Server responded WORK_ACK (400)
23:51:08:WU01:FS01:Cleaning up
23:51:08:WU02:FS01:Connecting to 171.67.108.45:80
23:51:08:WU02:FS01:Assigned to work server 171.67.108.101
23:51:08:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:G92 [GeForce GTS 250] from 171.67.108.101
23:51:08:WU02:FS01:Connecting to 171.67.108.101:8080
23:51:10:WU02:FS01:Downloading 2.95MiB
23:51:12:WU02:FS01:Download complete

Re: Sending unit results: id:02 state:SEND error:DUMPED

Posted: Thu Nov 23, 2017 6:16 am
by Joe_H
Looking through your log, it shows that there is a configuration problem with the slot you think is a GPU slot. What the log shows is that Slot 01 is actually running CPU projects. One clue is the information shown when the slot requests a new WU:

Code: Select all

17:05:21:WU00:FS01:0xa7:Completed 495000 out of 500000 steps (99%)
17:05:21:WU01:FS01:Connecting to 171.67.108.45:80
17:05:21:WU01:FS01:Assigned to work server 171.67.108.158
17:05:21:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:G92 [GeForce GTS 250] from 171.67.108.158
17:05:21:WU01:FS01:Connecting to 171.67.108.158:8080
17:05:23:WU01:FS01:Downloading 807.32KiB
17:05:24:WU01:FS01:Download complete
17:05:24:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9036 run:349 clone:0 gen:1407 core:0xa4 unit:0x000005f1ab436c9e56982cef9f908836
Somehow the slot is being seen as actually a CPU slot in spite of the GPU information in the request. It was assigned a Project 9036 WU which is a CPU project, and that later is shown as being run on the CPU A4 core.

The misconfiguration may be the cause of the WU's not folding, and being dumped. Another possibility is an issue connected with some installs on Windows resulting in files not in the right locations and the client not being able to open or modify them. If you could post the beginning section of your log to show up to the end of the folding configuration, we may be able to tell if that is the case.

If you actually do have a GTS 250 for your GPU, that is no longer a supported GPU and should show as Unsupported in the System Info section at the beginning of the log file. It will not get any currently available GPU assignments as they require hardware and software features that the GTS 250 does not support. If a WU is currently running in that slot, set it to Finish and delete the slot after it is completed.

Re: Sending unit results: id:02 state:SEND error:DUMPED

Posted: Thu Nov 23, 2017 6:58 am
by fluke76
Thanks Joe for taking a look. I was doing some research and came to the same conclusion as you...my old GTS 250 is not supported and probably the cause of the dumps. I still think it's a bit weird, though. I started folding again on the 13th, and the issue did not appear until the 19th. I do know that there were some WUs completed by the GPU that I got credit for. Regardless, I have removed the GPU from my folding config and am now only using the CPU. I have a GTX 1070 on my xmas wishlist, but I was hoping prices would come down a little bit. I have posted my old config below if you care to take a look and see if there is anything other than the GPU that might be problematic.

Thanks again.

Code: Select all

*********************** Log Started 2017-11-17T12:18:33Z ***********************
12:18:33:************************* Folding@home Client *************************
12:18:33:      Website: http://folding.stanford.edu/
12:18:33:    Copyright: (c) 2009-2014 Stanford University
12:18:33:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:18:33:         Args: --open-web-control
12:18:33:       Config: C:/Users/Jeff/AppData/Roaming/FAHClient/config.xml
12:18:33:******************************** Build ********************************
12:18:33:      Version: 7.4.4
12:18:33:         Date: Mar 4 2014
12:18:33:         Time: 20:26:54
12:18:33:      SVN Rev: 4130
12:18:33:       Branch: fah/trunk/client
12:18:33:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
12:18:33:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
12:18:33:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
12:18:33:     Platform: win32 XP
12:18:33:         Bits: 32
12:18:33:         Mode: Release
12:18:33:******************************* System ********************************
12:18:33:          CPU: Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz
12:18:33:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
12:18:33:         CPUs: 8
12:18:33:       Memory: 7.94GiB
12:18:33:  Free Memory: 6.02GiB
12:18:33:      Threads: WINDOWS_THREADS
12:18:33:   OS Version: 6.1
12:18:33:  Has Battery: false
12:18:33:   On Battery: false
12:18:33:   UTC Offset: -6
12:18:33:          PID: 20204
12:18:33:          CWD: C:/Users/Jeff/AppData/Roaming/FAHClient
12:18:33:           OS: Windows 7 Ultimate
12:18:33:      OS Arch: AMD64
12:18:33:         GPUs: 1
12:18:33:        GPU 0: UNSUPPORTED: G92 [GeForce GTS 250]
12:18:33:         CUDA: 1.1
12:18:33:  CUDA Driver: 6050
12:18:33:Win32 Service: false
12:18:33:***********************************************************************
12:18:33:<config>
12:18:33:  <!-- Folding Slot Configuration -->
12:18:33:  <cause v='PARKINSONS'/>
12:18:33:
12:18:33:  <!-- Network -->
12:18:33:  <proxy v=':8080'/>
12:18:33:
12:18:33:  <!-- User Information -->
12:18:33:  <passkey v='********************************'/>
12:18:33:  <team v='51394'/>
12:18:33:  <user v='fluke76'/>
12:18:33:
12:18:33:  <!-- Folding Slots -->
12:18:33:  <slot id='0' type='CPU'>
12:18:33:    <paused v='true'/>
12:18:33:  </slot>
12:18:33:  <slot id='1' type='GPU'>
12:18:33:    <gpu-index v='0'/>
12:18:33:    <paused v='true'/>
12:18:33:  </slot>
12:18:33:</config>
12:18:33:Trying to access database...
12:18:33:Successfully acquired database lock
12:18:33:Enabled folding slot 00: PAUSED cpu:6 (by user)
12:18:33:Enabled folding slot 01: PAUSED gpu:0:G92 [GeForce GTS 250] (by user)

Re: Sending unit results: id:02 state:SEND error:DUMPED

Posted: Thu Nov 23, 2017 4:54 pm
by Joe_H
Looking at the configuration info in the log, it looks okay. The location for the Config and the CWD: are both where they should be. So it looks like the bad GPU slot settings were the likely cause of the problems.

A couple notes about your setup. With the public release 7.4.4 you will want to keep the CPU slot set to 6 threads, or 8 if you want to assign all CPU resources to folding. The default settings for this version of the client may set the CPU slot to 7 threads with the "GPU" slot removed. There currently is no assignments available for requests for a CPU:7 setting.

The public beta client, version 7.4.16 has new code that will negotiate with the Assignment Servers for WU's for the highest number of threads available that are less than or equal to the requested number. It does have some bugs that are covered in the topics related to the public beta.

I strongly suspect that your "GPU" slot has always been folding CPU projects. There just has not been any that would process on a GTS 250 for over 2 years. The client keeps a folder of older logs, 16 by default, in the same directory as the current log. Checking the oldest one there should show just core A4 or A7 being used by the "GPU" slot.

How did this happen? My best guess is that when you installed the client it created a GPU slot based on the version of GPUs.txt included in the download. 7.4.4 is old enough that it would show the GTS 250 as supported in that version. Then as part of the operation of the client, it would download the current version of GPUs.txt and install it. That would change the GPU to unsupported. Apparently that left the created GPU slot in a strange mixed up state that created requests recognized by the AS as being for CPU WU's.
All times are UTC
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited