Page 7 of 7

Re: Can't upload to 140.163.4.231 again

Posted: Wed May 06, 2020 8:04 pm
by Frontiers
Having same problem with 140.163.4.241:

Code: Select all

19:01:01:WU01:FS01:0x22:Completed 950000 out of 1000000 steps (95%)
19:02:58:WU01:FS01:0x22:Completed 960000 out of 1000000 steps (96%)
19:04:42:WU01:FS01:0x22:Completed 970000 out of 1000000 steps (97%)
19:06:27:WU01:FS01:0x22:Completed 980000 out of 1000000 steps (98%)
19:06:53:FS01:Finishing
19:08:11:WU01:FS01:0x22:Completed 990000 out of 1000000 steps (99%)
19:09:58:WU01:FS01:0x22:Completed 1000000 out of 1000000 steps (100%)
19:10:06:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
19:10:06:WU01:FS01:0x22:Saving result file checkpointState.xml
19:10:12:WU01:FS01:0x22:Saving result file checkpt.crc
19:10:12:WU01:FS01:0x22:Saving result file positions.xtc
19:10:15:WU01:FS01:0x22:Saving result file science.log
19:10:15:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
19:10:16:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:10:16:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11741 run:0 clone:7326 gen:73 core:0x22 unit:0x000000708ca304f15e6bc57649ad712b
19:10:16:WU01:FS01:Uploading 22.06MiB to 140.163.4.241
19:10:16:WU01:FS01:Connecting to 140.163.4.241:8080
19:10:27:WU01:FS01:Upload 0.57%
19:10:33:WU01:FS01:Upload 10.20%
19:10:39:WU01:FS01:Upload 18.99%
19:10:45:WU01:FS01:Upload 28.90%
19:10:51:WU01:FS01:Upload 40.52%
19:10:57:WU01:FS01:Upload 51.57%
19:11:03:WU01:FS01:Upload 63.19%
19:11:09:WU01:FS01:Upload 74.81%
19:11:15:WU01:FS01:Upload 83.88%
19:11:21:WU01:FS01:Upload 93.23%
19:11:27:WU01:FS01:Upload 100.00%
19:11:28:WU01:FS01:Upload complete
19:11:28:WU01:FS01:Server responded PLEASE_WAIT (464)
19:11:28:WARNING:WU01:FS01:Failed to send results, will try again later
19:11:28:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11741 run:0 clone:7326 gen:73 core:0x22 unit:0x000000708ca304f15e6bc57649ad712b
19:11:28:WU01:FS01:Uploading 22.06MiB to 140.163.4.241
19:11:28:WU01:FS01:Connecting to 140.163.4.241:8080
19:12:48:WU01:FS01:Upload 0.85%
19:12:54:WU01:FS01:Upload 8.78%
19:13:00:WU01:FS01:Upload 16.72%
19:13:06:WU01:FS01:Upload 28.90%
19:13:12:WU01:FS01:Upload 41.09%
19:13:18:WU01:FS01:Upload 53.27%
19:13:24:WU01:FS01:Upload 65.46%
19:13:30:WU01:FS01:Upload 77.64%
19:13:36:WU01:FS01:Upload 89.54%
19:13:41:WU01:FS01:Upload complete
19:13:41:WU01:FS01:Server responded PLEASE_WAIT (464)
19:13:41:WARNING:WU01:FS01:Failed to send results, will try again later
19:13:41:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11741 run:0 clone:7326 gen:73 core:0x22 unit:0x000000708ca304f15e6bc57649ad712b
19:13:41:WU01:FS01:Uploading 22.06MiB to 140.163.4.241
19:13:41:WU01:FS01:Connecting to 140.163.4.241:8080

etc, multiple retries to upload, each ending with "WU01:FS01:Server responded PLEASE_WAIT (464)"

Re: Can't upload to 140.163.4.231 again

Posted: Thu May 07, 2020 9:51 am
by PantherX
I opened the landing page of the Server and it was slow. I am guessing that it is under heavy load so hopefully, your client can try again when the load is a bit less.

Re: Can't upload to 140.163.4.231 again

Posted: Sat Jul 04, 2020 12:33 pm
by Tashgan
Hello,

in the last hours i got three WUs from the Server 140.163.4.231 where the upload has ended up with the "Server did not like results, dumping" message. The upload of WUs to other work servers works normaly for my machine without throwing this error at the end. Maybe there is something wrong with this server. It would be nice if you could check it.

Code: Select all

03:35:19:WU01:FS01:Connecting to assign1.foldingathome.org:80
03:35:19:WU01:FS01:Assigned to work server 140.163.4.231
03:35:19:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU104 [GeForce RTX 2080 SUPER] from 140.163.4.231
03:35:19:WU01:FS01:Connecting to 140.163.4.231:8080
03:35:34:WU01:FS01:Downloading 7.92MiB
03:35:39:WU01:FS01:Download complete
03:35:40:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:11751 run:0 clone:6822 gen:44 core:0x22 unit:0x0000005a8ca304e75e6bbbd719142ff1
03:37:16:WU01:FS01:Starting
03:37:16:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Markus\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 5372 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
03:37:16:WU01:FS01:Started FahCore on PID 5056
03:37:16:WU01:FS01:Core PID:12764
03:37:16:WU01:FS01:FahCore 0x22 started
03:37:17:WU01:FS01:0x22:*********************** Log Started 2020-07-04T03:37:16Z ***********************
03:37:17:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
03:37:17:WU01:FS01:0x22:       Core: Core22
03:37:17:WU01:FS01:0x22:       Type: 0x22
03:37:17:WU01:FS01:0x22:    Version: 0.0.11
03:37:17:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
03:37:17:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
03:37:17:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
03:37:17:WU01:FS01:0x22:       Date: Jun 26 2020
03:37:17:WU01:FS01:0x22:       Time: 19:49:16
03:37:17:WU01:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
03:37:17:WU01:FS01:0x22:     Branch: core22-0.0.11
03:37:17:WU01:FS01:0x22:   Compiler: Visual C++ 2015
03:37:17:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
03:37:17:WU01:FS01:0x22:   Platform: win32 10
03:37:17:WU01:FS01:0x22:       Bits: 64
03:37:17:WU01:FS01:0x22:       Mode: Release
03:37:17:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
03:37:17:WU01:FS01:0x22:             <peastman@stanford.edu>
03:37:17:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 5056 -checkpoint 15
03:37:17:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
03:37:17:WU01:FS01:0x22:             0 -gpu 0
03:37:17:WU01:FS01:0x22:************************************ libFAH ************************************
03:37:17:WU01:FS01:0x22:       Date: Jun 26 2020
03:37:17:WU01:FS01:0x22:       Time: 19:47:12
03:37:17:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
03:37:17:WU01:FS01:0x22:     Branch: HEAD
03:37:17:WU01:FS01:0x22:   Compiler: Visual C++ 2015
03:37:17:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
03:37:17:WU01:FS01:0x22:   Platform: win32 10
03:37:17:WU01:FS01:0x22:       Bits: 64
03:37:17:WU01:FS01:0x22:       Mode: Release
03:37:17:WU01:FS01:0x22:************************************ CBang *************************************
03:37:17:WU01:FS01:0x22:       Date: Jun 26 2020
03:37:17:WU01:FS01:0x22:       Time: 19:46:11
03:37:17:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
03:37:17:WU01:FS01:0x22:     Branch: master
03:37:17:WU01:FS01:0x22:   Compiler: Visual C++ 2015
03:37:17:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
03:37:17:WU01:FS01:0x22:   Platform: win32 10
03:37:17:WU01:FS01:0x22:       Bits: 64
03:37:17:WU01:FS01:0x22:       Mode: Release
03:37:17:WU01:FS01:0x22:************************************ System ************************************
03:37:17:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
03:37:17:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
03:37:17:WU01:FS01:0x22:       CPUs: 8
03:37:17:WU01:FS01:0x22:     Memory: 31.94GiB
03:37:17:WU01:FS01:0x22:Free Memory: 25.25GiB
03:37:17:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
03:37:17:WU01:FS01:0x22: OS Version: 6.2
03:37:17:WU01:FS01:0x22:Has Battery: false
03:37:17:WU01:FS01:0x22: On Battery: false
03:37:17:WU01:FS01:0x22: UTC Offset: 2
03:37:17:WU01:FS01:0x22:        PID: 12764
03:37:17:WU01:FS01:0x22:        CWD: C:\Users\Markus\AppData\Roaming\FAHClient\work
03:37:17:WU01:FS01:0x22:********************************************************************************
03:37:17:WU01:FS01:0x22:Project: 11751 (Run 0, Clone 6822, Gen 44)
03:37:17:WU01:FS01:0x22:Unit: 0x0000005a8ca304e75e6bbbd719142ff1
03:37:17:WU01:FS01:0x22:Reading tar file core.xml
03:37:17:WU01:FS01:0x22:Reading tar file integrator.xml
03:37:17:WU01:FS01:0x22:Reading tar file state.xml
03:37:17:WU01:FS01:0x22:Reading tar file system.xml
03:37:18:WU01:FS01:0x22:Digital signatures verified
03:37:18:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
03:37:18:WU01:FS01:0x22:Version 0.0.11
03:37:18:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
03:37:18:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
03:37:18:WU01:FS01:0x22:  XTC frame write interval: 50000 steps (5%) [20 total]
03:37:18:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
03:37:25:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
03:38:03:WU01:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
...
04:40:05:WU01:FS01:0x22:Completed 990000 out of 1000000 steps (99%)
04:40:43:WU01:FS01:0x22:Completed 1000000 out of 1000000 steps (100%)
04:40:43:WU01:FS01:0x22:Average performance: 90.9474 ns/day
04:40:45:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
04:40:45:WU01:FS01:0x22:Saving result file checkpointState.xml
04:40:47:WU01:FS01:0x22:Saving result file positions.xtc
04:40:48:WU01:FS01:0x22:Saving result file science.log
04:40:48:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
04:40:48:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:40:48:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11751 run:0 clone:6822 gen:44 core:0x22 unit:0x0000005a8ca304e75e6bbbd719142ff1
04:40:48:WU01:FS01:Uploading 14.66MiB to 140.163.4.231
04:40:48:WU01:FS01:Connecting to 140.163.4.231:8080
04:40:54:WU01:FS01:Upload 21.32%
04:41:00:WU01:FS01:Upload 47.34%
04:41:06:WU01:FS01:Upload 68.24%
04:41:12:WU01:FS01:Upload 93.40%
04:41:13:WU01:FS01:Upload complete
04:41:13:WU01:FS01:Server responded WORK_QUIT (404)
04:41:13:WARNING:WU01:FS01:Server did not like results, dumping
04:41:13:WU01:FS01:Cleaning up

Code: Select all

08:36:06:WU00:FS01:Connecting to assign1.foldingathome.org:80
08:36:06:WU00:FS01:Assigned to work server 140.163.4.231
08:36:06:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU104 [GeForce RTX 2080 SUPER] from 140.163.4.231
08:36:06:WU00:FS01:Connecting to 140.163.4.231:8080
08:36:15:WU00:FS01:Downloading 4.53MiB
08:36:21:WU00:FS01:Download 80.05%
08:36:21:WU00:FS01:Download complete
08:36:21:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11748 run:0 clone:4194 gen:39 core:0x22 unit:0x000000558ca304e75e6a7ff6cb95098a
08:38:04:WU00:FS01:Starting
08:38:04:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Markus\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 5372 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
08:38:04:WU00:FS01:Started FahCore on PID 17012
08:38:04:WU00:FS01:Core PID:3996
08:38:04:WU00:FS01:FahCore 0x22 started
08:38:04:WU00:FS01:0x22:*********************** Log Started 2020-07-04T08:38:04Z ***********************
08:38:04:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
08:38:04:WU00:FS01:0x22:       Core: Core22
08:38:04:WU00:FS01:0x22:       Type: 0x22
08:38:04:WU00:FS01:0x22:    Version: 0.0.11
08:38:04:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
08:38:04:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
08:38:04:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
08:38:04:WU00:FS01:0x22:       Date: Jun 26 2020
08:38:04:WU00:FS01:0x22:       Time: 19:49:16
08:38:04:WU00:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
08:38:04:WU00:FS01:0x22:     Branch: core22-0.0.11
08:38:04:WU00:FS01:0x22:   Compiler: Visual C++ 2015
08:38:04:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
08:38:04:WU00:FS01:0x22:   Platform: win32 10
08:38:04:WU00:FS01:0x22:       Bits: 64
08:38:04:WU00:FS01:0x22:       Mode: Release
08:38:04:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
08:38:04:WU00:FS01:0x22:             <peastman@stanford.edu>
08:38:05:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 17012 -checkpoint 15
08:38:05:WU00:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
08:38:05:WU00:FS01:0x22:             0 -gpu 0
08:38:05:WU00:FS01:0x22:************************************ libFAH ************************************
08:38:05:WU00:FS01:0x22:       Date: Jun 26 2020
08:38:05:WU00:FS01:0x22:       Time: 19:47:12
08:38:05:WU00:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
08:38:05:WU00:FS01:0x22:     Branch: HEAD
08:38:05:WU00:FS01:0x22:   Compiler: Visual C++ 2015
08:38:05:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
08:38:05:WU00:FS01:0x22:   Platform: win32 10
08:38:05:WU00:FS01:0x22:       Bits: 64
08:38:05:WU00:FS01:0x22:       Mode: Release
08:38:05:WU00:FS01:0x22:************************************ CBang *************************************
08:38:05:WU00:FS01:0x22:       Date: Jun 26 2020
08:38:05:WU00:FS01:0x22:       Time: 19:46:11
08:38:05:WU00:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
08:38:05:WU00:FS01:0x22:     Branch: master
08:38:05:WU00:FS01:0x22:   Compiler: Visual C++ 2015
08:38:05:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
08:38:05:WU00:FS01:0x22:   Platform: win32 10
08:38:05:WU00:FS01:0x22:       Bits: 64
08:38:05:WU00:FS01:0x22:       Mode: Release
08:38:05:WU00:FS01:0x22:************************************ System ************************************
08:38:05:WU00:FS01:0x22:        CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
08:38:05:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
08:38:05:WU00:FS01:0x22:       CPUs: 8
08:38:05:WU00:FS01:0x22:     Memory: 31.94GiB
08:38:05:WU00:FS01:0x22:Free Memory: 25.15GiB
08:38:05:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
08:38:05:WU00:FS01:0x22: OS Version: 6.2
08:38:05:WU00:FS01:0x22:Has Battery: false
08:38:05:WU00:FS01:0x22: On Battery: false
08:38:05:WU00:FS01:0x22: UTC Offset: 2
08:38:05:WU00:FS01:0x22:        PID: 3996
08:38:05:WU00:FS01:0x22:        CWD: C:\Users\Markus\AppData\Roaming\FAHClient\work
08:38:05:WU00:FS01:0x22:********************************************************************************
08:38:05:WU00:FS01:0x22:Project: 11748 (Run 0, Clone 4194, Gen 39)
08:38:05:WU00:FS01:0x22:Unit: 0x000000558ca304e75e6a7ff6cb95098a
08:38:05:WU00:FS01:0x22:Reading tar file core.xml
08:38:05:WU00:FS01:0x22:Reading tar file integrator.xml
08:38:05:WU00:FS01:0x22:Reading tar file state.xml
08:38:05:WU00:FS01:0x22:Reading tar file system.xml
08:38:05:WU00:FS01:0x22:Digital signatures verified
08:38:05:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
08:38:05:WU00:FS01:0x22:Version 0.0.11
08:38:05:WU00:FS01:0x22:  Checkpoint write interval: 100000 steps (5%) [20 total]
08:38:05:WU00:FS01:0x22:  JSON viewer frame write interval: 20000 steps (1%) [100 total]
08:38:05:WU00:FS01:0x22:  XTC frame write interval: 50000 steps (2.5%) [40 total]
08:38:05:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled
08:38:09:WU00:FS01:0x22:Completed 0 out of 2000000 steps (0%)
08:38:53:WU00:FS01:0x22:Completed 20000 out of 2000000 steps (1%)
...
09:50:49:WU00:FS01:0x22:Completed 1980000 out of 2000000 steps (99%)
09:51:32:WU00:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
09:51:32:WU00:FS01:0x22:Average performance: 79.2661 ns/day
09:51:34:WU00:FS01:0x22:Saving result file ..\logfile_01.txt
09:51:34:WU00:FS01:0x22:Saving result file checkpointState.xml
09:51:35:WU00:FS01:0x22:Saving result file positions.xtc
09:51:36:WU00:FS01:0x22:Saving result file science.log
09:51:36:WU00:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
09:51:36:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:51:36:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:11748 run:0 clone:4194 gen:39 core:0x22 unit:0x000000558ca304e75e6a7ff6cb95098a
09:51:36:WU00:FS01:Uploading 12.57MiB to 140.163.4.231
09:51:36:WU00:FS01:Connecting to 140.163.4.231:8080
09:51:42:WU00:FS01:Upload 25.35%
09:51:48:WU00:FS01:Upload 54.68%
09:51:54:WU00:FS01:Upload 84.50%
09:51:57:WU00:FS01:Upload complete
09:51:57:WU00:FS01:Server responded WORK_QUIT (404)
09:51:57:WARNING:WU00:FS01:Server did not like results, dumping
09:51:57:WU00:FS01:Cleaning up

Code: Select all

09:50:50:WU01:FS01:Connecting to assign1.foldingathome.org:80
09:50:50:WU01:FS01:Assigned to work server 140.163.4.231
09:50:50:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU104 [GeForce RTX 2080 SUPER] from 140.163.4.231
09:50:50:WU01:FS01:Connecting to 140.163.4.231:8080
09:51:17:WU01:FS01:Downloading 13.15MiB
09:51:24:WU01:FS01:Download 61.31%
09:51:30:WU01:FS01:Download 98.38%
09:51:30:WU01:FS01:Download complete
09:51:30:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:11752 run:0 clone:534 gen:37 core:0x22 unit:0x000000518ca304e75e6a805bf7ffb6b2
09:51:36:WU01:FS01:Starting
09:51:36:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Markus\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 5372 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
09:51:36:WU01:FS01:Started FahCore on PID 15316
09:51:36:WU01:FS01:Core PID:3540
09:51:36:WU01:FS01:FahCore 0x22 started
09:51:37:WU01:FS01:0x22:*********************** Log Started 2020-07-04T09:51:36Z ***********************
09:51:37:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
09:51:37:WU01:FS01:0x22:       Core: Core22
09:51:37:WU01:FS01:0x22:       Type: 0x22
09:51:37:WU01:FS01:0x22:    Version: 0.0.11
09:51:37:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
09:51:37:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
09:51:37:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
09:51:37:WU01:FS01:0x22:       Date: Jun 26 2020
09:51:37:WU01:FS01:0x22:       Time: 19:49:16
09:51:37:WU01:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
09:51:37:WU01:FS01:0x22:     Branch: core22-0.0.11
09:51:37:WU01:FS01:0x22:   Compiler: Visual C++ 2015
09:51:37:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
09:51:37:WU01:FS01:0x22:   Platform: win32 10
09:51:37:WU01:FS01:0x22:       Bits: 64
09:51:37:WU01:FS01:0x22:       Mode: Release
09:51:37:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
09:51:37:WU01:FS01:0x22:             <peastman@stanford.edu>
09:51:37:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 15316 -checkpoint 15
09:51:37:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
09:51:37:WU01:FS01:0x22:             0 -gpu 0
09:51:37:WU01:FS01:0x22:************************************ libFAH ************************************
09:51:37:WU01:FS01:0x22:       Date: Jun 26 2020
09:51:37:WU01:FS01:0x22:       Time: 19:47:12
09:51:37:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
09:51:37:WU01:FS01:0x22:     Branch: HEAD
09:51:37:WU01:FS01:0x22:   Compiler: Visual C++ 2015
09:51:37:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
09:51:37:WU01:FS01:0x22:   Platform: win32 10
09:51:37:WU01:FS01:0x22:       Bits: 64
09:51:37:WU01:FS01:0x22:       Mode: Release
09:51:37:WU01:FS01:0x22:************************************ CBang *************************************
09:51:37:WU01:FS01:0x22:       Date: Jun 26 2020
09:51:37:WU01:FS01:0x22:       Time: 19:46:11
09:51:37:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
09:51:37:WU01:FS01:0x22:     Branch: master
09:51:37:WU01:FS01:0x22:   Compiler: Visual C++ 2015
09:51:37:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
09:51:37:WU01:FS01:0x22:   Platform: win32 10
09:51:37:WU01:FS01:0x22:       Bits: 64
09:51:37:WU01:FS01:0x22:       Mode: Release
09:51:37:WU01:FS01:0x22:************************************ System ************************************
09:51:37:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
09:51:37:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
09:51:37:WU01:FS01:0x22:       CPUs: 8
09:51:37:WU01:FS01:0x22:     Memory: 31.94GiB
09:51:37:WU01:FS01:0x22:Free Memory: 24.52GiB
09:51:37:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
09:51:37:WU01:FS01:0x22: OS Version: 6.2
09:51:37:WU01:FS01:0x22:Has Battery: false
09:51:37:WU01:FS01:0x22: On Battery: false
09:51:37:WU01:FS01:0x22: UTC Offset: 2
09:51:37:WU01:FS01:0x22:        PID: 3540
09:51:37:WU01:FS01:0x22:        CWD: C:\Users\Markus\AppData\Roaming\FAHClient\work
09:51:37:WU01:FS01:0x22:********************************************************************************
09:51:37:WU01:FS01:0x22:Project: 11752 (Run 0, Clone 534, Gen 37)
09:51:37:WU01:FS01:0x22:Unit: 0x000000518ca304e75e6a805bf7ffb6b2
09:51:37:WU01:FS01:0x22:Reading tar file core.xml
09:51:37:WU01:FS01:0x22:Reading tar file integrator.xml
09:51:37:WU01:FS01:0x22:Reading tar file state.xml
09:51:38:WU01:FS01:0x22:Reading tar file system.xml
09:51:39:WU01:FS01:0x22:Digital signatures verified
09:51:39:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
09:51:39:WU01:FS01:0x22:Version 0.0.11
09:51:39:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
09:51:39:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
09:51:39:WU01:FS01:0x22:  XTC frame write interval: 50000 steps (5%) [20 total]
09:51:39:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
09:51:50:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
09:52:55:WU01:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
...
11:38:21:WU01:FS01:0x22:Completed 990000 out of 1000000 steps (99%)
11:39:25:WU01:FS01:0x22:Completed 1000000 out of 1000000 steps (100%)
11:39:25:WU01:FS01:0x22:Average performance: 53.0061 ns/day
11:39:30:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
11:39:30:WU01:FS01:0x22:Saving result file checkpointState.xml
11:39:33:WU01:FS01:0x22:Saving result file positions.xtc
11:39:34:WU01:FS01:0x22:Saving result file science.log
11:39:34:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
11:39:35:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
11:39:35:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11752 run:0 clone:534 gen:37 core:0x22 unit:0x000000518ca304e75e6a805bf7ffb6b2
11:39:35:WU01:FS01:Uploading 24.33MiB to 140.163.4.231
11:39:35:WU01:FS01:Connecting to 140.163.4.231:8080
11:39:41:WU01:FS01:Upload 14.90%
11:39:47:WU01:FS01:Upload 30.31%
11:39:53:WU01:FS01:Upload 45.72%
11:39:59:WU01:FS01:Upload 60.87%
11:40:05:WU01:FS01:Upload 76.02%
11:40:11:WU01:FS01:Upload 91.18%
11:40:14:WU01:FS01:Upload complete
11:40:14:WU01:FS01:Server responded WORK_QUIT (404)
11:40:14:WARNING:WU01:FS01:Server did not like results, dumping
11:40:14:WU01:FS01:Cleaning up

Re: Can't upload to 140.163.4.231 again

Posted: Sat Jul 04, 2020 7:38 pm
by Knish
same, checked recent 14 hrs from a few cloud instances and there was 1 WU from this server and it behaved by dumping
(edit: make that 2)

Code: Select all

11:48:09:WU00:FS01:Assigned to work server 140.163.4.231
11:48:09:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU104GL [Tesla T4] 8141 from 140.163.4.231
11:48:09:WU00:FS01:Connecting to 140.163.4.231:8080
11:48:22:WU00:FS01:Downloading 4.52MiB
11:48:23:WU00:FS01:Download complete
11:48:23:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11749 run:0 clone:3683 gen:54 core:0x22 unit:0x000000698ca304e75e6a8010a2abbe61

11:52:03:WU00:FS01:Starting
11:52:03:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 706 -lifeline 445 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
11:52:03:WU00:FS01:Started FahCore on PID 3465
11:52:03:WU00:FS01:Core PID:3469
11:52:03:WU00:FS01:FahCore 0x22 started
11:52:04:WU00:FS01:0x22:*********************** Log Started 2020-07-04T11:52:03Z ***********************
11:52:04:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
11:52:04:WU00:FS01:0x22:       Core: Core22
11:52:04:WU00:FS01:0x22:       Type: 0x22
11:52:04:WU00:FS01:0x22:    Version: 0.0.11
11:52:04:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
11:52:04:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
11:52:04:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
11:52:04:WU00:FS01:0x22:       Date: Jun 27 2020
11:52:04:WU00:FS01:0x22:       Time: 22:50:00
11:52:04:WU00:FS01:0x22:   Revision: cfc2940c5dd1aa80f60daa6e28d4a2a417f74edb
11:52:04:WU00:FS01:0x22:     Branch: core22-0.0.11
11:52:04:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
11:52:04:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
11:52:04:WU00:FS01:0x22:             -funroll-loops
11:52:04:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
11:52:04:WU00:FS01:0x22:       Bits: 64
11:52:04:WU00:FS01:0x22:       Mode: Release
11:52:04:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
11:52:04:WU00:FS01:0x22:             <peastman@stanford.edu>
11:52:04:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 3465 -checkpoint 15
11:52:04:WU00:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
11:52:04:WU00:FS01:0x22:             0 -gpu 0
11:52:04:WU00:FS01:0x22:************************************ libFAH ************************************
11:52:04:WU00:FS01:0x22:       Date: Jun 27 2020
11:52:04:WU00:FS01:0x22:       Time: 22:11:04
11:52:04:WU00:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
11:52:04:WU00:FS01:0x22:     Branch: HEAD
11:52:04:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
11:52:04:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
11:52:04:WU00:FS01:0x22:             -funroll-loops
11:52:04:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
11:52:04:WU00:FS01:0x22:       Bits: 64
11:52:04:WU00:FS01:0x22:       Mode: Release
11:52:04:WU00:FS01:0x22:************************************ CBang *************************************
11:52:04:WU00:FS01:0x22:       Date: Jun 27 2020
11:52:04:WU00:FS01:0x22:       Time: 22:10:11
11:52:04:WU00:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
11:52:04:WU00:FS01:0x22:     Branch: HEAD
11:52:04:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
11:52:04:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
11:52:04:WU00:FS01:0x22:             -funroll-loops -fPIC
11:52:04:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
11:52:04:WU00:FS01:0x22:       Bits: 64
11:52:04:WU00:FS01:0x22:       Mode: Release
11:52:04:WU00:FS01:0x22:************************************ System ************************************
11:52:04:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU @ 2.30GHz
11:52:04:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 0
11:52:04:WU00:FS01:0x22:       CPUs: 1
11:52:04:WU00:FS01:0x22:     Memory: 2.44GiB
11:52:04:WU00:FS01:0x22:Free Memory: 1.60GiB
11:52:04:WU00:FS01:0x22:    Threads: POSIX_THREADS
11:52:04:WU00:FS01:0x22: OS Version: 4.19
11:52:04:WU00:FS01:0x22:Has Battery: false
11:52:04:WU00:FS01:0x22: On Battery: false
11:52:04:WU00:FS01:0x22: UTC Offset: 0
11:52:04:WU00:FS01:0x22:        PID: 3469
11:52:04:WU00:FS01:0x22:        CWD: /var/lib/fahclient/work
11:52:04:WU00:FS01:0x22:********************************************************************************
11:52:04:WU00:FS01:0x22:Project: 11749 (Run 0, Clone 3683, Gen 54)
11:52:04:WU00:FS01:0x22:Unit: 0x000000698ca304e75e6a8010a2abbe61
11:52:04:WU00:FS01:0x22:Reading tar file core.xml
11:52:04:WU00:FS01:0x22:Reading tar file integrator.xml
11:52:04:WU00:FS01:0x22:Reading tar file state.xml
11:52:04:WU00:FS01:0x22:Reading tar file system.xml
11:52:04:WU00:FS01:0x22:Digital signatures verified
11:52:04:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
11:52:04:WU00:FS01:0x22:Version 0.0.11
11:52:05:WU00:FS01:0x22:  Checkpoint write interval: 100000 steps (5%) [20 total]
11:52:05:WU00:FS01:0x22:  JSON viewer frame write interval: 20000 steps (1%) [100 total]
11:52:05:WU00:FS01:0x22:  XTC frame write interval: 50000 steps (2.5%) [40 total]
11:52:05:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled

11:52:13:WU00:FS01:0x22:Completed 0 out of 2000000 steps (0%)

11:53:32:WU00:FS01:0x22:Completed 20000 out of 2000000 steps (1%)
11:54:50:WU00:FS01:0x22:Completed 40000 out of 2000000 steps (2%)

******************************* Date: 2020-07-04 *******************************
12:27:23:WU00:FS01:0x22:Completed 540000 out of 2000000 steps (27%)
12:28:41:WU00:FS01:0x22:Completed 560000 out of 2000000 steps (28%)

14:01:08:WU00:FS01:0x22:Completed 1980000 out of 2000000 steps (99%)

14:02:26:WU00:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
14:02:26:WU00:FS01:0x22:Average performance: 44.3077 ns/day
14:02:28:WU00:FS01:0x22:Saving result file ../logfile_01.txt
14:02:28:WU00:FS01:0x22:Saving result file checkpointState.xml
14:02:30:WU00:FS01:0x22:Saving result file positions.xtc
14:02:31:WU00:FS01:0x22:Saving result file science.log
14:02:31:WU00:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
14:02:31:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:02:31:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:11749 run:0 clone:3683 gen:54 core:0x22 unit:0x000000698ca304e75e6a8010a2abbe61
14:02:31:WU00:FS01:Uploading 12.57MiB to 140.163.4.231
14:02:31:WU00:FS01:Connecting to 140.163.4.231:8080


14:02:37:WU00:FS01:Upload 76.60%
14:02:38:WU00:FS01:Upload complete
14:02:38:WU00:FS01:Server responded WORK_QUIT (404)
14:02:38:WARNING:WU00:FS01:Server did not like results, dumping

this "machine" also got a WU from *.241 but that uploaded and got credited fine

here's the 2nd from another cloud instance

Code: Select all

12:06:27:WU00:FS01:Connecting to assign1.foldingathome.org:80
12:06:27:WU00:FS01:Assigned to work server 140.163.4.231
12:06:27:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU104GL [Tesla T4] 8141 from 140.163.4.231
12:06:27:WU00:FS01:Connecting to 140.163.4.231:8080
12:06:48:WU00:FS01:Downloading 13.29MiB
12:06:54:WU00:FS01:Download 96.86%
12:06:54:WU00:FS01:Download complete
12:06:54:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11752 run:0 clone:1908 gen:38 core:0x22 unit:0x000000598ca304e75e6a806420fa5a95

12:07:40:WU00:FS01:Starting
12:07:40:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 706 -lifeline 446 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
12:07:40:WU00:FS01:Started FahCore on PID 2455
12:07:40:WU00:FS01:Core PID:2459
12:07:40:WU00:FS01:FahCore 0x22 started
12:07:40:WU00:FS01:0x22:*********************** Log Started 2020-07-04T12:07:40Z ***********************
12:07:40:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
12:07:40:WU00:FS01:0x22:       Core: Core22
12:07:40:WU00:FS01:0x22:       Type: 0x22
12:07:40:WU00:FS01:0x22:    Version: 0.0.11
12:07:40:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:07:40:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
12:07:40:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
12:07:40:WU00:FS01:0x22:       Date: Jun 27 2020
12:07:40:WU00:FS01:0x22:       Time: 22:50:00
12:07:40:WU00:FS01:0x22:   Revision: cfc2940c5dd1aa80f60daa6e28d4a2a417f74edb
12:07:40:WU00:FS01:0x22:     Branch: core22-0.0.11
12:07:40:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
12:07:40:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
12:07:40:WU00:FS01:0x22:             -funroll-loops
12:07:40:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
12:07:40:WU00:FS01:0x22:       Bits: 64
12:07:40:WU00:FS01:0x22:       Mode: Release
12:07:40:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
12:07:40:WU00:FS01:0x22:             <peastman@stanford.edu>
12:07:40:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 2455 -checkpoint 15
12:07:40:WU00:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
12:07:40:WU00:FS01:0x22:             0 -gpu 0
12:07:40:WU00:FS01:0x22:************************************ libFAH ************************************
12:07:40:WU00:FS01:0x22:       Date: Jun 27 2020
12:07:40:WU00:FS01:0x22:       Time: 22:11:04
12:07:40:WU00:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
12:07:40:WU00:FS01:0x22:     Branch: HEAD
12:07:40:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
12:07:40:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
12:07:40:WU00:FS01:0x22:             -funroll-loops
12:07:40:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
12:07:40:WU00:FS01:0x22:       Bits: 64
12:07:40:WU00:FS01:0x22:       Mode: Release
12:07:40:WU00:FS01:0x22:************************************ CBang *************************************
12:07:40:WU00:FS01:0x22:       Date: Jun 27 2020
12:07:40:WU00:FS01:0x22:       Time: 22:10:11
12:07:40:WU00:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
12:07:40:WU00:FS01:0x22:     Branch: HEAD
12:07:40:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
12:07:40:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
12:07:40:WU00:FS01:0x22:             -funroll-loops -fPIC
12:07:40:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
12:07:40:WU00:FS01:0x22:       Bits: 64
12:07:40:WU00:FS01:0x22:       Mode: Release
12:07:40:WU00:FS01:0x22:************************************ System ************************************
12:07:40:WU00:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU @ 2.20GHz
12:07:40:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 79 Stepping 0
12:07:40:WU00:FS01:0x22:       CPUs: 1
12:07:40:WU00:FS01:0x22:     Memory: 2.44GiB
12:07:40:WU00:FS01:0x22:Free Memory: 1.61GiB
12:07:40:WU00:FS01:0x22:    Threads: POSIX_THREADS
12:07:40:WU00:FS01:0x22: OS Version: 4.19
12:07:40:WU00:FS01:0x22:Has Battery: false
12:07:40:WU00:FS01:0x22: On Battery: false
12:07:40:WU00:FS01:0x22: UTC Offset: 0
12:07:40:WU00:FS01:0x22:        PID: 2459
12:07:40:WU00:FS01:0x22:        CWD: /var/lib/fahclient/work
12:07:40:WU00:FS01:0x22:********************************************************************************
12:07:40:WU00:FS01:0x22:Project: 11752 (Run 0, Clone 1908, Gen 38)
12:07:40:WU00:FS01:0x22:Unit: 0x000000598ca304e75e6a806420fa5a95
12:07:40:WU00:FS01:0x22:Reading tar file core.xml
12:07:40:WU00:FS01:0x22:Reading tar file integrator.xml
12:07:40:WU00:FS01:0x22:Reading tar file state.xml
12:07:42:WU00:FS01:0x22:Reading tar file system.xml
12:07:42:WU00:FS01:0x22:Digital signatures verified
12:07:42:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
12:07:42:WU00:FS01:0x22:Version 0.0.11
12:07:42:WU00:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
12:07:42:WU00:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
12:07:42:WU00:FS01:0x22:  XTC frame write interval: 50000 steps (5%) [20 total]
12:07:42:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled

12:07:56:WU00:FS01:0x22:Completed 0 out of 1000000 steps (0%)
12:10:05:WU00:FS01:0x22:Completed 10000 out of 1000000 steps (1%)

15:34:18:WU00:FS01:0x22:Completed 970000 out of 1000000 steps (97%)
15:36:25:WU00:FS01:0x22:Completed 980000 out of 1000000 steps (98%)
15:38:33:WU00:FS01:0x22:Completed 990000 out of 1000000 steps (99%)

15:40:40:WU00:FS01:0x22:Completed 1000000 out of 1000000 steps (100%)
15:40:40:WU00:FS01:0x22:Average performance: 27.1272 ns/day
15:40:45:WU00:FS01:0x22:Saving result file ../logfile_01.txt
15:40:45:WU00:FS01:0x22:Saving result file checkpointState.xml
15:40:50:WU00:FS01:0x22:Saving result file positions.xtc
15:40:52:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
15:40:52:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:11752 run:0 clone:1908 gen:38 core:0x22 unit:0x000000598ca304e75e6a806420fa5a95
15:40:52:WU00:FS01:Uploading 24.34MiB to 140.163.4.231
15:40:52:WU00:FS01:Connecting to 140.163.4.231:8080

15:40:58:WU00:FS01:Upload 19.52%
15:41:04:WU00:FS01:Upload 42.37%
15:41:08:WU01:FS01:0x22:Completed 0 out of 2000000 steps (0%)
15:41:10:WU00:FS01:Upload 65.23%
15:41:16:WU00:FS01:Upload 88.34%
15:41:19:WU00:FS01:Upload complete
15:41:19:WU00:FS01:Server responded WORK_QUIT (404)
15:41:19:WARNING:WU00:FS01:Server did not like results, dumping

Re: Can't upload to 140.163.4.231 again

Posted: Sat Jul 04, 2020 8:29 pm
by Joe_H
I sent a notification to the person managing this server and projects earlier today.

Re: Can't upload to 140.163.4.231 again

Posted: Sat Jul 04, 2020 11:22 pm
by bruce
Confirmed that 140.163.4.231 is not responding to pings or http requests. Notified a second person who may be able to deal with it. (It's a holiday in USA.)

Re: Can't upload to 140.163.4.231 again

Posted: Sun Jul 05, 2020 2:05 am
by JohnChodera
We think we've tracked these issues down to an XFS filesystem issue, and I think we may have fixed it. Fingers crossed!

~ John Chodera // MSKCC

Re: Can't upload to 140.163.4.231 again

Posted: Sun Jul 05, 2020 8:16 am
by DRQ
A few people have had WUs dumped by this server and reported them in a different topic "WORK_QUIT for WU 11752 (Run 0, Clone 9163, Gen 14)"
I know some people posting on this topic already know this but I'm adding the link so that anyone can see the other problems if they wish.

Re: Can't upload to 140.163.4.231 again

Posted: Sun Jul 05, 2020 3:17 pm
by DRQ
JohnChodera wrote:Fingers crossed!
My machine has just uploaded to 140.163.4.231 successfully.

Code: Select all

14:53:02:WU01:FS00:0x22:Folding@home Core Shutdown: FINISHED_UNIT
14:53:03:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:53:03:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11748 run:0 clone:3228 gen:35 core:0x22 unit:0x000000458ca304e75e6a7ff081e87763
14:53:03:WU01:FS00:Uploading 12.58MiB to 140.163.4.231
14:53:03:WU01:FS00:Connecting to 140.163.4.231:8080
14:53:09:WU01:FS00:Upload 26.34%
14:53:15:WU01:FS00:Upload 46.21%
14:53:21:WU01:FS00:Upload 69.57%
14:53:27:WU01:FS00:Upload 90.44%
14:53:31:WU01:FS00:Upload complete
14:53:31:WU01:FS00:Server responded WORK_ACK (400)

Re: Can't upload to 140.163.4.231 again

Posted: Sun Jul 05, 2020 9:10 pm
by JohnChodera
plfah1-1.mskcc.org again ran into trouble, so we're trying a few more things...

~ John Chodera // MSKCC

Re: Can't upload to 140.163.4.231 again

Posted: Mon Jul 06, 2020 6:59 pm
by bruce
Modifying the code in the client and in the server to recognize when a connection has stalled and forcing the connection to close would be a good start. Restarting the server code serves the same purpose but it also aborts active connections.

The bug has been reported some seven years now: Feb 20, 2013
https://github.com/FoldingAtHome/fah-issues/issues/983

Re: Can't upload to 140.163.4.231 again

Posted: Tue Jul 07, 2020 6:45 pm
by JohnChodera
We think we have identified the issue as fragmentation with plfah1-1.mskcc.org's XFS filesystem. We're now running xfs_fsr to attempt to reduce fragmentation and keep the server running.

Hopefully this will fix it!

~ John Chodera // MSKCC

Re: Can't upload to 140.163.4.231 again

Posted: Wed Jul 15, 2020 3:18 pm
by Knish
things have been going great!
...but this morning I'm noticing when assign2.foldingathome.org assigns me to *.231 it takes upwards of 3 minutes before either a) i download a 7MB WU in 1 second, or b) Exception and server did not assign WU

or is this just me?