Some WUs send without points

Moderators: Site Moderators, FAHC Science Team

Post Reply
schmiddi
Posts: 15
Joined: Tue Feb 10, 2015 6:43 am

Re: Some WUs send without points

Post by schmiddi »

Same problem here, I am Missing credit for several WUs of that project,that got handed in to 128.252.203.11 successfully
Top
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Some WUs send without points

Post by Neil-B »

When this type of thing happens the general advice is to have patience .. if the logs show successful uploads with estimated points then in my experience the points always turn up - although it can take weeks or even months in bad cases - when the issue with the stats gets sorted there will normally be a spike where all the outstanding points turn up in a single update - it just depends on how long it takes to get resource on sorting out the problem as stats issues tend to be lower priority than issues that impact the actual progress of science
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
psaam0001
Posts: 378
Joined: Mon May 18, 2020 2:02 am
Location: Ruckersville, Virginia, USA

Re: Some WUs send without points

Post by psaam0001 »

Sometimes, it is just a matter of the System Operator/Administrator giving the equivalent of a gentle, but firm back massage (using operating system commands), to get everything running smoothly.

I know I have to do the same when I update my Ryzen 9 (3950x) systems Fedora kernel modules. Especially when those Fedora updates require me to follow the process for installing updated NVidia drivers.

Paul
Top
mgetz
Posts: 57
Joined: Tue Aug 11, 2020 6:23 pm

Re: Some WUs send without points

Post by mgetz »

It's stranger than that... all the 18202 WU's I've turned in give base credit instead of bonus even when other WUs give bonus. So they may actually be showing up in stats... just without any bonus.
Image
Top
jjmiller
Scientist
Posts: 139
Joined: Fri Apr 09, 2021 4:43 pm

Re: Some WUs send without points

Post by jjmiller »

Hi all,

Apologies about the points issues on 18202. We've been working the assignment server that that project has been housed on particularly hard in recent days trying to get a few new CPU projects out. I've temporarily turned down the assignments on that server to try and give it a chance to catch up. You should be able to turn in WUs, you just won't be receiving new ones from this project in the immediate moment.

Please continue to let us know if there are any issues.
Top
mgetz
Posts: 57
Joined: Tue Aug 11, 2020 6:23 pm

Re: Some WUs send without points

Post by mgetz »

jjmiller wrote: Please continue to let us know if there are any issues.
Other than the stats issue? The only thing I've noticed is that I've seen several WUs get turned in without error and well before time and get base credit only.

Code: Select all

18:35:32:WU00:FS01:0x22:*********************** Log Started 2021-06-21T18:35:31Z ***********************
18:35:32:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
18:35:32:WU00:FS01:0x22:       Core: Core22
18:35:32:WU00:FS01:0x22:       Type: 0x22
18:35:32:WU00:FS01:0x22:    Version: 0.0.13
18:35:32:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:35:32:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
18:35:32:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
18:35:32:WU00:FS01:0x22:       Date: Sep 19 2020
18:35:32:WU00:FS01:0x22:       Time: 01:10:35
18:35:32:WU00:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
18:35:32:WU00:FS01:0x22:     Branch: core22-0.0.13
18:35:32:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
18:35:32:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
18:35:32:WU00:FS01:0x22:             -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
18:35:32:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
18:35:32:WU00:FS01:0x22:       Bits: 64
18:35:32:WU00:FS01:0x22:       Mode: Release
18:35:32:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
18:35:32:WU00:FS01:0x22:             <peastman@stanford.edu>
18:35:32:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 2266 -checkpoint 15
18:35:32:WU00:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
18:35:32:WU00:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
18:35:32:WU00:FS01:0x22:************************************ libFAH ************************************
18:35:32:WU00:FS01:0x22:       Date: Sep 15 2020
18:35:32:WU00:FS01:0x22:       Time: 05:14:43
18:35:32:WU00:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
18:35:32:WU00:FS01:0x22:     Branch: HEAD
18:35:32:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
18:35:32:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
18:35:32:WU00:FS01:0x22:             -funroll-loops
18:35:32:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
18:35:32:WU00:FS01:0x22:       Bits: 64
18:35:32:WU00:FS01:0x22:       Mode: Release
18:35:32:WU00:FS01:0x22:************************************ CBang *************************************
18:35:32:WU00:FS01:0x22:       Date: Sep 15 2020
18:35:32:WU00:FS01:0x22:       Time: 05:11:04
18:35:32:WU00:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
18:35:32:WU00:FS01:0x22:     Branch: HEAD
18:35:32:WU00:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
18:35:32:WU00:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
18:35:32:WU00:FS01:0x22:             -funroll-loops -fPIC
18:35:32:WU00:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
18:35:32:WU00:FS01:0x22:       Bits: 64
18:35:32:WU00:FS01:0x22:       Mode: Release
18:35:32:WU00:FS01:0x22:************************************ System ************************************
18:35:32:WU00:FS01:0x22:        CPU: AMD Ryzen 7 3800X 8-Core Processor
18:35:32:WU00:FS01:0x22:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
18:35:32:WU00:FS01:0x22:       CPUs: 8
18:35:32:WU00:FS01:0x22:     Memory: 15.60GiB
18:35:32:WU00:FS01:0x22:Free Memory: 14.07GiB
18:35:32:WU00:FS01:0x22:    Threads: POSIX_THREADS
18:35:32:WU00:FS01:0x22: OS Version: 5.11
18:35:32:WU00:FS01:0x22:Has Battery: false
18:35:32:WU00:FS01:0x22: On Battery: false
18:35:32:WU00:FS01:0x22: UTC Offset: -6
18:35:32:WU00:FS01:0x22:        PID: 2270
18:35:32:WU00:FS01:0x22:        CWD: /home/<redacted>/snap/folding-at-home-fcole90/common/work
18:35:32:WU00:FS01:0x22:************************************ OpenMM ************************************
18:35:32:WU00:FS01:0x22:   Revision: 189320d0
18:35:32:WU00:FS01:0x22:********************************************************************************
18:35:32:WU00:FS01:0x22:Project: 18202 (Run 13005, Clone 1, Gen 4)
18:35:32:WU00:FS01:0x22:Unit: 0x00000000000000000000000000000000
18:35:32:WU00:FS01:0x22:Digital signatures verified
18:35:32:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
18:35:32:WU00:FS01:0x22:Version 0.0.13
18:35:32:WU00:FS01:0x22:  Checkpoint write interval: 25000 steps (2%) [50 total]
18:35:32:WU00:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
18:35:32:WU00:FS01:0x22:  XTC frame write interval: 20000 steps (1.6%) [62 total]
18:35:32:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled
18:35:32:WU00:FS01:0x22:There are 4 platforms available.
18:35:32:WU00:FS01:0x22:Platform 0: Reference
18:35:32:WU00:FS01:0x22:Platform 1: CPU
18:35:32:WU00:FS01:0x22:Platform 2: OpenCL
18:35:32:WU00:FS01:0x22:  opencl-device 0 specified
18:35:32:WU00:FS01:0x22:Platform 3: CUDA
18:35:32:WU00:FS01:0x22:  cuda-device 0 specified
18:35:39:WU00:FS01:0x22:Attempting to create CUDA context:
18:35:39:WU00:FS01:0x22:  Configuring platform CUDA
18:35:46:WU00:FS01:0x22:  Using CUDA and gpu 0
18:35:46:WU00:FS01:0x22:Completed 1225000 out of 1250000 steps (98%)
18:37:26:WU00:FS01:0x22:Completed 1237500 out of 1250000 steps (99%)
18:39:05:WU00:FS01:0x22:Completed 1250000 out of 1250000 steps (100%)
18:39:07:WU00:FS01:0x22:Checkpoint completed at step 1250000
18:39:11:WU00:FS01:0x22:Saving result file ../logfile_01.txt
18:39:11:WU00:FS01:0x22:Saving result file checkpointIntegrator.xml
18:39:11:WU00:FS01:0x22:Saving result file checkpointState.xml
18:39:14:WU00:FS01:0x22:Saving result file positions.xtc
18:39:14:WU00:FS01:0x22:Saving result file science.log
18:39:14:WU00:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
18:39:15:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:39:15:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:18202 run:13005 clone:1 gen:4 core:0x22 unit:0x00000001000000040000471a000032cd
18:39:15:WU00:FS01:Uploading 27.51MiB to 128.252.203.11
18:39:15:WU00:FS01:Connecting to 128.252.203.11:8080
18:39:21:WU00:FS01:Upload 53.16%
18:39:28:WU00:FS01:Upload complete
18:39:28:WU00:FS01:Server responded WORK_ACK (400)
18:39:28:WU00:FS01:Final credit estimate, 67770.00 points
18:39:28:WU00:FS01:Cleaning up
I did have to restart the computer but that was a quick one... so I have no idea why something that was less than two hours fold time would get base credit.

Edit confirmation on assignment time:

Code: Select all

15:41:34:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:18202 run:13005 clone:1 gen:4 core:0x22 unit:0x00000001000000040000471a000032cd
Edit 2: just saw a core restart... something is unstable with this project

Code: Select all

*********************** Log Started 2021-06-21T18:35:27Z ***********************
18:39:15:WU01:FS01:Starting
18:39:15:WU01:FS01:Running FahCore: /snap/folding-at-home-fcole90/168/usr/bin/FAHCoreWrapper /home/<redacted>/snap/folding-at-home-fcole90/common/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 01 -suffix 01 -version 706 -lifeline 2175 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
18:39:15:WU01:FS01:Started FahCore on PID 4208
18:39:15:WU01:FS01:Core PID:4212
18:39:15:WU01:FS01:FahCore 0x22 started
18:39:15:WU01:FS01:0x22:*********************** Log Started 2021-06-21T18:39:15Z ***********************
18:39:15:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
18:39:15:WU01:FS01:0x22:       Core: Core22
18:39:15:WU01:FS01:0x22:       Type: 0x22
18:39:15:WU01:FS01:0x22:    Version: 0.0.13
18:39:15:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:39:15:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
18:39:15:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
18:39:15:WU01:FS01:0x22:       Date: Sep 19 2020
18:39:15:WU01:FS01:0x22:       Time: 01:10:35
18:39:15:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
18:39:15:WU01:FS01:0x22:     Branch: core22-0.0.13
18:39:15:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
18:39:15:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
18:39:15:WU01:FS01:0x22:             -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
18:39:15:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
18:39:15:WU01:FS01:0x22:       Bits: 64
18:39:15:WU01:FS01:0x22:       Mode: Release
18:39:15:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
18:39:15:WU01:FS01:0x22:             <peastman@stanford.edu>
18:39:15:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 4208 -checkpoint 15
18:39:15:WU01:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
18:39:15:WU01:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
18:39:15:WU01:FS01:0x22:************************************ libFAH ************************************
18:39:15:WU01:FS01:0x22:       Date: Sep 15 2020
18:39:15:WU01:FS01:0x22:       Time: 05:14:43
18:39:15:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
18:39:15:WU01:FS01:0x22:     Branch: HEAD
18:39:15:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
18:39:15:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
18:39:15:WU01:FS01:0x22:             -funroll-loops
18:39:15:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
18:39:15:WU01:FS01:0x22:       Bits: 64
18:39:15:WU01:FS01:0x22:       Mode: Release
18:39:15:WU01:FS01:0x22:************************************ CBang *************************************
18:39:15:WU01:FS01:0x22:       Date: Sep 15 2020
18:39:15:WU01:FS01:0x22:       Time: 05:11:04
18:39:15:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
18:39:15:WU01:FS01:0x22:     Branch: HEAD
18:39:15:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
18:39:15:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
18:39:15:WU01:FS01:0x22:             -funroll-loops -fPIC
18:39:15:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
18:39:15:WU01:FS01:0x22:       Bits: 64
18:39:15:WU01:FS01:0x22:       Mode: Release
18:39:15:WU01:FS01:0x22:************************************ System ************************************
18:39:15:WU01:FS01:0x22:        CPU: AMD Ryzen 7 3800X 8-Core Processor
18:39:15:WU01:FS01:0x22:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
18:39:15:WU01:FS01:0x22:       CPUs: 8
18:39:15:WU01:FS01:0x22:     Memory: 15.60GiB
18:39:15:WU01:FS01:0x22:Free Memory: 13.80GiB
18:39:15:WU01:FS01:0x22:    Threads: POSIX_THREADS
18:39:15:WU01:FS01:0x22: OS Version: 5.11
18:39:15:WU01:FS01:0x22:Has Battery: false
18:39:15:WU01:FS01:0x22: On Battery: false
18:39:15:WU01:FS01:0x22: UTC Offset: -6
18:39:15:WU01:FS01:0x22:        PID: 4212
18:39:15:WU01:FS01:0x22:        CWD: /home/<redacted>/snap/folding-at-home-fcole90/common/work
18:39:15:WU01:FS01:0x22:************************************ OpenMM ************************************
18:39:15:WU01:FS01:0x22:   Revision: 189320d0
18:39:15:WU01:FS01:0x22:********************************************************************************
18:39:15:WU01:FS01:0x22:Project: 18202 (Run 4259, Clone 4, Gen 8)
18:39:15:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
18:39:15:WU01:FS01:0x22:Digital signatures verified
18:39:15:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
18:39:15:WU01:FS01:0x22:Version 0.0.13
18:39:15:WU01:FS01:0x22:  Checkpoint write interval: 25000 steps (2%) [50 total]
18:39:15:WU01:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
18:39:15:WU01:FS01:0x22:  XTC frame write interval: 20000 steps (1.6%) [62 total]
18:39:15:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
18:39:15:WU01:FS01:0x22:There are 4 platforms available.
18:39:15:WU01:FS01:0x22:Platform 0: Reference
18:39:15:WU01:FS01:0x22:Platform 1: CPU
18:39:15:WU01:FS01:0x22:Platform 2: OpenCL
18:39:15:WU01:FS01:0x22:  opencl-device 0 specified
18:39:15:WU01:FS01:0x22:Platform 3: CUDA
18:39:15:WU01:FS01:0x22:  cuda-device 0 specified
18:39:23:WU01:FS01:0x22:Attempting to create CUDA context:
18:39:23:WU01:FS01:0x22:  Configuring platform CUDA
18:39:28:WU01:FS01:0x22:  Using CUDA and gpu 0
18:39:28:WU01:FS01:0x22:Completed 25000 out of 1250000 steps (2%)
18:41:08:WU01:FS01:0x22:Completed 37500 out of 1250000 steps (3%)
18:42:47:WU01:FS01:0x22:Completed 50000 out of 1250000 steps (4%)
18:42:49:WU01:FS01:0x22:Checkpoint completed at step 50000
18:44:28:WU01:FS01:0x22:Completed 62500 out of 1250000 steps (5%)
18:46:07:WU01:FS01:0x22:Completed 75000 out of 1250000 steps (6%)
18:46:08:WU01:FS01:0x22:Checkpoint completed at step 75000
18:47:48:WU01:FS01:0x22:Completed 87500 out of 1250000 steps (7%)
18:49:27:WU01:FS01:0x22:Completed 100000 out of 1250000 steps (8%)
18:49:28:WU01:FS01:0x22:Checkpoint completed at step 100000
18:51:08:WU01:FS01:0x22:Completed 112500 out of 1250000 steps (9%)
18:52:47:WU01:FS01:0x22:Completed 125000 out of 1250000 steps (10%)
18:52:48:WU01:FS01:0x22:Checkpoint completed at step 125000
18:54:27:WU01:FS01:0x22:Completed 137500 out of 1250000 steps (11%)
18:56:07:WU01:FS01:0x22:Completed 150000 out of 1250000 steps (12%)
18:56:08:WU01:FS01:0x22:Checkpoint completed at step 150000
18:57:47:WU01:FS01:0x22:Completed 162500 out of 1250000 steps (13%)
18:59:26:WU01:FS01:0x22:Completed 175000 out of 1250000 steps (14%)
18:59:27:WU01:FS01:0x22:Checkpoint completed at step 175000
19:01:07:WU01:FS01:0x22:Completed 187500 out of 1250000 steps (15%)
19:02:46:WU01:FS01:0x22:Completed 200000 out of 1250000 steps (16%)
19:02:47:WU01:FS01:0x22:Checkpoint completed at step 200000
19:04:26:WU01:FS01:0x22:Completed 212500 out of 1250000 steps (17%)
19:06:05:WU01:FS01:0x22:Completed 225000 out of 1250000 steps (18%)
19:06:07:WU01:FS01:0x22:Checkpoint completed at step 225000
19:07:46:WU01:FS01:0x22:Completed 237500 out of 1250000 steps (19%)
19:09:25:WU01:FS01:0x22:Completed 250000 out of 1250000 steps (20%)
19:09:26:WU01:FS01:0x22:Checkpoint completed at step 250000
19:11:06:WU01:FS01:0x22:Completed 262500 out of 1250000 steps (21%)
19:12:45:WU01:FS01:0x22:Completed 275000 out of 1250000 steps (22%)
19:12:46:WU01:FS01:0x22:Checkpoint completed at step 275000
19:14:25:WU01:FS01:0x22:Completed 287500 out of 1250000 steps (23%)
19:16:05:WU01:FS01:0x22:Completed 300000 out of 1250000 steps (24%)
19:16:06:WU01:FS01:0x22:Checkpoint completed at step 300000
19:17:45:WU01:FS01:0x22:Completed 312500 out of 1250000 steps (25%)
19:19:25:WU01:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
19:19:26:WU01:FS01:0x22:Checkpoint completed at step 325000
19:21:05:WU01:FS01:0x22:Completed 337500 out of 1250000 steps (27%)
19:22:44:WU01:FS01:0x22:Completed 350000 out of 1250000 steps (28%)
19:22:45:WU01:FS01:0x22:Checkpoint completed at step 350000
19:24:25:WU01:FS01:0x22:Completed 362500 out of 1250000 steps (29%)
19:26:04:WU01:FS01:0x22:Completed 375000 out of 1250000 steps (30%)
19:26:05:WU01:FS01:0x22:Checkpoint completed at step 375000
19:27:44:WU01:FS01:0x22:Completed 387500 out of 1250000 steps (31%)
19:29:24:WU01:FS01:0x22:Completed 400000 out of 1250000 steps (32%)
19:29:25:WU01:FS01:0x22:Checkpoint completed at step 400000
19:31:04:WU01:FS01:0x22:Completed 412500 out of 1250000 steps (33%)
19:32:43:WU01:FS01:0x22:Completed 425000 out of 1250000 steps (34%)
19:32:45:WU01:FS01:0x22:Checkpoint completed at step 425000
19:34:24:WU01:FS01:0x22:Completed 437500 out of 1250000 steps (35%)
19:36:03:WU01:FS01:0x22:Completed 450000 out of 1250000 steps (36%)
19:36:04:WU01:FS01:0x22:Checkpoint completed at step 450000
19:37:44:WU01:FS01:0x22:Completed 462500 out of 1250000 steps (37%)
19:39:23:WU01:FS01:0x22:Completed 475000 out of 1250000 steps (38%)
19:39:24:WU01:FS01:0x22:Checkpoint completed at step 475000
19:41:03:WU01:FS01:0x22:Completed 487500 out of 1250000 steps (39%)
19:42:43:WU01:FS01:0x22:Completed 500000 out of 1250000 steps (40%)
19:42:44:WU01:FS01:0x22:Checkpoint completed at step 500000
19:44:23:WU01:FS01:0x22:Completed 512500 out of 1250000 steps (41%)
19:46:02:WU01:FS01:0x22:Completed 525000 out of 1250000 steps (42%)
19:46:04:WU01:FS01:0x22:Checkpoint completed at step 525000
19:47:43:WU01:FS01:0x22:Completed 537500 out of 1250000 steps (43%)
19:49:22:WU01:FS01:0x22:Completed 550000 out of 1250000 steps (44%)
19:49:23:WU01:FS01:0x22:Checkpoint completed at step 550000
19:51:02:WU01:FS01:0x22:Completed 562500 out of 1250000 steps (45%)
19:52:42:WU01:FS01:0x22:Completed 575000 out of 1250000 steps (46%)
19:52:43:WU01:FS01:0x22:An exception occurred at step 575000: Force RMSE error of 5.36168 with threshold of 5
19:52:43:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
19:52:43:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
19:52:43:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
19:52:43:WU01:FS01:Starting
19:52:43:WU01:FS01:Running FahCore: /snap/folding-at-home-fcole90/168/usr/bin/FAHCoreWrapper /home/<redacted>/snap/folding-at-home-fcole90/common/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 01 -suffix 01 -version 706 -lifeline 2175 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
19:52:43:WU01:FS01:Started FahCore on PID 38371
19:52:43:WU01:FS01:Core PID:38375
19:52:43:WU01:FS01:FahCore 0x22 started
19:52:44:WU01:FS01:0x22:*********************** Log Started 2021-06-21T19:52:43Z ***********************
19:52:44:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
19:52:44:WU01:FS01:0x22:       Core: Core22
19:52:44:WU01:FS01:0x22:       Type: 0x22
19:52:44:WU01:FS01:0x22:    Version: 0.0.13
19:52:44:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:52:44:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
19:52:44:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
19:52:44:WU01:FS01:0x22:       Date: Sep 19 2020
19:52:44:WU01:FS01:0x22:       Time: 01:10:35
19:52:44:WU01:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
19:52:44:WU01:FS01:0x22:     Branch: core22-0.0.13
19:52:44:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
19:52:44:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
19:52:44:WU01:FS01:0x22:             -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
19:52:44:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
19:52:44:WU01:FS01:0x22:       Bits: 64
19:52:44:WU01:FS01:0x22:       Mode: Release
19:52:44:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
19:52:44:WU01:FS01:0x22:             <peastman@stanford.edu>
19:52:44:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 38371 -checkpoint 15
19:52:44:WU01:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
19:52:44:WU01:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
19:52:44:WU01:FS01:0x22:************************************ libFAH ************************************
19:52:44:WU01:FS01:0x22:       Date: Sep 15 2020
19:52:44:WU01:FS01:0x22:       Time: 05:14:43
19:52:44:WU01:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
19:52:44:WU01:FS01:0x22:     Branch: HEAD
19:52:44:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
19:52:44:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
19:52:44:WU01:FS01:0x22:             -funroll-loops
19:52:44:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
19:52:44:WU01:FS01:0x22:       Bits: 64
19:52:44:WU01:FS01:0x22:       Mode: Release
19:52:44:WU01:FS01:0x22:************************************ CBang *************************************
19:52:44:WU01:FS01:0x22:       Date: Sep 15 2020
19:52:44:WU01:FS01:0x22:       Time: 05:11:04
19:52:44:WU01:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
19:52:44:WU01:FS01:0x22:     Branch: HEAD
19:52:44:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
19:52:44:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
19:52:44:WU01:FS01:0x22:             -funroll-loops -fPIC
19:52:44:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
19:52:44:WU01:FS01:0x22:       Bits: 64
19:52:44:WU01:FS01:0x22:       Mode: Release
19:52:44:WU01:FS01:0x22:************************************ System ************************************
19:52:44:WU01:FS01:0x22:        CPU: AMD Ryzen 7 3800X 8-Core Processor
19:52:44:WU01:FS01:0x22:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
19:52:44:WU01:FS01:0x22:       CPUs: 8
19:52:44:WU01:FS01:0x22:     Memory: 15.60GiB
19:52:44:WU01:FS01:0x22:Free Memory: 13.62GiB
19:52:44:WU01:FS01:0x22:    Threads: POSIX_THREADS
19:52:44:WU01:FS01:0x22: OS Version: 5.11
19:52:44:WU01:FS01:0x22:Has Battery: false
19:52:44:WU01:FS01:0x22: On Battery: false
19:52:44:WU01:FS01:0x22: UTC Offset: -6
19:52:44:WU01:FS01:0x22:        PID: 38375
19:52:44:WU01:FS01:0x22:        CWD: /home/<redacted>/snap/folding-at-home-fcole90/common/work
19:52:44:WU01:FS01:0x22:************************************ OpenMM ************************************
19:52:44:WU01:FS01:0x22:   Revision: 189320d0
19:52:44:WU01:FS01:0x22:********************************************************************************
19:52:44:WU01:FS01:0x22:Project: 18202 (Run 4259, Clone 4, Gen 8)
19:52:44:WU01:FS01:0x22:Unit: 0x00000000000000000000000000000000
19:52:44:WU01:FS01:0x22:Digital signatures verified
19:52:44:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
19:52:44:WU01:FS01:0x22:Version 0.0.13
19:52:44:WU01:FS01:0x22:  Checkpoint write interval: 25000 steps (2%) [50 total]
19:52:44:WU01:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
19:52:44:WU01:FS01:0x22:  XTC frame write interval: 20000 steps (1.6%) [62 total]
19:52:44:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
19:52:44:WU01:FS01:0x22:There are 4 platforms available.
19:52:44:WU01:FS01:0x22:Platform 0: Reference
19:52:44:WU01:FS01:0x22:Platform 1: CPU
19:52:44:WU01:FS01:0x22:Platform 2: OpenCL
19:52:44:WU01:FS01:0x22:  opencl-device 0 specified
19:52:44:WU01:FS01:0x22:Platform 3: CUDA
19:52:44:WU01:FS01:0x22:  cuda-device 0 specified
19:52:51:WU01:FS01:0x22:Attempting to create CUDA context:
19:52:51:WU01:FS01:0x22:  Configuring platform CUDA
19:52:56:WU01:FS01:0x22:  Using CUDA and gpu 0
19:52:56:WU01:FS01:0x22:Completed 550000 out of 1250000 steps (44%)
19:54:35:WU01:FS01:0x22:Completed 562500 out of 1250000 steps (45%)
Image
Top
DocJonz
Posts: 244
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 4080 Super
Location: United Kingdom
Contact:
Contact DocJonz

Re: Some WUs send without points

Post by DocJonz »

I assume the issue I am seeing is related to the thread heading;
my daily PPD has dropped from a steady 15M down to 10M over the last three days - there has been no change to the machines at my end (all GPU folding) and they have all been ticking along as normal, expect for a big points drop ...
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
Top
gunnarre
Posts: 559
Joined: Sun May 24, 2020 7:23 pm
Location: Norway

Re: Some WUs send without points

Post by gunnarre »

DocJonz wrote:I assume the issue I am seeing is related to the thread heading;
my daily PPD has dropped from a steady 15M down to 10M over the last three days - there has been no change to the machines at my end (all GPU folding) and they have all been ticking along as normal, expect for a big points drop ...
It's quite possibly correlated, but also note that for some GPUs, they get a lot more points on Covid Moonshot WUs than other projects - so you might see both a lack of stats updates, and less Moonshot WUs. I've seen up to 30% more points on Moonshot WUs, but of course this will vary depending on card and WU.
Image
Online: GTX 1660 Super + occasional CPU folding in the cold.
Offline: Radeon HD 7770, GTX 1050 Ti 4G OC, RX580
Top
Post Reply

Return to “Issues with a specific server”