Waiting for work on 192.0.2.1 ?

Moderators: Site Moderators, FAHC Science Team

Post Reply
DocJonz
Posts: 244
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 4080 Super
Location: United Kingdom
Contact:
Contact DocJonz

Waiting for work on 192.0.2.1 ?

Post by DocJonz »

Having an odd problem today ... woke up to find four of my dual GPU rigs sitting idle looking for work on 192.0.2.1.
Given that is a reserved IP address, looks like something has gone awry in the code.
Any suggestions on how to kick it out of this loop (re-booting the router, switch and PC's didn't change anything, nor did deleting the GPU slots and re-configuring them)?

Code: Select all

09:20:03:WU02:FS01:Connecting to assign1.foldingathome.org:80
09:20:03:WU00:FS00:Connecting to assign1.foldingathome.org:80
09:20:03:WU00:FS00:Assigned to work server 192.0.2.1
09:20:03:WU00:FS00:Requesting new work unit for slot 00: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
09:20:03:WU00:FS00:Connecting to 192.0.2.1:8080
09:20:03:WU02:FS01:Assigned to work server 192.0.2.1
09:20:03:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
09:20:03:WU02:FS01:Connecting to 192.0.2.1:8080
09:22:13:WARNING:WU02:FS01:WorkServer connection failed on port 8080 trying 80
09:22:13:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
09:22:13:WU02:FS01:Connecting to 192.0.2.1:80
09:22:13:WU00:FS00:Connecting to 192.0.2.1:80
09:24:24:ERROR:WU02:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
09:24:24:ERROR:WU00:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
09:24:25:WU02:FS01:Connecting to assign1.foldingathome.org:80
09:24:25:WU00:FS00:Connecting to assign1.foldingathome.org:80
09:24:25:WU02:FS01:Assigned to work server 192.0.2.1
09:24:25:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
09:24:25:WU02:FS01:Connecting to 192.0.2.1:8080
09:24:25:WU00:FS00:Assigned to work server 192.0.2.1
09:24:25:WU00:FS00:Requesting new work unit for slot 00: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
09:24:25:WU00:FS00:Connecting to 192.0.2.1:8080
If you want to see the full config from one of the other logs, and where it is seen running fine, and then getting stuck, it can be found here;

Code: Select all

20:07:53:WU00:FS01:Connecting to 18.188.125.154:8080
20:07:53:WU01:FS01:Starting
20:07:53:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.11/Core_22.fah/FahCore_22 -dir 01 -suffix 01 -version 706 -lifeline 1448 -checkpoint 15 -gpu-vendor nvidia -opencl-device 1 -cuda-device 1 -gpu 1
20:07:53:WU01:FS01:Started FahCore on PID 6284
20:07:53:WU01:FS01:Core PID:6288
20:07:53:WU01:FS01:FahCore 0x22 started
20:07:53:WU01:FS01:0x22:*********************** Log Started 2020-07-31T20:07:53Z ***********************
20:07:53:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:07:53:WU01:FS01:0x22:       Core: Core22
20:07:53:WU01:FS01:0x22:       Type: 0x22
20:07:53:WU01:FS01:0x22:    Version: 0.0.11
20:07:53:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:07:53:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
20:07:53:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
20:07:53:WU01:FS01:0x22:       Date: Jun 27 2020
20:07:53:WU01:FS01:0x22:       Time: 22:50:00
20:07:53:WU01:FS01:0x22:   Revision: cfc2940c5dd1aa80f60daa6e28d4a2a417f74edb
20:07:53:WU01:FS01:0x22:     Branch: core22-0.0.11
20:07:53:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:07:53:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:07:53:WU01:FS01:0x22:             -funroll-loops
20:07:53:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
20:07:53:WU01:FS01:0x22:       Bits: 64
20:07:53:WU01:FS01:0x22:       Mode: Release
20:07:53:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
20:07:53:WU01:FS01:0x22:             <peastman@stanford.edu>
20:07:53:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 6284 -checkpoint 15
20:07:53:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-device 1 -cuda-device 1 -gpu 1
20:07:53:WU01:FS01:0x22:************************************ libFAH ************************************
20:07:53:WU01:FS01:0x22:       Date: Jun 27 2020
20:07:53:WU01:FS01:0x22:       Time: 22:11:04
20:07:53:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
20:07:53:WU01:FS01:0x22:     Branch: HEAD
20:07:53:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:07:53:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:07:53:WU01:FS01:0x22:             -funroll-loops
20:07:53:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
20:07:53:WU01:FS01:0x22:       Bits: 64
20:07:53:WU01:FS01:0x22:       Mode: Release
20:07:53:WU01:FS01:0x22:************************************ CBang *************************************
20:07:53:WU01:FS01:0x22:       Date: Jun 27 2020
20:07:53:WU01:FS01:0x22:       Time: 22:10:11
20:07:53:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
20:07:53:WU01:FS01:0x22:     Branch: HEAD
20:07:53:WU01:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:07:53:WU01:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:07:53:WU01:FS01:0x22:             -funroll-loops -fPIC
20:07:53:WU01:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
20:07:53:WU01:FS01:0x22:       Bits: 64
20:07:53:WU01:FS01:0x22:       Mode: Release
20:07:53:WU01:FS01:0x22:************************************ System ************************************
20:07:53:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-9700 CPU @ 3.00GHz
20:07:53:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
20:07:53:WU01:FS01:0x22:       CPUs: 8
20:07:53:WU01:FS01:0x22:     Memory: 15.56GiB
20:07:53:WU01:FS01:0x22:Free Memory: 11.84GiB
20:07:53:WU01:FS01:0x22:    Threads: POSIX_THREADS
20:07:53:WU01:FS01:0x22: OS Version: 5.4
20:07:53:WU01:FS01:0x22:Has Battery: false
20:07:53:WU01:FS01:0x22: On Battery: false
20:07:53:WU01:FS01:0x22: UTC Offset: 1
20:07:53:WU01:FS01:0x22:        PID: 6288
20:07:53:WU01:FS01:0x22:        CWD: /var/lib/fahclient/work
20:07:53:WU01:FS01:0x22:********************************************************************************
20:07:53:WU01:FS01:0x22:Project: 13420 (Run 3748, Clone 92, Gen 0)
20:07:53:WU01:FS01:0x22:Unit: 0x0000000112bc7d9a5f202052a26fe5bd
20:07:53:WU01:FS01:0x22:Reading tar file core.xml
20:07:53:WU01:FS01:0x22:Reading tar file integrator.xml
20:07:53:WU01:FS01:0x22:Reading tar file state.xml.bz2
20:07:53:WU01:FS01:0x22:Reading tar file system.xml.bz2
20:07:53:WU01:FS01:0x22:Digital signatures verified
20:07:53:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:07:53:WU01:FS01:0x22:Version 0.0.11
20:07:53:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
20:07:53:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
20:07:53:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
20:07:53:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
20:07:59:WU00:FS01:Upload 62.40%
20:08:00:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
20:08:04:WU00:FS01:Upload complete
20:08:04:WU00:FS01:Server responded WORK_ACK (400)
20:08:04:WU00:FS01:Final credit estimate, 181342.00 points
20:08:04:WU00:FS01:Cleaning up
20:08:29:WU02:FS00:0x22:Completed 280000 out of 1000000 steps (28%)
20:10:23:WU01:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
20:11:35:WU02:FS00:0x22:Completed 290000 out of 1000000 steps (29%)
20:12:45:WU01:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
20:14:41:WU02:FS00:0x22:Completed 300000 out of 1000000 steps (30%)
20:15:08:WU01:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
20:17:30:WU01:FS01:0x22:Completed 40000 out of 1000000 steps (4%)
20:17:47:WU02:FS00:0x22:Completed 310000 out of 1000000 steps (31%)
20:19:53:WU01:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
20:20:53:WU02:FS00:0x22:Completed 320000 out of 1000000 steps (32%)
20:22:16:WU01:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
20:23:59:WU02:FS00:0x22:Completed 330000 out of 1000000 steps (33%)
20:24:38:WU01:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
20:27:01:WU01:FS01:0x22:Completed 80000 out of 1000000 steps (8%)
20:27:05:WU02:FS00:0x22:Completed 340000 out of 1000000 steps (34%)
20:29:23:WU01:FS01:0x22:Completed 90000 out of 1000000 steps (9%)
20:30:11:WU02:FS00:0x22:Completed 350000 out of 1000000 steps (35%)
20:31:46:WU01:FS01:0x22:Completed 100000 out of 1000000 steps (10%)
20:33:17:WU02:FS00:0x22:Completed 360000 out of 1000000 steps (36%)
20:34:09:WU01:FS01:0x22:Completed 110000 out of 1000000 steps (11%)
20:36:23:WU02:FS00:0x22:Completed 370000 out of 1000000 steps (37%)
20:36:31:WU01:FS01:0x22:Completed 120000 out of 1000000 steps (12%)
20:38:54:WU01:FS01:0x22:Completed 130000 out of 1000000 steps (13%)
20:39:30:WU02:FS00:0x22:Completed 380000 out of 1000000 steps (38%)
20:41:16:WU01:FS01:0x22:Completed 140000 out of 1000000 steps (14%)
20:42:37:WU02:FS00:0x22:Completed 390000 out of 1000000 steps (39%)
20:43:39:WU01:FS01:0x22:Completed 150000 out of 1000000 steps (15%)
20:45:43:WU02:FS00:0x22:Completed 400000 out of 1000000 steps (40%)
20:46:02:WU01:FS01:0x22:Completed 160000 out of 1000000 steps (16%)
20:48:24:WU01:FS01:0x22:Completed 170000 out of 1000000 steps (17%)
20:48:50:WU02:FS00:0x22:Completed 410000 out of 1000000 steps (41%)
20:50:47:WU01:FS01:0x22:Completed 180000 out of 1000000 steps (18%)
20:51:56:WU02:FS00:0x22:Completed 420000 out of 1000000 steps (42%)
20:53:09:WU01:FS01:0x22:Completed 190000 out of 1000000 steps (19%)
20:55:03:WU02:FS00:0x22:Completed 430000 out of 1000000 steps (43%)
20:55:32:WU01:FS01:0x22:Completed 200000 out of 1000000 steps (20%)
20:57:55:WU01:FS01:0x22:Completed 210000 out of 1000000 steps (21%)
20:58:09:WU02:FS00:0x22:Completed 440000 out of 1000000 steps (44%)
21:00:17:WU01:FS01:0x22:Completed 220000 out of 1000000 steps (22%)
21:01:16:WU02:FS00:0x22:Completed 450000 out of 1000000 steps (45%)
21:02:40:WU01:FS01:0x22:Completed 230000 out of 1000000 steps (23%)
21:04:23:WU02:FS00:0x22:Completed 460000 out of 1000000 steps (46%)
21:05:03:WU01:FS01:0x22:Completed 240000 out of 1000000 steps (24%)
21:07:25:WU01:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
21:07:29:WU02:FS00:0x22:Completed 470000 out of 1000000 steps (47%)
21:09:49:WU01:FS01:0x22:Completed 260000 out of 1000000 steps (26%)
21:10:35:WU02:FS00:0x22:Completed 480000 out of 1000000 steps (48%)
21:12:11:WU01:FS01:0x22:Completed 270000 out of 1000000 steps (27%)
21:13:42:WU02:FS00:0x22:Completed 490000 out of 1000000 steps (49%)
21:14:34:WU01:FS01:0x22:Completed 280000 out of 1000000 steps (28%)
21:16:48:WU02:FS00:0x22:Completed 500000 out of 1000000 steps (50%)
21:16:57:WU01:FS01:0x22:Completed 290000 out of 1000000 steps (29%)
21:19:20:WU01:FS01:0x22:Completed 300000 out of 1000000 steps (30%)
21:19:55:WU02:FS00:0x22:Completed 510000 out of 1000000 steps (51%)
21:21:43:WU01:FS01:0x22:Completed 310000 out of 1000000 steps (31%)
21:23:02:WU02:FS00:0x22:Completed 520000 out of 1000000 steps (52%)
21:24:06:WU01:FS01:0x22:Completed 320000 out of 1000000 steps (32%)
21:26:08:WU02:FS00:0x22:Completed 530000 out of 1000000 steps (53%)
21:26:29:WU01:FS01:0x22:Completed 330000 out of 1000000 steps (33%)
21:28:51:WU01:FS01:0x22:Completed 340000 out of 1000000 steps (34%)
21:29:14:WU02:FS00:0x22:Completed 540000 out of 1000000 steps (54%)
21:31:14:WU01:FS01:0x22:Completed 350000 out of 1000000 steps (35%)
21:32:21:WU02:FS00:0x22:Completed 550000 out of 1000000 steps (55%)
21:33:38:WU01:FS01:0x22:Completed 360000 out of 1000000 steps (36%)
21:35:27:WU02:FS00:0x22:Completed 560000 out of 1000000 steps (56%)
21:36:00:WU01:FS01:0x22:Completed 370000 out of 1000000 steps (37%)
21:38:23:WU01:FS01:0x22:Completed 380000 out of 1000000 steps (38%)
21:38:34:WU02:FS00:0x22:Completed 570000 out of 1000000 steps (57%)
21:40:46:WU01:FS01:0x22:Completed 390000 out of 1000000 steps (39%)
21:41:40:WU02:FS00:0x22:Completed 580000 out of 1000000 steps (58%)
21:43:08:WU01:FS01:0x22:Completed 400000 out of 1000000 steps (40%)
21:44:46:WU02:FS00:0x22:Completed 590000 out of 1000000 steps (59%)
21:45:32:WU01:FS01:0x22:Completed 410000 out of 1000000 steps (41%)
21:47:52:WU02:FS00:0x22:Completed 600000 out of 1000000 steps (60%)
21:47:55:WU01:FS01:0x22:Completed 420000 out of 1000000 steps (42%)
21:50:17:WU01:FS01:0x22:Completed 430000 out of 1000000 steps (43%)
21:50:59:WU02:FS00:0x22:Completed 610000 out of 1000000 steps (61%)
21:52:40:WU01:FS01:0x22:Completed 440000 out of 1000000 steps (44%)
21:54:05:WU02:FS00:0x22:Completed 620000 out of 1000000 steps (62%)
21:55:03:WU01:FS01:0x22:Completed 450000 out of 1000000 steps (45%)
21:57:11:WU02:FS00:0x22:Completed 630000 out of 1000000 steps (63%)
21:57:26:WU01:FS01:0x22:Completed 460000 out of 1000000 steps (46%)
21:59:49:WU01:FS01:0x22:Completed 470000 out of 1000000 steps (47%)
22:00:17:WU02:FS00:0x22:Completed 640000 out of 1000000 steps (64%)
22:02:12:WU01:FS01:0x22:Completed 480000 out of 1000000 steps (48%)
22:03:23:WU02:FS00:0x22:Completed 650000 out of 1000000 steps (65%)
22:04:34:WU01:FS01:0x22:Completed 490000 out of 1000000 steps (49%)
22:06:30:WU02:FS00:0x22:Completed 660000 out of 1000000 steps (66%)
22:06:57:WU01:FS01:0x22:Completed 500000 out of 1000000 steps (50%)
22:09:20:WU01:FS01:0x22:Completed 510000 out of 1000000 steps (51%)
22:09:36:WU02:FS00:0x22:Completed 670000 out of 1000000 steps (67%)
22:11:42:WU01:FS01:0x22:Completed 520000 out of 1000000 steps (52%)
22:12:43:WU02:FS00:0x22:Completed 680000 out of 1000000 steps (68%)
22:14:05:WU01:FS01:0x22:Completed 530000 out of 1000000 steps (53%)
22:15:49:WU02:FS00:0x22:Completed 690000 out of 1000000 steps (69%)
22:16:27:WU01:FS01:0x22:Completed 540000 out of 1000000 steps (54%)
22:18:50:WU01:FS01:0x22:Completed 550000 out of 1000000 steps (55%)
22:18:55:WU02:FS00:0x22:Completed 700000 out of 1000000 steps (70%)
22:21:13:WU01:FS01:0x22:Completed 560000 out of 1000000 steps (56%)
22:22:02:WU02:FS00:0x22:Completed 710000 out of 1000000 steps (71%)
22:23:35:WU01:FS01:0x22:Completed 570000 out of 1000000 steps (57%)
22:25:08:WU02:FS00:0x22:Completed 720000 out of 1000000 steps (72%)
22:25:58:WU01:FS01:0x22:Completed 580000 out of 1000000 steps (58%)
22:28:14:WU02:FS00:0x22:Completed 730000 out of 1000000 steps (73%)
22:28:21:WU01:FS01:0x22:Completed 590000 out of 1000000 steps (59%)
22:30:43:WU01:FS01:0x22:Completed 600000 out of 1000000 steps (60%)
22:31:21:WU02:FS00:0x22:Completed 740000 out of 1000000 steps (74%)
22:33:06:WU01:FS01:0x22:Completed 610000 out of 1000000 steps (61%)
22:34:27:WU02:FS00:0x22:Completed 750000 out of 1000000 steps (75%)
22:35:29:WU01:FS01:0x22:Completed 620000 out of 1000000 steps (62%)
22:37:34:WU02:FS00:0x22:Completed 760000 out of 1000000 steps (76%)
22:37:51:WU01:FS01:0x22:Completed 630000 out of 1000000 steps (63%)
22:40:14:WU01:FS01:0x22:Completed 640000 out of 1000000 steps (64%)
22:40:41:WU02:FS00:0x22:Completed 770000 out of 1000000 steps (77%)
22:42:37:WU01:FS01:0x22:Completed 650000 out of 1000000 steps (65%)
22:43:47:WU02:FS00:0x22:Completed 780000 out of 1000000 steps (78%)
22:45:00:WU01:FS01:0x22:Completed 660000 out of 1000000 steps (66%)
22:46:54:WU02:FS00:0x22:Completed 790000 out of 1000000 steps (79%)
22:47:22:WU01:FS01:0x22:Completed 670000 out of 1000000 steps (67%)
22:49:45:WU01:FS01:0x22:Completed 680000 out of 1000000 steps (68%)
22:50:00:WU02:FS00:0x22:Completed 800000 out of 1000000 steps (80%)
22:52:07:WU01:FS01:0x22:Completed 690000 out of 1000000 steps (69%)
22:53:07:WU02:FS00:0x22:Completed 810000 out of 1000000 steps (81%)
22:54:30:WU01:FS01:0x22:Completed 700000 out of 1000000 steps (70%)
22:56:14:WU02:FS00:0x22:Completed 820000 out of 1000000 steps (82%)
22:56:53:WU01:FS01:0x22:Completed 710000 out of 1000000 steps (71%)
22:59:15:WU01:FS01:0x22:Completed 720000 out of 1000000 steps (72%)
22:59:20:WU02:FS00:0x22:Completed 830000 out of 1000000 steps (83%)
23:01:38:WU01:FS01:0x22:Completed 730000 out of 1000000 steps (73%)
23:02:26:WU02:FS00:0x22:Completed 840000 out of 1000000 steps (84%)
23:04:00:WU01:FS01:0x22:Completed 740000 out of 1000000 steps (74%)
23:05:32:WU02:FS00:0x22:Completed 850000 out of 1000000 steps (85%)
23:06:23:WU01:FS01:0x22:Completed 750000 out of 1000000 steps (75%)
23:08:39:WU02:FS00:0x22:Completed 860000 out of 1000000 steps (86%)
23:08:46:WU01:FS01:0x22:Completed 760000 out of 1000000 steps (76%)
23:11:09:WU01:FS01:0x22:Completed 770000 out of 1000000 steps (77%)
23:11:46:WU02:FS00:0x22:Completed 870000 out of 1000000 steps (87%)
23:13:32:WU01:FS01:0x22:Completed 780000 out of 1000000 steps (78%)
23:14:52:WU02:FS00:0x22:Completed 880000 out of 1000000 steps (88%)
23:15:54:WU01:FS01:0x22:Completed 790000 out of 1000000 steps (79%)
23:17:59:WU02:FS00:0x22:Completed 890000 out of 1000000 steps (89%)
23:18:17:WU01:FS01:0x22:Completed 800000 out of 1000000 steps (80%)
23:20:40:WU01:FS01:0x22:Completed 810000 out of 1000000 steps (81%)
23:21:05:WU02:FS00:0x22:Completed 900000 out of 1000000 steps (90%)
23:23:03:WU01:FS01:0x22:Completed 820000 out of 1000000 steps (82%)
23:24:12:WU02:FS00:0x22:Completed 910000 out of 1000000 steps (91%)
23:25:26:WU01:FS01:0x22:Completed 830000 out of 1000000 steps (83%)
23:27:18:WU02:FS00:0x22:Completed 920000 out of 1000000 steps (92%)
23:27:49:WU01:FS01:0x22:Completed 840000 out of 1000000 steps (84%)
23:30:12:WU01:FS01:0x22:Completed 850000 out of 1000000 steps (85%)
23:30:25:WU02:FS00:0x22:Completed 930000 out of 1000000 steps (93%)
23:32:35:WU01:FS01:0x22:Completed 860000 out of 1000000 steps (86%)
23:33:31:WU02:FS00:0x22:Completed 940000 out of 1000000 steps (94%)
23:34:58:WU01:FS01:0x22:Completed 870000 out of 1000000 steps (87%)
23:36:37:WU02:FS00:0x22:Completed 950000 out of 1000000 steps (95%)
23:37:21:WU01:FS01:0x22:Completed 880000 out of 1000000 steps (88%)
23:39:43:WU01:FS01:0x22:Completed 890000 out of 1000000 steps (89%)
23:39:44:WU02:FS00:0x22:Completed 960000 out of 1000000 steps (96%)
23:42:06:WU01:FS01:0x22:Completed 900000 out of 1000000 steps (90%)
23:42:50:WU02:FS00:0x22:Completed 970000 out of 1000000 steps (97%)
23:44:29:WU01:FS01:0x22:Completed 910000 out of 1000000 steps (91%)
23:45:56:WU02:FS00:0x22:Completed 980000 out of 1000000 steps (98%)
23:46:52:WU01:FS01:0x22:Completed 920000 out of 1000000 steps (92%)
23:49:02:WU02:FS00:0x22:Completed 990000 out of 1000000 steps (99%)
23:49:02:WU00:FS00:Connecting to assign1.foldingathome.org:80
23:49:02:WU00:FS00:Assigned to work server 18.188.125.154
23:49:02:WU00:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GP104 [GeForce GTX 1070] 6463 from 18.188.125.154
23:49:02:WU00:FS00:Connecting to 18.188.125.154:8080
23:49:03:WU00:FS00:Downloading 7.03MiB
23:49:06:WU00:FS00:Download complete
23:49:06:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13420 run:5418 clone:99 gen:0 core:0x22 unit:0x0000000012bc7d9a5f224964ef6402b1
23:49:15:WU01:FS01:0x22:Completed 930000 out of 1000000 steps (93%)
23:51:38:WU01:FS01:0x22:Completed 940000 out of 1000000 steps (94%)
23:52:08:WU02:FS00:0x22:Completed 1000000 out of 1000000 steps (100%)
23:52:08:WU02:FS00:0x22:Average performance: 92.8034 ns/day
23:52:11:WU02:FS00:0x22:Saving result file ../logfile_01.txt
23:52:11:WU02:FS00:0x22:Saving result file checkpointState.xml.bz2
23:52:11:WU02:FS00:0x22:Saving result file globals.csv
23:52:11:WU02:FS00:0x22:Saving result file positions.xtc
23:52:11:WU02:FS00:0x22:Saving result file science.log
23:52:11:WU02:FS00:0x22:Folding@home Core Shutdown: FINISHED_UNIT
23:52:11:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:52:11:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:13420 run:3630 clone:89 gen:0 core:0x22 unit:0x0000000112bc7d9a5f20201da77a7649
23:52:11:WU02:FS00:Uploading 5.71MiB to 18.188.125.154
23:52:11:WU02:FS00:Connecting to 18.188.125.154:8080
23:52:11:WU00:FS00:Starting
23:52:11:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.11/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 706 -lifeline 1448 -checkpoint 15 -gpu-vendor nvidia -opencl-device 0 -cuda-device 0 -gpu 0
23:52:11:WU00:FS00:Started FahCore on PID 6558
23:52:11:WU00:FS00:Core PID:6562
23:52:11:WU00:FS00:FahCore 0x22 started
23:52:12:WU00:FS00:0x22:*********************** Log Started 2020-07-31T23:52:11Z ***********************
23:52:12:WU00:FS00:0x22:*************************** Core22 Folding@home Core ***************************
23:52:12:WU00:FS00:0x22:       Core: Core22
23:52:12:WU00:FS00:0x22:       Type: 0x22
23:52:12:WU00:FS00:0x22:    Version: 0.0.11
23:52:12:WU00:FS00:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:52:12:WU00:FS00:0x22:  Copyright: 2020 foldingathome.org
23:52:12:WU00:FS00:0x22:   Homepage: https://foldingathome.org/
23:52:12:WU00:FS00:0x22:       Date: Jun 27 2020
23:52:12:WU00:FS00:0x22:       Time: 22:50:00
23:52:12:WU00:FS00:0x22:   Revision: cfc2940c5dd1aa80f60daa6e28d4a2a417f74edb
23:52:12:WU00:FS00:0x22:     Branch: core22-0.0.11
23:52:12:WU00:FS00:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
23:52:12:WU00:FS00:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
23:52:12:WU00:FS00:0x22:             -funroll-loops
23:52:12:WU00:FS00:0x22:   Platform: linux2 4.19.76-linuxkit
23:52:12:WU00:FS00:0x22:       Bits: 64
23:52:12:WU00:FS00:0x22:       Mode: Release
23:52:12:WU00:FS00:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
23:52:12:WU00:FS00:0x22:             <peastman@stanford.edu>
23:52:12:WU00:FS00:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 6558 -checkpoint 15
23:52:12:WU00:FS00:0x22:             -gpu-vendor nvidia -opencl-device 0 -cuda-device 0 -gpu 0
23:52:12:WU00:FS00:0x22:************************************ libFAH ************************************
23:52:12:WU00:FS00:0x22:       Date: Jun 27 2020
23:52:12:WU00:FS00:0x22:       Time: 22:11:04
23:52:12:WU00:FS00:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
23:52:12:WU00:FS00:0x22:     Branch: HEAD
23:52:12:WU00:FS00:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
23:52:12:WU00:FS00:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
23:52:12:WU00:FS00:0x22:             -funroll-loops
23:52:12:WU00:FS00:0x22:   Platform: linux2 4.19.76-linuxkit
23:52:12:WU00:FS00:0x22:       Bits: 64
23:52:12:WU00:FS00:0x22:       Mode: Release
23:52:12:WU00:FS00:0x22:************************************ CBang *************************************
23:52:12:WU00:FS00:0x22:       Date: Jun 27 2020
23:52:12:WU00:FS00:0x22:       Time: 22:10:11
23:52:12:WU00:FS00:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
23:52:12:WU00:FS00:0x22:     Branch: HEAD
23:52:12:WU00:FS00:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
23:52:12:WU00:FS00:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
23:52:12:WU00:FS00:0x22:             -funroll-loops -fPIC
23:52:12:WU00:FS00:0x22:   Platform: linux2 4.19.76-linuxkit
23:52:12:WU00:FS00:0x22:       Bits: 64
23:52:12:WU00:FS00:0x22:       Mode: Release
23:52:12:WU00:FS00:0x22:************************************ System ************************************
23:52:12:WU00:FS00:0x22:        CPU: Intel(R) Core(TM) i7-9700 CPU @ 3.00GHz
23:52:12:WU00:FS00:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
23:52:12:WU00:FS00:0x22:       CPUs: 8
23:52:12:WU00:FS00:0x22:     Memory: 15.56GiB
23:52:12:WU00:FS00:0x22:Free Memory: 11.81GiB
23:52:12:WU00:FS00:0x22:    Threads: POSIX_THREADS
23:52:12:WU00:FS00:0x22: OS Version: 5.4
23:52:12:WU00:FS00:0x22:Has Battery: false
23:52:12:WU00:FS00:0x22: On Battery: false
23:52:12:WU00:FS00:0x22: UTC Offset: 1
23:52:12:WU00:FS00:0x22:        PID: 6562
23:52:12:WU00:FS00:0x22:        CWD: /var/lib/fahclient/work
23:52:12:WU00:FS00:0x22:********************************************************************************
23:52:12:WU00:FS00:0x22:Project: 13420 (Run 5418, Clone 99, Gen 0)
23:52:12:WU00:FS00:0x22:Unit: 0x0000000012bc7d9a5f224964ef6402b1
23:52:12:WU00:FS00:0x22:Reading tar file core.xml
23:52:12:WU00:FS00:0x22:Reading tar file integrator.xml
23:52:12:WU00:FS00:0x22:Reading tar file state.xml.bz2
23:52:12:WU00:FS00:0x22:Reading tar file system.xml.bz2
23:52:12:WU00:FS00:0x22:Digital signatures verified
23:52:12:WU00:FS00:0x22:Folding@home GPU Core22 Folding@home Core
23:52:12:WU00:FS00:0x22:Version 0.0.11
23:52:12:WU00:FS00:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
23:52:12:WU00:FS00:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
23:52:12:WU00:FS00:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
23:52:12:WU00:FS00:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
23:52:17:WU02:FS00:Upload 54.74%
23:52:17:WU00:FS00:0x22:Completed 0 out of 1000000 steps (0%)
23:52:22:WU02:FS00:Upload complete
23:52:22:WU02:FS00:Server responded WORK_ACK (400)
23:52:22:WU02:FS00:Final credit estimate, 158910.00 points
23:52:22:WU02:FS00:Cleaning up
23:54:01:WU01:FS01:0x22:Completed 950000 out of 1000000 steps (95%)
23:54:42:WU00:FS00:0x22:Completed 10000 out of 1000000 steps (1%)
23:56:24:WU01:FS01:0x22:Completed 960000 out of 1000000 steps (96%)
23:57:07:WU00:FS00:0x22:Completed 20000 out of 1000000 steps (2%)
23:58:47:WU01:FS01:0x22:Completed 970000 out of 1000000 steps (97%)
23:59:31:WU00:FS00:0x22:Completed 30000 out of 1000000 steps (3%)
00:01:09:WU01:FS01:0x22:Completed 980000 out of 1000000 steps (98%)
00:01:56:WU00:FS00:0x22:Completed 40000 out of 1000000 steps (4%)
00:03:32:WU01:FS01:0x22:Completed 990000 out of 1000000 steps (99%)
00:03:33:WU02:FS01:Connecting to assign1.foldingathome.org:80
00:03:33:WU02:FS01:Assigned to work server 18.188.125.154
00:03:33:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:GP104 [GeForce GTX 1070] 6463 from 18.188.125.154
00:03:33:WU02:FS01:Connecting to 18.188.125.154:8080
00:03:34:WU02:FS01:Downloading 7.03MiB
00:03:37:WU02:FS01:Download complete
00:03:37:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13420 run:7457 clone:99 gen:0 core:0x22 unit:0x0000000012bc7d9a5f2249b3ab3b0638
00:04:20:WU00:FS00:0x22:Completed 50000 out of 1000000 steps (5%)
00:05:55:WU01:FS01:0x22:Completed 1000000 out of 1000000 steps (100%)
00:05:55:WU01:FS01:0x22:Average performance: 121.008 ns/day
00:05:58:WU01:FS01:0x22:Saving result file ../logfile_01.txt
00:05:58:WU01:FS01:0x22:Saving result file checkpointState.xml.bz2
00:05:58:WU01:FS01:0x22:Saving result file globals.csv
00:05:58:WU01:FS01:0x22:Saving result file positions.xtc
00:05:58:WU01:FS01:0x22:Saving result file science.log
00:05:58:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
00:05:59:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:05:59:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:13420 run:3748 clone:92 gen:0 core:0x22 unit:0x0000000112bc7d9a5f202052a26fe5bd
00:05:59:WU01:FS01:Uploading 5.71MiB to 18.188.125.154
00:05:59:WU01:FS01:Connecting to 18.188.125.154:8080
00:05:59:WU02:FS01:Starting
00:05:59:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.11/Core_22.fah/FahCore_22 -dir 02 -suffix 01 -version 706 -lifeline 1448 -checkpoint 15 -gpu-vendor nvidia -opencl-device 1 -cuda-device 1 -gpu 1
00:05:59:WU02:FS01:Started FahCore on PID 6604
00:05:59:WU02:FS01:Core PID:6608
00:05:59:WU02:FS01:FahCore 0x22 started
00:05:59:WU02:FS01:0x22:*********************** Log Started 2020-08-01T00:05:59Z ***********************
00:05:59:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
00:05:59:WU02:FS01:0x22:       Core: Core22
00:05:59:WU02:FS01:0x22:       Type: 0x22
00:05:59:WU02:FS01:0x22:    Version: 0.0.11
00:05:59:WU02:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:05:59:WU02:FS01:0x22:  Copyright: 2020 foldingathome.org
00:05:59:WU02:FS01:0x22:   Homepage: https://foldingathome.org/
00:05:59:WU02:FS01:0x22:       Date: Jun 27 2020
00:05:59:WU02:FS01:0x22:       Time: 22:50:00
00:05:59:WU02:FS01:0x22:   Revision: cfc2940c5dd1aa80f60daa6e28d4a2a417f74edb
00:05:59:WU02:FS01:0x22:     Branch: core22-0.0.11
00:05:59:WU02:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
00:05:59:WU02:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
00:05:59:WU02:FS01:0x22:             -funroll-loops
00:05:59:WU02:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
00:05:59:WU02:FS01:0x22:       Bits: 64
00:05:59:WU02:FS01:0x22:       Mode: Release
00:05:59:WU02:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
00:05:59:WU02:FS01:0x22:             <peastman@stanford.edu>
00:05:59:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 6604 -checkpoint 15
00:05:59:WU02:FS01:0x22:             -gpu-vendor nvidia -opencl-device 1 -cuda-device 1 -gpu 1
00:05:59:WU02:FS01:0x22:************************************ libFAH ************************************
00:05:59:WU02:FS01:0x22:       Date: Jun 27 2020
00:05:59:WU02:FS01:0x22:       Time: 22:11:04
00:05:59:WU02:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
00:05:59:WU02:FS01:0x22:     Branch: HEAD
00:05:59:WU02:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
00:05:59:WU02:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
00:05:59:WU02:FS01:0x22:             -funroll-loops
00:05:59:WU02:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
00:05:59:WU02:FS01:0x22:       Bits: 64
00:05:59:WU02:FS01:0x22:       Mode: Release
00:05:59:WU02:FS01:0x22:************************************ CBang *************************************
00:05:59:WU02:FS01:0x22:       Date: Jun 27 2020
00:05:59:WU02:FS01:0x22:       Time: 22:10:11
00:05:59:WU02:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
00:05:59:WU02:FS01:0x22:     Branch: HEAD
00:05:59:WU02:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
00:05:59:WU02:FS01:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
00:05:59:WU02:FS01:0x22:             -funroll-loops -fPIC
00:05:59:WU02:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
00:05:59:WU02:FS01:0x22:       Bits: 64
00:05:59:WU02:FS01:0x22:       Mode: Release
00:05:59:WU02:FS01:0x22:************************************ System ************************************
00:05:59:WU02:FS01:0x22:        CPU: Intel(R) Core(TM) i7-9700 CPU @ 3.00GHz
00:05:59:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
00:05:59:WU02:FS01:0x22:       CPUs: 8
00:05:59:WU02:FS01:0x22:     Memory: 15.56GiB
00:05:59:WU02:FS01:0x22:Free Memory: 11.84GiB
00:05:59:WU02:FS01:0x22:    Threads: POSIX_THREADS
00:05:59:WU02:FS01:0x22: OS Version: 5.4
00:05:59:WU02:FS01:0x22:Has Battery: false
00:05:59:WU02:FS01:0x22: On Battery: false
00:05:59:WU02:FS01:0x22: UTC Offset: 1
00:05:59:WU02:FS01:0x22:        PID: 6608
00:05:59:WU02:FS01:0x22:        CWD: /var/lib/fahclient/work
00:05:59:WU02:FS01:0x22:********************************************************************************
00:05:59:WU02:FS01:0x22:Project: 13420 (Run 7457, Clone 99, Gen 0)
00:05:59:WU02:FS01:0x22:Unit: 0x0000000012bc7d9a5f2249b3ab3b0638
00:05:59:WU02:FS01:0x22:Reading tar file core.xml
00:05:59:WU02:FS01:0x22:Reading tar file integrator.xml
00:05:59:WU02:FS01:0x22:Reading tar file state.xml.bz2
00:05:59:WU02:FS01:0x22:Reading tar file system.xml.bz2
00:05:59:WU02:FS01:0x22:Digital signatures verified
00:05:59:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
00:05:59:WU02:FS01:0x22:Version 0.0.11
00:05:59:WU02:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
00:05:59:WU02:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
00:05:59:WU02:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
00:05:59:WU02:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
00:06:05:WU01:FS01:Upload 54.77%
00:06:05:WU02:FS01:0x22:Completed 0 out of 1000000 steps (0%)
00:06:11:WU01:FS01:Upload complete
00:06:11:WU01:FS01:Server responded WORK_ACK (400)
00:06:11:WU01:FS01:Final credit estimate, 181223.00 points
00:06:11:WU01:FS01:Cleaning up
00:06:45:WU00:FS00:0x22:Completed 60000 out of 1000000 steps (6%)
00:08:27:WU02:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
00:09:10:WU00:FS00:0x22:Completed 70000 out of 1000000 steps (7%)
00:10:50:WU02:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
00:11:34:WU00:FS00:0x22:Completed 80000 out of 1000000 steps (8%)
00:13:12:WU02:FS01:0x22:Completed 30000 out of 1000000 steps (3%)
00:13:59:WU00:FS00:0x22:Completed 90000 out of 1000000 steps (9%)
00:15:35:WU02:FS01:0x22:Completed 40000 out of 1000000 steps (4%)
00:16:23:WU00:FS00:0x22:Completed 100000 out of 1000000 steps (10%)
00:17:57:WU02:FS01:0x22:Completed 50000 out of 1000000 steps (5%)
00:18:48:WU00:FS00:0x22:Completed 110000 out of 1000000 steps (11%)
00:20:20:WU02:FS01:0x22:Completed 60000 out of 1000000 steps (6%)
00:21:12:WU00:FS00:0x22:Completed 120000 out of 1000000 steps (12%)
00:22:42:WU02:FS01:0x22:Completed 70000 out of 1000000 steps (7%)
00:23:37:WU00:FS00:0x22:Completed 130000 out of 1000000 steps (13%)
00:25:04:WU02:FS01:0x22:Completed 80000 out of 1000000 steps (8%)
00:26:01:WU00:FS00:0x22:Completed 140000 out of 1000000 steps (14%)
00:27:27:WU02:FS01:0x22:Completed 90000 out of 1000000 steps (9%)
00:28:26:WU00:FS00:0x22:Completed 150000 out of 1000000 steps (15%)
00:29:49:WU02:FS01:0x22:Completed 100000 out of 1000000 steps (10%)
00:30:51:WU00:FS00:0x22:Completed 160000 out of 1000000 steps (16%)
00:32:12:WU02:FS01:0x22:Completed 110000 out of 1000000 steps (11%)
00:33:15:WU00:FS00:0x22:Completed 170000 out of 1000000 steps (17%)
00:34:34:WU02:FS01:0x22:Completed 120000 out of 1000000 steps (12%)
00:35:39:WU00:FS00:0x22:Completed 180000 out of 1000000 steps (18%)
00:36:56:WU02:FS01:0x22:Completed 130000 out of 1000000 steps (13%)
00:38:04:WU00:FS00:0x22:Completed 190000 out of 1000000 steps (19%)
00:39:18:WU02:FS01:0x22:Completed 140000 out of 1000000 steps (14%)
00:40:28:WU00:FS00:0x22:Completed 200000 out of 1000000 steps (20%)
00:41:41:WU02:FS01:0x22:Completed 150000 out of 1000000 steps (15%)
******************************* Date: 2020-08-01 *******************************
00:42:53:WU00:FS00:0x22:Completed 210000 out of 1000000 steps (21%)
00:44:04:WU02:FS01:0x22:Completed 160000 out of 1000000 steps (16%)
00:45:18:WU00:FS00:0x22:Completed 220000 out of 1000000 steps (22%)
00:46:26:WU02:FS01:0x22:Completed 170000 out of 1000000 steps (17%)
00:47:42:WU00:FS00:0x22:Completed 230000 out of 1000000 steps (23%)
00:48:48:WU02:FS01:0x22:Completed 180000 out of 1000000 steps (18%)
00:50:07:WU00:FS00:0x22:Completed 240000 out of 1000000 steps (24%)
00:51:10:WU02:FS01:0x22:Completed 190000 out of 1000000 steps (19%)
00:52:31:WU00:FS00:0x22:Completed 250000 out of 1000000 steps (25%)
00:53:33:WU02:FS01:0x22:Completed 200000 out of 1000000 steps (20%)
00:54:56:WU00:FS00:0x22:Completed 260000 out of 1000000 steps (26%)
00:55:55:WU02:FS01:0x22:Completed 210000 out of 1000000 steps (21%)
00:57:21:WU00:FS00:0x22:Completed 270000 out of 1000000 steps (27%)
00:58:18:WU02:FS01:0x22:Completed 220000 out of 1000000 steps (22%)
00:59:46:WU00:FS00:0x22:Completed 280000 out of 1000000 steps (28%)
01:00:40:WU02:FS01:0x22:Completed 230000 out of 1000000 steps (23%)
01:02:11:WU00:FS00:0x22:Completed 290000 out of 1000000 steps (29%)
01:03:02:WU02:FS01:0x22:Completed 240000 out of 1000000 steps (24%)
01:04:36:WU00:FS00:0x22:Completed 300000 out of 1000000 steps (30%)
01:05:24:WU02:FS01:0x22:Completed 250000 out of 1000000 steps (25%)
01:07:01:WU00:FS00:0x22:Completed 310000 out of 1000000 steps (31%)
01:07:47:WU02:FS01:0x22:Completed 260000 out of 1000000 steps (26%)
01:09:25:WU00:FS00:0x22:Completed 320000 out of 1000000 steps (32%)
01:10:10:WU02:FS01:0x22:Completed 270000 out of 1000000 steps (27%)
01:11:50:WU00:FS00:0x22:Completed 330000 out of 1000000 steps (33%)
01:12:33:WU02:FS01:0x22:Completed 280000 out of 1000000 steps (28%)
01:14:15:WU00:FS00:0x22:Completed 340000 out of 1000000 steps (34%)
01:14:55:WU02:FS01:0x22:Completed 290000 out of 1000000 steps (29%)
01:16:40:WU00:FS00:0x22:Completed 350000 out of 1000000 steps (35%)
01:17:18:WU02:FS01:0x22:Completed 300000 out of 1000000 steps (30%)
01:19:05:WU00:FS00:0x22:Completed 360000 out of 1000000 steps (36%)
01:19:40:WU02:FS01:0x22:Completed 310000 out of 1000000 steps (31%)
01:21:30:WU00:FS00:0x22:Completed 370000 out of 1000000 steps (37%)
01:22:03:WU02:FS01:0x22:Completed 320000 out of 1000000 steps (32%)
01:23:54:WU00:FS00:0x22:Completed 380000 out of 1000000 steps (38%)
01:24:26:WU02:FS01:0x22:Completed 330000 out of 1000000 steps (33%)
01:26:19:WU00:FS00:0x22:Completed 390000 out of 1000000 steps (39%)
01:26:49:WU02:FS01:0x22:Completed 340000 out of 1000000 steps (34%)
01:28:44:WU00:FS00:0x22:Completed 400000 out of 1000000 steps (40%)
01:29:11:WU02:FS01:0x22:Completed 350000 out of 1000000 steps (35%)
01:31:09:WU00:FS00:0x22:Completed 410000 out of 1000000 steps (41%)
01:31:34:WU02:FS01:0x22:Completed 360000 out of 1000000 steps (36%)
01:33:34:WU00:FS00:0x22:Completed 420000 out of 1000000 steps (42%)
01:33:57:WU02:FS01:0x22:Completed 370000 out of 1000000 steps (37%)
01:35:58:WU00:FS00:0x22:Completed 430000 out of 1000000 steps (43%)
01:36:20:WU02:FS01:0x22:Completed 380000 out of 1000000 steps (38%)
01:38:23:WU00:FS00:0x22:Completed 440000 out of 1000000 steps (44%)
01:38:42:WU02:FS01:0x22:Completed 390000 out of 1000000 steps (39%)
01:40:48:WU00:FS00:0x22:Completed 450000 out of 1000000 steps (45%)
01:41:05:WU02:FS01:0x22:Completed 400000 out of 1000000 steps (40%)
01:43:13:WU00:FS00:0x22:Completed 460000 out of 1000000 steps (46%)
01:43:28:WU02:FS01:0x22:Completed 410000 out of 1000000 steps (41%)
01:45:38:WU00:FS00:0x22:Completed 470000 out of 1000000 steps (47%)
01:45:51:WU02:FS01:0x22:Completed 420000 out of 1000000 steps (42%)
01:48:02:WU00:FS00:0x22:Completed 480000 out of 1000000 steps (48%)
01:48:13:WU02:FS01:0x22:Completed 430000 out of 1000000 steps (43%)
01:50:27:WU00:FS00:0x22:Completed 490000 out of 1000000 steps (49%)
01:50:36:WU02:FS01:0x22:Completed 440000 out of 1000000 steps (44%)
01:52:52:WU00:FS00:0x22:Completed 500000 out of 1000000 steps (50%)
01:52:59:WU02:FS01:0x22:Completed 450000 out of 1000000 steps (45%)
01:55:17:WU00:FS00:0x22:Completed 510000 out of 1000000 steps (51%)
01:55:22:WU02:FS01:0x22:Completed 460000 out of 1000000 steps (46%)
01:57:41:WU00:FS00:0x22:Completed 520000 out of 1000000 steps (52%)
01:57:44:WU02:FS01:0x22:Completed 470000 out of 1000000 steps (47%)
02:00:06:WU00:FS00:0x22:Completed 530000 out of 1000000 steps (53%)
02:00:07:WU02:FS01:0x22:Completed 480000 out of 1000000 steps (48%)
02:02:30:WU02:FS01:0x22:Completed 490000 out of 1000000 steps (49%)
02:02:30:WU00:FS00:0x22:Completed 540000 out of 1000000 steps (54%)
02:04:52:WU02:FS01:0x22:Completed 500000 out of 1000000 steps (50%)
02:04:54:WU00:FS00:0x22:Completed 550000 out of 1000000 steps (55%)
02:07:15:WU02:FS01:0x22:Completed 510000 out of 1000000 steps (51%)
02:07:20:WU00:FS00:0x22:Completed 560000 out of 1000000 steps (56%)
02:09:37:WU02:FS01:0x22:Completed 520000 out of 1000000 steps (52%)
02:09:44:WU00:FS00:0x22:Completed 570000 out of 1000000 steps (57%)
02:12:00:WU02:FS01:0x22:Completed 530000 out of 1000000 steps (53%)
02:12:08:WU00:FS00:0x22:Completed 580000 out of 1000000 steps (58%)
02:14:22:WU02:FS01:0x22:Completed 540000 out of 1000000 steps (54%)
02:14:33:WU00:FS00:0x22:Completed 590000 out of 1000000 steps (59%)
02:16:45:WU02:FS01:0x22:Completed 550000 out of 1000000 steps (55%)
02:16:57:WU00:FS00:0x22:Completed 600000 out of 1000000 steps (60%)
02:19:07:WU02:FS01:0x22:Completed 560000 out of 1000000 steps (56%)
02:19:22:WU00:FS00:0x22:Completed 610000 out of 1000000 steps (61%)
02:21:30:WU02:FS01:0x22:Completed 570000 out of 1000000 steps (57%)
02:21:47:WU00:FS00:0x22:Completed 620000 out of 1000000 steps (62%)
02:23:52:WU02:FS01:0x22:Completed 580000 out of 1000000 steps (58%)
02:24:11:WU00:FS00:0x22:Completed 630000 out of 1000000 steps (63%)
02:26:14:WU02:FS01:0x22:Completed 590000 out of 1000000 steps (59%)
02:26:36:WU00:FS00:0x22:Completed 640000 out of 1000000 steps (64%)
02:28:36:WU02:FS01:0x22:Completed 600000 out of 1000000 steps (60%)
02:29:00:WU00:FS00:0x22:Completed 650000 out of 1000000 steps (65%)
02:30:59:WU02:FS01:0x22:Completed 610000 out of 1000000 steps (61%)
02:31:25:WU00:FS00:0x22:Completed 660000 out of 1000000 steps (66%)
02:33:22:WU02:FS01:0x22:Completed 620000 out of 1000000 steps (62%)
02:33:50:WU00:FS00:0x22:Completed 670000 out of 1000000 steps (67%)
02:35:44:WU02:FS01:0x22:Completed 630000 out of 1000000 steps (63%)
02:36:14:WU00:FS00:0x22:Completed 680000 out of 1000000 steps (68%)
02:38:06:WU02:FS01:0x22:Completed 640000 out of 1000000 steps (64%)
02:38:39:WU00:FS00:0x22:Completed 690000 out of 1000000 steps (69%)
02:40:29:WU02:FS01:0x22:Completed 650000 out of 1000000 steps (65%)
02:41:03:WU00:FS00:0x22:Completed 700000 out of 1000000 steps (70%)
02:42:51:WU02:FS01:0x22:Completed 660000 out of 1000000 steps (66%)
02:43:28:WU00:FS00:0x22:Completed 710000 out of 1000000 steps (71%)
02:45:14:WU02:FS01:0x22:Completed 670000 out of 1000000 steps (67%)
02:45:53:WU00:FS00:0x22:Completed 720000 out of 1000000 steps (72%)
02:47:36:WU02:FS01:0x22:Completed 680000 out of 1000000 steps (68%)
02:48:17:WU00:FS00:0x22:Completed 730000 out of 1000000 steps (73%)
02:49:59:WU02:FS01:0x22:Completed 690000 out of 1000000 steps (69%)
02:50:42:WU00:FS00:0x22:Completed 740000 out of 1000000 steps (74%)
02:52:21:WU02:FS01:0x22:Completed 700000 out of 1000000 steps (70%)
02:53:06:WU00:FS00:0x22:Completed 750000 out of 1000000 steps (75%)
02:54:44:WU02:FS01:0x22:Completed 710000 out of 1000000 steps (71%)
02:55:31:WU00:FS00:0x22:Completed 760000 out of 1000000 steps (76%)
02:57:06:WU02:FS01:0x22:Completed 720000 out of 1000000 steps (72%)
02:57:56:WU00:FS00:0x22:Completed 770000 out of 1000000 steps (77%)
02:59:29:WU02:FS01:0x22:Completed 730000 out of 1000000 steps (73%)
03:00:21:WU00:FS00:0x22:Completed 780000 out of 1000000 steps (78%)
03:01:51:WU02:FS01:0x22:Completed 740000 out of 1000000 steps (74%)
03:02:45:WU00:FS00:0x22:Completed 790000 out of 1000000 steps (79%)
03:04:13:WU02:FS01:0x22:Completed 750000 out of 1000000 steps (75%)
03:05:10:WU00:FS00:0x22:Completed 800000 out of 1000000 steps (80%)
03:06:36:WU02:FS01:0x22:Completed 760000 out of 1000000 steps (76%)
03:07:35:WU00:FS00:0x22:Completed 810000 out of 1000000 steps (81%)
03:08:59:WU02:FS01:0x22:Completed 770000 out of 1000000 steps (77%)
03:10:00:WU00:FS00:0x22:Completed 820000 out of 1000000 steps (82%)
03:11:22:WU02:FS01:0x22:Completed 780000 out of 1000000 steps (78%)
03:12:25:WU00:FS00:0x22:Completed 830000 out of 1000000 steps (83%)
03:13:44:WU02:FS01:0x22:Completed 790000 out of 1000000 steps (79%)
03:14:50:WU00:FS00:0x22:Completed 840000 out of 1000000 steps (84%)
03:16:07:WU02:FS01:0x22:Completed 800000 out of 1000000 steps (80%)
03:17:14:WU00:FS00:0x22:Completed 850000 out of 1000000 steps (85%)
03:18:30:WU02:FS01:0x22:Completed 810000 out of 1000000 steps (81%)
03:19:40:WU00:FS00:0x22:Completed 860000 out of 1000000 steps (86%)
03:20:53:WU02:FS01:0x22:Completed 820000 out of 1000000 steps (82%)
03:22:04:WU00:FS00:0x22:Completed 870000 out of 1000000 steps (87%)
03:23:15:WU02:FS01:0x22:Completed 830000 out of 1000000 steps (83%)
03:24:29:WU00:FS00:0x22:Completed 880000 out of 1000000 steps (88%)
03:25:38:WU02:FS01:0x22:Completed 840000 out of 1000000 steps (84%)
03:26:54:WU00:FS00:0x22:Completed 890000 out of 1000000 steps (89%)
03:28:01:WU02:FS01:0x22:Completed 850000 out of 1000000 steps (85%)
03:29:19:WU00:FS00:0x22:Completed 900000 out of 1000000 steps (90%)
03:30:24:WU02:FS01:0x22:Completed 860000 out of 1000000 steps (86%)
03:31:44:WU00:FS00:0x22:Completed 910000 out of 1000000 steps (91%)
03:32:46:WU02:FS01:0x22:Completed 870000 out of 1000000 steps (87%)
03:34:09:WU00:FS00:0x22:Completed 920000 out of 1000000 steps (92%)
03:35:09:WU02:FS01:0x22:Completed 880000 out of 1000000 steps (88%)
03:36:33:WU00:FS00:0x22:Completed 930000 out of 1000000 steps (93%)
03:37:32:WU02:FS01:0x22:Completed 890000 out of 1000000 steps (89%)
03:38:58:WU00:FS00:0x22:Completed 940000 out of 1000000 steps (94%)
03:39:54:WU02:FS01:0x22:Completed 900000 out of 1000000 steps (90%)
03:41:23:WU00:FS00:0x22:Completed 950000 out of 1000000 steps (95%)
03:42:18:WU02:FS01:0x22:Completed 910000 out of 1000000 steps (91%)
03:43:48:WU00:FS00:0x22:Completed 960000 out of 1000000 steps (96%)
03:44:40:WU02:FS01:0x22:Completed 920000 out of 1000000 steps (92%)
03:46:13:WU00:FS00:0x22:Completed 970000 out of 1000000 steps (97%)
03:47:03:WU02:FS01:0x22:Completed 930000 out of 1000000 steps (93%)
03:48:38:WU00:FS00:0x22:Completed 980000 out of 1000000 steps (98%)
03:49:25:WU02:FS01:0x22:Completed 940000 out of 1000000 steps (94%)
03:51:03:WU00:FS00:0x22:Completed 990000 out of 1000000 steps (99%)
03:51:03:WU01:FS00:Connecting to assign1.foldingathome.org:80
03:51:03:WU01:FS00:Assigned to work server 192.0.2.1
03:51:03:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
03:51:03:WU01:FS00:Connecting to 192.0.2.1:8080
03:51:48:WU02:FS01:0x22:Completed 950000 out of 1000000 steps (95%)
03:53:13:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
03:53:13:WU01:FS00:Connecting to 192.0.2.1:80
03:53:28:WU00:FS00:0x22:Completed 1000000 out of 1000000 steps (100%)
03:53:28:WU00:FS00:0x22:Average performance: 119.337 ns/day
03:53:31:WU00:FS00:0x22:Saving result file ../logfile_01.txt
03:53:31:WU00:FS00:0x22:Saving result file checkpointState.xml.bz2
03:53:31:WU00:FS00:0x22:Saving result file globals.csv
03:53:31:WU00:FS00:0x22:Saving result file positions.xtc
03:53:31:WU00:FS00:0x22:Saving result file science.log
03:53:31:WU00:FS00:0x22:Folding@home Core Shutdown: FINISHED_UNIT
03:53:31:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:53:31:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13420 run:5418 clone:99 gen:0 core:0x22 unit:0x0000000012bc7d9a5f224964ef6402b1
03:53:31:WU00:FS00:Uploading 5.71MiB to 18.188.125.154
03:53:31:WU00:FS00:Connecting to 18.188.125.154:8080
03:53:37:WU00:FS00:Upload 59.12%
03:53:42:WU00:FS00:Upload complete
03:53:42:WU00:FS00:Server responded WORK_ACK (400)
03:53:42:WU00:FS00:Final credit estimate, 179760.00 points
03:53:42:WU00:FS00:Cleaning up
03:54:11:WU02:FS01:0x22:Completed 960000 out of 1000000 steps (96%)
03:55:24:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
03:55:24:WU01:FS00:Connecting to assign1.foldingathome.org:80
03:55:24:WU01:FS00:Assigned to work server 192.0.2.1
03:55:24:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
03:55:24:WU01:FS00:Connecting to 192.0.2.1:8080
03:56:34:WU02:FS01:0x22:Completed 970000 out of 1000000 steps (97%)
03:57:35:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
03:57:35:WU01:FS00:Connecting to 192.0.2.1:80
03:58:56:WU02:FS01:0x22:Completed 980000 out of 1000000 steps (98%)
03:59:46:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
03:59:46:WU01:FS00:Connecting to assign1.foldingathome.org:80
03:59:47:WU01:FS00:Assigned to work server 192.0.2.1
03:59:47:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
03:59:47:WU01:FS00:Connecting to 192.0.2.1:8080
04:01:19:WU02:FS01:0x22:Completed 990000 out of 1000000 steps (99%)
04:01:20:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:01:20:WU00:FS01:Assigned to work server 192.0.2.1
04:01:20:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:01:20:WU00:FS01:Connecting to 192.0.2.1:8080
04:01:57:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:01:57:WU01:FS00:Connecting to 192.0.2.1:80
04:03:31:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:03:31:WU00:FS01:Connecting to 192.0.2.1:80
04:03:41:WU02:FS01:0x22:Completed 1000000 out of 1000000 steps (100%)
04:03:41:WU02:FS01:0x22:Average performance: 121.178 ns/day
04:03:44:WU02:FS01:0x22:Saving result file ../logfile_01.txt
04:03:44:WU02:FS01:0x22:Saving result file checkpointState.xml.bz2
04:03:44:WU02:FS01:0x22:Saving result file globals.csv
04:03:44:WU02:FS01:0x22:Saving result file positions.xtc
04:03:44:WU02:FS01:0x22:Saving result file science.log
04:03:44:WU02:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
04:03:44:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:03:45:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:13420 run:7457 clone:99 gen:0 core:0x22 unit:0x0000000012bc7d9a5f2249b3ab3b0638
04:03:45:WU02:FS01:Uploading 5.71MiB to 18.188.125.154
04:03:45:WU02:FS01:Connecting to 18.188.125.154:8080
04:03:51:WU02:FS01:Upload 58.04%
04:03:56:WU02:FS01:Upload complete
04:03:56:WU02:FS01:Server responded WORK_ACK (400)
04:03:56:WU02:FS01:Final credit estimate, 181355.00 points
04:03:56:WU02:FS01:Cleaning up
04:04:08:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:04:08:WU01:FS00:Connecting to assign1.foldingathome.org:80
04:04:09:WU01:FS00:Assigned to work server 192.0.2.1
04:04:09:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:04:09:WU01:FS00:Connecting to 192.0.2.1:8080
04:05:42:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:05:42:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:05:43:WU00:FS01:Assigned to work server 192.0.2.1
04:05:43:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:05:43:WU00:FS01:Connecting to 192.0.2.1:8080
04:06:19:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:06:19:WU01:FS00:Connecting to 192.0.2.1:80
04:07:53:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:07:53:WU00:FS01:Connecting to 192.0.2.1:80
04:08:30:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:08:31:WU01:FS00:Connecting to assign1.foldingathome.org:80
04:08:31:WU01:FS00:Assigned to work server 192.0.2.1
04:08:31:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:08:31:WU01:FS00:Connecting to 192.0.2.1:8080
04:10:04:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:10:05:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:10:05:WU00:FS01:Assigned to work server 192.0.2.1
04:10:05:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:10:05:WU00:FS01:Connecting to 192.0.2.1:8080
04:10:41:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:10:41:WU01:FS00:Connecting to 192.0.2.1:80
04:12:15:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:12:15:WU00:FS01:Connecting to 192.0.2.1:80
04:12:52:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:12:53:WU01:FS00:Connecting to assign1.foldingathome.org:80
04:12:53:WU01:FS00:Assigned to work server 192.0.2.1
04:12:53:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:12:53:WU01:FS00:Connecting to 192.0.2.1:8080
04:14:27:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:14:27:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:14:27:WU00:FS01:Assigned to work server 192.0.2.1
04:14:27:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:14:27:WU00:FS01:Connecting to 192.0.2.1:8080
04:15:03:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:15:03:WU01:FS00:Connecting to 192.0.2.1:80
04:16:38:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:16:38:WU00:FS01:Connecting to 192.0.2.1:80
04:17:15:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:18:49:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:18:49:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:18:49:WU00:FS01:Assigned to work server 192.0.2.1
04:18:49:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:18:49:WU00:FS01:Connecting to 192.0.2.1:8080
04:19:44:WU01:FS00:Connecting to assign1.foldingathome.org:80
04:19:44:WU01:FS00:Assigned to work server 192.0.2.1
04:19:44:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:19:44:WU01:FS00:Connecting to 192.0.2.1:8080
04:21:00:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:21:00:WU00:FS01:Connecting to 192.0.2.1:80
04:21:55:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:21:55:WU01:FS00:Connecting to 192.0.2.1:80
04:23:11:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:23:11:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:23:12:WU00:FS01:Assigned to work server 192.0.2.1
04:23:12:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:23:12:WU00:FS01:Connecting to 192.0.2.1:8080
04:24:06:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:25:22:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:25:22:WU00:FS01:Connecting to 192.0.2.1:80
04:27:33:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:30:02:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:30:03:WU00:FS01:Assigned to work server 192.0.2.1
04:30:03:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:30:03:WU00:FS01:Connecting to 192.0.2.1:8080
04:30:49:WU01:FS00:Connecting to assign1.foldingathome.org:80
04:30:50:WU01:FS00:Assigned to work server 192.0.2.1
04:30:50:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:30:50:WU01:FS00:Connecting to 192.0.2.1:8080
04:32:14:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:32:14:WU00:FS01:Connecting to 192.0.2.1:80
04:33:01:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:33:01:WU01:FS00:Connecting to 192.0.2.1:80
04:34:25:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:35:12:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:41:08:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:41:08:WU00:FS01:Assigned to work server 192.0.2.1
04:41:08:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:41:08:WU00:FS01:Connecting to 192.0.2.1:8080
04:43:19:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
04:43:19:WU00:FS01:Connecting to 192.0.2.1:80
04:45:30:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:48:46:WU01:FS00:Connecting to assign1.foldingathome.org:80
04:48:47:WU01:FS00:Assigned to work server 192.0.2.1
04:48:47:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:48:47:WU01:FS00:Connecting to 192.0.2.1:8080
04:50:58:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:50:58:WU01:FS00:Connecting to 192.0.2.1:80
04:53:09:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
04:59:05:WU00:FS01:Connecting to assign1.foldingathome.org:80
04:59:05:WU00:FS01:Assigned to work server 192.0.2.1
04:59:05:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
04:59:05:WU00:FS01:Connecting to 192.0.2.1:8080
05:01:16:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
05:01:16:WU00:FS01:Connecting to 192.0.2.1:80
05:03:28:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
05:17:49:WU01:FS00:Connecting to assign1.foldingathome.org:80
05:17:49:WU01:FS00:Assigned to work server 192.0.2.1
05:17:49:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
05:17:49:WU01:FS00:Connecting to 192.0.2.1:8080
05:19:59:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
05:19:59:WU01:FS00:Connecting to 192.0.2.1:80
05:22:10:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
05:28:07:WU00:FS01:Connecting to assign1.foldingathome.org:80
05:28:08:WU00:FS01:Assigned to work server 192.0.2.1
05:28:08:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
05:28:08:WU00:FS01:Connecting to 192.0.2.1:8080
05:30:17:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
05:30:17:WU00:FS01:Connecting to 192.0.2.1:80
05:32:28:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
06:04:47:WU01:FS00:Connecting to assign1.foldingathome.org:80
06:04:48:WU01:FS00:Assigned to work server 192.0.2.1
06:04:48:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
06:04:48:WU01:FS00:Connecting to 192.0.2.1:8080
06:06:59:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
06:06:59:WU01:FS00:Connecting to 192.0.2.1:80
06:09:10:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
06:15:06:WU00:FS01:Connecting to assign1.foldingathome.org:80
06:15:06:WU00:FS01:Assigned to work server 192.0.2.1
06:15:06:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
06:15:06:WU00:FS01:Connecting to 192.0.2.1:8080
06:17:17:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
06:17:17:WU00:FS01:Connecting to 192.0.2.1:80
06:19:28:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
******************************* Date: 2020-08-01 *******************************
07:04:48:WU01:FS00:Connecting to assign1.foldingathome.org:80
07:04:48:WU01:FS00:Assigned to work server 192.0.2.1
07:04:48:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
07:04:48:WU01:FS00:Connecting to 192.0.2.1:8080
07:06:59:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
07:06:59:WU01:FS00:Connecting to 192.0.2.1:80
07:09:10:ERROR:WU01:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
07:15:06:WU00:FS01:Connecting to assign1.foldingathome.org:80
07:15:07:WU00:FS01:Assigned to work server 192.0.2.1
07:15:07:WU00:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 192.0.2.1
07:15:07:WU00:FS01:Connecting to 192.0.2.1:8080
07:17:18:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
07:17:18:WU00:FS01:Connecting to 192.0.2.1:80
07:19:29:ERROR:WU00:FS01:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
Top
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Waiting for work on 192.0.2.1 ?

Post by Neil-B »

There have been some changes/alterations happening over the last weeks on GPUs.txt ... Something issue with that may be causing this effect - or possibly a driver update? ... I am however not a GPU guru so probably best to wait for more definitive responses !!
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
DocJonz
Posts: 244
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 4080 Super
Location: United Kingdom
Contact:
Contact DocJonz

Re: Waiting for work on 192.0.2.1 ?

Post by DocJonz »

Thanks Neil-B - whatever it was has kicked in while I was asleep - so no changes at my end (my Linux boxes are not set to auto update).
The second box of code above shows it started about 03:51 (BST), so maybe someone working late on Friday at the US end has inadvertently glitched something?
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
Top
foldingfanmucde
Posts: 18
Joined: Sat Aug 01, 2020 10:26 am
Hardware configuration: 1. AMD Ryzen 9 3900X / 64GB RAM / 2x NVIDIA RTX 2080 Ti / Win10 64 Pro / F@H 7.6.13 / ~6-8M PPD /
2. Intel Core i7 4790K / 32GB RAM / 1x AMD RX 5700 XT / Win10 64 Pro / F@H 7.6.21 / ~1-1.5M PPD /
Location: Munich, Germany

Re: Waiting for work on 192.0.2.1 ?

Post by foldingfanmucde »

Hi,
Starting from around 2am UTC on 1st August, I have the same issue with the work server IP 192.0.2.1 on a twin GPU system (Nvidia RTX 2080 Ti). The latest Nvidia drivers are installed. CPU work units on that system are [not] being assigned normally. Could it be that the work server IP address is within the "private" range allocation and not routed publicly (or similar)? => Seems to indicates some sort of misconfiguration. (Another system with [a single] AMD 5700 XT currently does not have the issue.)
Logfile extract attached.
Thanks and regards

Code: Select all

10:37:51:Removing old file 'logs/log-20200706-215743.txt'
10:37:51:Trying to access database...
10:37:51:Successfully acquired database lock
10:37:51:Read GPUs.txt
10:37:52:Enabled folding slot 00: PAUSED gpu:0:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 (by user)
10:37:52:Enabled folding slot 01: PAUSED gpu:1:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 (by user)
10:37:52:****************************** FAHClient ******************************
10:37:52:      Version: 7.6.13
10:37:52:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:37:52:    Copyright: 2020 foldingathome.org
10:37:52:     Homepage: https://foldingathome.org/
10:37:52:         Date: Apr 27 2020
10:37:52:         Time: 21:21:01
10:37:52:     Revision: 5a652817f46116b6e135503af97f18e094414e3b
10:37:52:       Branch: master
10:37:52:     Compiler: Visual C++ 2008
10:37:52:      Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:37:52:     Platform: win32 10
10:37:52:         Bits: 32
10:37:52:         Mode: Release
10:37:52:       Config: C:\Program Files (x86)\FAHClient\config.xml
10:37:52:******************************** CBang ********************************
10:37:52:         Date: Apr 24 2020
10:37:52:         Time: 17:07:55
10:37:52:     Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
10:37:52:       Branch: master
10:37:52:     Compiler: Visual C++ 2008
10:37:52:      Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:37:52:     Platform: win32 10
10:37:52:         Bits: 32
10:37:52:         Mode: Release
10:37:52:******************************* System ********************************
10:37:52:          CPU: AMD Ryzen 9 3900X 12-Core Processor
10:37:52:       CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
10:37:52:         CPUs: 24
10:37:52:       Memory: 63.92GiB
10:37:52:  Free Memory: 59.14GiB
10:37:52:      Threads: WINDOWS_THREADS
10:37:52:   OS Version: 6.2
10:37:52:  Has Battery: false
10:37:52:   On Battery: false
10:37:52:   UTC Offset: 2
10:37:52:          PID: 1456
10:37:52:          CWD: C:\Program Files (x86)\FAHClient
10:37:52:Win32 Service: false
10:37:52:           OS: Windows 10 Enterprise
10:37:52:      OS Arch: AMD64
10:37:52:         GPUs: 2
10:37:52:        GPU 0: Bus:12 Slot:0 Func:0 NVIDIA:8 TU102 [GeForce RTX 2080 Ti Rev. A]
10:37:52:               M 13448
10:37:52:        GPU 1: Bus:11 Slot:0 Func:0 NVIDIA:8 TU102 [GeForce RTX 2080 Ti Rev. A]
10:37:52:               M 13448
10:37:52:CUDA Device 0: Platform:0 Device:0 Bus:11 Slot:0 Compute:7.5 Driver:11.0
10:37:52:CUDA Device 1: Platform:0 Device:1 Bus:12 Slot:0 Compute:7.5 Driver:11.0
10:37:52:       OpenCL: Not detected: clGetDeviceIDs() returned -1
10:37:52:******************************* libFAH ********************************
10:37:52:         Date: Apr 15 2020
10:37:52:         Time: 14:53:14
10:37:52:     Revision: 216968bc7025029c841ed6e36e81a03a316890d3
10:37:52:       Branch: master
10:37:52:     Compiler: Visual C++ 2008
10:37:52:      Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:37:52:     Platform: win32 10
10:37:52:         Bits: 32
10:37:52:         Mode: Release
10:37:52:***********************************************************************
10:37:52:<config>
10:37:52:  <!-- Folding Core -->
10:37:52:  <checkpoint v='10'/>
10:37:52:  <core-priority v='low'/>
10:37:52:
10:37:52:  <!-- Folding Slot Configuration -->
10:37:52:  <cause v='COVID_19'/>
10:37:52:
10:37:52:  <!-- Network -->
10:37:52:  <proxy v=':8080'/>
10:37:52:
10:37:52:  <!-- Remote Command Server -->
10:37:52:  <password v='*****'/>
10:37:52:
10:37:52:  <!-- Slot Control -->
10:37:52:  <pause-on-start v='true'/>
10:37:52:  <power v='full'/>
10:37:52:
10:37:52:  <!-- User Information -->
10:37:52:  <passkey v='*****'/>
10:37:52:  <team v='TeamRemoved'/>
10:37:52:  <user v='UserRemoved'/>
10:37:52:
10:37:52:  <!-- Folding Slots -->
10:37:52:  <slot id='0' type='GPU'>
10:37:52:    <opencl-index v='0'/>
10:37:52:  </slot>
10:37:52:  <slot id='1' type='GPU'>
10:37:52:    <opencl-index v='1'/>
10:37:52:  </slot>
10:37:52:</config>
10:38:45:FS00:Unpaused
10:38:45:FS01:Unpaused
10:38:46:WU00:FS00:Connecting to assign1.foldingathome.org:80
10:38:46:WU01:FS01:Connecting to assign1.foldingathome.org:80
10:38:46:WU00:FS00:Assigned to work server 192.0.2.1
10:38:46:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 from 192.0.2.1
10:38:46:WU00:FS00:Connecting to 192.0.2.1:8080
10:38:46:WU01:FS01:Assigned to work server 192.0.2.1
10:38:46:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 from 192.0.2.1
10:38:46:WU01:FS01:Connecting to 192.0.2.1:8080
10:39:07:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
10:39:07:WU00:FS00:Connecting to 192.0.2.1:80
10:39:07:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
10:39:07:WU01:FS01:Connecting to 192.0.2.1:80
10:39:28:ERROR:WU00:FS00:Exception: Failed to connect to 192.0.2.1:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
10:39:28:WU00:FS00:Connecting to assign1.foldingathome.org:80
10:39:28:ERROR:WU01:FS01:Exception: Failed to connect to 192.0.2.1:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
10:39:29:WU00:FS00:Assigned to work server 192.0.2.1
10:39:29:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 from 192.0.2.1
10:39:29:WU00:FS00:Connecting to 192.0.2.1:8080
10:39:29:WU01:FS01:Connecting to assign1.foldingathome.org:80
10:39:29:WU01:FS01:Assigned to work server 192.0.2.1
10:39:29:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 from 192.0.2.1
10:39:29:WU01:FS01:Connecting to 192.0.2.1:8080
10:39:50:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
10:39:50:WU00:FS00:Connecting to 192.0.2.1:80
10:39:50:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
10:39:50:WU01:FS01:Connecting to 192.0.2.1:80
10:40:11:ERROR:WU00:FS00:Exception: Failed to connect to 192.0.2.1:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
10:40:11:ERROR:WU01:FS01:Exception: Failed to connect to 192.0.2.1:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
10:40:28:WU00:FS00:Connecting to assign1.foldingathome.org:80
10:40:29:WU00:FS00:Assigned to work server 192.0.2.1
10:40:29:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 from 192.0.2.1
10:40:29:WU00:FS00:Connecting to 192.0.2.1:8080
10:40:29:WU01:FS01:Connecting to assign1.foldingathome.org:80
10:40:29:WU01:FS01:Assigned to work server 192.0.2.1
10:40:29:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 from 192.0.2.1
10:40:29:WU01:FS01:Connecting to 192.0.2.1:8080
10:40:50:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
10:40:50:WU00:FS00:Connecting to 192.0.2.1:80
10:40:50:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
10:40:50:WU01:FS01:Connecting to 192.0.2.1:80
10:41:11:ERROR:WU00:FS00:Exception: Failed to connect to 192.0.2.1:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
10:41:11:ERROR:WU01:FS01:Exception: Failed to connect to 192.0.2.1:80: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht richtig reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
Last edited by foldingfanmucde on Sun Aug 02, 2020 12:39 pm, edited 1 time in total.
1. AMD Ryzen 9 3900X / 64GB RAM / 2x NVIDIA RTX 2080 Ti / Win10 64 Pro / F@H 7.6.13 / ~6-8M PPD /
2. Intel Core i7 4790K / 32GB RAM / 1x AMD RX 5700 XT / Win10 64 Pro / F@H 7.6.21 / ~1-1.5M PPD /
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Waiting for work on 192.0.2.1 ?

Post by bruce »

references to that IP SHOULD be accompanied with an error message explaining that there's some kind of a configration problem with your GPU. Maybe OpenCL has gotten uninstalled. Maybe you're trying to fold with an unsupported device. Maybe you tried to edit GPUs.txt Maybe you're using a laptop with Optimus and the GPU changed from nVidia to Intel. (etc.)

We can't help diagnose the problem without seeing the first couple hundred lines of FAH's log. (See below)
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Waiting for work on 192.0.2.1 ?

Post by bruce »

In the case shown above, I see:
foldingfanmucde wrote:

Code: Select all

10:37:52:Enabled folding slot 00: PAUSED gpu:0:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 (by user)
10:37:52:Enabled folding slot 01: PAUSED gpu:1:TU102 [GeForce RTX 2080 Ti Rev. A] M 13448 (by user)
...
10:37:52:******************************* System ********************************
...
10:37:52:         GPUs: 2
10:37:52:        GPU 0: Bus:12 Slot:0 Func:0 NVIDIA:8 TU102 [GeForce RTX 2080 Ti Rev. A] M 13448
10:37:52:        GPU 1: Bus:11 Slot:0 Func:0 NVIDIA:8 TU102 [GeForce RTX 2080 Ti Rev. A] M 13448
10:37:52:CUDA Device 0: Platform:0 Device:0 Bus:11 Slot:0 Compute:7.5 Driver:11.0
10:37:52:CUDA Device 1: Platform:0 Device:1 Bus:12 Slot:0 Compute:7.5 Driver:11.0
10:37:52:       OpenCL: Not detected: clGetDeviceIDs() returned -1
and the critical message is that OpenCL is not installed. That means that you need to download and install the drivers for your GPUs directly from the nVidia.com site as their driver package includes OpenCL.

Even if you've been previously folding with those drivers, from time-to-time Microsoft will update your drivers and when they do they REMOVE a previously installed OpenCL package. The problem is NOT due to changes made to GPUs.txt.
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: Waiting for work on 192.0.2.1 ?

Post by JimboPalmer »

https://www.nvidia.com/en-us/drivers/results/162105/

may well be the correct driver
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
DocJonz
Posts: 244
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 4080 Super
Location: United Kingdom
Contact:
Contact DocJonz

Re: Waiting for work on 192.0.2.1 ?

Post by DocJonz »

I have looked at my five Folding rigs - the four with dual GPUs suddenly seemed to have F@H not detecting OpenCL in the night (the log in the first post shows it was Folding fine until then), whereas the one rig with a single GPU remained running OK.
All five rigs have the same Ubuntu 18.04.4 build with no auto updates, all running v440 nVidia drivers (have been using this driver since January) - all were Folding fine until the middle of last night. Makes no sense to me.

For those who hit the same problem, I (re)installed OpenCL using;

Code: Select all

sudo apt install ocl-icd-opencl-dev
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Waiting for work on 192.0.2.1 ?

Post by bruce »

(Sorry. I assumed Windows, not Linux when I mentioned the driver package. I should have checked.)

There must be some connection with single vs dual GPUs, but I have no ideal how or why OpenCL got uninstalled/disabled/whatever. Do you happen to have more than one OpenCL version on those systems?
Top
foldingfanmucde
Posts: 18
Joined: Sat Aug 01, 2020 10:26 am
Hardware configuration: 1. AMD Ryzen 9 3900X / 64GB RAM / 2x NVIDIA RTX 2080 Ti / Win10 64 Pro / F@H 7.6.13 / ~6-8M PPD /
2. Intel Core i7 4790K / 32GB RAM / 1x AMD RX 5700 XT / Win10 64 Pro / F@H 7.6.21 / ~1-1.5M PPD /
Location: Munich, Germany

Re: Waiting for work on 192.0.2.1 ?

Post by foldingfanmucde »

Thanks bruce and JimboPalmer for the hints/troubleshooting.

The driver JimboPalmer posted is the exact one I am using.
In fact, to make sure, I just removed it and reinstalled it completely (not just updating) and rebooted. (Win 10 64bit).
All to no avail, I'm still getting the message: " OpenCL: Not detected: clGetDeviceIDs() returned -1 "

What puzzles me ist that everthing was running fine until around 2am UTC last night.
There were no Windows updates, no restarts, no config changes made by me, nothing. It just came out of the blue.
So somehow I get the feeling it's not (only) related to the drivers and/or Windows.
That also seems to be supported by DocJonz post - he is using Ubuntu, not Windows, but is encounterng the same issue.
BTW: my system is also a dual GPU system, like the ones DocJonz mentioned. Is that a clue?

Addtional info, that now comes to mind and may be helpful:
When provisioning GPU slots (back when things were still working) I was never able to use the default "-1" value for the parameter opencl-index,
instead I would have to set opencl-index = 0 for the first GPU and opencl-index = 1 for the second.
If I did not do it that way, then I would always get an error message stating that openCL is not installed.

Any other ideas?

Many thanks.

Update: to my knowledge there is not more than one openCL version on my Win10 system - not sure that is even possible within windows. Ist there a way for me to verify that?
Update 2: going by the low scores in the ranking lists in the last 12 hours, this issue (or maybe related issue) seems to be affecting quite some folders.
1. AMD Ryzen 9 3900X / 64GB RAM / 2x NVIDIA RTX 2080 Ti / Win10 64 Pro / F@H 7.6.13 / ~6-8M PPD /
2. Intel Core i7 4790K / 32GB RAM / 1x AMD RX 5700 XT / Win10 64 Pro / F@H 7.6.21 / ~1-1.5M PPD /
Top
DocJonz
Posts: 244
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 4080 Super
Location: United Kingdom
Contact:
Contact DocJonz

Re: Waiting for work on 192.0.2.1 ?

Post by DocJonz »

@bruce - all had the same OpenCL version - the entire software builds are the same.

@foldingfanmucde - I always get this as well (see below) when setting up a new rig for Folding (I knocked one up a few weeks ago; Frankenstein build and had the same issue).
I just assume it is a bug in the code that hasn't been fixed yet.
foldingfanmucde wrote: When provisioning GPU slots (back when things were still working) I was never able to use the default "-1" value for the parameter opencl-index,
instead I would have to set opencl-index = 0 for the first GPU and opencl-index = 1 for the second.
If I did not do it that way, then I would always get an error message stating that openCL is not installed.
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
Top
Joe_H
Site Admin
Posts: 7936
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Waiting for work on 192.0.2.1 ?

Post by Joe_H »

foldingfanmucde wrote:Update: to my knowledge there is not more than one openCL version on my Win10 system - not sure that is even possible within windows. Ist there a way for me to verify that?
It is possible to have more than one OpenCL version, for instance it can be installed to support both the CPU and iGPU on an Intel processor. Or you could have two versions installed to support an AMD GPU (OpenCL 2) alongside one from nVidia (OpenCL 1.2 max).

As for checking, not a Windows person, but recall someone posting about checking in the registry to see what is installed and active. This came up sometime back when early versions of Intel OpenCL support could sometimes interfere with use of OpenCL on AMD or nVidia discrete GPU cards.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Top
ZePompom
Posts: 50
Joined: Tue Apr 21, 2020 1:16 pm
Hardware configuration: Ryzen 5 2600
Gigabyte B450M DS3H
16GB G.Skill DDR4
MSI GTX 1660 6GB
Location: France

Re: Waiting for work on 192.0.2.1 ?

Post by ZePompom »

Hello.

I have the very same issue since today, with a nvidia P106-90 under unbuntu 20.04,it worked just fine until now.

I reinstalled fahclient, with reset of config file, then reinstalled nvidia-driver-440, made a reboot, but it doesn't seem to work, still stuck with 192.0.2.1 assignement.

Code: Select all

17:38:27:WU00:FS00:Connecting to assign1.foldingathome.org:80
17:38:28:WU00:FS00:Assigned to work server 192.0.2.1
17:38:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GP106 [P106-090] from 192.0.2.1
17:38:28:WU00:FS00:Connecting to 192.0.2.1:8080
17:40:37:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
17:40:37:WU00:FS00:Connecting to 192.0.2.1:80
17:42:48:ERROR:WU00:FS00:Exception: Failed to connect to 192.0.2.1:80: Connection timed out
17:42:48:WU00:FS00:Connecting to assign1.foldingathome.org:80
17:42:49:WU00:FS00:Assigned to work server 192.0.2.1
17:42:49:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GP106 [P106-090] from 192.0.2.1
17:42:49:WU00:FS00:Connecting to 192.0.2.1:8080

Code: Select all

*********************** Log Started 2020-08-01T17:38:26Z ***********************
17:38:26:Trying to access database...
17:38:26:Successfully acquired database lock
17:38:26:Read GPUs.txt
17:38:27:Enabled folding slot 00: READY gpu:0:GP106 [P106-090]
17:38:27:****************************** FAHClient ******************************
17:38:27:      Version: 7.6.13
17:38:27:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:38:27:    Copyright: 2020 foldingathome.org
17:38:27:     Homepage: https://foldingathome.org/
17:38:27:         Date: Apr 28 2020
17:38:27:         Time: 04:20:16
17:38:27:     Revision: 5a652817f46116b6e135503af97f18e094414e3b
17:38:27:       Branch: master
17:38:27:     Compiler: GNU 8.3.0
17:38:27:      Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:38:27:               -fno-pie
17:38:27:     Platform: linux2 4.19.0-5-amd64
17:38:27:         Bits: 64
17:38:27:         Mode: Release
17:38:27:         Args: --child /etc/fahclient/config.xml --run-as fahclient
17:38:27:               --pid-file=/var/run/fahclient.pid --daemon
17:38:27:       Config: /etc/fahclient/config.xml
17:38:27:******************************** CBang ********************************
17:38:27:         Date: Apr 25 2020
17:38:27:         Time: 00:07:53
17:38:27:     Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
17:38:27:       Branch: master
17:38:27:     Compiler: GNU 8.3.0
17:38:27:      Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:38:27:               -fno-pie -fPIC
17:38:27:     Platform: linux2 4.19.0-5-amd64
17:38:27:         Bits: 64
17:38:27:         Mode: Release
17:38:27:******************************* System ********************************
17:38:27:          CPU: AMD Athlon 200GE with Radeon Vega Graphics
17:38:27:       CPU ID: AuthenticAMD Family 23 Model 17 Stepping 0
17:38:27:         CPUs: 4
17:38:27:       Memory: 29.40GiB
17:38:27:  Free Memory: 25.36GiB
17:38:27:      Threads: POSIX_THREADS
17:38:27:   OS Version: 5.4
17:38:27:  Has Battery: false
17:38:27:   On Battery: false
17:38:27:   UTC Offset: 2
17:38:27:          PID: 1869
17:38:27:          CWD: /var/lib/fahclient
17:38:27:           OS: Linux 5.4.0-42-generic x86_64
17:38:27:      OS Arch: AMD64
17:38:27:         GPUs: 2
17:38:27:        GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:7 GP106 [P106-090]
17:38:27:        GPU 1: Bus:9 Slot:0 Func:0 AMD:5 Raven [Ryzen vega 8 mobile]
17:38:27:CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:10.2
17:38:27:       OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.so':
17:38:27:               libOpenCL.so: cannot open shared object file: No such file or
17:38:27:               directory
17:38:27:******************************* libFAH ********************************
17:38:27:         Date: Apr 15 2020
17:38:27:         Time: 21:43:24
17:38:27:     Revision: 216968bc7025029c841ed6e36e81a03a316890d3
17:38:27:       Branch: master
17:38:27:     Compiler: GNU 8.3.0
17:38:27:      Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:38:27:               -fno-pie
17:38:27:     Platform: linux2 4.19.0-5-amd64
17:38:27:         Bits: 64
17:38:27:         Mode: Release
17:38:27:***********************************************************************
17:38:27:<config>
17:38:27:  <!-- Client Control -->
17:38:27:  <fold-anon v='true'/>
17:38:27:
17:38:27:  <!-- Folding Slot Configuration -->
17:38:27:  <gpu v='false'/>
17:38:27:
17:38:27:  <!-- HTTP Server -->
17:38:27:  <allow v='127.0.0.1 192.168.0.0/16'/>
17:38:27:
17:38:27:  <!-- Network -->
17:38:27:  <proxy v=':8080'/>
17:38:27:
17:38:27:  <!-- Remote Command Server -->
17:38:27:  <password v='*****'/>
17:38:27:
17:38:27:  <!-- User Information -->
17:38:27:  <passkey v='*****'/>
17:38:27:  <team v='223518'/>
17:38:27:  <user v='ZePompom'/>
17:38:27:
17:38:27:  <!-- Folding Slots -->
17:38:27:  <slot id='0' type='GPU'>
17:38:27:    <opencl-index v='0'/>
17:38:27:  </slot>
17:38:27:</config>

Any idea? I assembled this folding machine not so long ago, I would be stonned it doesnt work anymore already because can't get an assignment :?

Thank you in advance.


P.S : Already had the 'OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.so':' error before, even if OpenCL is indeed installed, but I was still able to fold by setting opencl-index to 0.


EDIT : I found this topic : https://askubuntu.com/questions/796770/ ... -on-ubuntu

So I was able to install the ocl-icd-opencl-dev package, restart FAH client, and seem it's back on track, worked without it before but seem it's not the case anymore :eo
Last edited by ZePompom on Sat Aug 01, 2020 5:48 pm, edited 4 times in total.
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Waiting for work on 192.0.2.1 ?

Post by bruce »

foldingfanmucde wrote: Any other ideas?
We have added some entries to GPUs.txt for Intel iGPUs. (They are currently not supported except for a little back-room testing.) I hdon't remember any comments from Linux folks, but the addition of the entries has caused some problems in Windows where the index values changed.
Top
goodyca
Posts: 187
Joined: Sun Dec 02, 2007 12:36 pm

server 192.0.2.1 status

Post by goodyca »

I am not able to connect to the subject server with a web browser, and it is not shown on the FAH Server Status page at https://apps.foldingathome.org/serverstats

Is the subject server currently on-line and working?
Top
Post Reply

Return to “Issues with a specific server”