Page 1 of 1

Project: 14719 (Run 802, Clone 4, Gen 0) GROMACS Error

Posted: Sun Jul 26, 2020 4:33 pm
by HendricksSA
Project: 14719 (Run 802, Clone 4, Gen 0) is stuck on my 48 thread server with this error. Any way I can process this or should I get rid of it? I have not seen this error before. Log extract follows:

Code: Select all

15:03:18:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14719 run:802 clone:4 gen:0 core:0xa7 unit:0x000000022879986c5ea9670ab49b086c
15:03:18:WU01:FS00:Starting
15:03:18:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
15:03:18:WU01:FS00:Started FahCore on PID 14407
15:03:18:WU01:FS00:Core PID:14411
15:03:18:WU01:FS00:FahCore 0xa7 started
15:03:18:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T15:03:18Z ***********************
15:03:18:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:03:18:WU01:FS00:0xa7:       Type: 0xa7
15:03:18:WU01:FS00:0xa7:       Core: Gromacs
15:03:18:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14407 -checkpoint 15 -np
15:03:18:WU01:FS00:0xa7:             48
15:03:18:WU01:FS00:0xa7:************************************ CBang *************************************
15:03:18:WU01:FS00:0xa7:       Date: Nov 27 2019
15:03:18:WU01:FS00:0xa7:       Time: 11:26:54
15:03:18:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
15:03:18:WU01:FS00:0xa7:     Branch: master
15:03:18:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:18:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:18:WU01:FS00:0xa7:             -fno-pie -fPIC
15:03:18:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:18:WU01:FS00:0xa7:       Bits: 64
15:03:18:WU01:FS00:0xa7:       Mode: Release
15:03:18:WU01:FS00:0xa7:************************************ System ************************************
15:03:18:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
15:03:18:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:03:18:WU01:FS00:0xa7:       CPUs: 48
15:03:18:WU01:FS00:0xa7:     Memory: 62.80GiB
15:03:18:WU01:FS00:0xa7:Free Memory: 59.87GiB
15:03:18:WU01:FS00:0xa7:    Threads: POSIX_THREADS
15:03:18:WU01:FS00:0xa7: OS Version: 5.3
15:03:18:WU01:FS00:0xa7:Has Battery: false
15:03:18:WU01:FS00:0xa7: On Battery: false
15:03:18:WU01:FS00:0xa7: UTC Offset: -5
15:03:18:WU01:FS00:0xa7:        PID: 14411
15:03:18:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
15:03:18:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
15:03:18:WU01:FS00:0xa7:    Version: 0.0.19
15:03:18:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:03:18:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
15:03:18:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
15:03:18:WU01:FS00:0xa7:       Date: Nov 26 2019
15:03:18:WU01:FS00:0xa7:       Time: 00:41:42
15:03:18:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
15:03:18:WU01:FS00:0xa7:     Branch: master
15:03:18:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:18:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:18:WU01:FS00:0xa7:             -fno-pie
15:03:18:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:18:WU01:FS00:0xa7:       Bits: 64
15:03:18:WU01:FS00:0xa7:       Mode: Release
15:03:18:WU01:FS00:0xa7:************************************ Build *************************************
15:03:18:WU01:FS00:0xa7:       SIMD: avx_256
15:03:18:WU01:FS00:0xa7:********************************************************************************
15:03:18:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
15:03:18:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
15:03:18:WU01:FS00:0xa7:Reading tar file core.xml
15:03:18:WU01:FS00:0xa7:Reading tar file frame0.tpr
15:03:18:WU01:FS00:0xa7:Digital signatures verified
15:03:18:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
15:03:18:WU01:FS00:0xa7:Steps: first=0 total=250000
15:03:20:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
15:03:23:WU00:FS00:Upload 79.17%
15:03:23:WU01:FS00:0xa7:ERROR:
15:03:23:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:03:24:WU01:FS00:Starting
15:03:24:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
15:03:24:WU01:FS00:Started FahCore on PID 14463
15:03:24:WU01:FS00:Core PID:14467
15:03:24:WU01:FS00:FahCore 0xa7 started
15:03:24:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T15:03:24Z ***********************
15:03:24:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:03:24:WU01:FS00:0xa7:       Type: 0xa7
15:03:24:WU01:FS00:0xa7:       Core: Gromacs
15:03:24:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14463 -checkpoint 15 -np
15:03:24:WU01:FS00:0xa7:             48
15:03:24:WU01:FS00:0xa7:************************************ CBang *************************************
15:03:24:WU01:FS00:0xa7:       Date: Nov 27 2019
15:03:24:WU01:FS00:0xa7:       Time: 11:26:54
15:03:24:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
15:03:24:WU01:FS00:0xa7:     Branch: master
15:03:24:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:24:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:24:WU01:FS00:0xa7:             -fno-pie -fPIC
15:03:24:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:24:WU01:FS00:0xa7:       Bits: 64
15:03:24:WU01:FS00:0xa7:       Mode: Release
15:03:24:WU01:FS00:0xa7:************************************ System ************************************
15:03:24:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
15:03:24:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:03:24:WU01:FS00:0xa7:       CPUs: 48
15:03:24:WU01:FS00:0xa7:     Memory: 62.80GiB
15:03:24:WU01:FS00:0xa7:Free Memory: 59.86GiB
15:03:24:WU01:FS00:0xa7:    Threads: POSIX_THREADS
15:03:24:WU01:FS00:0xa7: OS Version: 5.3
15:03:24:WU01:FS00:0xa7:Has Battery: false
15:03:24:WU01:FS00:0xa7: On Battery: false
15:03:24:WU01:FS00:0xa7: UTC Offset: -5
15:03:24:WU01:FS00:0xa7:        PID: 14467
15:03:24:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
15:03:24:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
15:03:24:WU01:FS00:0xa7:    Version: 0.0.19
15:03:24:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:03:24:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
15:03:24:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
15:03:24:WU01:FS00:0xa7:       Date: Nov 26 2019
15:03:24:WU01:FS00:0xa7:       Time: 00:41:42
15:03:24:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
15:03:24:WU01:FS00:0xa7:     Branch: master
15:03:24:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:24:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:24:WU01:FS00:0xa7:             -fno-pie
15:03:24:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:24:WU01:FS00:0xa7:       Bits: 64
15:03:24:WU01:FS00:0xa7:       Mode: Release
15:03:24:WU01:FS00:0xa7:************************************ Build *************************************
15:03:24:WU01:FS00:0xa7:       SIMD: avx_256
15:03:24:WU01:FS00:0xa7:********************************************************************************
15:03:24:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
15:03:24:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
15:03:24:WU01:FS00:0xa7:Digital signatures verified
15:03:24:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
15:03:24:WU01:FS00:0xa7:Steps: first=0 total=250000
15:03:25:WU00:FS00:Upload complete
15:03:25:WU00:FS00:Server responded WORK_ACK (400)
15:03:25:WU00:FS00:Final credit estimate, 9043.00 points
15:03:25:WU00:FS00:Cleaning up
15:03:26:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
15:03:29:WU01:FS00:0xa7:ERROR:
15:03:29:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
15:03:29:WU01:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
15:03:29:WU01:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/expanded.c, line: 946
15:03:29:WU01:FS00:0xa7:ERROR:
15:03:29:WU01:FS00:0xa7:ERROR:Fatal error:
15:03:29:WU01:FS00:0xa7:ERROR:Something wrong in choosing new lambda state with a Gibbs move -- probably underflow in weight determination.
15:03:29:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:04:24:WU01:FS00:Starting
15:04:24:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
15:04:24:WU01:FS00:Started FahCore on PID 14520
15:04:24:WU01:FS00:Core PID:14524
15:04:24:WU01:FS00:FahCore 0xa7 started
15:04:24:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T15:04:24Z ***********************
15:04:24:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:04:24:WU01:FS00:0xa7:       Type: 0xa7
15:04:24:WU01:FS00:0xa7:       Core: Gromacs
15:04:24:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14520 -checkpoint 15 -np
15:04:24:WU01:FS00:0xa7:             48
15:04:24:WU01:FS00:0xa7:************************************ CBang *********************************
... errors continue ...
16:20:26:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
16:20:26:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
16:20:26:WU01:FS00:0xa7:Digital signatures verified
16:20:26:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
16:20:26:WU01:FS00:0xa7:Steps: first=0 total=250000
16:20:28:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
16:20:31:WU01:FS00:0xa7:ERROR:
16:20:31:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
16:20:31:WU01:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
16:20:31:WU01:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/expanded.c, line: 946
16:20:31:WU01:FS00:0xa7:ERROR:
16:20:31:WU01:FS00:0xa7:ERROR:Fatal error:
16:20:31:WU01:FS00:0xa7:ERROR:Something wrong in choosing new lambda state with a Gibbs move -- probably underflow in weight determination.
16:20:31:WU01:FS00:0xa7:ERROR:Denominator is:   0 1.0000000000e+00
16:20:31:WU01:FS00:0xa7:ERROR:  i                dE        numerator          weights
16:20:31:WU01:FS00:0xa7:ERROR:  0  0.0000000000e+00 1.0000000000e+00 0.0000000000e+00
16:20:31:WU01:FS00:0xa7:ERROR:  1 -3.5460235596e+01 3.9793794585e-16 1.0000000000e+01
16:20:31:WU01:FS00:0xa7:ERROR:  2 -7.0920471191e+01 1.5835460875e-31 1.0000000000e+01
16:20:31:WU01:FS00:0xa7:ERROR:  3 -1.0638024139e+02 6.3044641435e-47 1.0000000000e+01
16:20:32:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)

Re: Project: 14719 (Run 802, Clone 4, Gen 0) GROMACS Error

Posted: Mon Jul 27, 2020 2:48 am
by bruce
You should dump it.

Acording to the WU app, that WU has been reissued several times and successfully completed. Only one error was reported.

Re: Project: 14719 (Run 802, Clone 4, Gen 0) GROMACS Error

Posted: Mon Jul 27, 2020 5:18 am
by HendricksSA
If at first you don't succeed ...

After nearly three hours of trying to do this work unit, my computer finally went right through it without problems and successfully completed it. Bruce, I am at a loss to explain this one.

Code: Select all

17:05:27:WU01:FS00:Starting
17:05:27:WU01:FS00:Removing old file 'work/01/logfile_01-20200726-163326.txt'
17:05:27:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
17:05:27:WU01:FS00:Started FahCore on PID 21734
17:05:27:WU01:FS00:Core PID:21738
17:05:27:WU01:FS00:FahCore 0xa7 started
17:05:28:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T17:05:27Z ***********************
17:05:28:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:05:28:WU01:FS00:0xa7:       Type: 0xa7
17:05:28:WU01:FS00:0xa7:       Core: Gromacs
17:05:28:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 21734 -checkpoint 15 -np
17:05:28:WU01:FS00:0xa7:             48
17:05:28:WU01:FS00:0xa7:************************************ CBang *************************************
17:05:28:WU01:FS00:0xa7:       Date: Nov 27 2019
17:05:28:WU01:FS00:0xa7:       Time: 11:26:54
17:05:28:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
17:05:28:WU01:FS00:0xa7:     Branch: master
17:05:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:05:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:05:28:WU01:FS00:0xa7:             -fno-pie -fPIC
17:05:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:05:28:WU01:FS00:0xa7:       Bits: 64
17:05:28:WU01:FS00:0xa7:       Mode: Release
17:05:28:WU01:FS00:0xa7:************************************ System ************************************
17:05:28:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
17:05:28:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
17:05:28:WU01:FS00:0xa7:       CPUs: 48
17:05:28:WU01:FS00:0xa7:     Memory: 62.80GiB
17:05:28:WU01:FS00:0xa7:Free Memory: 60.50GiB
17:05:28:WU01:FS00:0xa7:    Threads: POSIX_THREADS
17:05:28:WU01:FS00:0xa7: OS Version: 5.3
17:05:28:WU01:FS00:0xa7:Has Battery: false
17:05:28:WU01:FS00:0xa7: On Battery: false
17:05:28:WU01:FS00:0xa7: UTC Offset: -5
17:05:28:WU01:FS00:0xa7:        PID: 21738
17:05:28:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
17:05:28:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:05:28:WU01:FS00:0xa7:    Version: 0.0.19
17:05:28:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:05:28:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:05:28:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:05:28:WU01:FS00:0xa7:       Date: Nov 26 2019
17:05:28:WU01:FS00:0xa7:       Time: 00:41:42
17:05:28:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
17:05:28:WU01:FS00:0xa7:     Branch: master
17:05:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:05:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:05:28:WU01:FS00:0xa7:             -fno-pie
17:05:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:05:28:WU01:FS00:0xa7:       Bits: 64
17:05:28:WU01:FS00:0xa7:       Mode: Release
17:05:28:WU01:FS00:0xa7:************************************ Build *************************************
17:05:28:WU01:FS00:0xa7:       SIMD: avx_256
17:05:28:WU01:FS00:0xa7:********************************************************************************
17:05:28:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
17:05:28:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
17:05:28:WU01:FS00:0xa7:Digital signatures verified
17:05:28:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
17:05:28:WU01:FS00:0xa7:Steps: first=0 total=250000
17:05:30:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
17:05:33:WU01:FS00:0xa7:ERROR:
17:05:33:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
17:05:33:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
17:06:27:WU01:FS00:Starting
17:06:27:WU01:FS00:Removing old file 'work/01/logfile_01-20200726-163426.txt'
17:06:27:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
17:06:27:WU01:FS00:Started FahCore on PID 21790
17:06:27:WU01:FS00:Core PID:21794
17:06:27:WU01:FS00:FahCore 0xa7 started
17:06:28:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T17:06:27Z ***********************
17:06:28:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:06:28:WU01:FS00:0xa7:       Type: 0xa7
17:06:28:WU01:FS00:0xa7:       Core: Gromacs
17:06:28:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 21790 -checkpoint 15 -np
17:06:28:WU01:FS00:0xa7:             48
17:06:28:WU01:FS00:0xa7:************************************ CBang *************************************
17:06:28:WU01:FS00:0xa7:       Date: Nov 27 2019
17:06:28:WU01:FS00:0xa7:       Time: 11:26:54
17:06:28:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
17:06:28:WU01:FS00:0xa7:     Branch: master
17:06:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:06:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:06:28:WU01:FS00:0xa7:             -fno-pie -fPIC
17:06:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:06:28:WU01:FS00:0xa7:       Bits: 64
17:06:28:WU01:FS00:0xa7:       Mode: Release
17:06:28:WU01:FS00:0xa7:************************************ System ************************************
17:06:28:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
17:06:28:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
17:06:28:WU01:FS00:0xa7:       CPUs: 48
17:06:28:WU01:FS00:0xa7:     Memory: 62.80GiB
17:06:28:WU01:FS00:0xa7:Free Memory: 60.50GiB
17:06:28:WU01:FS00:0xa7:    Threads: POSIX_THREADS
17:06:28:WU01:FS00:0xa7: OS Version: 5.3
17:06:28:WU01:FS00:0xa7:Has Battery: false
17:06:28:WU01:FS00:0xa7: On Battery: false
17:06:28:WU01:FS00:0xa7: UTC Offset: -5
17:06:28:WU01:FS00:0xa7:        PID: 21794
17:06:28:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
17:06:28:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:06:28:WU01:FS00:0xa7:    Version: 0.0.19
17:06:28:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
17:06:28:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:06:28:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:06:28:WU01:FS00:0xa7:       Date: Nov 26 2019
17:06:28:WU01:FS00:0xa7:       Time: 00:41:42
17:06:28:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
17:06:28:WU01:FS00:0xa7:     Branch: master
17:06:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:06:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:06:28:WU01:FS00:0xa7:             -fno-pie
17:06:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:06:28:WU01:FS00:0xa7:       Bits: 64
17:06:28:WU01:FS00:0xa7:       Mode: Release
17:06:28:WU01:FS00:0xa7:************************************ Build *************************************
17:06:28:WU01:FS00:0xa7:       SIMD: avx_256
17:06:28:WU01:FS00:0xa7:********************************************************************************
17:06:28:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
17:06:28:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
17:06:28:WU01:FS00:0xa7:Digital signatures verified
17:06:28:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
17:06:28:WU01:FS00:0xa7:Steps: first=0 total=250000
17:06:30:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
17:06:56:WU01:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
17:07:22:WU01:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
17:07:50:WU01:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
17:08:16:WU01:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
17:08:41:WU01:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
17:09:06:WU01:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
17:09:32:WU01:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
17:09:55:WU01:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
17:10:18:WU01:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
17:10:40:WU01:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
17:11:03:WU01:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
17:11:26:WU01:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
17:11:48:WU01:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
17:12:10:WU01:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
17:12:32:WU01:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
17:12:53:WU01:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
17:13:16:WU01:FS00:0xa7:Completed 42500 out of 250000 steps (17%)
17:13:38:WU01:FS00:0xa7:Completed 45000 out of 250000 steps (18%)
17:14:00:WU01:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
17:14:24:WU01:FS00:0xa7:Completed 50000 out of 250000 steps (20%)
17:14:47:WU01:FS00:0xa7:Completed 52500 out of 250000 steps (21%)
17:15:11:WU01:FS00:0xa7:Completed 55000 out of 250000 steps (22%)
17:15:34:WU01:FS00:0xa7:Completed 57500 out of 250000 steps (23%)
17:15:58:WU01:FS00:0xa7:Completed 60000 out of 250000 steps (24%)
17:16:22:WU01:FS00:0xa7:Completed 62500 out of 250000 steps (25%)
17:16:45:WU01:FS00:0xa7:Completed 65000 out of 250000 steps (26%)
17:17:10:WU01:FS00:0xa7:Completed 67500 out of 250000 steps (27%)
17:17:34:WU01:FS00:0xa7:Completed 70000 out of 250000 steps (28%)
17:17:57:WU01:FS00:0xa7:Completed 72500 out of 250000 steps (29%)
17:18:20:WU01:FS00:0xa7:Completed 75000 out of 250000 steps (30%)
17:18:44:WU01:FS00:0xa7:Completed 77500 out of 250000 steps (31%)
17:19:09:WU01:FS00:0xa7:Completed 80000 out of 250000 steps (32%)
17:19:33:WU01:FS00:0xa7:Completed 82500 out of 250000 steps (33%)
17:20:00:WU01:FS00:0xa7:Completed 85000 out of 250000 steps (34%)
17:20:26:WU01:FS00:0xa7:Completed 87500 out of 250000 steps (35%)
17:20:49:WU01:FS00:0xa7:Completed 90000 out of 250000 steps (36%)
17:21:16:WU01:FS00:0xa7:Completed 92500 out of 250000 steps (37%)
17:21:43:WU01:FS00:0xa7:Completed 95000 out of 250000 steps (38%)
17:22:07:WU01:FS00:0xa7:Completed 97500 out of 250000 steps (39%)
17:22:31:WU01:FS00:0xa7:Completed 100000 out of 250000 steps (40%)
17:22:55:WU01:FS00:0xa7:Completed 102500 out of 250000 steps (41%)
17:23:20:WU01:FS00:0xa7:Completed 105000 out of 250000 steps (42%)
17:23:46:WU01:FS00:0xa7:Completed 107500 out of 250000 steps (43%)
17:24:12:WU01:FS00:0xa7:Completed 110000 out of 250000 steps (44%)
17:24:38:WU01:FS00:0xa7:Completed 112500 out of 250000 steps (45%)
17:25:04:WU01:FS00:0xa7:Completed 115000 out of 250000 steps (46%)
17:25:26:WU01:FS00:0xa7:Completed 117500 out of 250000 steps (47%)
17:25:53:WU01:FS00:0xa7:Completed 120000 out of 250000 steps (48%)
17:26:18:WU01:FS00:0xa7:Completed 122500 out of 250000 steps (49%)
17:26:40:WU01:FS00:0xa7:Completed 125000 out of 250000 steps (50%)
17:27:02:WU01:FS00:0xa7:Completed 127500 out of 250000 steps (51%)
17:27:23:WU01:FS00:0xa7:Completed 130000 out of 250000 steps (52%)
17:27:45:WU01:FS00:0xa7:Completed 132500 out of 250000 steps (53%)
17:28:08:WU01:FS00:0xa7:Completed 135000 out of 250000 steps (54%)
17:28:30:WU01:FS00:0xa7:Completed 137500 out of 250000 steps (55%)
17:28:53:WU01:FS00:0xa7:Completed 140000 out of 250000 steps (56%)
17:29:16:WU01:FS00:0xa7:Completed 142500 out of 250000 steps (57%)
17:29:39:WU01:FS00:0xa7:Completed 145000 out of 250000 steps (58%)
17:30:02:WU01:FS00:0xa7:Completed 147500 out of 250000 steps (59%)
17:30:26:WU01:FS00:0xa7:Completed 150000 out of 250000 steps (60%)
17:30:51:WU01:FS00:0xa7:Completed 152500 out of 250000 steps (61%)
17:31:14:WU01:FS00:0xa7:Completed 155000 out of 250000 steps (62%)
17:31:38:WU01:FS00:0xa7:Completed 157500 out of 250000 steps (63%)
17:32:03:WU01:FS00:0xa7:Completed 160000 out of 250000 steps (64%)
17:32:28:WU01:FS00:0xa7:Completed 162500 out of 250000 steps (65%)
17:32:52:WU01:FS00:0xa7:Completed 165000 out of 250000 steps (66%)
17:33:15:WU01:FS00:0xa7:Completed 167500 out of 250000 steps (67%)
17:33:37:WU01:FS00:0xa7:Completed 170000 out of 250000 steps (68%)
17:33:58:WU01:FS00:0xa7:Completed 172500 out of 250000 steps (69%)
17:34:19:WU01:FS00:0xa7:Completed 175000 out of 250000 steps (70%)
17:34:42:WU01:FS00:0xa7:Completed 177500 out of 250000 steps (71%)
17:35:04:WU01:FS00:0xa7:Completed 180000 out of 250000 steps (72%)
17:35:26:WU01:FS00:0xa7:Completed 182500 out of 250000 steps (73%)
17:35:49:WU01:FS00:0xa7:Completed 185000 out of 250000 steps (74%)
17:36:13:WU01:FS00:0xa7:Completed 187500 out of 250000 steps (75%)
17:36:35:WU01:FS00:0xa7:Completed 190000 out of 250000 steps (76%)
17:36:56:WU01:FS00:0xa7:Completed 192500 out of 250000 steps (77%)
17:37:18:WU01:FS00:0xa7:Completed 195000 out of 250000 steps (78%)
17:37:40:WU01:FS00:0xa7:Completed 197500 out of 250000 steps (79%)
17:38:01:WU01:FS00:0xa7:Completed 200000 out of 250000 steps (80%)
17:38:22:WU01:FS00:0xa7:Completed 202500 out of 250000 steps (81%)
17:38:44:WU01:FS00:0xa7:Completed 205000 out of 250000 steps (82%)
17:39:06:WU01:FS00:0xa7:Completed 207500 out of 250000 steps (83%)
17:39:27:WU01:FS00:0xa7:Completed 210000 out of 250000 steps (84%)
17:39:49:WU01:FS00:0xa7:Completed 212500 out of 250000 steps (85%)
17:40:11:WU01:FS00:0xa7:Completed 215000 out of 250000 steps (86%)
17:40:33:WU01:FS00:0xa7:Completed 217500 out of 250000 steps (87%)
17:40:55:WU01:FS00:0xa7:Completed 220000 out of 250000 steps (88%)
17:41:17:WU01:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
17:41:39:WU01:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
17:42:01:WU01:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
17:42:23:WU01:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
17:42:45:WU01:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
17:43:08:WU01:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
17:43:31:WU01:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
17:43:54:WU01:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
17:44:17:WU01:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
17:44:40:WU01:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
17:45:03:WU01:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
17:45:27:WU01:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
17:45:28:WU00:FS00:Connecting to assign1.foldingathome.org:80
17:45:29:WU00:FS00:Assigned to work server 3.21.157.11
17:45:29:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:48 from 3.21.157.11
17:45:29:WU00:FS00:Connecting to 3.21.157.11:8080
17:45:29:WU01:FS00:0xa7:Saving result file ../logfile_01.txt
17:45:29:WU01:FS00:0xa7:Saving result file dhdl.xvg
17:45:29:WU01:FS00:0xa7:Saving result file frame0.trr
17:45:29:WU01:FS00:0xa7:Saving result file md.log
17:45:29:WU01:FS00:0xa7:Saving result file pullf.xvg
17:45:29:WU01:FS00:0xa7:Saving result file pullx.xvg
17:45:29:WU01:FS00:0xa7:Saving result file science.log
17:45:29:WU01:FS00:0xa7:Saving result file traj_comp.xtc
17:45:29:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
17:45:30:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
17:45:30:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14719 run:802 clone:4 gen:0 core:0xa7 unit:0x000000022879986c5ea9670ab49b086c
17:45:30:WU01:FS00:Uploading 6.95MiB to 40.121.152.108
17:45:30:WU01:FS00:Connecting to 40.121.152.108:8080
17:45:36:WU01:FS00:Upload 80.98%
17:45:38:WU01:FS00:Upload complete
17:45:38:WU01:FS00:Server responded WORK_ACK (400)
17:45:38:WU01:FS00:Final credit estimate, 4310.00 points
17:45:38:WU01:FS00:Cleaning up