Windows or Linux?

[Nathan_P]

Your openCl indexes are not set, this is what mine looks like:-

Code: Select all

16:41:35:  <!-- User Information -->
16:41:35:  <passkey v='********************************'/>
16:41:35:  <team v='33'/>
16:41:35:  <user v='Nathan_P'/>
16:41:35:
16:41:35:  <!-- Folding Slots -->
16:41:35:  <slot id='1' type='GPU'>
16:41:35:    <cuda-index v='2'/>
16:41:35:    <opencl-index v='2'/>
16:41:35:  </slot>
16:41:35:  <slot id='0' type='GPU'>
16:41:35:    <cuda-index v='1'/>
16:41:35:    <gpu-index v='0'/>
16:41:35:    <opencl-index v='1'/>
16:41:35:  </slot>
16:41:35:</config>

this is Yours:-

Code: Select all

07:25:21: <!-- User Information -->
07:25:21: <passkey v='********************************'/>
07:25:21: <team v='212997'/>
07:25:21: <user v='hiigaran'/>
07:25:21:
07:25:21: <!-- Folding Slots -->
07:25:21: <slot id='0' type='CPU'/>
07:25:21: <slot id='1' type='GPU'>
07:25:21: <gpu-index v='0'/>
07:25:21: </slot>
07:25:21: <slot id='2' type='GPU'>
07:25:21: <gpu-index v='1'/>
07:25:21: </slot>
07:25:21: <slot id='3' type='GPU'>
07:25:21: <gpu-index v='2'/>
07:25:21: </slot>
07:25:21: <slot id='4' type='GPU'>
07:25:21: <gpu-index v='3'/>
07:25:21: </slot>
07:25:21:</config>

Its going to take some time to set all these up.

Pause all 4 slots, go into slot 0's config and edit the cuda, gpu and open cl indexes - set the gpu to 0 and then cuda and open cl to 1. save and close. Restart slot 0 and check that that card is folding by checking the temp and gpu utilisation in x server, if that card is not the one folding then alter the cuda and open cl values until it is.
For slot 1 the gpu index is 2, not sure on slots 2 & 3 but try 4 and 6 as there are 2 chips on a modern gpu - not sure what the 2nd one is but thats what is being dectected as a NV3 . Open cl and cuda values can be different to the gpu values. It took me about 20 minutes of stopping and starting to get my 2 cards running so it shouldn't take more than 45 minutes or so.

Oh you will also need to allow one cpu thread per gpu so you will only be able to have 4 cpu threads folding - this is a NV driver issue.

[SteveWillis]

Apparently your first stop should be to choose 'documentation' on the Linux welcome page. Teaching you how to use Linux is beyond the scope of this post.

BTW in the forum when you paste in your log you need to go to the full editor and click 'code' before pasting.

If you are going to run Linux you are going to have to get comfortable entering instructions on the terminal command line.
You get to it by clicking the menu icon which is where the start icon is in windows.
The commands I gave in the other thread have to be pasted in on a terminal command line. the command I gave you includes the path to the file so, as I said, on the command line first enter

Code: Select all

sudo nvidia-xconfig -a --cool-bits=28 --allow-empty-initial-configuration

then enter your system password
then to edit the file enter the following line. I edit with the vi editor. BTW sudo tells the OS to execute as a privileged user.

Code: Select all

sudo vi /etc/X11/xorg.conf

then prepend "#" to each line containing allow-empty-initial-configuration to comment it out. That is insert a # at the beginning of the line. To insert in vi enter an 'i' to go into insert mode. Type the '#' then press esc to go back to command mode. Enter 'WW' to save and exit. ':q!' exits without saving. If you need to delete a character then while in command mode press 'x'. Yes vi is strange and there are easier editors but it's what I know and use.
Reboot.

To set up the over-clock go back to menu and execute 'Nvidia X server settings'


I'm going back to bed

[ChristianVirtual]

What I wonder how you managed to get so many CPU WU's (all 0xA7) running at the same time ... there is something really really wrong with your current setup. And no wonder the GPU are idle; there is no 0x17, 0x18 or 0x21 WU assigned (at least not visible in the part of the log file). I would suggest to set every running slot you have to "Finish" ; get those done and uninstall FAH software you have running. Reboot.

Then check once more the driver running (e.g. you can call nvidia-smi ; it should show you all the cards and driver version)
Finally install the beta version of FAH software 7.4.16 (see here: viewtopic.php?f=104&t=29541 which should do a better job on hardware detection). Don't think right now about overclocking; first you need to get the cards working in a basic setup.

[hiigaran]

Yep, no point overclocking an idle system!

No idea why there are CPU work units. My guess is that they were assigned because the GPUs weren't properly detected. I'll try the beta software now and get back to you shortly with an update.

Pause all 4 slots, go into slot 0's config and edit the cuda, gpu and open cl indexes - set the gpu to 0 and then cuda and open cl to 1. save and close. Restart slot 0 and check that that card is folding by checking the temp and gpu utilisation in x server, if that card is not the one folding then alter the cuda and open cl values until it is.
For slot 1 the gpu index is 2, not sure on slots 2 & 3 but try 4 and 6 as there are 2 chips on a modern gpu - not sure what the 2nd one is but thats what is being dectected as a NV3 . Open cl and cuda values can be different to the gpu values. It took me about 20 minutes of stopping and starting to get my 2 cards running so it shouldn't take more than 45 minutes or so.

Oh you will also need to allow one cpu thread per gpu so you will only be able to have 4 cpu threads folding - this is a NV driver issue.

Slot0 is the CPU. It's 8 core, running at 4 cores to allow the other 4 to assist the GPU slots. So I assume your instructions will apply to slot 1, which is my first GPU, set to GPU 0.
I've tried setting the cuda and opencl indexes to every number from 0 to 8. GPU0 in X server has not shown GPU utilization to exceed more than 2%.

@Steve:

Unfortunately, I lack the free time to delve too much into learning anything beyond basic terminal usage. With all the praise that is constantly around Linux, I suppose I expected too much. Would have thought it would be a simple matter of installing a distro, downloading the folding software, and finding (apparently nonexistent) fan control and overclocking software. In all likelihood, I'm just going to revert back to Windows 10, because it simply works.

It's just really frustrating, I suppose. It's always 'Windows sucks because privacy, security and performance is better on Linux, why don't you switch?', which is all well and good, but it feels like as soon as you make that switch, you're on your own. By that point, everyone just says 'read the documentation', or 'these are simple instructions'. I mean, I can tell you that it's easy to fly a plane, but that's coming from someone who spent many hours getting the basic theoretical and practical experience, and I think many people tend to forget that they speak from very experienced perspectives. I'd like to think that it's not laziness that stops me from learning more. It's just a lack of time. As much as I would love to get the additional performance and stability, I just can't spare that much time learning this, especially when it feels like the amount of time my system has been idle, any performance gains will be negated by the downtime.

Anyway, that's my little rant. In any case, if I can get the GPU folding to work, I'll continue with your instructions.

EDIT: Okay, software uninstalled. Beta client and control are installed. By default, it only detects the CPU and defaults to running it as 8 cores. To be expected. No GPUs detected. Log:

Code: Select all

*********************** Log Started 2017-03-26T10:06:25Z ***********************
10:06:25:************************* Folding@home Client *************************
10:06:25:      Website: http://folding.stanford.edu/
10:06:25:    Copyright: (c) 2009-2016 Stanford University
10:06:25:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:06:25:         Args: --child --lifeline 4982 /etc/fahclient/config.xml --run-as
10:06:25:               fahclient --pid-file=/var/run/fahclient.pid --daemon
10:06:25:       Config: /etc/fahclient/config.xml
10:06:25:******************************** Build ********************************
10:06:25:      Version: 7.4.16
10:06:25:         Date: Jan 6 2017
10:06:25:         Time: 08:08:33
10:06:25:   Repository: Git
10:06:25:     Revision: e12187cbb0bd6937c067b9749af011374563b7b9
10:06:25:       Branch: master
10:06:25:     Compiler: GNU 4.9.2
10:06:25:      Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
10:06:25:               -fno-unsafe-math-optimizations -msse2
10:06:25:     Platform: linux2 4.8.0-2-amd64
10:06:25:         Bits: 64
10:06:25:         Mode: Release
10:06:25:******************************* System ********************************
10:06:25:          CPU: Intel(R) Xeon(R) CPU E5-2609 v4 @ 1.70GHz
10:06:25:       CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
10:06:25:         CPUs: 8
10:06:25:       Memory: 7.72GiB
10:06:25:  Free Memory: 4.28GiB
10:06:25:      Threads: POSIX_THREADS
10:06:25:   OS Version: 4.4
10:06:25:  Has Battery: false
10:06:25:   On Battery: false
10:06:25:   UTC Offset: 4
10:06:25:          PID: 4984
10:06:25:          CWD: /var/lib/fahclient
10:06:25:           OS: Linux 4.4.0-66-generic x86_64
10:06:25:      OS Arch: AMD64
10:06:25:         GPUs: 0
10:06:25:CUDA Device 0: Platform:0 Device:0 Bus:4 Slot:0 Compute:6.1 Driver:8.0
10:06:25:CUDA Device 1: Platform:0 Device:1 Bus:5 Slot:0 Compute:6.1 Driver:8.0
10:06:25:CUDA Device 2: Platform:0 Device:2 Bus:8 Slot:0 Compute:6.1 Driver:8.0
10:06:25:CUDA Device 3: Platform:0 Device:3 Bus:9 Slot:0 Compute:6.1 Driver:8.0
10:06:25:       OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.so':
10:06:25:               libOpenCL.so: cannot open shared object file: No such file or
10:06:25:               directory
10:06:25:***********************************************************************
10:06:25:<config>
10:06:25:  <!-- Client Control -->
10:06:25:  <fold-anon v='true'/>
10:06:25:
10:06:25:  <!-- Folding Slot Configuration -->
10:06:25:  <gpu v='false'/>
10:06:25:
10:06:25:  <!-- Slot Control -->
10:06:25:  <power v='full'/>
10:06:25:
10:06:25:  <!-- User Information -->
10:06:25:  <passkey v='********************************'/>
10:06:25:  <team v='212997'/>
10:06:25:  <user v='hiigaran'/>
10:06:25:
10:06:25:  <!-- Folding Slots -->
10:06:25:</config>
10:06:25:Switching to user fahclient
10:06:25:Trying to access database...
10:06:26:Successfully acquired database lock
10:06:26:FS00:Set client configured
10:06:26:Enabled folding slot 00: READY cpu:8
10:06:26:WU00:FS00:Connecting to 171.67.108.45:8080
10:06:28:WU00:FS00:Connecting to 171.67.108.45:8080
10:06:29:WU00:FS00:Assigned to work server 128.252.203.4
10:06:29:WU00:FS00:Requesting new work unit for slot 00: READY cpu:8 from 128.252.203.4
10:06:29:WU00:FS00:Connecting to 128.252.203.4:8080
10:06:30:WU00:FS00:Downloading 7.48MiB
10:06:36:WU00:FS00:Download 72.69%
10:06:38:WU00:FS00:Download complete
10:06:38:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13801 run:0 clone:2069 gen:34 core:0xa7 unit:0x0000002880fccb0458a5fc591d9b86e7
10:06:38:WU00:FS00:Downloading core from http://fahwebx.stanford.edu/cores/Linux/AMD64/AVX/Core_a7.fah
10:06:38:WU00:FS00:Connecting to fahwebx.stanford.edu:80
10:06:39:WU00:FS00:FahCore a7: Downloading 8.38MiB
10:06:45:WU00:FS00:FahCore a7: 7.46%
10:06:51:WU00:FS00:FahCore a7: 26.12%
10:06:57:WU00:FS00:FahCore a7: 55.97%
10:07:03:WU00:FS00:FahCore a7: 99.25%
10:07:03:WU00:FS00:FahCore a7: Download complete
10:07:03:WU00:FS00:Valid core signature
10:07:03:WU00:FS00:Unpacked 19.43MiB to cores/fahwebx.stanford.edu/cores/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7
10:07:03:WU00:FS00:Starting
10:07:03:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 704 -lifeline 4984 -checkpoint 15 -np 8
10:07:03:WU00:FS00:Started FahCore on PID 5071
10:07:03:WU00:FS00:Core PID:5075
10:07:03:WU00:FS00:FahCore 0xa7 started
10:07:03:WU00:FS00:0xa7:*********************** Log Started 2017-03-26T10:07:03Z ***********************
10:07:03:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
10:07:03:WU00:FS00:0xa7:       Type: 0xa7
10:07:03:WU00:FS00:0xa7:       Core: Gromacs
10:07:03:WU00:FS00:0xa7:    Website: http://folding.stanford.edu/
10:07:03:WU00:FS00:0xa7:  Copyright: (c) 2009-2016 Stanford University
10:07:03:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:07:03:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 704 -lifeline 5071 -checkpoint 15 -np 8
10:07:03:WU00:FS00:0xa7:     Config: <none>
10:07:03:WU00:FS00:0xa7:************************************ Build *************************************
10:07:03:WU00:FS00:0xa7:    Version: 0.0.11
10:07:03:WU00:FS00:0xa7:       Date: Sep 20 2016
10:07:03:WU00:FS00:0xa7:       Time: 06:40:11
10:07:03:WU00:FS00:0xa7: Repository: Git
10:07:03:WU00:FS00:0xa7:   Revision: 957bd90e68d95ddcf1594dc15ff6c64cc4555146
10:07:03:WU00:FS00:0xa7:     Branch: master
10:07:03:WU00:FS00:0xa7:   Compiler: GNU 4.8.5
10:07:03:WU00:FS00:0xa7:    Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
10:07:03:WU00:FS00:0xa7:             -fno-unsafe-math-optimizations -msse2
10:07:03:WU00:FS00:0xa7:   Platform: linux2 4.6.0-1-amd64
10:07:03:WU00:FS00:0xa7:       Bits: 64
10:07:03:WU00:FS00:0xa7:       Mode: Release
10:07:03:WU00:FS00:0xa7:       SIMD: avx_256
10:07:03:WU00:FS00:0xa7:************************************ System ************************************
10:07:03:WU00:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2609 v4 @ 1.70GHz
10:07:03:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
10:07:03:WU00:FS00:0xa7:       CPUs: 8
10:07:03:WU00:FS00:0xa7:     Memory: 7.72GiB
10:07:03:WU00:FS00:0xa7:Free Memory: 4.27GiB
10:07:03:WU00:FS00:0xa7:    Threads: POSIX_THREADS
10:07:03:WU00:FS00:0xa7: OS Version: 4.4
10:07:03:WU00:FS00:0xa7:Has Battery: false
10:07:03:WU00:FS00:0xa7: On Battery: false
10:07:03:WU00:FS00:0xa7: UTC Offset: 4
10:07:03:WU00:FS00:0xa7:        PID: 5075
10:07:03:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
10:07:03:WU00:FS00:0xa7:         OS: Linux 4.4.0-66-generic x86_64
10:07:03:WU00:FS00:0xa7:    OS Arch: AMD64
10:07:03:WU00:FS00:0xa7:********************************************************************************
10:07:03:WU00:FS00:0xa7:Project: 13801 (Run 0, Clone 2069, Gen 34)
10:07:03:WU00:FS00:0xa7:Unit: 0x0000002880fccb0458a5fc591d9b86e7
10:07:03:WU00:FS00:0xa7:Reading tar file core.xml
10:07:03:WU00:FS00:0xa7:Reading tar file frame34.tpr
10:07:03:WU00:FS00:0xa7:Digital signatures verified
10:07:03:WU00:FS00:0xa7:Calling: mdrun -s frame34.tpr -o frame34.trr -x frame34.xtc -cpt 15 -nt 8
10:07:03:WU00:FS00:0xa7:Steps: first=8500000 total=250000
10:07:06:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
10:07:27:Saving configuration to /etc/fahclient/config.xml
10:07:27:<config>
10:07:27:  <!-- Client Control -->
10:07:27:  <fold-anon v='true'/>
10:07:27:
10:07:27:  <!-- Folding Slot Configuration -->
10:07:27:  <gpu v='false'/>
10:07:27:
10:07:27:  <!-- Slot Control -->
10:07:27:  <power v='full'/>
10:07:27:
10:07:27:  <!-- User Information -->
10:07:27:  <passkey v='********************************'/>
10:07:27:  <team v='212997'/>
10:07:27:  <user v='hiigaran'/>
10:07:27:
10:07:27:  <!-- Folding Slots -->
10:07:27:  <slot id='0' type='CPU'/>
10:07:27:</config>

smi reports driver version as 375.39

Attempting to add a GPU with a -1 GPU index results in error "On client "local" 127.0.0.1 No available GPUs"

EDIT2: I've noticed that despite the update manager showing that 375.39 is the latest stable driver, Nvidia shows their latest stable driver to be 378.13 since January. However, downloading the .run file gives me an error, stating that xed has not been able to detect the character encoding.

[ChristianVirtual]

The source where you got the nV driver from did not include the required OpenCL-libs. With the .run version of the driver from nVidia-website you should be ok; I run the 378.13 myself (but under CentOS).

The thing we can't solve for you is the time you need to spend and get familiar with Linux (whatever distribution) and the way to install the required components (still a guide worth reading: viewtopic.php?f=80&t=27040 )

But yes, maybe easier to get you running with Windows. BUT: please keep in mind that with the automatic update of Windows it often "kill" the setup of video driver too (specially the OpenCL driver; again). Please search the forum for advice how to prevent that (I'm not a Windows user; not having the detail at hand).

Good luck with your "monster setup" and hope you get it folding soon.

[Nathan_P]

The 1st post in this thread should get you up and running, its for all debian based distro's of Linux so you should be OK, I use this guide on my zorin 9 distro's and just ignore the first part of the post about downgrading python as zorin 9is based on Ubuntu 14.04

http://www.overclockers.com/forums/show ... alling-FAH

this guide has info on setting up cool bits for overclocking:-

http://www.overclockers.com/forums/show ... olding-box

[SteveWillis]

Couple of things. I only GPU fold as the way I use my pc it takes too much of a performance hit with cpu folding for not a lot of return. Using the beta control I could only get the beta control working by manually setting the gpu indexes. for me that was 0 through 4.

Now let me show you the easy way to install nvidia drivers on Linux Mint. No muss no fuss. Version 370.28 works best for me but in the instructions below just use 370.

Go to the terminal command line like I explained before.

Code: Select all

sudo add-apt-repository ppa:graphics-drivers/ppa
sudo apt update
sudo apt-get install nvidia-370 nvidia-settings

you have to enter your password and answer yes if it asks you anything.

Then you have to go back to the gui and into menu/system settings - Driver Manager. It will show 370 as installed. You then change to the generic driver apply changes, then back to 370 apply changes, This takes a few minutes, then reboot.


One other thing, Are you sure your power supply is up to running 4 gpus? Also, my motherboard couldn't supply power properly to all 5 of my gpus and I had to use powered riser extensions on two of them to get the OS to recognize them consistently or even at all.

[hiigaran]

1080s don't use more than around 180 watts at load, according to techpowerup (not the TDP value, mind you). Either way, each quad card system is powered by a decent 1600 watt PSU, and the motherboard has two molex connectors on the board to power the PCI-e slots. Server grade X99s.

Anyway, I followed your instructions and the drivers are now 370. Still shows that error about unavailable GPUs. So I followed Nathan's first link. Installed the two opencl packages and added the gpus.txt file to the right place. Still nothing. What's next?

The thing we can't solve for you is the time you need to spend and get familiar with Linux (whatever distribution) and the way to install the required components (still a guide worth reading: viewtopic.php?f=80&t=27040 )

True. I hope I didn't sound demanding when asking for assistance here. I've tried doing specialised things in Linux many times, and for the most part, I could never get things to work as I needed them to. Most people usually lose patience with me and that's the end of that, resulting in another download of Windows.

There are things in Linux I am familiar with. It's just that a lot of times, I need to re-learn a lot of things because I usually go long periods at a time between Linux usages. Had I been using it more frequently, I might remember more terminal commands, and file locations.

EDIT: Okay, got some progress. After the txt file was added, I forgot to restart. Probably fahclient needed restarting. I can now add GPUs with -1 index, and they detect the right hardware. Cuda and OpenCL indexes needed manual adjustments, but I think I have the right ones now. At least, X server is showing full utilisation.

Now on to the cooling part...

EDIT: Right, for now, I've set all fans for the cards to 100 in X server, after doing coolbits=28. GPUs appear to be running properly now. PPD appears to be stable at almost 2.8 million currently. Maybe this headache was worth it in the end.

I'm going to see whether or not I can stand the noise of 100% fans, and then decide if I want to complicate things again with fan profiles and such. If I can handle it, I'll leave them to run at full. I think I should be fine though. The fans were running at around 80% before. For the time being, I think I'll just need to figure out how to set X server to put the fans to 100% on each startup.

[ChristianVirtual]

always good to show us the log file (in

Code: Select all

blocks)

how is the GPU utilization and PPD ?

[hiigaran]

See my edit. As far as GPU utilisation goes, two cards are consistently in the 90s, one in the 80s, and one hovering around 75. Would this be due to WU variances, or is there some way I can max these out?

EDIT: Current log:

Code: Select all

*********************** Log Started 2017-03-26T13:46:41Z ***********************
13:46:41:************************* Folding@home Client *************************
13:46:41:      Website: http://folding.stanford.edu/
13:46:41:    Copyright: (c) 2009-2016 Stanford University
13:46:41:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
13:46:41:         Args: --child --lifeline 1502 /etc/fahclient/config.xml --run-as
13:46:41:               fahclient --pid-file=/var/run/fahclient.pid --daemon
13:46:41:       Config: /etc/fahclient/config.xml
13:46:41:******************************** Build ********************************
13:46:41:      Version: 7.4.16
13:46:41:         Date: Jan 6 2017
13:46:41:         Time: 08:08:33
13:46:41:   Repository: Git
13:46:41:     Revision: e12187cbb0bd6937c067b9749af011374563b7b9
13:46:41:       Branch: master
13:46:41:     Compiler: GNU 4.9.2
13:46:41:      Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
13:46:41:               -fno-unsafe-math-optimizations -msse2
13:46:41:     Platform: linux2 4.8.0-2-amd64
13:46:41:         Bits: 64
13:46:41:         Mode: Release
13:46:41:******************************* System ********************************
13:46:41:          CPU: Intel(R) Xeon(R) CPU E5-2609 v4 @ 1.70GHz
13:46:41:       CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
13:46:41:         CPUs: 8
13:46:41:       Memory: 7.72GiB
13:46:41:  Free Memory: 7.17GiB
13:46:41:      Threads: POSIX_THREADS
13:46:41:   OS Version: 4.4
13:46:41:  Has Battery: false
13:46:41:   On Battery: false
13:46:41:   UTC Offset: 4
13:46:41:          PID: 1504
13:46:41:          CWD: /var/lib/fahclient
13:46:41:           OS: Linux 4.4.0-66-generic x86_64
13:46:41:      OS Arch: AMD64
13:46:41:         GPUs: 4
13:46:41:        GPU 0: Bus:4 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:        GPU 1: Bus:5 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:        GPU 2: Bus:8 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:        GPU 3: Bus:9 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:CUDA Device 0: Platform:0 Device:0 Bus:4 Slot:0 Compute:6.1 Driver:8.0
13:46:41:CUDA Device 1: Platform:0 Device:1 Bus:5 Slot:0 Compute:6.1 Driver:8.0
13:46:41:CUDA Device 2: Platform:0 Device:2 Bus:8 Slot:0 Compute:6.1 Driver:8.0
13:46:41:CUDA Device 3: Platform:0 Device:3 Bus:9 Slot:0 Compute:6.1 Driver:8.0
13:46:41:       OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.so':
13:46:41:               libOpenCL.so: cannot open shared object file: No such file or
13:46:41:               directory
13:46:41:***********************************************************************
13:46:41:<config>
13:46:41:  <!-- Client Control -->
13:46:41:  <fold-anon v='true'/>
13:46:41:
13:46:41:  <!-- Folding Slot Configuration -->
13:46:41:  <gpu v='false'/>
13:46:41:
13:46:41:  <!-- Network -->
13:46:41:  <proxy v=':8080'/>
13:46:41:
13:46:41:  <!-- Slot Control -->
13:46:41:  <power v='full'/>
13:46:41:
13:46:41:  <!-- User Information -->
13:46:41:  <passkey v='********************************'/>
13:46:41:  <team v='212997'/>
13:46:41:  <user v='hiigaran'/>
13:46:41:
13:46:41:  <!-- Folding Slots -->
13:46:41:  <slot id='0' type='CPU'>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='1' type='GPU'>
13:46:41:    <opencl-index v='0'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='2' type='GPU'>
13:46:41:    <opencl-index v='1'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='3' type='GPU'>
13:46:41:    <opencl-index v='2'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='4' type='GPU'>
13:46:41:    <cuda-index v='4'/>
13:46:41:    <opencl-index v='4'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:</config>
13:46:41:Switching to user fahclient
13:46:41:Trying to access database...
13:46:41:Successfully acquired database lock
13:46:41:Enabled folding slot 00: PAUSED cpu:4 (by user)
13:46:41:Enabled folding slot 01: PAUSED gpu:0:GP104 [GeForce GTX 1080] (by user)
13:46:41:Enabled folding slot 02: PAUSED gpu:1:GP104 [GeForce GTX 1080] (by user)
13:46:41:Enabled folding slot 03: PAUSED gpu:2:GP104 [GeForce GTX 1080] (by user)
13:46:41:ERROR:FS04:CUDA device not found for 'cuda-index' = 4, plese correct this by removing the manually configured 'cuda-index' option.
13:46:41:Enabled folding slot 04: PAUSED gpu:3:GP104 [GeForce GTX 1080] (by user)
13:46:41:ERROR:No compute devices matched GPU #3 NVIDIA:5 GP104 [GeForce GTX 1080].  You may need to update your graphics drivers.
13:48:27:FS00:Unpaused
13:48:27:FS01:Unpaused
13:48:27:FS02:Unpaused
13:48:27:FS03:Unpaused
13:48:27:FS04:Unpaused
*********************** Log Started 2017-03-26T13:46:41Z ***********************
13:46:41:************************* Folding@home Client *************************
13:46:41:      Website: http://folding.stanford.edu/
13:46:41:    Copyright: (c) 2009-2016 Stanford University
13:46:41:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
13:46:41:         Args: --child --lifeline 1502 /etc/fahclient/config.xml --run-as
13:46:41:               fahclient --pid-file=/var/run/fahclient.pid --daemon
13:46:41:       Config: /etc/fahclient/config.xml
13:46:41:******************************** Build ********************************
13:46:41:      Version: 7.4.16
13:46:41:         Date: Jan 6 2017
13:46:41:         Time: 08:08:33
13:46:41:   Repository: Git
13:46:41:     Revision: e12187cbb0bd6937c067b9749af011374563b7b9
13:46:41:       Branch: master
13:46:41:     Compiler: GNU 4.9.2
13:46:41:      Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
13:46:41:               -fno-unsafe-math-optimizations -msse2
13:46:41:     Platform: linux2 4.8.0-2-amd64
13:46:41:         Bits: 64
13:46:41:         Mode: Release
13:46:41:******************************* System ********************************
13:46:41:          CPU: Intel(R) Xeon(R) CPU E5-2609 v4 @ 1.70GHz
13:46:41:       CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
13:46:41:         CPUs: 8
13:46:41:       Memory: 7.72GiB
13:46:41:  Free Memory: 7.17GiB
13:46:41:      Threads: POSIX_THREADS
13:46:41:   OS Version: 4.4
13:46:41:  Has Battery: false
13:46:41:   On Battery: false
13:46:41:   UTC Offset: 4
13:46:41:          PID: 1504
13:46:41:          CWD: /var/lib/fahclient
13:46:41:           OS: Linux 4.4.0-66-generic x86_64
13:46:41:      OS Arch: AMD64
13:46:41:         GPUs: 4
13:46:41:        GPU 0: Bus:4 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:        GPU 1: Bus:5 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:        GPU 2: Bus:8 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:        GPU 3: Bus:9 Slot:0 Func:0 NVIDIA:5 GP104 [GeForce GTX 1080]
13:46:41:CUDA Device 0: Platform:0 Device:0 Bus:4 Slot:0 Compute:6.1 Driver:8.0
13:46:41:CUDA Device 1: Platform:0 Device:1 Bus:5 Slot:0 Compute:6.1 Driver:8.0
13:46:41:CUDA Device 2: Platform:0 Device:2 Bus:8 Slot:0 Compute:6.1 Driver:8.0
13:46:41:CUDA Device 3: Platform:0 Device:3 Bus:9 Slot:0 Compute:6.1 Driver:8.0
13:46:41:       OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.so':
13:46:41:               libOpenCL.so: cannot open shared object file: No such file or
13:46:41:               directory
13:46:41:***********************************************************************
13:46:41:<config>
13:46:41:  <!-- Client Control -->
13:46:41:  <fold-anon v='true'/>
13:46:41:
13:46:41:  <!-- Folding Slot Configuration -->
13:46:41:  <gpu v='false'/>
13:46:41:
13:46:41:  <!-- Network -->
13:46:41:  <proxy v=':8080'/>
13:46:41:
13:46:41:  <!-- Slot Control -->
13:46:41:  <power v='full'/>
13:46:41:
13:46:41:  <!-- User Information -->
13:46:41:  <passkey v='********************************'/>
13:46:41:  <team v='212997'/>
13:46:41:  <user v='hiigaran'/>
13:46:41:
13:46:41:  <!-- Folding Slots -->
13:46:41:  <slot id='0' type='CPU'>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='1' type='GPU'>
13:46:41:    <opencl-index v='0'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='2' type='GPU'>
13:46:41:    <opencl-index v='1'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='3' type='GPU'>
13:46:41:    <opencl-index v='2'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:  <slot id='4' type='GPU'>
13:46:41:    <cuda-index v='4'/>
13:46:41:    <opencl-index v='4'/>
13:46:41:    <paused v='true'/>
13:46:41:  </slot>
13:46:41:</config>
13:46:41:Switching to user fahclient
13:46:41:Trying to access database...
13:46:41:Successfully acquired database lock
13:46:41:Enabled folding slot 00: PAUSED cpu:4 (by user)
13:46:41:Enabled folding slot 01: PAUSED gpu:0:GP104 [GeForce GTX 1080] (by user)
13:46:41:Enabled folding slot 02: PAUSED gpu:1:GP104 [GeForce GTX 1080] (by user)
13:46:41:Enabled folding slot 03: PAUSED gpu:2:GP104 [GeForce GTX 1080] (by user)
13:46:41:ERROR:FS04:CUDA device not found for 'cuda-index' = 4, plese correct this by removing the manually configured 'cuda-index' option.
13:46:41:Enabled folding slot 04: PAUSED gpu:3:GP104 [GeForce GTX 1080] (by user)
13:46:41:ERROR:No compute devices matched GPU #3 NVIDIA:5 GP104 [GeForce GTX 1080].  You may need to update your graphics drivers.
13:48:27:FS00:Unpaused
13:48:27:FS01:Unpaused
13:48:27:FS02:Unpaused
13:48:27:FS03:Unpaused
13:48:27:FS04:Unpaused
13:48:27:WU02:FS02:Starting
13:48:27:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -gpu-vendor nvidia -opencl-device 1 -cuda-device 1 -gpu 1
13:48:27:WU02:FS02:Started FahCore on PID 2639
13:48:27:WU02:FS02:Core PID:2643
13:48:27:WU02:FS02:FahCore 0x21 started
13:48:27:WU03:FS03:Starting
13:48:27:WU03:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 03 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -gpu-vendor nvidia -opencl-device 2 -cuda-device 2 -gpu 2
13:48:27:WU03:FS03:Started FahCore on PID 2644
13:48:27:WU03:FS03:Core PID:2648
13:48:27:WU03:FS03:FahCore 0x21 started
13:48:27:WU01:FS01:Starting
13:48:27:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -gpu-vendor nvidia -opencl-device 0 -cuda-device 0 -gpu 0
13:48:27:WU01:FS01:Started FahCore on PID 2649
13:48:27:WU01:FS01:Core PID:2653
13:48:27:WU01:FS01:FahCore 0x21 started
13:48:28:WU04:FS04:Starting
13:48:28:WU04:FS04:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 04 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -gpu-vendor nvidia -opencl-device 4 -cuda-device 4 -gpu 4
13:48:28:WU04:FS04:Started FahCore on PID 2654
13:48:28:WU04:FS04:Core PID:2658
13:48:28:WU04:FS04:FahCore 0x21 started
13:48:28:WU00:FS00:Starting
13:48:28:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -np 4
13:48:28:WU00:FS00:Started FahCore on PID 2667
13:48:28:WU00:FS00:Core PID:2671
13:48:28:WU00:FS00:FahCore 0xa7 started
13:48:28:WU04:FS04:0x21:*********************** Log Started 2017-03-26T13:48:28Z ***********************
13:48:28:WU04:FS04:0x21:Project: 9839 (Run 0, Clone 41, Gen 104)
13:48:28:WU04:FS04:0x21:Unit: 0x00000078ab436ca05890cac6d1f0cd5a
13:48:28:WU04:FS04:0x21:CPU: 0x00000000000000000000000000000000
13:48:28:WU04:FS04:0x21:Machine: 4
13:48:28:WU04:FS04:0x21:Digital signatures verified
13:48:28:WU04:FS04:0x21:Folding@home GPU Core21 Folding@home Core
13:48:28:WU04:FS04:0x21:Version 0.0.18
13:48:28:WU01:FS01:0x21:*********************** Log Started 2017-03-26T13:48:28Z ***********************
13:48:28:WU01:FS01:0x21:Project: 9196 (Run 2, Clone 97, Gen 355)
13:48:28:WU01:FS01:0x21:Unit: 0x000001d4ab40415c57cb3f6fcf17fdd2
13:48:28:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
13:48:28:WU01:FS01:0x21:Machine: 1
13:48:28:WU01:FS01:0x21:Digital signatures verified
13:48:28:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
13:48:28:WU01:FS01:0x21:Version 0.0.18
13:48:28:WU03:FS03:0x21:*********************** Log Started 2017-03-26T13:48:28Z ***********************
13:48:28:WU03:FS03:0x21:Project: 9192 (Run 2, Clone 11, Gen 315)
13:48:28:WU03:FS03:0x21:Unit: 0x000001abab40415457cb2d67f77fd4e7
13:48:28:WU03:FS03:0x21:CPU: 0x00000000000000000000000000000000
13:48:28:WU03:FS03:0x21:Machine: 3
13:48:28:WU03:FS03:0x21:Digital signatures verified
13:48:28:WU03:FS03:0x21:Folding@home GPU Core21 Folding@home Core
13:48:28:WU03:FS03:0x21:Version 0.0.18
13:48:28:WU02:FS02:0x21:*********************** Log Started 2017-03-26T13:48:28Z ***********************
13:48:28:WU02:FS02:0x21:Project: 9431 (Run 50, Clone 0, Gen 145)
13:48:28:WU02:FS02:0x21:Unit: 0x000000abab436c9d586fdd342bb93250
13:48:28:WU02:FS02:0x21:CPU: 0x00000000000000000000000000000000
13:48:28:WU02:FS02:0x21:Machine: 2
13:48:28:WU02:FS02:0x21:Digital signatures verified
13:48:28:WU02:FS02:0x21:Folding@home GPU Core21 Folding@home Core
13:48:28:WU02:FS02:0x21:Version 0.0.18
13:48:29:WU00:FS00:0xa7:*********************** Log Started 2017-03-26T13:48:29Z ***********************
13:48:29:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
13:48:29:WU00:FS00:0xa7:       Type: 0xa7
13:48:29:WU00:FS00:0xa7:       Core: Gromacs
13:48:29:WU00:FS00:0xa7:    Website: http://folding.stanford.edu/
13:48:29:WU00:FS00:0xa7:  Copyright: (c) 2009-2016 Stanford University
13:48:29:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
13:48:29:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 704 -lifeline 2667 -checkpoint 15 -np 4
13:48:29:WU00:FS00:0xa7:     Config: <none>
13:48:29:WU00:FS00:0xa7:************************************ Build *************************************
13:48:29:WU00:FS00:0xa7:    Version: 0.0.11
13:48:29:WU00:FS00:0xa7:       Date: Sep 20 2016
13:48:29:WU00:FS00:0xa7:       Time: 06:40:11
13:48:29:WU00:FS00:0xa7: Repository: Git
13:48:29:WU00:FS00:0xa7:   Revision: 957bd90e68d95ddcf1594dc15ff6c64cc4555146
13:48:29:WU00:FS00:0xa7:     Branch: master
13:48:29:WU00:FS00:0xa7:   Compiler: GNU 4.8.5
13:48:29:WU00:FS00:0xa7:    Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
13:48:29:WU00:FS00:0xa7:             -fno-unsafe-math-optimizations -msse2
13:48:29:WU00:FS00:0xa7:   Platform: linux2 4.6.0-1-amd64
13:48:29:WU00:FS00:0xa7:       Bits: 64
13:48:29:WU00:FS00:0xa7:       Mode: Release
13:48:29:WU00:FS00:0xa7:       SIMD: avx_256
13:48:29:WU00:FS00:0xa7:************************************ System ************************************
13:48:29:WU00:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2609 v4 @ 1.70GHz
13:48:29:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
13:48:29:WU00:FS00:0xa7:       CPUs: 8
13:48:29:WU00:FS00:0xa7:     Memory: 7.72GiB
13:48:29:WU00:FS00:0xa7:Free Memory: 6.43GiB
13:48:29:WU00:FS00:0xa7:    Threads: POSIX_THREADS
13:48:29:WU00:FS00:0xa7: OS Version: 4.4
13:48:29:WU00:FS00:0xa7:Has Battery: false
13:48:29:WU00:FS00:0xa7: On Battery: false
13:48:29:WU00:FS00:0xa7: UTC Offset: 4
13:48:29:WU00:FS00:0xa7:        PID: 2671
13:48:29:WU00:FS00:0xa7:        CWD: /var/lib/fahclient/work
13:48:29:WU00:FS00:0xa7:         OS: Linux 4.4.0-66-generic x86_64
13:48:29:WU00:FS00:0xa7:    OS Arch: AMD64
13:48:29:WU00:FS00:0xa7:********************************************************************************
13:48:30:WU00:FS00:0xa7:Project: 13801 (Run 0, Clone 2069, Gen 34)
13:48:30:WU00:FS00:0xa7:Unit: 0x0000002880fccb0458a5fc591d9b86e7
13:48:30:WU00:FS00:0xa7:Digital signatures verified
13:48:30:WU00:FS00:0xa7:Calling: mdrun -s frame34.tpr -o frame34.trr -x frame34.xtc -cpi state.cpt -cpt 15 -nt 4
13:48:33:WU00:FS00:0xa7:Steps: first=8500000 total=250000
13:48:36:WU00:FS00:0xa7:Completed 113679 out of 250000 steps (45%)
13:48:39:ERROR:Send error: 32: Broken pipe
13:48:42:WU02:FS02:0x21:Completed 0 out of 6250000 steps (0%)
13:48:42:WU02:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:48:42:WU04:FS04:0x21:Completed 0 out of 2400000 steps (0%)
13:48:42:WU04:FS04:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:48:42:WU01:FS01:0x21:Completed 0 out of 2500000 steps (0%)
13:48:42:WU01:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:48:43:WU03:FS03:0x21:Completed 0 out of 2500000 steps (0%)
13:48:43:WU03:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:48:43:Removing old file 'configs/config-20170326-132600.xml'
13:48:43:Saving configuration to /etc/fahclient/config.xml
13:48:43:<config>
13:48:43:  <!-- Client Control -->
13:48:43:  <fold-anon v='true'/>
13:48:43:
13:48:43:  <!-- Folding Slot Configuration -->
13:48:43:  <gpu v='false'/>
13:48:43:
13:48:43:  <!-- Network -->
13:48:43:  <proxy v=':8080'/>
13:48:43:
13:48:43:  <!-- Slot Control -->
13:48:43:  <power v='full'/>
13:48:43:
13:48:43:  <!-- User Information -->
13:48:43:  <passkey v='********************************'/>
13:48:43:  <team v='212997'/>
13:48:43:  <user v='hiigaran'/>
13:48:43:
13:48:43:  <!-- Folding Slots -->
13:48:43:  <slot id='0' type='CPU'/>
13:48:43:  <slot id='1' type='GPU'>
13:48:43:    <opencl-index v='0'/>
13:48:43:  </slot>
13:48:43:  <slot id='2' type='GPU'>
13:48:43:    <opencl-index v='1'/>
13:48:43:  </slot>
13:48:43:  <slot id='3' type='GPU'>
13:48:43:    <opencl-index v='2'/>
13:48:43:  </slot>
13:48:43:  <slot id='4' type='GPU'>
13:48:43:    <cuda-index v='4'/>
13:48:43:    <opencl-index v='4'/>
13:48:43:  </slot>
13:48:43:</config>
13:49:18:Removing old file 'configs/config-20170326-132606.xml'
13:49:18:Saving configuration to /etc/fahclient/config.xml
13:49:18:<config>
13:49:18:  <!-- Client Control -->
13:49:18:  <fold-anon v='true'/>
13:49:18:
13:49:18:  <!-- Folding Slot Configuration -->
13:49:18:  <gpu v='false'/>
13:49:18:
13:49:18:  <!-- Network -->
13:49:18:  <proxy v=':8080'/>
13:49:18:
13:49:18:  <!-- Slot Control -->
13:49:18:  <power v='full'/>
13:49:18:
13:49:18:  <!-- User Information -->
13:49:18:  <passkey v='********************************'/>
13:49:18:  <team v='212997'/>
13:49:18:  <user v='hiigaran'/>
13:49:18:
13:49:18:  <!-- Folding Slots -->
13:49:18:  <slot id='0' type='CPU'/>
13:49:18:  <slot id='1' type='GPU'>
13:49:18:    <opencl-index v='0'/>
13:49:18:  </slot>
13:49:18:  <slot id='2' type='GPU'>
13:49:18:    <opencl-index v='1'/>
13:49:18:  </slot>
13:49:18:  <slot id='3' type='GPU'>
13:49:18:    <opencl-index v='2'/>
13:49:18:  </slot>
13:49:18:  <slot id='4' type='GPU'>
13:49:18:    <cuda-index v='5'/>
13:49:18:    <opencl-index v='5'/>
13:49:18:  </slot>
13:49:18:</config>
13:49:21:FS04:Paused
13:49:21:FS04:Shutting core down
13:49:21:WU04:FS04:0x21:Caught signal SIGINT(2) on PID 2658
13:49:21:WU04:FS04:0x21:Exiting, please wait. . .
13:49:22:WU04:FS04:0x21:Folding@home Core Shutdown: INTERRUPTED
13:49:22:WU04:FS04:FahCore returned: INTERRUPTED (102 = 0x66)
13:49:24:FS04:Unpaused
13:49:24:WU04:FS04:Starting
13:49:24:WU04:FS04:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 04 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -gpu-vendor nvidia -opencl-device 5 -cuda-device 5 -gpu 5
13:49:24:WU04:FS04:Started FahCore on PID 2747
13:49:24:WU04:FS04:Core PID:2751
13:49:24:WU04:FS04:FahCore 0x21 started
13:49:25:WU04:FS04:0x21:*********************** Log Started 2017-03-26T13:49:24Z ***********************
13:49:25:WU04:FS04:0x21:Project: 9839 (Run 0, Clone 41, Gen 104)
13:49:25:WU04:FS04:0x21:Unit: 0x00000078ab436ca05890cac6d1f0cd5a
13:49:25:WU04:FS04:0x21:CPU: 0x00000000000000000000000000000000
13:49:25:WU04:FS04:0x21:Machine: 4
13:49:25:WU04:FS04:0x21:Digital signatures verified
13:49:25:WU04:FS04:0x21:Folding@home GPU Core21 Folding@home Core
13:49:25:WU04:FS04:0x21:Version 0.0.18
13:49:27:WU03:FS03:0x21:Completed 25000 out of 2500000 steps (1%)
13:49:28:WU01:FS01:0x21:Completed 25000 out of 2500000 steps (1%)
13:49:30:WU04:FS04:0x21:Completed 0 out of 2400000 steps (0%)
13:49:30:WU04:FS04:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:49:43:WARNING:FS02:Size of positions 346 does not match topology 334
13:49:44:Removing old file 'configs/config-20170326-132607.xml'
13:49:44:Saving configuration to /etc/fahclient/config.xml
13:49:44:<config>
13:49:44:  <!-- Client Control -->
13:49:44:  <fold-anon v='true'/>
13:49:44:
13:49:44:  <!-- Folding Slot Configuration -->
13:49:44:  <gpu v='false'/>
13:49:44:
13:49:44:  <!-- Network -->
13:49:44:  <proxy v=':8080'/>
13:49:44:
13:49:44:  <!-- Slot Control -->
13:49:44:  <power v='full'/>
13:49:44:
13:49:44:  <!-- User Information -->
13:49:44:  <passkey v='********************************'/>
13:49:44:  <team v='212997'/>
13:49:44:  <user v='hiigaran'/>
13:49:44:
13:49:44:  <!-- Folding Slots -->
13:49:44:  <slot id='0' type='CPU'/>
13:49:44:  <slot id='1' type='GPU'>
13:49:44:    <opencl-index v='0'/>
13:49:44:  </slot>
13:49:44:  <slot id='2' type='GPU'>
13:49:44:    <opencl-index v='1'/>
13:49:44:  </slot>
13:49:44:  <slot id='3' type='GPU'>
13:49:44:    <opencl-index v='2'/>
13:49:44:  </slot>
13:49:44:  <slot id='4' type='GPU'>
13:49:44:    <cuda-index v='5'/>
13:49:44:    <opencl-index v='5'/>
13:49:44:  </slot>
13:49:44:</config>
13:49:52:WU02:FS02:0x21:Completed 62500 out of 6250000 steps (1%)
13:50:11:WU03:FS03:0x21:Completed 50000 out of 2500000 steps (2%)
13:50:12:WU01:FS01:0x21:Completed 50000 out of 2500000 steps (2%)
13:50:38:Removing old file 'configs/config-20170326-132614.xml'
13:50:38:Saving configuration to /etc/fahclient/config.xml
13:50:38:<config>
13:50:38:  <!-- Client Control -->
13:50:38:  <fold-anon v='true'/>
13:50:38:
13:50:38:  <!-- Folding Slot Configuration -->
13:50:38:  <gpu v='false'/>
13:50:38:
13:50:38:  <!-- Network -->
13:50:38:  <proxy v=':8080'/>
13:50:38:
13:50:38:  <!-- Slot Control -->
13:50:38:  <power v='full'/>
13:50:38:
13:50:38:  <!-- User Information -->
13:50:38:  <passkey v='********************************'/>
13:50:38:  <team v='212997'/>
13:50:38:  <user v='hiigaran'/>
13:50:38:
13:50:38:  <!-- Folding Slots -->
13:50:38:  <slot id='0' type='CPU'/>
13:50:38:  <slot id='1' type='GPU'>
13:50:38:    <opencl-index v='0'/>
13:50:38:  </slot>
13:50:38:  <slot id='2' type='GPU'>
13:50:38:    <opencl-index v='1'/>
13:50:38:  </slot>
13:50:38:  <slot id='3' type='GPU'>
13:50:38:    <opencl-index v='2'/>
13:50:38:  </slot>
13:50:38:  <slot id='4' type='GPU'>
13:50:38:    <opencl-index v='3'/>
13:50:38:  </slot>
13:50:38:</config>
13:50:41:WARNING:FS02:Size of positions 346 does not match topology 334
13:50:45:Removing old file 'configs/config-20170326-132707.xml'
13:50:45:Saving configuration to /etc/fahclient/config.xml
13:50:45:<config>
13:50:45:  <!-- Client Control -->
13:50:45:  <fold-anon v='true'/>
13:50:45:
13:50:45:  <!-- Folding Slot Configuration -->
13:50:45:  <gpu v='false'/>
13:50:45:
13:50:45:  <!-- Network -->
13:50:45:  <proxy v=':8080'/>
13:50:45:
13:50:45:  <!-- Slot Control -->
13:50:45:  <power v='full'/>
13:50:45:
13:50:45:  <!-- User Information -->
13:50:45:  <passkey v='********************************'/>
13:50:45:  <team v='212997'/>
13:50:45:  <user v='hiigaran'/>
13:50:45:
13:50:45:  <!-- Folding Slots -->
13:50:45:  <slot id='0' type='CPU'/>
13:50:45:  <slot id='1' type='GPU'>
13:50:45:    <opencl-index v='0'/>
13:50:45:  </slot>
13:50:45:  <slot id='2' type='GPU'>
13:50:45:    <opencl-index v='1'/>
13:50:45:  </slot>
13:50:45:  <slot id='3' type='GPU'>
13:50:45:    <opencl-index v='2'/>
13:50:45:  </slot>
13:50:45:  <slot id='4' type='GPU'>
13:50:45:    <opencl-index v='3'/>
13:50:45:  </slot>
13:50:45:</config>
13:50:47:FS04:Paused
13:50:47:FS04:Shutting core down
13:50:47:WU04:FS04:0x21:Caught signal SIGINT(2) on PID 2751
13:50:47:WU04:FS04:0x21:Exiting, please wait. . .
13:50:47:WU04:FS04:0x21:Folding@home Core Shutdown: INTERRUPTED
13:50:48:WU04:FS04:FahCore returned: INTERRUPTED (102 = 0x66)
13:50:55:FS04:Unpaused
13:50:55:WU04:FS04:Starting
13:50:55:ERROR:WU04:FS04:Failed to start core: Option 'cuda-index' has no default and is not set.
13:50:55:WU03:FS03:0x21:Completed 75000 out of 2500000 steps (3%)
13:50:58:WU01:FS01:0x21:Completed 75000 out of 2500000 steps (3%)
13:51:01:WU02:FS02:0x21:Completed 125000 out of 6250000 steps (2%)
13:51:21:FS04:Paused
13:51:29:Removing old file 'configs/config-20170326-132751.xml'
13:51:29:Saving configuration to /etc/fahclient/config.xml
13:51:29:<config>
13:51:29:  <!-- Client Control -->
13:51:29:  <fold-anon v='true'/>
13:51:29:
13:51:29:  <!-- Folding Slot Configuration -->
13:51:29:  <gpu v='false'/>
13:51:29:
13:51:29:  <!-- Network -->
13:51:29:  <proxy v=':8080'/>
13:51:29:
13:51:29:  <!-- Slot Control -->
13:51:29:  <power v='full'/>
13:51:29:
13:51:29:  <!-- User Information -->
13:51:29:  <passkey v='********************************'/>
13:51:29:  <team v='212997'/>
13:51:29:  <user v='hiigaran'/>
13:51:29:
13:51:29:  <!-- Folding Slots -->
13:51:29:  <slot id='0' type='CPU'/>
13:51:29:  <slot id='1' type='GPU'>
13:51:29:    <opencl-index v='0'/>
13:51:29:  </slot>
13:51:29:  <slot id='2' type='GPU'>
13:51:29:    <opencl-index v='1'/>
13:51:29:  </slot>
13:51:29:  <slot id='3' type='GPU'>
13:51:29:    <opencl-index v='2'/>
13:51:29:  </slot>
13:51:29:  <slot id='4' type='GPU'>
13:51:29:    <cuda-index v='3'/>
13:51:29:    <opencl-index v='3'/>
13:51:29:    <paused v='true'/>
13:51:29:  </slot>
13:51:29:</config>
13:51:30:WARNING:FS02:Size of positions 346 does not match topology 334
13:51:32:FS04:Unpaused
13:51:39:WU03:FS03:0x21:Completed 100000 out of 2500000 steps (4%)
13:51:43:WU01:FS01:0x21:Completed 100000 out of 2500000 steps (4%)
13:51:46:Removing old file 'configs/config-20170326-132808.xml'
13:51:46:Saving configuration to /etc/fahclient/config.xml
13:51:46:<config>
13:51:46:  <!-- Client Control -->
13:51:46:  <fold-anon v='true'/>
13:51:46:
13:51:46:  <!-- Folding Slot Configuration -->
13:51:46:  <gpu v='false'/>
13:51:46:
13:51:46:  <!-- Network -->
13:51:46:  <proxy v=':8080'/>
13:51:46:
13:51:46:  <!-- Slot Control -->
13:51:46:  <power v='full'/>
13:51:46:
13:51:46:  <!-- User Information -->
13:51:46:  <passkey v='********************************'/>
13:51:46:  <team v='212997'/>
13:51:46:  <user v='hiigaran'/>
13:51:46:
13:51:46:  <!-- Folding Slots -->
13:51:46:  <slot id='0' type='CPU'/>
13:51:46:  <slot id='1' type='GPU'>
13:51:46:    <opencl-index v='0'/>
13:51:46:  </slot>
13:51:46:  <slot id='2' type='GPU'>
13:51:46:    <opencl-index v='1'/>
13:51:46:  </slot>
13:51:46:  <slot id='3' type='GPU'>
13:51:46:    <opencl-index v='2'/>
13:51:46:  </slot>
13:51:46:  <slot id='4' type='GPU'>
13:51:46:    <cuda-index v='3'/>
13:51:46:    <opencl-index v='3'/>
13:51:46:  </slot>
13:51:46:</config>
13:51:55:WU04:FS04:Starting
13:51:55:WU04:FS04:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 04 -suffix 01 -version 704 -lifeline 1504 -checkpoint 15 -gpu-vendor nvidia -opencl-device 3 -cuda-device 3 -gpu 3
13:51:55:WU04:FS04:Started FahCore on PID 2781
13:51:55:WU04:FS04:Core PID:2785
13:51:55:WU04:FS04:FahCore 0x21 started
13:51:55:WU04:FS04:0x21:*********************** Log Started 2017-03-26T13:51:55Z ***********************
13:51:55:WU04:FS04:0x21:Project: 9839 (Run 0, Clone 41, Gen 104)
13:51:55:WU04:FS04:0x21:Unit: 0x00000078ab436ca05890cac6d1f0cd5a
13:51:55:WU04:FS04:0x21:CPU: 0x00000000000000000000000000000000
13:51:55:WU04:FS04:0x21:Machine: 4
13:51:55:WU04:FS04:0x21:Digital signatures verified
13:51:55:WU04:FS04:0x21:Folding@home GPU Core21 Folding@home Core
13:51:55:WU04:FS04:0x21:Version 0.0.18
13:52:00:WU04:FS04:0x21:Completed 0 out of 2400000 steps (0%)
13:52:00:WU04:FS04:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:52:00:WU02:FS02:0x21:Completed 187500 out of 6250000 steps (3%)
13:52:18:WARNING:FS02:Size of positions 346 does not match topology 334
13:52:26:WU03:FS03:0x21:Completed 125000 out of 2500000 steps (5%)
13:52:29:WU01:FS01:0x21:Completed 125000 out of 2500000 steps (5%)
13:52:40:WU04:FS04:0x21:Completed 24000 out of 2400000 steps (1%)
13:52:51:WU00:FS00:0xa7:Completed 115000 out of 250000 steps (46%)
13:52:59:WU02:FS02:0x21:Completed 250000 out of 6250000 steps (4%)
13:53:05:WARNING:FS02:Size of positions 346 does not match topology 334
13:53:10:WU03:FS03:0x21:Completed 150000 out of 2500000 steps (6%)
13:53:14:WU01:FS01:0x21:Completed 150000 out of 2500000 steps (6%)
13:53:21:WU04:FS04:0x21:Completed 48000 out of 2400000 steps (2%)
13:53:52:WARNING:FS02:Size of positions 346 does not match topology 334
13:53:55:WU03:FS03:0x21:Completed 175000 out of 2500000 steps (7%)
13:53:59:WU02:FS02:0x21:Completed 312500 out of 6250000 steps (5%)
13:53:59:WU01:FS01:0x21:Completed 175000 out of 2500000 steps (7%)
13:54:01:WU04:FS04:0x21:Completed 72000 out of 2400000 steps (3%)
13:54:39:WARNING:FS02:Size of positions 346 does not match topology 334
13:54:39:WU03:FS03:0x21:Completed 200000 out of 2500000 steps (8%)
13:54:41:WU04:FS04:0x21:Completed 96000 out of 2400000 steps (4%)
13:54:44:WU01:FS01:0x21:Completed 200000 out of 2500000 steps (8%)
13:54:58:WU02:FS02:0x21:Completed 375000 out of 6250000 steps (6%)
13:55:21:WU04:FS04:0x21:Completed 120000 out of 2400000 steps (5%)
13:55:26:WARNING:FS02:Size of positions 346 does not match topology 334
13:55:26:WU03:FS03:0x21:Completed 225000 out of 2500000 steps (9%)
13:55:31:WU01:FS01:0x21:Completed 225000 out of 2500000 steps (9%)
13:55:57:WU02:FS02:0x21:Completed 437500 out of 6250000 steps (7%)
13:56:01:WU04:FS04:0x21:Completed 144000 out of 2400000 steps (6%)
13:56:10:WU03:FS03:0x21:Completed 250000 out of 2500000 steps (10%)
13:56:14:WARNING:FS02:Size of positions 346 does not match topology 334
13:56:16:WU01:FS01:0x21:Completed 250000 out of 2500000 steps (10%)
13:56:41:WU04:FS04:0x21:Completed 168000 out of 2400000 steps (7%)
13:56:55:WU03:FS03:0x21:Completed 275000 out of 2500000 steps (11%)
13:56:56:WU02:FS02:0x21:Completed 500000 out of 6250000 steps (8%)
13:57:01:WU01:FS01:0x21:Completed 275000 out of 2500000 steps (11%)
13:57:02:WARNING:FS02:Size of positions 346 does not match topology 334
13:57:22:WU04:FS04:0x21:Completed 192000 out of 2400000 steps (8%)
13:57:40:WU03:FS03:0x21:Completed 300000 out of 2500000 steps (12%)
13:57:47:WU01:FS01:0x21:Completed 300000 out of 2500000 steps (12%)
13:57:49:WARNING:FS02:Size of positions 346 does not match topology 334
13:57:56:WU02:FS02:0x21:Completed 562500 out of 6250000 steps (9%)
13:58:04:WU04:FS04:0x21:Completed 216000 out of 2400000 steps (9%)
13:58:26:WU03:FS03:0x21:Completed 325000 out of 2500000 steps (13%)
13:58:34:WU01:FS01:0x21:Completed 325000 out of 2500000 steps (13%)
13:58:37:WARNING:FS02:Size of positions 346 does not match topology 334
13:58:44:WU04:FS04:0x21:Completed 240000 out of 2400000 steps (10%)
13:58:55:WU02:FS02:0x21:Completed 625000 out of 6250000 steps (10%)
13:59:10:WU03:FS03:0x21:Completed 350000 out of 2500000 steps (14%)
13:59:19:WU01:FS01:0x21:Completed 350000 out of 2500000 steps (14%)
13:59:24:WARNING:FS02:Size of positions 346 does not match topology 334
13:59:24:WU04:FS04:0x21:Completed 264000 out of 2400000 steps (11%)
13:59:53:WU02:FS02:0x21:Completed 687500 out of 6250000 steps (11%)
13:59:55:WU03:FS03:0x21:Completed 375000 out of 2500000 steps (15%)
14:00:05:WU01:FS01:0x21:Completed 375000 out of 2500000 steps (15%)
14:00:06:WU04:FS04:0x21:Completed 288000 out of 2400000 steps (12%)
14:00:11:WARNING:FS02:Size of positions 346 does not match topology 334
14:00:40:WU03:FS03:0x21:Completed 400000 out of 2500000 steps (16%)
14:00:42:WU00:FS00:0xa7:Completed 117500 out of 250000 steps (47%)
14:00:46:WU04:FS04:0x21:Completed 312000 out of 2400000 steps (13%)
14:00:50:WU01:FS01:0x21:Completed 400000 out of 2500000 steps (16%)
14:00:52:WU02:FS02:0x21:Completed 750000 out of 6250000 steps (12%)
14:00:58:WARNING:FS02:Size of positions 346 does not match topology 334
14:01:26:WU03:FS03:0x21:Completed 425000 out of 2500000 steps (17%)
14:01:26:WU04:FS04:0x21:Completed 336000 out of 2400000 steps (14%)
14:01:37:WU01:FS01:0x21:Completed 425000 out of 2500000 steps (17%)
14:01:46:WARNING:FS02:Size of positions 346 does not match topology 334
14:01:52:WU02:FS02:0x21:Completed 812500 out of 6250000 steps (13%)
14:02:08:WU04:FS04:0x21:Completed 360000 out of 2400000 steps (15%)
14:02:10:WU03:FS03:0x21:Completed 450000 out of 2500000 steps (18%)
14:02:22:WU01:FS01:0x21:Completed 450000 out of 2500000 steps (18%)
14:02:33:WARNING:FS02:Size of positions 346 does not match topology 334
14:02:50:WU04:FS04:0x21:Completed 384000 out of 2400000 steps (16%)
14:02:51:WU02:FS02:0x21:Completed 875000 out of 6250000 steps (14%)
14:02:55:WU03:FS03:0x21:Completed 475000 out of 2500000 steps (19%)
14:03:08:WU01:FS01:0x21:Completed 475000 out of 2500000 steps (19%)
14:03:20:WARNING:FS02:Size of positions 346 does not match topology 334
14:03:32:WU04:FS04:0x21:Completed 408000 out of 2400000 steps (17%)
14:03:39:WU03:FS03:0x21:Completed 500000 out of 2500000 steps (20%)
14:03:50:WU02:FS02:0x21:Completed 937500 out of 6250000 steps (15%)
14:03:53:WU01:FS01:0x21:Completed 500000 out of 2500000 steps (20%)
14:04:08:WARNING:FS02:Size of positions 346 does not match topology 334
14:04:11:WU04:FS04:0x21:Completed 432000 out of 2400000 steps (18%)
14:04:26:WU03:FS03:0x21:Completed 525000 out of 2500000 steps (21%)
14:04:40:WU01:FS01:0x21:Completed 525000 out of 2500000 steps (21%)
14:04:49:WU02:FS02:0x21:Completed 1000000 out of 6250000 steps (16%)
14:04:51:WU04:FS04:0x21:Completed 456000 out of 2400000 steps (19%)
14:04:55:WARNING:FS02:Size of positions 346 does not match topology 334
14:05:10:WU03:FS03:0x21:Completed 550000 out of 2500000 steps (22%)
14:05:25:WU01:FS01:0x21:Completed 550000 out of 2500000 steps (22%)
14:05:32:WU04:FS04:0x21:Completed 480000 out of 2400000 steps (20%)
14:05:42:WARNING:FS02:Size of positions 346 does not match topology 334
14:05:49:WU02:FS02:0x21:Completed 1062500 out of 6250000 steps (17%)
14:05:55:WU03:FS03:0x21:Completed 575000 out of 2500000 steps (23%)
14:06:10:WU01:FS01:0x21:Completed 575000 out of 2500000 steps (23%)
14:06:13:WU04:FS04:0x21:Completed 504000 out of 2400000 steps (21%)
14:06:30:WARNING:FS02:Size of positions 346 does not match topology 334
14:06:39:WU03:FS03:0x21:Completed 600000 out of 2500000 steps (24%)
14:06:48:WU02:FS02:0x21:Completed 1125000 out of 6250000 steps (18%)
14:06:54:WU04:FS04:0x21:Completed 528000 out of 2400000 steps (22%)
14:06:56:WU01:FS01:0x21:Completed 600000 out of 2500000 steps (24%)
14:07:17:WARNING:FS02:Size of positions 346 does not match topology 334
14:07:26:WU03:FS03:0x21:Completed 625000 out of 2500000 steps (25%)
14:07:36:WU04:FS04:0x21:Completed 552000 out of 2400000 steps (23%)
14:07:43:WU01:FS01:0x21:Completed 625000 out of 2500000 steps (25%)
14:07:48:WU02:FS02:0x21:Completed 1187500 out of 6250000 steps (19%)
14:08:05:WARNING:FS02:Size of positions 346 does not match topology 334
14:08:10:WU03:FS03:0x21:Completed 650000 out of 2500000 steps (26%)
14:08:17:WU04:FS04:0x21:Completed 576000 out of 2400000 steps (24%)
14:08:29:WU01:FS01:0x21:Completed 650000 out of 2500000 steps (26%)
14:08:40:WU00:FS00:0xa7:Completed 120000 out of 250000 steps (48%)
14:08:47:WU02:FS02:0x21:Completed 1250000 out of 6250000 steps (20%)
14:08:53:WARNING:FS02:Size of positions 346 does not match topology 334
14:08:55:WU03:FS03:0x21:Completed 675000 out of 2500000 steps (27%)
14:08:57:WU04:FS04:0x21:Completed 600000 out of 2400000 steps (25%)
14:09:14:WU01:FS01:0x21:Completed 675000 out of 2500000 steps (27%)
14:09:39:WU04:FS04:0x21:Completed 624000 out of 2400000 steps (26%)
14:09:40:WU03:FS03:0x21:Completed 700000 out of 2500000 steps (28%)
14:09:41:WARNING:FS02:Size of positions 346 does not match topology 334
14:09:48:WU02:FS02:0x21:Completed 1312500 out of 6250000 steps (21%)
14:10:00:WU01:FS01:0x21:Completed 700000 out of 2500000 steps (28%)

What's this thing about topology?

[ChristianVirtual]

the one with the topology you can ignore. In the current version of Core 21 is some bug with prevent the usage of viewer (some atoms in the topology are wrong coded; roughly). But it don't impact your folding performance or has any negative scientific side effect. Don't worry.

Looks like you made great progress; though the OpenCL error in the header still confuse me a bit.

[Nert]

Hiigaran,

Glad to see you're up and running. I think you'll be happy with Linux.

Thanks for contributing 2.8 Million PPD. At that rate you'll pass me up in a little over 2 months. It took me 10+ years to get there.

You're contributing a lot of processing power to a very valuable project.

[hiigaran]

If I have the time and energy, I might switch the next system over to Mint as well. Hardware is identical, so as long as I just repeat everything I've done exactly as I've done it, I should be able to make the switch without any issues. Most likely I'll end up doing it tomorrow though.

PPD is now at 3.25 on the first system, so combined with my second system, I should have a good 6.5 between the two. My personal system runs BOINC apps at the moment, but it's mostly for gaming anyway, so I doubt there would be that much output from there.

I still have one more GTX 1080 that is still in its box. Been meaning to drop that into an old system I planned on making for a media server, but I ran out of standoffs, so I'll probably need to wait a few more weeks before they arrive.

[ComputerGenie]

the one with the topology you can ignore. In the current version of Core 21 is some bug with prevent the usage of viewer (some atoms in the topology are wrong coded; roughly)...

Obviously I don't know any of the code-behind, but I'm not 100% convinced it's the Core that's the issue as it works fine in Debian/Xfce (Ive had viewer up and running, as well as 3 separate views from 3 separate cards on the screensaver). In my experience, the issue seems to be isolated to Windows.

[Nathan_P]

If I have the time and energy, I might switch the next system over to Mint as well. Hardware is identical, so as long as I just repeat everything I've done exactly as I've done it, I should be able to make the switch without any issues. Most likely I'll end up doing it tomorrow though.

PPD is now at 3.25 on the first system, so combined with my second system, I should have a good 6.5 between the two. My personal system runs BOINC apps at the moment, but it's mostly for gaming anyway, so I doubt there would be that much output from there.

I still have one more GTX 1080 that is still in its box. Been meaning to drop that into an old system I planned on making for a media server, but I ran out of standoffs, so I'll probably need to wait a few more weeks before they arrive.

3.25 sounds about right for 4x1080, glad you got it working