Nvidia Titan V

[Sven]

If one has spare 3000$, you'll probably get the fastest FoldingCard on the Planet:

https://www.hardocp.com/news/2017/12/07 ... tan_v_3000

[toTOW]

Delirious price ...

You can find an indication of the PPD here from the rack mounted GV100 : viewtopic.php?p=298515#p298515

[Sven]

One Card nearly makes as much points as my two 1080Ti together, that's impressive.

[foldy]

Guess it will take until late 2018 until we see consumer cards.

Nvidia Titan V: 5120 shaders
gtx 1180ti: 4800 shaders (Winter 2018/2019)
gtx 1180: 3584 shaders (Summer 2018) [= gtx 1080ti]
gtx 1170: 2560 shaders (Summer 2018) [= gtx 1080]
gtx 1160: 1920 shaders (Summer 2018) [= gtx 1070]

So the Volta generation just ups each class in shader count.

[foldy]

Expected PPD for small 9415 work units is 1700k PPD but overclocked and higher TDP it will go upto 2200k PPD for there work units.
For 11431 work units it gets 2600k PPD and overclocked will get 3500k PPD.

[Kuno]

Still for the price of the card you can get 4 1080Ti's and get almost twice the points.

[coffeechaps]

so i went ahead and got a pair of these Titans to test them out for folding. i cant get them to push past 800-900k PPD and I would like some help on this. 1080's have always been plug and play for me, so im assuming that may FAH or the NVIDIA drivers arent yet compatible.

Here is my log, any ideas would help:

Code: Select all

*********************** Log Started 2017-12-16T07:06:10Z ***********************
07:06:10:************************* Folding@home Client *************************
07:06:10:      Website: http://folding.stanford.edu/
07:06:10:    Copyright: (c) 2009-2014 Stanford University
07:06:10:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
07:06:10:         Args: 
07:06:10:       Config: C:/Users/Robert Ross/AppData/Roaming/FAHClient/config.xml
07:06:10:******************************** Build ********************************
07:06:10:      Version: 7.4.4
07:06:10:         Date: Mar 4 2014
07:06:10:         Time: 20:26:54
07:06:10:      SVN Rev: 4130
07:06:10:       Branch: fah/trunk/client
07:06:10:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
07:06:10:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
07:06:10:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
07:06:10:     Platform: win32 XP
07:06:10:         Bits: 32
07:06:10:         Mode: Release
07:06:10:******************************* System ********************************
07:06:10:          CPU: Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz
07:06:10:       CPU ID: GenuineIntel Family 6 Model 85 Stepping 4
07:06:10:         CPUs: 12
07:06:10:       Memory: 31.70GiB
07:06:10:  Free Memory: 30.08GiB
07:06:10:      Threads: WINDOWS_THREADS
07:06:10:   OS Version: 6.2
07:06:10:  Has Battery: false
07:06:10:   On Battery: false
07:06:10:   UTC Offset: -5
07:06:10:          PID: 7744
07:06:10:          CWD: C:/Users/Robert Ross/AppData/Roaming/FAHClient
07:06:10:           OS: Windows 10 Home
07:06:10:      OS Arch: AMD64
07:06:10:         GPUs: 2
07:06:10:        GPU 0: NVIDIA:5 GV100 [xxx]
07:06:10:        GPU 1: NVIDIA:5 GV100 [xxx]
07:06:10:         CUDA: 7.0
07:06:10:  CUDA Driver: 9010
07:06:10:Win32 Service: false
07:06:10:***********************************************************************
07:06:10:<config>
07:06:10:  <!-- Network -->
07:06:10:  <proxy v=':8080'/>
07:06:10:
07:06:10:  <!-- Slot Control -->
07:06:10:  <idle v='true'/>
07:06:10:  <power v='full'/>
07:06:10:
07:06:10:  <!-- User Information -->
07:06:10:  <passkey v='********************************'/>
07:06:10:  <team v='224497'/>
07:06:10:  <user v='coffeechaps_ALL_13qsqp4V1rjdPD8tDPeaBwPARfoEYtHoSE'/>
07:06:10:
07:06:10:  <!-- Folding Slots -->
07:06:10:  <slot id='1' type='GPU'>
07:06:10:    <idle v='false'/>
07:06:10:  </slot>
07:06:10:  <slot id='2' type='GPU'>
07:06:10:    <idle v='false'/>
07:06:10:  </slot>
07:06:10:</config>
07:06:10:Trying to access database...
07:06:10:Successfully acquired database lock
07:06:10:Enabled folding slot 01: READY gpu:0:GV100 [xxx]
07:06:10:Enabled folding slot 02: READY gpu:1:GV100 [xxx]
07:06:10:WU00:FS01:Starting
07:06:10:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Robert Ross/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe" -dir 00 -suffix 01 -version 704 -lifeline 7744 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
07:06:10:WU00:FS01:Started FahCore on PID 8460
07:06:10:WU00:FS01:Core PID:8488
07:06:10:WU00:FS01:FahCore 0x21 started
07:06:10:WU01:FS02:Starting
07:06:10:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Robert Ross/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe" -dir 01 -suffix 01 -version 704 -lifeline 7744 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
07:06:10:WU01:FS02:Started FahCore on PID 8508
07:06:10:WU01:FS02:Core PID:8532
07:06:10:WU01:FS02:FahCore 0x21 started
07:06:11:WU00:FS01:0x21:*********************** Log Started 2017-12-16T07:06:10Z ***********************
07:06:11:WU00:FS01:0x21:Project: 9414 (Run 2071, Clone 1, Gen 541)
07:06:11:WU00:FS01:0x21:Unit: 0x0000026bab436c9d585e06a08d65007d
07:06:11:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
07:06:11:WU00:FS01:0x21:Machine: 1
07:06:11:WU00:FS01:0x21:Digital signatures verified
07:06:11:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
07:06:11:WU00:FS01:0x21:Version 0.0.18
07:06:11:WU00:FS01:0x21:  Found a checkpoint file
07:06:11:WU01:FS02:0x21:*********************** Log Started 2017-12-16T07:06:10Z ***********************
07:06:11:WU01:FS02:0x21:Project: 9415 (Run 16, Clone 1, Gen 549)
07:06:11:WU01:FS02:0x21:Unit: 0x00000282ab436c9d585e06c99e5b4c3c
07:06:11:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
07:06:11:WU01:FS02:0x21:Machine: 2
07:06:11:WU01:FS02:0x21:Digital signatures verified
07:06:11:WU01:FS02:0x21:Folding@home GPU Core21 Folding@home Core
07:06:11:WU01:FS02:0x21:Version 0.0.18
07:06:11:WU01:FS02:0x21:  Found a checkpoint file
07:06:12:WU00:FS01:0x21:Completed 5850000 out of 6250000 steps (93%)
07:06:12:WU00:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:06:12:WU01:FS02:0x21:Completed 5450000 out of 6250000 steps (87%)
07:06:12:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:06:30:WU00:FS01:0x21:Completed 5875000 out of 6250000 steps (94%)
07:06:48:WU01:FS02:0x21:Completed 5500000 out of 6250000 steps (88%)
07:07:18:WU00:FS01:0x21:Completed 5937500 out of 6250000 steps (95%)
07:07:34:WU01:FS02:0x21:Completed 5562500 out of 6250000 steps (89%)
07:08:05:WU00:FS01:0x21:Completed 6000000 out of 6250000 steps (96%)
07:08:20:WU01:FS02:0x21:Completed 5625000 out of 6250000 steps (90%)
07:08:53:WU00:FS01:0x21:Completed 6062500 out of 6250000 steps (97%)
07:09:05:WU01:FS02:0x21:Completed 5687500 out of 6250000 steps (91%)
07:09:40:WU00:FS01:0x21:Completed 6125000 out of 6250000 steps (98%)
07:09:51:WU01:FS02:0x21:Completed 5750000 out of 6250000 steps (92%)
07:10:28:WU00:FS01:0x21:Completed 6187500 out of 6250000 steps (99%)
07:10:28:WU02:FS01:Connecting to 171.67.108.45:80
07:10:28:WU02:FS01:Assigned to work server 171.67.108.157
07:10:28:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GV100 [xxx] from 171.67.108.157
07:10:28:WU02:FS01:Connecting to 171.67.108.157:8080
07:10:29:WU02:FS01:Downloading 8.87MiB
07:10:31:WU02:FS01:Download complete
07:10:31:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9431 run:1307 clone:1 gen:127 core:0x21 unit:0x00000097ab436c9d586fdd3ec32e1354
07:10:36:WU01:FS02:0x21:Completed 5812500 out of 6250000 steps (93%)
07:11:15:WU00:FS01:0x21:Completed 6250000 out of 6250000 steps (100%)
07:11:15:WU00:FS01:0x21:Saving result file logfile_01.txt
07:11:15:WU00:FS01:0x21:Saving result file checkpointState.xml
07:11:15:WU00:FS01:0x21:Saving result file checkpt.crc
07:11:15:WU00:FS01:0x21:Saving result file log.txt
07:11:15:WU00:FS01:0x21:Saving result file positions.xtc
07:11:15:WU00:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
07:11:16:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
07:11:16:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9414 run:2071 clone:1 gen:541 core:0x21 unit:0x0000026bab436c9d585e06a08d65007d
07:11:16:WU00:FS01:Uploading 7.71MiB to 171.67.108.157
07:11:16:WU02:FS01:Starting
07:11:16:WU00:FS01:Connecting to 171.67.108.157:8080
07:11:16:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Robert Ross/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe" -dir 02 -suffix 01 -version 704 -lifeline 7744 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
07:11:16:WU02:FS01:Started FahCore on PID 7652
07:11:16:WU02:FS01:Core PID:7628
07:11:16:WU02:FS01:FahCore 0x21 started
07:11:17:WU02:FS01:0x21:*********************** Log Started 2017-12-16T07:11:16Z ***********************
07:11:17:WU02:FS01:0x21:Project: 9431 (Run 1307, Clone 1, Gen 127)
07:11:17:WU02:FS01:0x21:Unit: 0x00000097ab436c9d586fdd3ec32e1354
07:11:17:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
07:11:17:WU02:FS01:0x21:Machine: 1
07:11:17:WU02:FS01:0x21:Reading tar file core.xml
07:11:17:WU02:FS01:0x21:Reading tar file integrator.xml
07:11:17:WU02:FS01:0x21:Reading tar file state.xml
07:11:17:WU02:FS01:0x21:Reading tar file system.xml
07:11:17:WU02:FS01:0x21:Digital signatures verified
07:11:17:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
07:11:17:WU02:FS01:0x21:Version 0.0.18
07:11:20:WU02:FS01:0x21:Completed 0 out of 6250000 steps (0%)
07:11:20:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:11:22:WU00:FS01:Upload 93.26%
07:11:22:WU01:FS02:0x21:Completed 5875000 out of 6250000 steps (94%)
07:11:23:WU00:FS01:Upload complete
07:11:23:WU00:FS01:Server responded WORK_ACK (400)
07:11:23:WU00:FS01:Final credit estimate, 48049.00 points
07:11:23:WU00:FS01:Cleaning up
07:12:08:WU01:FS02:0x21:Completed 5937500 out of 6250000 steps (95%)
07:12:13:WU02:FS01:0x21:Completed 62500 out of 6250000 steps (1%)

[foldy]

The referenced Nvidia Tesla V uses Linux to get 1700k PPD/33sec TPF for the 9414/9415 work units.
Your Titan V uses Windows 10 and only gets 900k PPD/46 sec TPF for the 9414/9415 work units.

I hope the Titan V drivers do not cut down compute performance compared to Tesla V which gets those high speeds on Linux.

What is your slots pcie speed and bus usage?

[Ricky]

I am now running project 11432 on a Titan XP, and it is getting 1,382,701 PPD. This is a rare event. Most other project yield 780K PPD.

I would be interested in the Titan V if it could reliably get the high performance running projects. I can't justify adding more machines to my wife. I told the second machine is a spare, in case we have a problem with the other one.

[coffeechaps]

so I made sure that i got high end everything just in case it would under perform, the motherboard is a X299 AORUS LGA 2066 Gigabyte motherboard, and the 2 PCIe 3.0 x 16 slots are what both are in. In the bios i have everything set to high performance. MSI afterburner is showing only 42% on slot 1 and 24% on slot 2 for bus usage. I will check the BIOS again here in a second to make sure its setup right. Is there somewhere else I need to set the PCI higher, like perhaps motherboard drivers from the manufacture?

I attempted Ubuntu 16.04, but im not sure if anyone is having an issue with FAH on Ubuntu 16.04 but i couldnt get FAH or CUDA to work on it. I had some folding rigs on Ubuntu 14.04 before, but I cant find my installation disk for that version, so I will try and get it up on Ubuntu 14.04 when i can. But It still is under performing on Windows, and im not sure as to why. Overclocking them does bring the PPD to 1M roughly each, but I still feel this is low.

[bruce]

The drivers supplied with Ubuntu do not support OpenCL. YOu have to install the proprietary drivers to get all of the required run-time code. The Developer package also includes that code plus other things FAH doesn't care about.

[coffeechaps]

The drivers supplied with Ubuntu do not support OpenCL. YOu have to install the proprietary drivers to get all of the required run-time code. The Developer package also includes that code plus other things FAH doesn't care about.

i thought that CUDA came with the OpenCL drivers. i will try again, but i still had issues with the FAHclient and controller not installing properly.

i still am trying to get it working with windows first, unless i come to the conclusion that windows simply cant support these cards yet

[foldy]

The BIOS and mainboard drivers can sometimes make a difference. Your CPU i7-7800X brings 28 pcie lanes so this is one x16 and one x8 max. Can you check with tool GPU-Z which GPU gets what real pcie speeds? But as both perform the same pcie speed may not be the limit.

[Nathan_P]

The openCL drivers come with the cuda toolkit, but i'm not sure of the syntax to get the drivers & toolkit on Debian. I have found Mint to be the easiest to install everything on

[coffeechaps]

The BIOS and mainboard drivers can sometimes make a difference. Your CPU i7-7800X brings 28 pcie lanes so this is one x16 and one x8 max. Can you check with tool GPU-Z which GPU gets what real pcie speeds? But as both perform the same pcie speed may not be the limit.

So adding the mobo drivers def helped, one of my cards is beginning to do 2m PPD, but that is on a project 11432, the other however is still stuck at 900k PPD on project 9415. I downloaded the GPU-Z and you are correct, the second slot kicks down to PCIe x8, even though its a x16 card. Perhaps i can try removing it from folding all together and see if the other one begins to kick into even higher gear, does anyone know if this would help?