Page 1 of 1

Project 9414 (171.67.108.157) upload failing

Posted: Sat Jul 08, 2017 4:06 pm
by lovingfriendstar

Code: Select all

15:42:04:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9414 run:464 clone:0 gen:286 core:0x21 unit:0x00000152ab436c9d585e06936a4fa890
15:42:04:WU01:FS01:Uploading 7.76MiB to 171.67.108.157
15:42:04:WU01:FS01:Connecting to 171.67.108.157:8080
15:49:05:WU01:FS01:Upload 1.61%
15:49:05:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
I have had this work unit twice and it was stuck on the same uploading twice. In the meantime, I finished and uploaded about 3-4 other WUs from other projects just fine. Anyone else having issues with this server?

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sat Jul 08, 2017 6:26 pm
by bruce
For whatever reason, Server 171.67.108.157 is off-line at the moment. (Maybe as a result of yesterday's power outage at Stanford.)

Normally, your client will try both a Work Server and a Collection server. I don't see enough of your log to know what happened when it tried the other one.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sat Jul 08, 2017 10:09 pm
by Joe_H
This WS is responding on port 8080 in a browser, and the Server Status page and log show it accepting returns. It timed out on port 80 connections earlier this afternoon when I checked, but is now responding on that port as well.

As bruce mentioned, we would need to see more of your log.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sun Jul 09, 2017 1:03 am
by lovingfriendstar
bruce wrote:For whatever reason, Server 171.67.108.157 is off-line at the moment. (Maybe as a result of yesterday's power outage at Stanford.)

Normally, your client will try both a Work Server and a Collection server. I don't see enough of your log to know what happened when it tried the other one.
That particular WUs which failed uploading do not have a separate collection server and are showing 0.0.0.0 so I thought it was irrelevant to post. I also have another WU of project 9414 folding right now and this WU now has collection server of 171.67.108.46.

I had to restart the computer so I no longer have the old logs anymore(?). Anyways the failed ones will upload again in about 30 minutes. Will report again whether it succeeded this time or failed again.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sun Jul 09, 2017 1:19 am
by Joe_H
The client keeps the last 16 logs by default in a folder named 'logs' in the same folder as the current log file. A time stamp is added to the name.

Other important information is shown in the first 100 or so lines of the log file. That includes information about your system and it configuration for the folding client.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sun Jul 09, 2017 8:59 am
by lovingfriendstar
Now, the other WU from Project 9414 which has a collection server and ran completely fine without errors failed after upload. "Server did not like results, dumping"

Code: Select all

07:02:44:WU03:FS00:0x21:Saving result file logfile_01.txt
07:02:44:WU03:FS00:0x21:Saving result file checkpointState.xml
07:02:44:WU03:FS00:0x21:Saving result file checkpt.crc
07:02:44:WU03:FS00:0x21:Saving result file log.txt
07:02:44:WU03:FS00:0x21:Saving result file positions.xtc
07:02:44:WU03:FS00:0x21:Folding@home Core Shutdown: FINISHED_UNIT
07:02:44:WU03:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
07:02:44:WU03:FS00:Sending unit results: id:03 state:SEND error:NO_ERROR project:9431 run:1428 clone:0 gen:32 core:0x21 unit:0x0000002aab436c9d586fdd3fafda831e
07:02:44:WU03:FS00:Uploading 13.66MiB to 171.67.108.157
07:02:44:WU03:FS00:Connecting to 171.67.108.157:8080
07:06:42:WU03:FS00:Upload 1.37%
07:06:42:WARNING:WU03:FS00:Exception: Failed to send results to work server: Transfer failed
07:06:42:WU03:FS00:Trying to send results to collection server
07:06:42:WU03:FS00:Uploading 13.66MiB to 171.67.108.46
07:06:42:WU03:FS00:Connecting to 171.67.108.46:8080
07:06:48:WU03:FS00:Upload 1.37%
07:06:55:WU03:FS00:Upload 3.20%
07:07:02:WU03:FS00:Upload 4.58%
07:07:08:WU03:FS00:Upload 5.49%
07:07:14:WU03:FS00:Upload 7.32%
07:07:20:WU03:FS00:Upload 8.69%
07:07:26:WU03:FS00:Upload 10.07%
07:07:32:WU03:FS00:Upload 11.90%
07:07:38:WU03:FS00:Upload 13.27%
07:07:47:WU03:FS00:Upload 13.73%
07:07:55:WU03:FS00:Upload 16.01%
07:08:02:WU03:FS00:Upload 18.30%
07:08:08:WU03:FS00:Upload 20.59%
07:08:15:WU03:FS00:Upload 22.88%
07:08:21:WU03:FS00:Upload 23.79%
07:08:29:WU03:FS00:Upload 25.16%
07:08:44:WU03:FS00:Upload 26.99%
07:08:50:WU03:FS00:Upload 28.82%
07:08:57:WU03:FS00:Upload 30.65%
07:09:03:WU03:FS00:Upload 32.03%
07:09:09:WU03:FS00:Upload 33.86%
07:09:15:WU03:FS00:Upload 35.23%
07:09:21:WU03:FS00:Upload 37.06%
07:09:28:WU03:FS00:Upload 38.89%
07:09:39:WU03:FS00:Upload 40.26%
07:09:45:WU03:FS00:Upload 42.09%
07:09:51:WU03:FS00:Upload 43.46%
07:09:58:WU03:FS00:Upload 45.29%
07:10:06:WU03:FS00:Upload 47.12%
07:10:14:WU03:FS00:Upload 48.50%
07:10:20:WU03:FS00:Upload 49.87%
07:10:29:WU03:FS00:Upload 51.70%
07:10:36:WU03:FS00:Upload 53.53%
07:10:42:WU03:FS00:Upload 54.90%
07:10:48:WU03:FS00:Upload 55.82%
07:10:55:WU03:FS00:Upload 57.65%
07:11:07:WU03:FS00:Upload 59.02%
07:11:13:WU03:FS00:Upload 60.85%
07:11:19:WU03:FS00:Upload 62.68%
07:11:26:WU03:FS00:Upload 64.05%
07:11:35:WU03:FS00:Upload 65.88%
07:11:41:WU03:FS00:Upload 67.71%
07:11:48:WU03:FS00:Upload 69.54%
07:11:54:WU03:FS00:Upload 71.37%
07:12:04:WU03:FS00:Upload 72.29%
07:12:12:WU03:FS00:Upload 74.12%
07:12:19:WU03:FS00:Upload 75.95%
07:12:26:WU03:FS00:Upload 77.78%
07:12:33:WU03:FS00:Upload 79.61%
07:12:39:WU03:FS00:Upload 80.52%
07:12:46:WU03:FS00:Upload 82.35%
07:12:52:WU03:FS00:Upload 83.73%
07:12:58:WU03:FS00:Upload 84.64%
07:13:04:WU03:FS00:Upload 86.01%
07:13:21:WU03:FS00:Upload 86.93%
07:13:27:WU03:FS00:Upload 87.84%
07:13:35:WU03:FS00:Upload 88.76%
07:13:45:WU03:FS00:Upload 89.67%
07:13:51:WU03:FS00:Upload 91.50%
07:14:02:WU03:FS00:Upload 92.88%
07:14:08:WU03:FS00:Upload 94.25%
07:14:18:WU03:FS00:Upload 95.62%
07:14:25:WU03:FS00:Upload 96.99%
07:14:31:WU03:FS00:Upload 98.82%
07:14:49:WU03:FS00:Upload complete
07:14:49:WU03:FS00:Server responded WORK_QUIT (404)
07:14:49:WARNING:WU03:FS00:Server did not like results, dumping
07:14:49:WU03:FS00:Cleaning up
Here's the part when that WU started. No error or warning in the logs between these two parts.

Code: Select all

04:51:01:WU03:FS00:0x21:*********************** Log Started 2017-07-09T04:51:01Z ***********************
04:51:01:WU03:FS00:0x21:Project: 9431 (Run 1428, Clone 0, Gen 32)
04:51:01:WU03:FS00:0x21:Unit: 0x0000002aab436c9d586fdd3fafda831e
04:51:01:WU03:FS00:0x21:CPU: 0x00000000000000000000000000000000
04:51:01:WU03:FS00:0x21:Machine: 0
04:51:01:WU03:FS00:0x21:Reading tar file core.xml
04:51:01:WU03:FS00:0x21:Reading tar file integrator.xml
04:51:01:WU03:FS00:0x21:Reading tar file state.xml
04:51:01:WU03:FS00:0x21:Reading tar file system.xml
04:51:01:WU03:FS00:0x21:Digital signatures verified
04:51:01:WU03:FS00:0x21:Folding@home GPU Core21 Folding@home Core
04:51:01:WU03:FS00:0x21:Version 0.0.18
04:51:05:WU03:FS00:0x21:Completed 0 out of 6250000 steps (0%)
04:51:05:WU03:FS00:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
And it is running another project 9414 again. I will wait and see what happens after it finishes. I don't want it to fail again and waste computing power any more.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sun Jul 09, 2017 9:17 am
by lovingfriendstar
First few lines of the log file containing config

Code: Select all

*********************** Log Started 2017-07-08T16:47:06Z ***********************
16:47:06:************************* Folding@home Client *************************
16:47:06:      Website: http://folding.stanford.edu/
16:47:06:    Copyright: (c) 2009-2014 Stanford University
16:47:06:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:47:06:         Args: 
16:47:06:       Config: C:/ProgramData/FAHClient/config.xml
16:47:06:******************************** Build ********************************
16:47:06:      Version: 7.4.4
16:47:06:         Date: Mar 4 2014
16:47:06:         Time: 20:26:54
16:47:06:      SVN Rev: 4130
16:47:06:       Branch: fah/trunk/client
16:47:06:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
16:47:06:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
16:47:06:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
16:47:06:     Platform: win32 XP
16:47:06:         Bits: 32
16:47:06:         Mode: Release
16:47:06:******************************* System ********************************
16:47:06:          CPU: AMD Ryzen 7 1700 Eight-Core Processor
16:47:06:       CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
16:47:06:         CPUs: 16
16:47:06:       Memory: 7.95GiB
16:47:06:  Free Memory: 5.09GiB
16:47:06:      Threads: WINDOWS_THREADS
16:47:06:   OS Version: 6.2
16:47:06:  Has Battery: false
16:47:06:   On Battery: false
16:47:06:   UTC Offset: 6
16:47:06:          PID: 14756
16:47:06:          CWD: C:/ProgramData/FAHClient
16:47:06:           OS: Windows 10 Pro
16:47:06:      OS Arch: AMD64
16:47:06:         GPUs: 3
16:47:06:        GPU 0: NVIDIA:7 GP104 [GeForce GTX 1070] 6463
16:47:06:        GPU 1: NVIDIA:7 GP106 [GeForce GTX 1060 6GB] 4372
16:47:06:        GPU 2: UNSUPPORTED: NV3 [PCI]
16:47:06:         CUDA: 6.1
16:47:06:  CUDA Driver: 9000
16:47:06:Win32 Service: false
16:47:06:***********************************************************************
16:47:07:<config>
16:47:07:  <!-- Folding Core -->
16:47:07:  <checkpoint v='3'/>
16:47:07:  <core-priority v='low'/>
16:47:07:
16:47:07:  <!-- Folding Slot Configuration -->
16:47:07:  <cause v='ALZHEIMERS'/>
16:47:07:
16:47:07:  <!-- HTTP Server -->
16:47:07:  <allow v='127.0.0.1,192.168.1.0-192.168.1.255'/>
16:47:07:
16:47:07:  <!-- Network -->
16:47:07:  <proxy v=':8080'/>
16:47:07:
16:47:07:  <!-- Remote Command Server -->
16:47:07:  <password v='****'/>
16:47:07:
16:47:07:  <!-- Slot Control -->
16:47:07:  <power v='full'/>
16:47:07:
16:47:07:  <!-- User Information -->
16:47:07:  <passkey v='********************************'/>
16:47:07:  <team v='224497'/>
16:47:07:  <user v='lfriendstar_ALL_1GgybGsaXmxtL3NJzbwMGRAirUTUciSvrS'/>
16:47:07:
16:47:07:  <!-- Folding Slots -->
16:47:07:  <slot id='0' type='GPU'>
16:47:07:    <client-type v='advanced'/>
16:47:07:    <gpu-index v='0'/>
16:47:07:    <next-unit-percentage v='98'/>
16:47:07:  </slot>
16:47:07:  <slot id='1' type='GPU'>
16:47:07:    <gpu-index v='1'/>
16:47:07:  </slot>
16:47:07:</config>
16:47:07:Trying to access database...
16:47:07:Successfully acquired database lock
16:47:07:Enabled folding slot 00: READY gpu:0:GP104 [GeForce GTX 1070] 6463
16:47:07:Enabled folding slot 01: READY gpu:1:GP106 [GeForce GTX 1060 6GB] 4372

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sun Jul 09, 2017 10:20 am
by lovingfriendstar
It failed again.

Code: Select all

09:59:30:WU02:FS00:0x21:Completed 6250000 out of 6250000 steps (100%)
09:59:31:WU02:FS00:0x21:Saving result file logfile_01.txt
09:59:31:WU02:FS00:0x21:Saving result file checkpointState.xml
09:59:31:WU02:FS00:0x21:Saving result file checkpt.crc
09:59:31:WU02:FS00:0x21:Saving result file log.txt
09:59:31:WU02:FS00:0x21:Saving result file positions.xtc
09:59:31:WU02:FS00:0x21:Folding@home Core Shutdown: FINISHED_UNIT
09:59:31:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:59:31:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9414 run:417 clone:0 gen:198 core:0x21 unit:0x000000eaab436c9d585e0692a9c96be7
09:59:31:WU02:FS00:Uploading 7.78MiB to 171.67.108.157
09:59:31:WU02:FS00:Connecting to 171.67.108.157:8080
09:59:36:WU00:FS00:Download 17.64%
09:59:44:WU00:FS00:Download 18.81%
09:59:51:WU00:FS00:Download 19.99%
09:59:58:WU02:FS00:Upload 1.61%
09:59:59:WU00:FS00:Download 21.16%
10:00:08:WU00:FS00:Download 22.34%
10:00:15:WU00:FS00:Download 23.52%
10:00:25:WU00:FS00:Download 24.69%
10:00:32:WU00:FS00:Download 25.87%
10:00:39:WU00:FS00:Download 27.04%
10:00:45:WU00:FS00:Download 28.22%
10:00:54:WU00:FS00:Download 29.39%
10:01:00:WU00:FS00:Download 30.57%
10:01:03:WU04:FS01:0x21:Completed 1120000 out of 2000000 steps (56%)
10:01:10:WU00:FS00:Download 32.92%
10:01:18:WU00:FS00:Download 35.27%
10:01:25:WU00:FS00:Download 36.45%
10:01:33:WU00:FS00:Download 37.63%
10:01:40:WU00:FS00:Download 38.80%
10:01:47:WU00:FS00:Download 39.98%
10:01:56:WU00:FS00:Download 41.15%
10:02:07:WU00:FS00:Download 43.50%
10:02:15:WU00:FS00:Download 44.68%
10:02:22:WU00:FS00:Download 45.86%
10:02:33:WU00:FS00:Download 48.21%
10:02:39:WU00:FS00:Download 49.38%
10:02:47:WU00:FS00:Download 50.56%
10:02:51:WU02:FS00:Upload 2.41%
10:03:00:WU00:FS00:Download 51.73%
10:03:09:WU00:FS00:Download 52.91%
10:03:10:WU02:FS00:Upload 4.02%
10:03:16:WU02:FS00:Upload 4.82%
10:03:18:WU00:FS00:Download 54.09%
10:03:29:WU00:FS00:Download 55.26%
10:03:39:WU00:FS00:Download 56.44%
10:03:47:WU00:FS00:Download 57.61%
10:03:53:WU00:FS00:Download 58.79%
10:04:00:WU04:FS01:0x21:Completed 1140000 out of 2000000 steps (57%)
10:04:00:WU00:FS00:Download 59.97%
10:04:07:WU00:FS00:Download 61.14%
10:04:12:WU02:FS00:Upload 5.62%
10:04:12:WARNING:WU02:FS00:Exception: Failed to send results to work server: Transfer failed
10:04:12:WU02:FS00:Trying to send results to collection server
10:04:12:WU02:FS00:Uploading 7.78MiB to 171.67.108.46
10:04:12:WU02:FS00:Connecting to 171.67.108.46:8080
10:04:16:WU00:FS00:Download 62.32%
10:04:20:WU02:FS00:Upload 2.41%
10:04:26:WU00:FS00:Download 63.49%
10:04:30:WU02:FS00:Upload 4.02%
10:04:32:WU00:FS00:Download 64.67%
10:04:36:WU02:FS00:Upload 4.82%
10:04:39:WU00:FS00:Download 65.84%
10:04:44:WU02:FS00:Upload 7.23%
10:04:45:WU00:FS00:Download 67.02%
10:04:51:WU00:FS00:Download 68.20%
10:04:51:WU02:FS00:Upload 8.83%
10:04:57:WU00:FS00:Download 69.37%
10:04:58:WU02:FS00:Upload 10.44%
10:05:07:WU02:FS00:Upload 11.24%
10:05:09:WU00:FS00:Download 71.72%
10:05:13:WU02:FS00:Upload 12.85%
10:05:16:WU00:FS00:Download 72.90%
10:05:21:WU02:FS00:Upload 14.45%
10:05:23:WU00:FS00:Download 74.07%
10:05:27:WU02:FS00:Upload 16.06%
10:05:30:WU00:FS00:Download 75.25%
10:05:35:WU02:FS00:Upload 17.67%
10:05:36:WU00:FS00:Download 76.43%
10:05:42:WU00:FS00:Download 77.60%
10:05:43:WU02:FS00:Upload 19.27%
10:05:48:WU00:FS00:Download 78.78%
10:05:50:WU02:FS00:Upload 20.88%
10:05:55:WU00:FS00:Download 79.95%
10:05:56:WU02:FS00:Upload 21.68%
10:06:04:WU02:FS00:Upload 23.29%
10:06:07:WU00:FS00:Download 81.13%
10:06:11:WU02:FS00:Upload 24.89%
10:06:16:WU00:FS00:Download 82.31%
10:06:17:WU02:FS00:Upload 25.70%
10:06:24:WU02:FS00:Upload 26.50%
10:06:28:WU00:FS00:Download 84.66%
10:06:31:WU02:FS00:Upload 28.91%
10:06:38:WU02:FS00:Upload 30.51%
10:06:39:WU00:FS00:Download 85.83%
10:06:47:WU02:FS00:Upload 32.92%
10:06:48:WU00:FS00:Download 87.01%
10:06:51:WU04:FS01:0x21:Completed 1160000 out of 2000000 steps (58%)
10:06:53:WU02:FS00:Upload 34.53%
10:06:58:WU00:FS00:Download 88.18%
10:07:01:WU02:FS00:Upload 36.14%
10:07:06:WU00:FS00:Download 89.36%
10:07:08:WU02:FS00:Upload 36.94%
10:07:14:WU00:FS00:Download 90.54%
10:07:17:WU02:FS00:Upload 38.54%
10:07:20:WU00:FS00:Download 91.71%
10:07:26:WU02:FS00:Upload 40.15%
10:07:29:WU00:FS00:Download 94.06%
10:07:36:WU02:FS00:Upload 42.56%
10:07:38:WU00:FS00:Download 96.41%
10:07:44:WU02:FS00:Upload 44.97%
10:07:45:WU00:FS00:Download 97.59%
10:07:52:WU02:FS00:Upload 46.57%
10:07:55:WU00:FS00:Download 99.94%
10:07:55:WU00:FS00:Download complete
10:07:55:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11406 run:6 clone:37 gen:302 core:0x21 unit:0x000001b88ca304f25686b1f7b9c8bc17
10:07:55:WU00:FS00:Starting
10:07:55:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 14756 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
10:07:56:WU00:FS00:Started FahCore on PID 6252
10:07:56:WU00:FS00:Core PID:11284
10:07:56:WU00:FS00:FahCore 0x21 started
10:07:56:WU00:FS00:0x21:*********************** Log Started 2017-07-09T10:07:56Z ***********************
10:07:56:WU00:FS00:0x21:Project: 11406 (Run 6, Clone 37, Gen 302)
10:07:56:WU00:FS00:0x21:Unit: 0x000001b88ca304f25686b1f7b9c8bc17
10:07:56:WU00:FS00:0x21:CPU: 0x00000000000000000000000000000000
10:07:56:WU00:FS00:0x21:Machine: 0
10:07:56:WU00:FS00:0x21:Reading tar file core.xml
10:07:56:WU00:FS00:0x21:Reading tar file system.xml
10:07:56:WU00:FS00:0x21:Reading tar file integrator.xml
10:07:56:WU00:FS00:0x21:Reading tar file state.xml
10:07:57:WU00:FS00:0x21:Digital signatures verified
10:07:57:WU00:FS00:0x21:Folding@home GPU Core21 Folding@home Core
10:07:57:WU00:FS00:0x21:Version 0.0.18
10:07:59:WU02:FS00:Upload 48.98%
10:08:07:WU00:FS00:0x21:Completed 0 out of 5000000 steps (0%)
10:08:07:WU00:FS00:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:08:10:WU02:FS00:Upload 50.59%
10:08:16:WU02:FS00:Upload 53.00%
10:08:23:WU02:FS00:Upload 54.60%
10:08:30:WU02:FS00:Upload 55.41%
10:08:36:WU02:FS00:Upload 57.01%
10:08:43:WU02:FS00:Upload 57.82%
10:08:51:WU02:FS00:Upload 59.42%
10:08:58:WU02:FS00:Upload 61.03%
10:09:04:WU02:FS00:Upload 61.83%
10:09:12:WU02:FS00:Upload 63.44%
10:09:29:WU02:FS00:Upload 64.24%
10:09:37:WU02:FS00:Upload 65.04%
10:09:43:WU04:FS01:0x21:Completed 1180000 out of 2000000 steps (59%)
10:09:44:WU02:FS00:Upload 67.45%
10:09:51:WU02:FS00:Upload 69.06%
10:09:58:WU02:FS00:Upload 70.66%
10:10:04:WU02:FS00:Upload 72.27%
10:10:11:WU02:FS00:Upload 73.88%
10:10:17:WU02:FS00:Upload 75.48%
10:10:23:WU02:FS00:Upload 77.09%
10:10:30:WU02:FS00:Upload 78.70%
10:10:37:WU02:FS00:Upload 80.30%
10:10:43:WU02:FS00:Upload 81.91%
10:10:50:WU02:FS00:Upload 84.32%
10:10:57:WU02:FS00:Upload 85.92%
10:11:11:WU00:FS00:0x21:Completed 50000 out of 5000000 steps (1%)
10:11:14:WU02:FS00:Upload 87.53%
10:11:21:WU02:FS00:Upload 90.74%
10:11:34:WU02:FS00:Upload 92.35%
10:11:41:WU02:FS00:Upload 93.95%
10:11:48:WU02:FS00:Upload 95.56%
10:11:56:WU02:FS00:Upload 97.97%
10:12:03:WU02:FS00:Upload 100.00%
10:12:06:WU02:FS00:Upload complete
10:12:06:WU02:FS00:Server responded WORK_QUIT (404)
10:12:06:WARNING:WU02:FS00:Server did not like results, dumping
10:12:06:WU02:FS00:Cleaning up
I will delete p9414 WUs whenever they appear in the mean time before the solutions are found. It isn't worth to waste electricity and computing power on a project that is failing successively, and missing out on PPD because of a fault that isn't mine. I've wasted 130,000+ points on those WU in 24 hours. Hopefully, a solution will be found soon.

If anyone needs more info out of my logs, let me know which part I should be posting here though I haven't seen anything out of ordinary during the run of WU.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sun Jul 09, 2017 8:18 pm
by bruce
Is your GPU overclocked?

Many of the benchmarks used for overclocking are somewhat lax compared to FAH, which demands a very high degree of computational reliability compared to games/video/etc.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Mon Jul 10, 2017 1:54 pm
by lovingfriendstar
I have undervolted it a bit to help with power draw and heat but it isn't overclocked beyond what it normally boosts to. In fact, the maximum clock is even lower than what it boosts to. I don't suppose it is the culprit?

Re: Project 9414 (171.67.108.157) upload failing

Posted: Tue Jul 25, 2017 6:15 am
by bruce
The problem is back Serverstatus indicates that 171.67.108.157 is down (not accepting connections).
Apparently the CS doesn't work when the WS is in that state.

Code: Select all

05:44:23:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:9415 run:1366 clone:0 gen:124 core:0x21 unit:0x0000008fab436c9d585e06d5a5e323ed
05:44:23:WU03:FS01:Uploading 7.82MiB to 171.67.108.157
05:44:23:WU03:FS01:Connecting to 171.67.108.157:8080
05:44:45:WU03:FS01:Upload 1.60%
05:44:45:WARNING:WU03:FS01:Exception: Failed to send results to work server: Transfer failed
05:44:45:WU03:FS01:Trying to send results to collection server
05:44:45:WU03:FS01:Uploading 7.82MiB to 171.67.108.46
05:44:45:WU03:FS01:Connecting to 171.67.108.46:8080
05:44:52:WU03:FS01:Upload 6.40%
05:44:58:WU03:FS01:Upload 7.99%
(more like this)
05:47:57:WU03:FS01:Upload 97.53%
05:48:07:WU03:FS01:Upload complete
05:48:07:WU03:FS01:Server responded WORK_QUIT (404)
05:48:07:WARNING:WU03:FS01:Server did not like results, dumping
05:48:07:WU03:FS01:Cleaning up

Re: Project 9414 (171.67.108.157) upload failing

Posted: Tue Jul 25, 2017 11:43 am
by SteveWillis
Yesterday I had WU 9414 (397,0,246) stuck on "Send" and the FS stuck on "Ready". Not long before it happened I had deleted and recreated all my FSs(after finishing all WUs) in order to swap out a GPU and just assumed it was related to that. I finally deleted the WU directory in /var/lib/fahclient/work but strangely the WU still displays in the work queue with status "Send". Currently all FSs are working correctly.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Tue Jul 25, 2017 4:54 pm
by bruce
@Steve Willis

You appear to have a different problem.

The "WUs stuck send mode" problem has been reported there and several other places. You might want to read that topic and read the posts in the beta client subforum.

In my case (above) there were noted issues with the WS and it resulted in a dumped WU rather than a stuck WU. I'd much rather have a stuck WU which can be recovered than a "server did not like...dumping" from which there is no recovery.

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sat Sep 02, 2017 8:32 pm
by RABishop
I have been having repeated failures with this WS, as well as with 140.163.4.233 & *.232. All show off line, but whatever video card I load into one system, the card always tries to get jobs from these 2/3 sources, and fails. For a brief moment, I did see that the GPU had an actual job, the number being 9431, but that disappeared so fast I couldn't see what work and collection servers might have been associated with it.

Code: Select all

20:20:23:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:20:23:WU02:FS01:Started FahCore on PID 3226
20:20:23:WU02:FS01:Core PID:3230
20:20:23:WU02:FS01:FahCore 0x21 started
20:20:24:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:20:23Z ***********************
20:20:24:WU02:FS01:0x21:Project: 9414 (Run 2109, Clone 0, Gen 51)
20:20:24:WU02:FS01:0x21:Unit: 0x00000040ab436c9d585e06a06c144964
20:20:24:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:20:24:WU02:FS01:0x21:Machine: 1
20:20:24:WU02:FS01:0x21:Reading tar file core.xml
20:20:24:WU02:FS01:0x21:Reading tar file integrator.xml
20:20:24:WU02:FS01:0x21:Reading tar file state.xml
20:20:24:WU02:FS01:0x21:Reading tar file system.xml
20:20:24:WU02:FS01:0x21:Digital signatures verified
20:20:24:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:20:24:WU02:FS01:0x21:Version 0.0.18
20:20:24:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:20:24:WU02:FS01:0x21:Saving result file logfile_01.txt
20:20:24:WU02:FS01:0x21:Saving result file log.txt
20:20:24:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:20:24:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:20:24:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9414 run:2109 clone:0 gen:51 core:0x21 unit:0x00000040ab436c9d585e06a06c144964
20:20:24:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:20:24:WU02:FS01:Connecting to 171.67.108.157:8080
20:20:24:WU02:FS01:Upload complete
20:20:24:WU02:FS01:Server responded WORK_ACK (400)
20:20:24:WU02:FS01:Cleaning up
20:20:24:WU01:FS01:Connecting to 171.67.108.45:80
20:20:25:WU01:FS01:Assigned to work server 171.67.108.157
20:20:25:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:20:25:WU01:FS01:Connecting to 171.67.108.157:8080
20:20:25:WU01:FS01:Downloading 8.84MiB
20:20:26:WU01:FS01:Download complete
20:20:26:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:1241 clone:0 gen:94 core:0x21 unit:0x00000078ab436c9d586fdd3debcc8d2b
20:20:26:WU01:FS01:Starting
20:20:26:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:20:26:WU01:FS01:Started FahCore on PID 3235
20:20:26:WU01:FS01:Core PID:3239
20:20:26:WU01:FS01:FahCore 0x21 started
20:20:27:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:20:26Z ***********************
20:20:27:WU01:FS01:0x21:Project: 9431 (Run 1241, Clone 0, Gen 94)
20:20:27:WU01:FS01:0x21:Unit: 0x00000078ab436c9d586fdd3debcc8d2b
20:20:27:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:20:27:WU01:FS01:0x21:Machine: 1
20:20:27:WU01:FS01:0x21:Reading tar file core.xml
20:20:27:WU01:FS01:0x21:Reading tar file integrator.xml
20:20:27:WU01:FS01:0x21:Reading tar file state.xml
20:20:27:WU01:FS01:0x21:Reading tar file system.xml
20:20:27:WU01:FS01:0x21:Digital signatures verified
20:20:27:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:20:27:WU01:FS01:0x21:Version 0.0.18
20:20:27:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:20:27:WU01:FS01:0x21:Saving result file logfile_01.txt
20:20:27:WU01:FS01:0x21:Saving result file log.txt
20:20:27:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:20:27:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:20:27:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:1241 clone:0 gen:94 core:0x21 unit:0x00000078ab436c9d586fdd3debcc8d2b
20:20:27:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:20:27:WU01:FS01:Connecting to 171.67.108.157:8080
20:20:27:WU01:FS01:Upload complete
20:20:27:WU01:FS01:Server responded WORK_ACK (400)
20:20:27:WU01:FS01:Cleaning up
20:20:27:WU02:FS01:Connecting to 171.67.108.45:80
20:20:28:WU02:FS01:Assigned to work server 171.67.108.157
20:20:28:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:20:28:WU02:FS01:Connecting to 171.67.108.157:8080
20:20:28:WU02:FS01:Downloading 5.15MiB
20:20:28:WU02:FS01:Download complete
20:20:28:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9414 run:1799 clone:1 gen:45 core:0x21 unit:0x00000031ab436c9d585e069ee54ec177
20:20:28:WU02:FS01:Starting
20:20:28:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:20:28:WU02:FS01:Started FahCore on PID 3244
20:20:28:WU02:FS01:Core PID:3248
20:20:28:WU02:FS01:FahCore 0x21 started
20:20:29:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:20:29Z ***********************
20:20:29:WU02:FS01:0x21:Project: 9414 (Run 1799, Clone 1, Gen 45)
20:20:29:WU02:FS01:0x21:Unit: 0x00000031ab436c9d585e069ee54ec177
20:20:29:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:20:29:WU02:FS01:0x21:Machine: 1
20:20:29:WU02:FS01:0x21:Reading tar file core.xml
20:20:29:WU02:FS01:0x21:Reading tar file integrator.xml
20:20:29:WU02:FS01:0x21:Reading tar file state.xml
20:20:29:WU02:FS01:0x21:Reading tar file system.xml
20:20:29:WU02:FS01:0x21:Digital signatures verified
20:20:29:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:20:29:WU02:FS01:0x21:Version 0.0.18
20:20:29:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:20:29:WU02:FS01:0x21:Saving result file logfile_01.txt
20:20:29:WU02:FS01:0x21:Saving result file log.txt
20:20:29:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:20:29:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:20:29:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9414 run:1799 clone:1 gen:45 core:0x21 unit:0x00000031ab436c9d585e069ee54ec177
20:20:29:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:20:29:WU02:FS01:Connecting to 171.67.108.157:8080
20:20:29:WU02:FS01:Upload complete
20:20:29:WU02:FS01:Server responded WORK_ACK (400)
20:20:29:WU02:FS01:Cleaning up
20:20:30:WU01:FS01:Connecting to 171.67.108.45:80
20:20:30:WU01:FS01:Assigned to work server 140.163.4.233
20:20:30:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.233
20:20:30:WU01:FS01:Connecting to 140.163.4.233:8080
20:20:30:WU01:FS01:Downloading 26.85MiB
20:20:36:WU01:FS01:Download 99.15%
20:20:36:WU01:FS01:Download complete
20:20:36:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:11409 run:292 clone:15 gen:5 core:0x21 unit:0x000000088ca304e9598ca27706a2fe14
20:20:36:WU01:FS01:Starting
20:20:36:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:20:36:WU01:FS01:Started FahCore on PID 3253
20:20:36:WU01:FS01:Core PID:3257
20:20:36:WU01:FS01:FahCore 0x21 started
20:20:36:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:20:36Z ***********************
20:20:36:WU01:FS01:0x21:Project: 11409 (Run 292, Clone 15, Gen 5)
20:20:36:WU01:FS01:0x21:Unit: 0x000000088ca304e9598ca27706a2fe14
20:20:36:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:20:36:WU01:FS01:0x21:Machine: 1
20:20:36:WU01:FS01:0x21:Reading tar file core.xml
20:20:36:WU01:FS01:0x21:Reading tar file integrator.xml
20:20:36:WU01:FS01:0x21:Reading tar file state.xml
20:20:36:WU01:FS01:0x21:Reading tar file system.xml
20:20:36:WU01:FS01:0x21:Digital signatures verified
20:20:36:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:20:36:WU01:FS01:0x21:Version 0.0.18
20:20:36:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:20:36:WU01:FS01:0x21:Saving result file logfile_01.txt
20:20:36:WU01:FS01:0x21:Saving result file log.txt
20:20:36:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:20:37:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:20:37:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:11409 run:292 clone:15 gen:5 core:0x21 unit:0x000000088ca304e9598ca27706a2fe14
20:20:37:WU01:FS01:Uploading 5.50KiB to 140.163.4.233
20:20:37:WU01:FS01:Connecting to 140.163.4.233:8080
20:20:37:WU02:FS01:Connecting to 171.67.108.45:80
20:20:37:WU01:FS01:Upload complete
20:20:37:WU01:FS01:Server responded WORK_ACK (400)
20:20:37:WU01:FS01:Cleaning up
20:20:37:WU02:FS01:Assigned to work server 171.67.108.157
20:20:37:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:20:37:WU02:FS01:Connecting to 171.67.108.157:8080
20:20:38:WU02:FS01:Downloading 8.83MiB
20:20:39:WU02:FS01:Download complete
20:20:39:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9431 run:528 clone:1 gen:72 core:0x21 unit:0x0000004fab436c9d586fdd3887f41ab6
20:20:39:WU02:FS01:Starting
20:20:39:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:20:39:WU02:FS01:Started FahCore on PID 3262
20:20:39:WU02:FS01:Core PID:3266
20:20:39:WU02:FS01:FahCore 0x21 started
20:20:39:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:20:39Z ***********************
20:20:39:WU02:FS01:0x21:Project: 9431 (Run 528, Clone 1, Gen 72)
20:20:39:WU02:FS01:0x21:Unit: 0x0000004fab436c9d586fdd3887f41ab6
20:20:39:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:20:39:WU02:FS01:0x21:Machine: 1
20:20:39:WU02:FS01:0x21:Reading tar file core.xml
20:20:39:WU02:FS01:0x21:Reading tar file integrator.xml
20:20:39:WU02:FS01:0x21:Reading tar file state.xml
20:20:39:WU02:FS01:0x21:Reading tar file system.xml
20:20:39:WU02:FS01:0x21:Digital signatures verified
20:20:39:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:20:39:WU02:FS01:0x21:Version 0.0.18
20:20:39:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:20:39:WU02:FS01:0x21:Saving result file logfile_01.txt
20:20:39:WU02:FS01:0x21:Saving result file log.txt
20:20:39:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:20:40:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:20:40:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9431 run:528 clone:1 gen:72 core:0x21 unit:0x0000004fab436c9d586fdd3887f41ab6
20:20:40:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:20:40:WU02:FS01:Connecting to 171.67.108.157:8080
20:20:40:WU02:FS01:Upload complete
20:20:40:WU02:FS01:Server responded WORK_ACK (400)
20:20:40:WU02:FS01:Cleaning up
20:20:55:WU01:FS01:Connecting to 171.67.108.45:80
20:20:55:WU01:FS01:Assigned to work server 140.163.4.232
20:20:55:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:20:55:WU01:FS01:Connecting to 140.163.4.232:8080
20:20:55:ERROR:WU01:FS01:Exception: Server did not assign work unit
20:20:56:WU01:FS01:Connecting to 171.67.108.45:80
20:20:56:WU01:FS01:Assigned to work server 171.67.108.159
20:20:56:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.159
20:20:56:WU01:FS01:Connecting to 171.67.108.159:8080
20:20:56:WU01:FS01:Downloading 21.58MiB
20:20:59:WU01:FS01:Download complete
20:20:59:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9180 run:11 clone:9 gen:337 core:0x21 unit:0x000001f3ab436c9f57bdce05e0edf12e
20:20:59:WU01:FS01:Starting
20:20:59:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:20:59:WU01:FS01:Started FahCore on PID 3271
20:20:59:WU01:FS01:Core PID:3275
20:20:59:WU01:FS01:FahCore 0x21 started
20:21:00:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:20:59Z ***********************
20:21:00:WU01:FS01:0x21:Project: 9180 (Run 11, Clone 9, Gen 337)
20:21:00:WU01:FS01:0x21:Unit: 0x000001f3ab436c9f57bdce05e0edf12e
20:21:00:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:00:WU01:FS01:0x21:Machine: 1
20:21:00:WU01:FS01:0x21:Reading tar file core.xml
20:21:00:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:00:WU01:FS01:0x21:Reading tar file state.xml
20:21:00:WU01:FS01:0x21:Reading tar file system.xml
20:21:00:WU01:FS01:0x21:Digital signatures verified
20:21:00:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:00:WU01:FS01:0x21:Version 0.0.18
20:21:00:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:00:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:00:WU01:FS01:0x21:Saving result file log.txt
20:21:00:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:00:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:00:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9180 run:11 clone:9 gen:337 core:0x21 unit:0x000001f3ab436c9f57bdce05e0edf12e
20:21:00:WU01:FS01:Uploading 5.50KiB to 171.67.108.159
20:21:00:WU01:FS01:Connecting to 171.67.108.159:8080
20:21:00:WU01:FS01:Upload complete
20:21:01:WU01:FS01:Server responded WORK_ACK (400)
20:21:01:WU01:FS01:Cleaning up
20:21:01:WU02:FS01:Connecting to 171.67.108.45:80
20:21:01:WU02:FS01:Assigned to work server 171.67.108.157
20:21:01:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:01:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:01:WU02:FS01:Downloading 5.17MiB
20:21:02:WU02:FS01:Download complete
20:21:02:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9415 run:901 clone:0 gen:83 core:0x21 unit:0x0000005fab436c9d585e06d045472ac9
20:21:02:WU02:FS01:Starting
20:21:02:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:02:WU02:FS01:Started FahCore on PID 3280
20:21:02:WU02:FS01:Core PID:3284
20:21:02:WU02:FS01:FahCore 0x21 started
20:21:02:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:02Z ***********************
20:21:02:WU02:FS01:0x21:Project: 9415 (Run 901, Clone 0, Gen 83)
20:21:02:WU02:FS01:0x21:Unit: 0x0000005fab436c9d585e06d045472ac9
20:21:02:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:02:WU02:FS01:0x21:Machine: 1
20:21:02:WU02:FS01:0x21:Reading tar file core.xml
20:21:02:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:02:WU02:FS01:0x21:Reading tar file state.xml
20:21:02:WU02:FS01:0x21:Reading tar file system.xml
20:21:02:WU02:FS01:0x21:Digital signatures verified
20:21:02:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:02:WU02:FS01:0x21:Version 0.0.18
20:21:02:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:02:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:02:WU02:FS01:0x21:Saving result file log.txt
20:21:02:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:03:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:03:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9415 run:901 clone:0 gen:83 core:0x21 unit:0x0000005fab436c9d585e06d045472ac9
20:21:03:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:03:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:03:WU02:FS01:Upload complete
20:21:03:WU02:FS01:Server responded WORK_ACK (400)
20:21:03:WU02:FS01:Cleaning up
20:21:03:WU01:FS01:Connecting to 171.67.108.45:80
20:21:03:WU01:FS01:Assigned to work server 171.67.108.157
20:21:03:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:03:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:03:WU01:FS01:Downloading 8.84MiB
20:21:05:WU01:FS01:Download complete
20:21:05:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:1435 clone:0 gen:144 core:0x21 unit:0x000000a8ab436c9d586fdd3f1927cd72
20:21:05:WU01:FS01:Starting
20:21:05:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:05:WU01:FS01:Started FahCore on PID 3289
20:21:05:WU01:FS01:Core PID:3293
20:21:05:WU01:FS01:FahCore 0x21 started
20:21:05:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:05Z ***********************
20:21:05:WU01:FS01:0x21:Project: 9431 (Run 1435, Clone 0, Gen 144)
20:21:05:WU01:FS01:0x21:Unit: 0x000000a8ab436c9d586fdd3f1927cd72
20:21:05:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:05:WU01:FS01:0x21:Machine: 1
20:21:05:WU01:FS01:0x21:Reading tar file core.xml
20:21:05:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:05:WU01:FS01:0x21:Reading tar file state.xml
20:21:05:WU01:FS01:0x21:Reading tar file system.xml
20:21:05:WU01:FS01:0x21:Digital signatures verified
20:21:05:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:05:WU01:FS01:0x21:Version 0.0.18
20:21:05:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:05:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:05:WU01:FS01:0x21:Saving result file log.txt
20:21:05:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:05:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:06:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:1435 clone:0 gen:144 core:0x21 unit:0x000000a8ab436c9d586fdd3f1927cd72
20:21:06:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:06:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:06:WU01:FS01:Upload complete
20:21:06:WU01:FS01:Server responded WORK_ACK (400)
20:21:06:WU01:FS01:Cleaning up
20:21:06:WU02:FS01:Connecting to 171.67.108.45:80
20:21:06:WU02:FS01:Assigned to work server 171.67.108.157
20:21:06:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:06:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:06:WU02:FS01:Downloading 8.86MiB
20:21:07:WU02:FS01:Download complete
20:21:07:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9431 run:166 clone:1 gen:82 core:0x21 unit:0x0000005cab436c9d586fdd350fe6e2c4
20:21:07:WU02:FS01:Starting
20:21:07:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:07:WU02:FS01:Started FahCore on PID 3298
20:21:08:WU02:FS01:Core PID:3302
20:21:08:WU02:FS01:FahCore 0x21 started
20:21:08:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:08Z ***********************
20:21:08:WU02:FS01:0x21:Project: 9431 (Run 166, Clone 1, Gen 82)
20:21:08:WU02:FS01:0x21:Unit: 0x0000005cab436c9d586fdd350fe6e2c4
20:21:08:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:08:WU02:FS01:0x21:Machine: 1
20:21:08:WU02:FS01:0x21:Reading tar file core.xml
20:21:08:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:08:WU02:FS01:0x21:Reading tar file state.xml
20:21:08:WU02:FS01:0x21:Reading tar file system.xml
20:21:08:WU02:FS01:0x21:Digital signatures verified
20:21:08:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:08:WU02:FS01:0x21:Version 0.0.18
20:21:08:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:08:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:08:WU02:FS01:0x21:Saving result file log.txt
20:21:08:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:08:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:08:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9431 run:166 clone:1 gen:82 core:0x21 unit:0x0000005cab436c9d586fdd350fe6e2c4
20:21:08:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:08:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:08:WU02:FS01:Upload complete
20:21:08:WU02:FS01:Server responded WORK_ACK (400)
20:21:08:WU02:FS01:Cleaning up
20:21:09:WU01:FS01:Connecting to 171.67.108.45:80
20:21:09:WU01:FS01:Assigned to work server 171.67.108.157
20:21:09:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:09:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:09:WU01:FS01:Downloading 5.13MiB
20:21:10:WU01:FS01:Download complete
20:21:10:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9415 run:2025 clone:0 gen:65 core:0x21 unit:0x0000004fab436c9d585e06dbc8d7c164
20:21:10:WU01:FS01:Starting
20:21:10:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:10:WU01:FS01:Started FahCore on PID 3307
20:21:10:WU01:FS01:Core PID:3311
20:21:10:WU01:FS01:FahCore 0x21 started
20:21:11:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:10Z ***********************
20:21:11:WU01:FS01:0x21:Project: 9415 (Run 2025, Clone 0, Gen 65)
20:21:11:WU01:FS01:0x21:Unit: 0x0000004fab436c9d585e06dbc8d7c164
20:21:11:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:11:WU01:FS01:0x21:Machine: 1
20:21:11:WU01:FS01:0x21:Reading tar file core.xml
20:21:11:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:11:WU01:FS01:0x21:Reading tar file state.xml
20:21:11:WU01:FS01:0x21:Reading tar file system.xml
20:21:11:WU01:FS01:0x21:Digital signatures verified
20:21:11:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:11:WU01:FS01:0x21:Version 0.0.18
20:21:11:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:11:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:11:WU01:FS01:0x21:Saving result file log.txt
20:21:11:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:11:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:11:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9415 run:2025 clone:0 gen:65 core:0x21 unit:0x0000004fab436c9d585e06dbc8d7c164
20:21:11:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:11:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:11:WU01:FS01:Upload complete
20:21:11:WU01:FS01:Server responded WORK_ACK (400)
20:21:11:WU01:FS01:Cleaning up
20:21:11:WU02:FS01:Connecting to 171.67.108.45:80
20:21:11:WU02:FS01:Assigned to work server 171.67.108.157
20:21:11:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:11:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:11:WU02:FS01:Downloading 5.15MiB
20:21:12:WU02:FS01:Download complete
20:21:12:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9415 run:912 clone:0 gen:63 core:0x21 unit:0x0000004cab436c9d585e06d1db110bad
20:21:12:WU02:FS01:Starting
20:21:12:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:12:WU02:FS01:Started FahCore on PID 3316
20:21:12:WU02:FS01:Core PID:3320
20:21:12:WU02:FS01:FahCore 0x21 started
20:21:13:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:12Z ***********************
20:21:13:WU02:FS01:0x21:Project: 9415 (Run 912, Clone 0, Gen 63)
20:21:13:WU02:FS01:0x21:Unit: 0x0000004cab436c9d585e06d1db110bad
20:21:13:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:13:WU02:FS01:0x21:Machine: 1
20:21:13:WU02:FS01:0x21:Reading tar file core.xml
20:21:13:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:13:WU02:FS01:0x21:Reading tar file state.xml
20:21:13:WU02:FS01:0x21:Reading tar file system.xml
20:21:13:WU02:FS01:0x21:Digital signatures verified
20:21:13:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:13:WU02:FS01:0x21:Version 0.0.18
20:21:13:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:13:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:13:WU02:FS01:0x21:Saving result file log.txt
20:21:13:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:13:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:13:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9415 run:912 clone:0 gen:63 core:0x21 unit:0x0000004cab436c9d585e06d1db110bad
20:21:13:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:13:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:13:WU02:FS01:Upload complete
20:21:13:WU02:FS01:Server responded WORK_ACK (400)
20:21:13:WU02:FS01:Cleaning up
20:21:13:WU01:FS01:Connecting to 171.67.108.45:80
20:21:14:WU01:FS01:Assigned to work server 140.163.4.232
20:21:14:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:21:14:WU01:FS01:Connecting to 140.163.4.232:8080
20:21:14:ERROR:WU01:FS01:Exception: Server did not assign work unit
20:21:14:WU01:FS01:Connecting to 171.67.108.45:80
20:21:14:WU01:FS01:Assigned to work server 171.67.108.157
20:21:14:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:14:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:15:WU01:FS01:Downloading 8.82MiB
20:21:16:WU01:FS01:Download complete
20:21:16:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:1547 clone:0 gen:70 core:0x21 unit:0x00000054ab436c9d586fdd40caa21952
20:21:16:WU01:FS01:Starting
20:21:16:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:16:WU01:FS01:Started FahCore on PID 3325
20:21:16:WU01:FS01:Core PID:3329
20:21:16:WU01:FS01:FahCore 0x21 started
20:21:17:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:16Z ***********************
20:21:17:WU01:FS01:0x21:Project: 9431 (Run 1547, Clone 0, Gen 70)
20:21:17:WU01:FS01:0x21:Unit: 0x00000054ab436c9d586fdd40caa21952
20:21:17:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:17:WU01:FS01:0x21:Machine: 1
20:21:17:WU01:FS01:0x21:Reading tar file core.xml
20:21:17:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:17:WU01:FS01:0x21:Reading tar file state.xml
20:21:17:WU01:FS01:0x21:Reading tar file system.xml
20:21:17:WU01:FS01:0x21:Digital signatures verified
20:21:17:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:17:WU01:FS01:0x21:Version 0.0.18
20:21:17:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:17:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:17:WU01:FS01:0x21:Saving result file log.txt
20:21:17:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:17:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:17:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:1547 clone:0 gen:70 core:0x21 unit:0x00000054ab436c9d586fdd40caa21952
20:21:17:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:17:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:17:WU01:FS01:Upload complete
20:21:17:WU01:FS01:Server responded WORK_ACK (400)
20:21:17:WU01:FS01:Cleaning up
20:21:17:WU02:FS01:Connecting to 171.67.108.45:80
20:21:17:WU02:FS01:Assigned to work server 171.67.108.157
20:21:17:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:17:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:17:WU02:FS01:Downloading 8.89MiB
20:21:19:WU02:FS01:Download complete
20:21:19:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9431 run:733 clone:1 gen:62 core:0x21 unit:0x00000049ab436c9d586fdd393ad24ea4
20:21:19:WU02:FS01:Starting
20:21:19:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:19:WU02:FS01:Started FahCore on PID 3334
20:21:19:WU02:FS01:Core PID:3338
20:21:19:WU02:FS01:FahCore 0x21 started
20:21:20:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:19Z ***********************
20:21:20:WU02:FS01:0x21:Project: 9431 (Run 733, Clone 1, Gen 62)
20:21:20:WU02:FS01:0x21:Unit: 0x00000049ab436c9d586fdd393ad24ea4
20:21:20:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:20:WU02:FS01:0x21:Machine: 1
20:21:20:WU02:FS01:0x21:Reading tar file core.xml
20:21:20:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:20:WU02:FS01:0x21:Reading tar file state.xml
20:21:20:WU02:FS01:0x21:Reading tar file system.xml
20:21:20:WU02:FS01:0x21:Digital signatures verified
20:21:20:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:20:WU02:FS01:0x21:Version 0.0.18
20:21:20:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:20:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:20:WU02:FS01:0x21:Saving result file log.txt
20:21:20:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:20:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:20:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9431 run:733 clone:1 gen:62 core:0x21 unit:0x00000049ab436c9d586fdd393ad24ea4
20:21:20:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:20:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:20:WU02:FS01:Upload complete
20:21:20:WU02:FS01:Server responded WORK_ACK (400)
20:21:20:WU02:FS01:Cleaning up
20:21:20:WU01:FS01:Connecting to 171.67.108.45:80
20:21:21:WU01:FS01:Assigned to work server 140.163.4.232
20:21:21:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:21:21:WU01:FS01:Connecting to 140.163.4.232:8080
20:21:21:ERROR:WU01:FS01:Exception: Server did not assign work unit
20:21:21:WU01:FS01:Connecting to 171.67.108.45:80
20:21:21:WU01:FS01:Assigned to work server 171.67.108.157
20:21:21:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:21:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:22:WU01:FS01:Downloading 8.86MiB
20:21:23:WU01:FS01:Download complete
20:21:23:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:30 clone:1 gen:26 core:0x21 unit:0x00000022ab436c9d586fdd337f832f19
20:21:23:WU01:FS01:Starting
20:21:23:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:23:WU01:FS01:Started FahCore on PID 3343
20:21:23:WU01:FS01:Core PID:3347
20:21:23:WU01:FS01:FahCore 0x21 started
20:21:24:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:23Z ***********************
20:21:24:WU01:FS01:0x21:Project: 9431 (Run 30, Clone 1, Gen 26)
20:21:24:WU01:FS01:0x21:Unit: 0x00000022ab436c9d586fdd337f832f19
20:21:24:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:24:WU01:FS01:0x21:Machine: 1
20:21:24:WU01:FS01:0x21:Reading tar file core.xml
20:21:24:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:24:WU01:FS01:0x21:Reading tar file state.xml
20:21:24:WU01:FS01:0x21:Reading tar file system.xml
20:21:24:WU01:FS01:0x21:Digital signatures verified
20:21:24:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:24:WU01:FS01:0x21:Version 0.0.18
20:21:24:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:24:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:24:WU01:FS01:0x21:Saving result file log.txt
20:21:24:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:24:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:24:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:30 clone:1 gen:26 core:0x21 unit:0x00000022ab436c9d586fdd337f832f19
20:21:24:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:24:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:24:WU01:FS01:Upload complete
20:21:24:WU02:FS01:Connecting to 171.67.108.45:80
20:21:24:WU01:FS01:Server responded WORK_ACK (400)
20:21:24:WU01:FS01:Cleaning up
20:21:25:WU02:FS01:Assigned to work server 140.163.4.232
20:21:25:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:21:25:WU02:FS01:Connecting to 140.163.4.232:8080
20:21:25:WU02:FS01:Downloading 12.86MiB
20:21:27:WU02:FS01:Download complete
20:21:27:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11803 run:0 clone:294 gen:80 core:0x21 unit:0x000000638ca304e8582a2b9452559390
20:21:28:WU02:FS01:Starting
20:21:28:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:28:WU02:FS01:Started FahCore on PID 3354
20:21:28:WU02:FS01:Core PID:3358
20:21:28:WU02:FS01:FahCore 0x21 started
20:21:28:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:28Z ***********************
20:21:28:WU02:FS01:0x21:Project: 11803 (Run 0, Clone 294, Gen 80)
20:21:28:WU02:FS01:0x21:Unit: 0x000000638ca304e8582a2b9452559390
20:21:28:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:28:WU02:FS01:0x21:Machine: 1
20:21:28:WU02:FS01:0x21:Reading tar file core.xml
20:21:28:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:28:WU02:FS01:0x21:Reading tar file state.xml
20:21:28:WU02:FS01:0x21:Reading tar file system.xml
20:21:28:WU02:FS01:0x21:Digital signatures verified
20:21:28:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:28:WU02:FS01:0x21:Version 0.0.18
20:21:28:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:28:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:28:WU02:FS01:0x21:Saving result file log.txt
20:21:28:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:28:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:28:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11803 run:0 clone:294 gen:80 core:0x21 unit:0x000000638ca304e8582a2b9452559390
20:21:28:WU02:FS01:Uploading 5.50KiB to 140.163.4.232
20:21:28:WU02:FS01:Connecting to 140.163.4.232:8080
20:21:29:WU02:FS01:Upload complete
20:21:29:WU02:FS01:Server responded WORK_ACK (400)
20:21:29:WU02:FS01:Cleaning up
20:21:47:WU01:FS01:Connecting to 171.67.108.45:80
20:21:47:WU01:FS01:Assigned to work server 171.67.108.157
20:21:47:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:47:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:47:WU01:FS01:Downloading 8.84MiB
20:21:48:WU01:FS01:Download complete
20:21:48:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:206 clone:2 gen:9 core:0x21 unit:0x0000000aab436c9d586fdd352be0b90e
20:21:49:WU01:FS01:Starting
20:21:49:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:49:WU01:FS01:Started FahCore on PID 3363
20:21:49:WU01:FS01:Core PID:3367
20:21:49:WU01:FS01:FahCore 0x21 started
20:21:49:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:49Z ***********************
20:21:49:WU01:FS01:0x21:Project: 9431 (Run 206, Clone 2, Gen 9)
20:21:49:WU01:FS01:0x21:Unit: 0x0000000aab436c9d586fdd352be0b90e
20:21:49:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:49:WU01:FS01:0x21:Machine: 1
20:21:49:WU01:FS01:0x21:Reading tar file core.xml
20:21:49:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:49:WU01:FS01:0x21:Reading tar file state.xml
20:21:49:WU01:FS01:0x21:Reading tar file system.xml
20:21:49:WU01:FS01:0x21:Digital signatures verified
20:21:49:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:49:WU01:FS01:0x21:Version 0.0.18
20:21:49:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:49:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:49:WU01:FS01:0x21:Saving result file log.txt
20:21:49:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:49:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:50:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:206 clone:2 gen:9 core:0x21 unit:0x0000000aab436c9d586fdd352be0b90e
20:21:50:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:50:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:50:WU01:FS01:Upload complete
20:21:50:WU02:FS01:Connecting to 171.67.108.45:80
20:21:50:WU01:FS01:Server responded WORK_ACK (400)
20:21:50:WU01:FS01:Cleaning up
20:21:50:WU02:FS01:Assigned to work server 140.163.4.232
20:21:50:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:21:50:WU02:FS01:Connecting to 140.163.4.232:8080
20:21:51:ERROR:WU02:FS01:Exception: Server did not assign work unit
20:21:51:WU02:FS01:Connecting to 171.67.108.45:80
20:21:51:WU02:FS01:Assigned to work server 171.67.108.157
20:21:51:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:51:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:51:WU02:FS01:Downloading 5.14MiB
20:21:52:WU02:FS01:Download complete
20:21:52:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9414 run:681 clone:0 gen:96 core:0x21 unit:0x00000076ab436c9d585e06942b805256
20:21:52:WU02:FS01:Starting
20:21:52:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:52:WU02:FS01:Started FahCore on PID 3372
20:21:52:WU02:FS01:Core PID:3376
20:21:52:WU02:FS01:FahCore 0x21 started
20:21:53:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:52Z ***********************
20:21:53:WU02:FS01:0x21:Project: 9414 (Run 681, Clone 0, Gen 96)
20:21:53:WU02:FS01:0x21:Unit: 0x00000076ab436c9d585e06942b805256
20:21:53:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:53:WU02:FS01:0x21:Machine: 1
20:21:53:WU02:FS01:0x21:Reading tar file core.xml
20:21:53:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:53:WU02:FS01:0x21:Reading tar file state.xml
20:21:53:WU02:FS01:0x21:Reading tar file system.xml
20:21:53:WU02:FS01:0x21:Digital signatures verified
20:21:53:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:53:WU02:FS01:0x21:Version 0.0.18
20:21:53:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:53:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:53:WU02:FS01:0x21:Saving result file log.txt
20:21:53:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:53:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:53:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9414 run:681 clone:0 gen:96 core:0x21 unit:0x00000076ab436c9d585e06942b805256
20:21:53:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:53:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:53:WU02:FS01:Upload complete
20:21:53:WU02:FS01:Server responded WORK_ACK (400)
20:21:53:WU02:FS01:Cleaning up
20:21:53:WU01:FS01:Connecting to 171.67.108.45:80
20:21:53:WU01:FS01:Assigned to work server 171.67.108.157
20:21:53:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:53:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:53:WU01:FS01:Downloading 8.82MiB
20:21:55:WU01:FS01:Download complete
20:21:55:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:26 clone:0 gen:689 core:0x21 unit:0x00000325ab436c9d586fdd33ec6dda39
20:21:55:WU01:FS01:Starting
20:21:55:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:55:WU01:FS01:Started FahCore on PID 3381
20:21:55:WU01:FS01:Core PID:3385
20:21:55:WU01:FS01:FahCore 0x21 started
20:21:55:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:55Z ***********************
20:21:55:WU01:FS01:0x21:Project: 9431 (Run 26, Clone 0, Gen 689)
20:21:55:WU01:FS01:0x21:Unit: 0x00000325ab436c9d586fdd33ec6dda39
20:21:55:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:55:WU01:FS01:0x21:Machine: 1
20:21:55:WU01:FS01:0x21:Reading tar file core.xml
20:21:55:WU01:FS01:0x21:Reading tar file integrator.xml
20:21:55:WU01:FS01:0x21:Reading tar file state.xml
20:21:55:WU01:FS01:0x21:Reading tar file system.xml
20:21:55:WU01:FS01:0x21:Digital signatures verified
20:21:55:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:55:WU01:FS01:0x21:Version 0.0.18
20:21:55:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:21:55:WU01:FS01:0x21:Saving result file logfile_01.txt
20:21:55:WU01:FS01:0x21:Saving result file log.txt
20:21:55:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:56:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:56:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:26 clone:0 gen:689 core:0x21 unit:0x00000325ab436c9d586fdd33ec6dda39
20:21:56:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:56:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:56:WU01:FS01:Upload complete
20:21:56:WU01:FS01:Server responded WORK_ACK (400)
20:21:56:WU01:FS01:Cleaning up
20:21:56:WU02:FS01:Connecting to 171.67.108.45:80
20:21:56:WU02:FS01:Assigned to work server 171.67.108.157
20:21:56:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:56:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:56:WU02:FS01:Downloading 5.16MiB
20:21:57:WU02:FS01:Download complete
20:21:57:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9414 run:1305 clone:0 gen:71 core:0x21 unit:0x00000059ab436c9d585e069a1e9c528d
20:21:57:WU02:FS01:Starting
20:21:57:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:57:WU02:FS01:Started FahCore on PID 3390
20:21:57:WU02:FS01:Core PID:3394
20:21:57:WU02:FS01:FahCore 0x21 started
20:21:58:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:21:57Z ***********************
20:21:58:WU02:FS01:0x21:Project: 9414 (Run 1305, Clone 0, Gen 71)
20:21:58:WU02:FS01:0x21:Unit: 0x00000059ab436c9d585e069a1e9c528d
20:21:58:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:21:58:WU02:FS01:0x21:Machine: 1
20:21:58:WU02:FS01:0x21:Reading tar file core.xml
20:21:58:WU02:FS01:0x21:Reading tar file integrator.xml
20:21:58:WU02:FS01:0x21:Reading tar file state.xml
20:21:58:WU02:FS01:0x21:Reading tar file system.xml
20:21:58:WU02:FS01:0x21:Digital signatures verified
20:21:58:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:21:58:WU02:FS01:0x21:Version 0.0.18
20:21:58:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:21:58:WU02:FS01:0x21:Saving result file logfile_01.txt
20:21:58:WU02:FS01:0x21:Saving result file log.txt
20:21:58:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:21:58:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:21:58:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9414 run:1305 clone:0 gen:71 core:0x21 unit:0x00000059ab436c9d585e069a1e9c528d
20:21:58:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:21:58:WU02:FS01:Connecting to 171.67.108.157:8080
20:21:58:WU02:FS01:Upload complete
20:21:58:WU02:FS01:Server responded WORK_ACK (400)
20:21:58:WU02:FS01:Cleaning up
20:21:58:WU01:FS01:Connecting to 171.67.108.45:80
20:21:58:WU01:FS01:Assigned to work server 171.67.108.157
20:21:58:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:21:58:WU01:FS01:Connecting to 171.67.108.157:8080
20:21:59:WU01:FS01:Downloading 5.15MiB
20:21:59:WU01:FS01:Download complete
20:21:59:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9415 run:1041 clone:0 gen:74 core:0x21 unit:0x00000065ab436c9d585e06d252bbdeb0
20:21:59:WU01:FS01:Starting
20:21:59:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:21:59:WU01:FS01:Started FahCore on PID 3399
20:21:59:WU01:FS01:Core PID:3403
20:21:59:WU01:FS01:FahCore 0x21 started
20:22:00:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:21:59Z ***********************
20:22:00:WU01:FS01:0x21:Project: 9415 (Run 1041, Clone 0, Gen 74)
20:22:00:WU01:FS01:0x21:Unit: 0x00000065ab436c9d585e06d252bbdeb0
20:22:00:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:22:00:WU01:FS01:0x21:Machine: 1
20:22:00:WU01:FS01:0x21:Reading tar file core.xml
20:22:00:WU01:FS01:0x21:Reading tar file integrator.xml
20:22:00:WU01:FS01:0x21:Reading tar file state.xml
20:22:00:WU01:FS01:0x21:Reading tar file system.xml
20:22:00:WU01:FS01:0x21:Digital signatures verified
20:22:00:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:22:00:WU01:FS01:0x21:Version 0.0.18
20:22:00:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:22:00:WU01:FS01:0x21:Saving result file logfile_01.txt
20:22:00:WU01:FS01:0x21:Saving result file log.txt
20:22:00:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:22:00:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:22:00:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9415 run:1041 clone:0 gen:74 core:0x21 unit:0x00000065ab436c9d585e06d252bbdeb0
20:22:00:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:22:00:WU01:FS01:Connecting to 171.67.108.157:8080
20:22:00:WU01:FS01:Upload complete
20:22:00:WU01:FS01:Server responded WORK_ACK (400)
20:22:00:WU01:FS01:Cleaning up
20:22:00:WU02:FS01:Connecting to 171.67.108.45:80
20:22:01:WU02:FS01:Assigned to work server 171.67.108.157
20:22:01:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:22:01:WU02:FS01:Connecting to 171.67.108.157:8080
20:22:01:WU02:FS01:Downloading 8.85MiB
20:22:02:WU02:FS01:Download complete
20:22:02:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9431 run:744 clone:2 gen:8 core:0x21 unit:0x0000000aab436c9d586fdd39192022b9
20:22:02:WU02:FS01:Starting
20:22:02:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:22:02:WU02:FS01:Started FahCore on PID 3408
20:22:02:WU02:FS01:Core PID:3412
20:22:02:WU02:FS01:FahCore 0x21 started
20:22:03:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:22:02Z ***********************
20:22:03:WU02:FS01:0x21:Project: 9431 (Run 744, Clone 2, Gen 8)
20:22:03:WU02:FS01:0x21:Unit: 0x0000000aab436c9d586fdd39192022b9
20:22:03:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:22:03:WU02:FS01:0x21:Machine: 1
20:22:03:WU02:FS01:0x21:Reading tar file core.xml
20:22:03:WU02:FS01:0x21:Reading tar file integrator.xml
20:22:03:WU02:FS01:0x21:Reading tar file state.xml
20:22:03:WU02:FS01:0x21:Reading tar file system.xml
20:22:03:WU02:FS01:0x21:Digital signatures verified
20:22:03:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:22:03:WU02:FS01:0x21:Version 0.0.18
20:22:03:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:22:03:WU02:FS01:0x21:Saving result file logfile_01.txt
20:22:03:WU02:FS01:0x21:Saving result file log.txt
20:22:03:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:22:03:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:22:03:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9431 run:744 clone:2 gen:8 core:0x21 unit:0x0000000aab436c9d586fdd39192022b9
20:22:03:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:22:03:WU02:FS01:Connecting to 171.67.108.157:8080
20:22:03:WU02:FS01:Upload complete
20:22:03:WU02:FS01:Server responded WORK_ACK (400)
20:22:03:WU02:FS01:Cleaning up
20:22:03:WU01:FS01:Connecting to 171.67.108.45:80
20:22:03:WU01:FS01:Assigned to work server 171.67.108.157
20:22:03:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:22:03:WU01:FS01:Connecting to 171.67.108.157:8080
20:22:04:WU01:FS01:Downloading 8.88MiB
20:22:05:WU01:FS01:Download complete
20:22:05:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9431 run:781 clone:2 gen:8 core:0x21 unit:0x00000008ab436c9d586fdd3a632fc5c7
20:22:05:WU01:FS01:Starting
20:22:05:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:22:05:WU01:FS01:Started FahCore on PID 3417
20:22:05:WU01:FS01:Core PID:3421
20:22:05:WU01:FS01:FahCore 0x21 started
20:22:06:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:22:05Z ***********************
20:22:06:WU01:FS01:0x21:Project: 9431 (Run 781, Clone 2, Gen 8)
20:22:06:WU01:FS01:0x21:Unit: 0x00000008ab436c9d586fdd3a632fc5c7
20:22:06:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:22:06:WU01:FS01:0x21:Machine: 1
20:22:06:WU01:FS01:0x21:Reading tar file core.xml
20:22:06:WU01:FS01:0x21:Reading tar file integrator.xml
20:22:06:WU01:FS01:0x21:Reading tar file state.xml
20:22:06:WU01:FS01:0x21:Reading tar file system.xml
20:22:06:WU01:FS01:0x21:Digital signatures verified
20:22:06:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:22:06:WU01:FS01:0x21:Version 0.0.18
20:22:06:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:22:06:WU01:FS01:0x21:Saving result file logfile_01.txt
20:22:06:WU01:FS01:0x21:Saving result file log.txt
20:22:06:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:22:06:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:22:06:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9431 run:781 clone:2 gen:8 core:0x21 unit:0x00000008ab436c9d586fdd3a632fc5c7
20:22:06:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:22:06:WU01:FS01:Connecting to 171.67.108.157:8080
20:22:06:WU01:FS01:Upload complete
20:22:06:WU01:FS01:Server responded WORK_ACK (400)
20:22:06:WU01:FS01:Cleaning up
20:22:06:WU02:FS01:Connecting to 171.67.108.45:80
20:22:06:WU02:FS01:Assigned to work server 171.67.108.157
20:22:06:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:22:06:WU02:FS01:Connecting to 171.67.108.157:8080
20:22:07:WU02:FS01:Downloading 5.18MiB
20:22:07:WU02:FS01:Download complete
20:22:07:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9414 run:2309 clone:1 gen:38 core:0x21 unit:0x0000002bab436c9d585e06a2d17e23a1
20:22:07:WU02:FS01:Starting
20:22:07:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:22:07:WU02:FS01:Started FahCore on PID 3426
20:22:07:WU02:FS01:Core PID:3430
20:22:07:WU02:FS01:FahCore 0x21 started
20:22:08:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:22:07Z ***********************
20:22:08:WU02:FS01:0x21:Project: 9414 (Run 2309, Clone 1, Gen 38)
20:22:08:WU02:FS01:0x21:Unit: 0x0000002bab436c9d585e06a2d17e23a1
20:22:08:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:22:08:WU02:FS01:0x21:Machine: 1
20:22:08:WU02:FS01:0x21:Reading tar file core.xml
20:22:08:WU02:FS01:0x21:Reading tar file integrator.xml
20:22:08:WU02:FS01:0x21:Reading tar file state.xml
20:22:08:WU02:FS01:0x21:Reading tar file system.xml
20:22:08:WU02:FS01:0x21:Digital signatures verified
20:22:08:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:22:08:WU02:FS01:0x21:Version 0.0.18
20:22:08:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:22:08:WU02:FS01:0x21:Saving result file logfile_01.txt
20:22:08:WU02:FS01:0x21:Saving result file log.txt
20:22:08:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:22:08:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:22:08:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9414 run:2309 clone:1 gen:38 core:0x21 unit:0x0000002bab436c9d585e06a2d17e23a1
20:22:08:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:22:08:WU02:FS01:Connecting to 171.67.108.157:8080
20:22:08:WU02:FS01:Upload complete
20:22:08:WU02:FS01:Server responded WORK_ACK (400)
20:22:08:WU02:FS01:Cleaning up
20:22:08:WU01:FS01:Connecting to 171.67.108.45:80
20:22:09:WU01:FS01:Assigned to work server 140.163.4.232
20:22:09:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:22:09:WU01:FS01:Connecting to 140.163.4.232:8080
20:22:09:ERROR:WU01:FS01:Exception: Server did not assign work unit
20:22:09:WU01:FS01:Connecting to 171.67.108.45:80
20:22:10:WU01:FS01:Assigned to work server 140.163.4.232
20:22:10:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 140.163.4.232
20:22:10:WU01:FS01:Connecting to 140.163.4.232:8080
20:22:10:ERROR:WU01:FS01:Exception: Server did not assign work unit
20:23:09:WU01:FS01:Connecting to 171.67.108.45:80
20:23:10:WU01:FS01:Assigned to work server 171.67.108.157
20:23:10:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:23:10:WU01:FS01:Connecting to 171.67.108.157:8080
20:23:10:WU01:FS01:Downloading 5.16MiB
20:23:11:WU01:FS01:Download complete
20:23:11:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9414 run:1857 clone:0 gen:93 core:0x21 unit:0x0000006dab436c9d585e069e9a742d2d
20:23:11:WU01:FS01:Starting
20:23:11:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:23:11:WU01:FS01:Started FahCore on PID 3491
20:23:11:WU01:FS01:Core PID:3495
20:23:11:WU01:FS01:FahCore 0x21 started
20:23:12:WU01:FS01:0x21:*********************** Log Started 2017-09-02T20:23:11Z ***********************
20:23:12:WU01:FS01:0x21:Project: 9414 (Run 1857, Clone 0, Gen 93)
20:23:12:WU01:FS01:0x21:Unit: 0x0000006dab436c9d585e069e9a742d2d
20:23:12:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:23:12:WU01:FS01:0x21:Machine: 1
20:23:12:WU01:FS01:0x21:Reading tar file core.xml
20:23:12:WU01:FS01:0x21:Reading tar file integrator.xml
20:23:12:WU01:FS01:0x21:Reading tar file state.xml
20:23:12:WU01:FS01:0x21:Reading tar file system.xml
20:23:12:WU01:FS01:0x21:Digital signatures verified
20:23:12:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:23:12:WU01:FS01:0x21:Version 0.0.18
20:23:12:WU01:FS01:0x21:ERROR:126: Bad platformId size.
20:23:12:WU01:FS01:0x21:Saving result file logfile_01.txt
20:23:12:WU01:FS01:0x21:Saving result file log.txt
20:23:12:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:23:12:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:23:12:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9414 run:1857 clone:0 gen:93 core:0x21 unit:0x0000006dab436c9d585e069e9a742d2d
20:23:12:WU01:FS01:Uploading 5.50KiB to 171.67.108.157
20:23:12:WU01:FS01:Connecting to 171.67.108.157:8080
20:23:12:WU01:FS01:Upload complete
20:23:12:WU02:FS01:Connecting to 171.67.108.45:80
20:23:12:WU01:FS01:Server responded WORK_ACK (400)
20:23:12:WU01:FS01:Cleaning up
20:23:12:WU02:FS01:Assigned to work server 171.67.108.157
20:23:12:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1080] 8873 from 171.67.108.157
20:23:12:WU02:FS01:Connecting to 171.67.108.157:8080
20:23:13:WU02:FS01:Downloading 5.15MiB
20:23:14:WU02:FS01:Download complete
20:23:14:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9414 run:1708 clone:1 gen:35 core:0x21 unit:0x0000002aab436c9d585e069d4dd88862
20:23:14:WU02:FS01:Starting
20:23:14:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 1374 -checkpoint 24 -gpu 0 -gpu-vendor nvidia
20:23:14:WU02:FS01:Started FahCore on PID 3500
20:23:14:WU02:FS01:Core PID:3504
20:23:14:WU02:FS01:FahCore 0x21 started
20:23:14:WU02:FS01:0x21:*********************** Log Started 2017-09-02T20:23:14Z ***********************
20:23:14:WU02:FS01:0x21:Project: 9414 (Run 1708, Clone 1, Gen 35)
20:23:14:WU02:FS01:0x21:Unit: 0x0000002aab436c9d585e069d4dd88862
20:23:14:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:23:14:WU02:FS01:0x21:Machine: 1
20:23:14:WU02:FS01:0x21:Reading tar file core.xml
20:23:14:WU02:FS01:0x21:Reading tar file integrator.xml
20:23:14:WU02:FS01:0x21:Reading tar file state.xml
20:23:14:WU02:FS01:0x21:Reading tar file system.xml
20:23:14:WU02:FS01:0x21:Digital signatures verified
20:23:14:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:23:14:WU02:FS01:0x21:Version 0.0.18
20:23:14:WU02:FS01:0x21:ERROR:126: Bad platformId size.
20:23:14:WU02:FS01:0x21:Saving result file logfile_01.txt
20:23:14:WU02:FS01:0x21:Saving result file log.txt
20:23:14:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
20:23:14:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:23:14:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9414 run:1708 clone:1 gen:35 core:0x21 unit:0x0000002aab436c9d585e069d4dd88862
20:23:14:WU02:FS01:Uploading 5.50KiB to 171.67.108.157
20:23:14:WU02:FS01:Connecting to 171.67.108.157:8080
20:23:14:WU02:FS01:Upload complete
20:23:15:WU02:FS01:Server responded WORK_ACK (400)
20:23:15:WU02:FS01:Cleaning up
20:23:56:WU00:FS00:0xa4:Completed 50000 out of 2500000 steps  (2%)
20:27:58:WU00:FS00:0xa4:Completed 75000 out of 2500000 steps  (3%)
Mod edit: added Code tags to log file, please use them

Re: Project 9414 (171.67.108.157) upload failing

Posted: Sat Sep 02, 2017 9:19 pm
by Joe_H
The WU's are failing with a "Bad platformId size" message, that usually indicates a problem with the GPU driver installation. As for the WS and CS addresses, they are recorded in the log as part of the download and upload.

All 3 Work Servers that you mention are up and online, what did you use to determine they weren't?