GPU WU doesn't end

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

Post Reply
jabacrack
Posts: 11
Joined: Wed Aug 19, 2015 4:06 pm

GPU WU doesn't end

Post by jabacrack »

Last four WU end in some way (different projects): complete to ~40% and after I get next error:

Code: Select all

17:50:20:WU02:FS01:0x18:Bad State detected... attempting to resume from last good checkpoint
17:50:20:WU02:FS01:0x18:Max number of retries reached. Aborting.
17:50:20:WU02:FS01:0x18:ERROR:exception: Max Retries Reached
17:50:20:WU02:FS01:0x18:Saving result file logfile_01.txt
17:50:20:WU02:FS01:0x18:Saving result file log.txt
17:50:20:WU02:FS01:0x18:Folding@home Core Shutdown: BAD_WORK_UNIT
17:50:20:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
17:50:20:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:10471 run:0 clone:84 gen:80 core:0x18 unit:0x00000078538b3dbb53bea96250646ca9
My info and config:

Code: Select all

06:00:55:******************************** Build ********************************
06:00:55:      Version: 7.4.4
06:00:55:         Date: Mar 4 2014
06:00:55:         Time: 20:26:54
06:00:55:      SVN Rev: 4130
06:00:55:       Branch: fah/trunk/client
06:00:55:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
06:00:55:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
06:00:55:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
06:00:55:     Platform: win32 XP
06:00:55:         Bits: 32
06:00:55:         Mode: Release
06:00:55:******************************* System ********************************
06:00:55:          CPU: Intel(R) Core(TM) i5-4440 CPU @ 3.10GHz
06:00:55:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
06:00:55:         CPUs: 4
06:00:55:       Memory: 7.94GiB
06:00:55:  Free Memory: 6.49GiB
06:00:55:      Threads: WINDOWS_THREADS
06:00:55:   OS Version: 6.1
06:00:55:  Has Battery: true
06:00:55:   On Battery: false
06:00:55:   UTC Offset: 3
06:00:55:          PID: 4376
06:00:55:          CWD: D:/temp/FoldingAtHomeData
06:00:55:           OS: Windows 7 Ultimate
06:00:55:      OS Arch: AMD64
06:00:55:         GPUs: 1
06:00:55:        GPU 0: NVIDIA:3 GK104 [GeForce GTX 760]
06:00:55:         CUDA: 3.0
06:00:55:  CUDA Driver: 5050
06:00:55:Win32 Service: false
06:00:55:***********************************************************************
06:00:55:<config>
06:00:55:  <service-description v='Folding@home Client'/>
06:00:55:  <service-restart v='true'/>
06:00:55:  <service-restart-delay v='5000'/>
06:00:55:
06:00:55:  <!-- Client Control -->
06:00:55:  <client-threads v='6'/>
06:00:55:  <cycle-rate v='4'/>
06:00:55:  <cycles v='-1'/>
06:00:55:  <data-directory v='.'/>
06:00:55:  <disable-sleep-when-active v='true'/>
06:00:55:  <exec-directory v='C:\Program Files (x86)\FAHClient'/>
06:00:55:  <exit-when-done v='false'/>
06:00:55:  <fold-anon v='false'/>
06:00:55:  <open-web-control v='false'/>
06:00:55:
06:00:55:  <!-- Configuration -->
06:00:55:  <config-rotate v='true'/>
06:00:55:  <config-rotate-dir v='configs'/>
06:00:55:  <config-rotate-max v='16'/>
06:00:55:
06:00:55:  <!-- Debugging -->
06:00:55:  <assignment-servers>
06:00:55:    assign3.stanford.edu:8080 assign4.stanford.edu:80
06:00:55:  </assignment-servers>
06:00:55:  <auth-as v='true'/>
06:00:55:  <capture-directory v='capture'/>
06:00:55:  <capture-on-error v='false'/>
06:00:55:  <capture-packets v='false'/>
06:00:55:  <capture-requests v='false'/>
06:00:55:  <capture-responses v='false'/>
06:00:55:  <capture-sockets v='false'/>
06:00:55:  <core-exec v='FahCore_$type'/>
06:00:55:  <core-wrapper-exec v='FAHCoreWrapper'/>
06:00:55:  <debug-sockets v='false'/>
06:00:55:  <exception-locations v='true'/>
06:00:55:  <gpu-assignment-servers>
06:00:55:    assign-GPU.stanford.edu:80 assign-GPU2.stanford.edu:80
06:00:55:  </gpu-assignment-servers>
06:00:55:  <stack-traces v='false'/>
06:00:55:
06:00:55:  <!-- Error Handling -->
06:00:55:  <max-slot-errors v='10'/>
06:00:55:  <max-unit-errors v='5'/>
06:00:55:
06:00:55:  <!-- Folding Core -->
06:00:55:  <checkpoint v='10'/>
06:00:55:  <core-dir v='cores'/>
06:00:55:  <core-priority v='idle'/>
06:00:55:  <cpu-affinity v='false'/>
06:00:55:  <cpu-usage v='100'/>
06:00:55:  <gpu-usage v='100'/>
06:00:55:  <no-assembly v='false'/>
06:00:55:
06:00:55:  <!-- Folding Slot Configuration -->
06:00:55:  <cause v='ANY'/>
06:00:55:  <client-subtype v='STDCLI'/>
06:00:55:  <client-type v='normal'/>
06:00:55:  <cpu-species v='X86_PENTIUM_II'/>
06:00:55:  <cpu-type v='AMD64'/>
06:00:55:  <cpus v='-1'/>
06:00:55:  <gpu v='true'/>
06:00:55:  <max-packet-size v='normal'/>
06:00:55:  <os-species v='UNKNOWN'/>
06:00:55:  <os-type v='WIN32'/>
06:00:55:  <project-key v='0'/>
06:00:55:  <smp v='true'/>
06:00:55:
06:00:55:  <!-- GUI -->
06:00:55:  <gui-enabled v='true'/>
06:00:55:
06:00:55:  <!-- HTTP Server -->
06:00:55:  <allow v='127.0.0.1'/>
06:00:55:  <connection-timeout v='60'/>
06:00:55:  <deny v='0/0'/>
06:00:55:  <http-addresses v='0:7396'/>
06:00:55:  <https-addresses v=''/>
06:00:55:  <max-connect-time v='900'/>
06:00:55:  <max-connections v='800'/>
06:00:55:  <max-request-length v='52428800'/>
06:00:55:  <min-connect-time v='300'/>
06:00:55:  <threads v='4'/>
06:00:55:
06:00:55:  <!-- Logging -->
06:00:55:  <log v='log.txt'/>
06:00:55:  <log-color v='false'/>
06:00:55:  <log-crlf v='true'/>
06:00:55:  <log-date v='false'/>
06:00:55:  <log-date-periodically v='21600'/>
06:00:55:  <log-debug v='true'/>
06:00:55:  <log-domain v='false'/>
06:00:55:  <log-header v='true'/>
06:00:55:  <log-level v='true'/>
06:00:55:  <log-no-info-header v='true'/>
06:00:55:  <log-redirect v='false'/>
06:00:55:  <log-rotate v='true'/>
06:00:55:  <log-rotate-dir v='logs'/>
06:00:55:  <log-rotate-max v='16'/>
06:00:55:  <log-short-level v='false'/>
06:00:55:  <log-simple-domains v='true'/>
06:00:55:  <log-thread-id v='false'/>
06:00:55:  <log-thread-prefix v='true'/>
06:00:55:  <log-time v='true'/>
06:00:55:  <log-to-screen v='true'/>
06:00:55:  <log-truncate v='false'/>
06:00:55:  <verbosity v='5'/>
06:00:55:
06:00:55:  <!-- Network -->
06:00:55:  <proxy v=':8080'/>
06:00:55:  <proxy-enable v='false'/>
06:00:55:  <proxy-pass v=''/>
06:00:55:  <proxy-user v=''/>
06:00:55:
06:00:55:  <!-- Process Control -->
06:00:55:  <child v='false'/>
06:00:55:  <daemon v='false'/>
06:00:55:  <pid v='false'/>
06:00:55:  <pid-file v='Folding@home Client.pid'/>
06:00:55:  <respawn v='false'/>
06:00:55:  <service v='false'/>
06:00:55:
06:00:55:  <!-- Remote Command Server -->
06:00:55:  <command-address v='0.0.0.0'/>
06:00:55:  <command-allow-no-pass v='127.0.0.1'/>
06:00:55:  <command-deny-no-pass v='0/0'/>
06:00:55:  <command-enable v='true'/>
06:00:55:  <command-port v='36330'/>
06:00:55:
06:00:55:  <!-- Slot Control -->
06:00:55:  <idle v='false'/>
06:00:55:  <max-shutdown-wait v='60'/>
06:00:55:  <pause-on-battery v='true'/>
06:00:55:  <pause-on-start v='false'/>
06:00:55:  <paused v='false'/>
06:00:55:  <power v='medium'/>
06:00:55:
06:00:55:  <!-- User Information -->
06:00:55:  <machine-id v='0'/>
06:00:55:  <passkey v='********************************'/>
06:00:55:  <team v='43003'/>
06:00:55:  <user v='jabacrack_Ecguof2AZWpYPsvsNe6qzZCSk3LFaGwX7q'/>
06:00:55:
06:00:55:  <!-- Web Server -->
06:00:55:  <web-allow v='127.0.0.1'/>
06:00:55:  <web-deny v='0/0'/>
06:00:55:  <web-enable v='true'/>
06:00:55:
06:00:55:  <!-- Web Server Sessions -->
06:00:55:  <session-cookie v='sid'/>
06:00:55:  <session-lifetime v='86400'/>
06:00:55:  <session-timeout v='3600'/>
06:00:55:
06:00:55:  <!-- Work Unit Control -->
06:00:55:  <dump-after-deadline v='true'/>
06:00:55:  <max-queue v='16'/>
06:00:55:  <max-units v='0'/>
06:00:55:  <next-unit-percentage v='99'/>
06:00:55:  <stall-detection-enabled v='false'/>
06:00:55:  <stall-percent v='5'/>
06:00:55:  <stall-timeout v='1800'/>
06:00:55:
06:00:55:  <!-- Folding Slots -->
06:00:55:  <slot id='0' type='CPU'>
06:00:55:    <cpus v='3'/>
06:00:55:    <paused v='true'/>
06:00:55:  </slot>
06:00:55:  <slot id='1' type='GPU'>
06:00:55:    <paused v='true'/>
06:00:55:  </slot>
06:00:55:</config>
I doungrade nvidea driver to 327.23, but this doesn't help (result you can see above).
My client work in next mode: in day gpu work all time, at evening i switch it to idle mode (and often it ran 3 - 5 time = 20 min.) and sometime I pause all calculations.

Can you tell me what problem with my calculations?
jabacrack
Posts: 11
Joined: Wed Aug 19, 2015 4:06 pm

Re: GPU WU doesn't end

Post by jabacrack »

Again dead, now at 92%

Code: Select all

16:08:15:WU03:FS01:0x18:Completed 6400000 out of 8000000 steps (80%)
16:15:08:WU03:FS01:0x18:Completed 6480000 out of 8000000 steps (81%)
16:20:09:WU03:FS01:0x18:Bad State detected... attempting to resume from last good checkpoint
16:29:06:WU03:FS01:0x18:Completed 6560000 out of 8000000 steps (82%)
16:35:36:WU03:FS01:0x18:Completed 6640000 out of 8000000 steps (83%)
16:42:10:WU03:FS01:0x18:Completed 6720000 out of 8000000 steps (84%)
16:48:41:WU03:FS01:0x18:Completed 6800000 out of 8000000 steps (85%)
16:55:22:WU03:FS01:0x18:Completed 6880000 out of 8000000 steps (86%)
17:01:56:WU03:FS01:0x18:Completed 6960000 out of 8000000 steps (87%)
17:09:57:WU03:FS01:0x18:Bad State detected... attempting to resume from last good checkpoint
17:17:18:WU03:FS01:0x18:Completed 7040000 out of 8000000 steps (88%)
17:23:52:WU03:FS01:0x18:Completed 7120000 out of 8000000 steps (89%)
17:30:23:WU03:FS01:0x18:Completed 7200000 out of 8000000 steps (90%)
17:37:00:WU03:FS01:0x18:Completed 7280000 out of 8000000 steps (91%)
17:43:43:WU03:FS01:0x18:Completed 7360000 out of 8000000 steps (92%)
17:52:14:WU03:FS01:0x18:Bad State detected... attempting to resume from last good checkpoint
17:52:14:WU03:FS01:0x18:Max number of retries reached. Aborting.
17:52:14:WU03:FS01:0x18:ERROR:exception: Max Retries Reached
17:52:14:WU03:FS01:0x18:Saving result file logfile_01.txt
17:52:14:WU03:FS01:0x18:Saving result file log.txt
17:52:14:WU03:FS01:0x18:Folding@home Core Shutdown: BAD_WORK_UNIT
17:52:15:WARNING:WU03:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
17:52:15:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:9835 run:32 clone:3 gen:24 core:0x18 unit:0x000000266652edb255736751fad206bc
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: GPU WU doesn't end

Post by 7im »

Hello jabacrack, welcome to the folding support forum.

For best performance, core 18 likes 347.xx drivers or newer.

Please change <verbosity v='5'/> back to the default of 3. We don't need the extra detail in the config, and actually makes it harder to sort through the settings.

On the next work unit, let the GPU run full time, day and night, to see if it can get a lot farther past 40% completed. Need to test if this is a timing issue or a too many stops and starts issue, or something else. Thanks.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
jabacrack
Posts: 11
Joined: Wed Aug 19, 2015 4:06 pm

Re: GPU WU doesn't end

Post by jabacrack »

Ok, thank you, I'm try this.
Last WU (in my seocnd post) work all day without stopping. Most of day I was at work and nobody touch PC. I return at ~80% and start my usual activity (without iinterrupting folding process) - browsing, looking at folding client, nothing difficult. And it crash.
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: GPU WU doesn't end

Post by 7im »

Yes, didn't see the second post while writing my post. Newer driver should work better in most instances. The actual cause of the problem is still unclear, at least to me.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GPU WU doesn't end

Post by bruce »

Is the GPU overclocked?
toTOW
Site Moderator
Posts: 6396
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: GPU WU doesn't end

Post by toTOW »

Do the messages "Bad State detected... attempting to resume from last good checkpoint" correspond to a video driver reset (look in Windows Event Log) ?
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
jabacrack
Posts: 11
Joined: Wed Aug 19, 2015 4:06 pm

Re: GPU WU doesn't end

Post by jabacrack »

Is the GPU overclocked?
No
Do the messages "Bad State detected... attempting to resume from last good checkpoint" correspond to a video driver reset (look in Windows Event Log) ?
I did find any error about video driver reset in my system event log. And I didn't find any errors or warnings correspond "bad state" messages.

It's work all niight and day and calculate one and half WU without errors. But several times core shutdown. Difference between previous time:
1. Last drivers - 355.60 (but before it abort calculations with new drivers too)
2. Remove teamviewer from autostart (can service without input connections produce errors?)
3. Do nothing on PC.

I think last is the cause of problems. Can my activity cause errors?

Code: Select all

*********************** Log Started 2015-08-19T21:19:34Z ***********************
21:19:56:FS01:Unpaused
21:19:56:WU01:FS01:Starting
21:19:56:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" D:/temp/FoldingAtHomeData/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 01 -suffix 01 -version 704 -lifeline 11128 -checkpoint 10 -gpu 0 -gpu-vendor nvidia
21:19:56:WU01:FS01:Started FahCore on PID 9420
21:19:56:WU01:FS01:Core PID:10980
21:19:56:WU01:FS01:FahCore 0x18 started
21:19:58:WU01:FS01:0x18:*********************** Log Started 2015-08-19T21:19:57Z ***********************
21:19:58:WU01:FS01:0x18:Project: 9127 (Run 1, Clone 3, Gen 144)
21:19:58:WU01:FS01:0x18:Unit: 0x000000a40a3b1e815549363e10d6ce38
21:19:58:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000
21:19:58:WU01:FS01:0x18:Machine: 1
21:19:58:WU01:FS01:0x18:Digital signatures verified
21:19:58:WU01:FS01:0x18:Folding@home GPU core18
21:19:58:WU01:FS01:0x18:Version 0.0.4
21:19:58:WU01:FS01:0x18:  Found a checkpoint file
21:20:27:WU01:FS01:0x18:Completed 200000 out of 2500000 steps (8%)
21:20:27:WU01:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
21:25:23:WU01:FS01:0x18:Completed 225000 out of 2500000 steps (9%)
21:30:12:WU01:FS01:0x18:Completed 250000 out of 2500000 steps (10%)
21:35:00:WU01:FS01:0x18:Completed 275000 out of 2500000 steps (11%)
21:39:49:WU01:FS01:0x18:Completed 300000 out of 2500000 steps (12%)
21:44:50:WU01:FS01:0x18:Completed 325000 out of 2500000 steps (13%)
21:49:38:WU01:FS01:0x18:Completed 350000 out of 2500000 steps (14%)
21:54:27:WU01:FS01:0x18:Completed 375000 out of 2500000 steps (15%)
21:59:17:WU01:FS01:0x18:Completed 400000 out of 2500000 steps (16%)
22:04:21:WU01:FS01:0x18:Completed 425000 out of 2500000 steps (17%)
22:09:11:WU01:FS01:0x18:Completed 450000 out of 2500000 steps (18%)
22:14:02:WU01:FS01:0x18:Completed 475000 out of 2500000 steps (19%)
22:18:54:WU01:FS01:0x18:Completed 500000 out of 2500000 steps (20%)
22:24:10:WU01:FS01:0x18:Completed 525000 out of 2500000 steps (21%)
22:30:00:WU01:FS01:0x18:Completed 550000 out of 2500000 steps (22%)
22:41:00:FS01:Shutting core down
22:41:00:WU01:FS01:0x18:WARNING:Console control signal 1 on PID 10980
22:41:00:WU01:FS01:0x18:Exiting, please wait. . .
22:41:01:WU01:FS01:0x18:Lost lifeline PID 9420, exiting
22:41:01:WU01:FS01:0x18:ERROR:103: Lost client lifeline
22:41:01:WU01:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
22:41:02:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
22:41:05:WU01:FS01:Starting
22:41:05:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" D:/temp/FoldingAtHomeData/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 01 -suffix 01 -version 704 -lifeline 11128 -checkpoint 10 -gpu 0 -gpu-vendor nvidia
22:41:05:WU01:FS01:Started FahCore on PID 2168
22:41:05:WU01:FS01:Core PID:6788
22:41:05:WU01:FS01:FahCore 0x18 started
22:41:05:WU01:FS01:0x18:*********************** Log Started 2015-08-19T22:41:05Z ***********************
22:41:05:WU01:FS01:0x18:Project: 9127 (Run 1, Clone 3, Gen 144)
22:41:05:WU01:FS01:0x18:Unit: 0x000000a40a3b1e815549363e10d6ce38
22:41:05:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000
22:41:05:WU01:FS01:0x18:Machine: 1
22:41:05:WU01:FS01:0x18:Digital signatures verified
22:41:05:WU01:FS01:0x18:Folding@home GPU core18
22:41:05:WU01:FS01:0x18:Version 0.0.4
22:41:05:WU01:FS01:0x18:  Found a checkpoint file
22:41:30:WU01:FS01:0x18:Completed 500000 out of 2500000 steps (20%)
22:41:30:WU01:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:46:28:WU01:FS01:0x18:Completed 525000 out of 2500000 steps (21%)
22:51:17:WU01:FS01:0x18:Completed 550000 out of 2500000 steps (22%)
22:56:08:WU01:FS01:0x18:Completed 575000 out of 2500000 steps (23%)
23:00:57:WU01:FS01:0x18:Completed 600000 out of 2500000 steps (24%)
23:05:59:WU01:FS01:0x18:Completed 625000 out of 2500000 steps (25%)
23:10:50:WU01:FS01:0x18:Completed 650000 out of 2500000 steps (26%)
23:15:40:WU01:FS01:0x18:Completed 675000 out of 2500000 steps (27%)
23:20:30:WU01:FS01:0x18:Completed 700000 out of 2500000 steps (28%)
23:25:29:WU01:FS01:0x18:Completed 725000 out of 2500000 steps (29%)
23:30:18:WU01:FS01:0x18:Completed 750000 out of 2500000 steps (30%)
23:35:08:WU01:FS01:0x18:Completed 775000 out of 2500000 steps (31%)
23:39:57:WU01:FS01:0x18:Completed 800000 out of 2500000 steps (32%)
23:44:59:WU01:FS01:0x18:Completed 825000 out of 2500000 steps (33%)
23:49:48:WU01:FS01:0x18:Completed 850000 out of 2500000 steps (34%)
23:54:39:WU01:FS01:0x18:Completed 875000 out of 2500000 steps (35%)
23:59:29:WU01:FS01:0x18:Completed 900000 out of 2500000 steps (36%)
00:04:31:WU01:FS01:0x18:Completed 925000 out of 2500000 steps (37%)
00:09:20:WU01:FS01:0x18:Completed 950000 out of 2500000 steps (38%)
00:14:07:WU01:FS01:0x18:Completed 975000 out of 2500000 steps (39%)
00:18:55:WU01:FS01:0x18:Completed 1000000 out of 2500000 steps (40%)
00:23:57:WU01:FS01:0x18:Completed 1025000 out of 2500000 steps (41%)
00:28:47:WU01:FS01:0x18:Completed 1050000 out of 2500000 steps (42%)
00:33:37:WU01:FS01:0x18:Completed 1075000 out of 2500000 steps (43%)
00:38:27:WU01:FS01:0x18:Completed 1100000 out of 2500000 steps (44%)
00:43:29:WU01:FS01:0x18:Completed 1125000 out of 2500000 steps (45%)
00:48:18:WU01:FS01:0x18:Completed 1150000 out of 2500000 steps (46%)
00:53:16:WU01:FS01:0x18:Completed 1175000 out of 2500000 steps (47%)
00:58:56:WU01:FS01:0x18:Completed 1200000 out of 2500000 steps (48%)
01:03:59:WU01:FS01:0x18:Completed 1225000 out of 2500000 steps (49%)
01:08:48:WU01:FS01:0x18:Completed 1250000 out of 2500000 steps (50%)
01:13:43:WU01:FS01:0x18:Completed 1275000 out of 2500000 steps (51%)
01:18:32:WU01:FS01:0x18:Completed 1300000 out of 2500000 steps (52%)
01:23:36:WU01:FS01:0x18:Completed 1325000 out of 2500000 steps (53%)
02:13:43:WU01:FS01:0x18:Completed 1350000 out of 2500000 steps (54%)
03:09:29:WU01:FS01:0x18:Completed 1375000 out of 2500000 steps (55%)
******************************* Date: 2015-08-20 *******************************
04:05:16:WU01:FS01:0x18:Completed 1400000 out of 2500000 steps (56%)
04:05:16:WU01:FS01:0x18:Bad State detected... attempting to resume from last good checkpoint
04:10:06:WU01:FS01:0x18:Completed 1325000 out of 2500000 steps (53%)
04:14:55:WU01:FS01:0x18:Completed 1350000 out of 2500000 steps (54%)
04:19:45:WU01:FS01:0x18:Completed 1375000 out of 2500000 steps (55%)
04:24:36:WU01:FS01:0x18:Completed 1400000 out of 2500000 steps (56%)
04:29:38:WU01:FS01:0x18:Completed 1425000 out of 2500000 steps (57%)
04:34:27:WU01:FS01:0x18:Completed 1450000 out of 2500000 steps (58%)
04:39:17:WU01:FS01:0x18:Completed 1475000 out of 2500000 steps (59%)
04:44:06:WU01:FS01:0x18:Completed 1500000 out of 2500000 steps (60%)
04:49:07:WU01:FS01:0x18:Completed 1525000 out of 2500000 steps (61%)
04:53:55:WU01:FS01:0x18:Completed 1550000 out of 2500000 steps (62%)
04:58:43:WU01:FS01:0x18:Completed 1575000 out of 2500000 steps (63%)
05:03:32:WU01:FS01:0x18:Completed 1600000 out of 2500000 steps (64%)
05:08:34:WU01:FS01:0x18:Completed 1625000 out of 2500000 steps (65%)
05:13:23:WU01:FS01:0x18:Completed 1650000 out of 2500000 steps (66%)
05:18:20:WU01:FS01:0x18:Completed 1675000 out of 2500000 steps (67%)
05:23:09:WU01:FS01:0x18:Completed 1700000 out of 2500000 steps (68%)
05:44:45:WU01:FS01:0x18:Completed 1725000 out of 2500000 steps (69%)
06:18:01:FS01:Shutting core down
06:18:01:WU01:FS01:0x18:WARNING:Console control signal 1 on PID 6788
06:18:01:WU01:FS01:0x18:Exiting, please wait. . .
06:18:01:WU01:FS01:0x18:Lost lifeline PID 2168, exiting
06:18:01:WU01:FS01:0x18:ERROR:103: Lost client lifeline
06:18:01:WU01:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
06:18:02:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
06:18:05:WU01:FS01:Starting
06:18:05:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" D:/temp/FoldingAtHomeData/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 01 -suffix 01 -version 704 -lifeline 11128 -checkpoint 10 -gpu 0 -gpu-vendor nvidia
06:18:05:WU01:FS01:Started FahCore on PID 1888
06:18:05:WU01:FS01:Core PID:4684
06:18:05:WU01:FS01:FahCore 0x18 started
06:18:05:WU01:FS01:0x18:*********************** Log Started 2015-08-20T06:18:05Z ***********************
06:18:05:WU01:FS01:0x18:Project: 9127 (Run 1, Clone 3, Gen 144)
06:18:05:WU01:FS01:0x18:Unit: 0x000000a40a3b1e815549363e10d6ce38
06:18:05:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000
06:18:05:WU01:FS01:0x18:Machine: 1
06:18:05:WU01:FS01:0x18:Digital signatures verified
06:18:05:WU01:FS01:0x18:Folding@home GPU core18
06:18:05:WU01:FS01:0x18:Version 0.0.4
06:18:05:WU01:FS01:0x18:  Found a checkpoint file
06:18:29:WU01:FS01:0x18:Completed 1700000 out of 2500000 steps (68%)
06:18:29:WU01:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
06:23:25:WU01:FS01:0x18:Completed 1725000 out of 2500000 steps (69%)
06:28:15:WU01:FS01:0x18:Completed 1750000 out of 2500000 steps (70%)
06:33:02:WU01:FS01:0x18:Completed 1775000 out of 2500000 steps (71%)
06:37:50:WU01:FS01:0x18:Completed 1800000 out of 2500000 steps (72%)
06:42:48:WU01:FS01:0x18:Completed 1825000 out of 2500000 steps (73%)
06:47:34:WU01:FS01:0x18:Completed 1850000 out of 2500000 steps (74%)
06:52:21:WU01:FS01:0x18:Completed 1875000 out of 2500000 steps (75%)
06:57:08:WU01:FS01:0x18:Completed 1900000 out of 2500000 steps (76%)
07:02:06:WU01:FS01:0x18:Completed 1925000 out of 2500000 steps (77%)
07:06:54:WU01:FS01:0x18:Completed 1950000 out of 2500000 steps (78%)
07:11:42:WU01:FS01:0x18:Completed 1975000 out of 2500000 steps (79%)
07:16:30:WU01:FS01:0x18:Completed 2000000 out of 2500000 steps (80%)
07:21:29:WU01:FS01:0x18:Completed 2025000 out of 2500000 steps (81%)
07:26:15:WU01:FS01:0x18:Completed 2050000 out of 2500000 steps (82%)
07:31:02:WU01:FS01:0x18:Completed 2075000 out of 2500000 steps (83%)
07:35:49:WU01:FS01:0x18:Completed 2100000 out of 2500000 steps (84%)
07:40:46:WU01:FS01:0x18:Completed 2125000 out of 2500000 steps (85%)
07:45:33:WU01:FS01:0x18:Completed 2150000 out of 2500000 steps (86%)
07:50:20:WU01:FS01:0x18:Completed 2175000 out of 2500000 steps (87%)
07:55:06:WU01:FS01:0x18:Completed 2200000 out of 2500000 steps (88%)
08:00:04:WU01:FS01:0x18:Completed 2225000 out of 2500000 steps (89%)
08:04:51:WU01:FS01:0x18:Completed 2250000 out of 2500000 steps (90%)
08:09:39:WU01:FS01:0x18:Completed 2275000 out of 2500000 steps (91%)
08:14:26:WU01:FS01:0x18:Completed 2300000 out of 2500000 steps (92%)
08:19:24:WU01:FS01:0x18:Completed 2325000 out of 2500000 steps (93%)
08:24:11:WU01:FS01:0x18:Completed 2350000 out of 2500000 steps (94%)
08:28:58:WU01:FS01:0x18:Completed 2375000 out of 2500000 steps (95%)
08:33:45:WU01:FS01:0x18:Completed 2400000 out of 2500000 steps (96%)
08:38:43:WU01:FS01:0x18:Completed 2425000 out of 2500000 steps (97%)
08:43:30:WU01:FS01:0x18:Completed 2450000 out of 2500000 steps (98%)
08:48:17:WU01:FS01:0x18:Completed 2475000 out of 2500000 steps (99%)
08:53:04:WU01:FS01:0x18:Completed 2500000 out of 2500000 steps (100%)
08:53:06:WU00:FS01:Connecting to 171.67.108.200:80
08:53:07:WU00:FS01:Assigned to work server 140.163.4.235
08:53:07:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GK104 [GeForce GTX 760] from 140.163.4.235
08:53:07:WU00:FS01:Connecting to 140.163.4.235:8080
08:53:09:WU00:FS01:Downloading 4.24MiB
08:53:12:WU00:FS01:Download complete
08:53:13:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:10472 run:0 clone:32 gen:125 core:0x18 unit:0x000000c3538b3dbb53beb411ea5b8f32
08:53:15:WU01:FS01:0x18:Saving result file logfile_01.txt
08:53:15:WU01:FS01:0x18:Saving result file checkpointState.xml
08:53:17:WU01:FS01:0x18:Saving result file checkpt.crc
08:53:17:WU01:FS01:0x18:Saving result file log.txt
08:53:17:WU01:FS01:0x18:Saving result file positions.xtc
08:53:23:WU01:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
08:53:23:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
08:53:23:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9127 run:1 clone:3 gen:144 core:0x18 unit:0x000000a40a3b1e815549363e10d6ce38
08:53:23:WU01:FS01:Uploading 6.40MiB to 171.64.65.93
08:53:23:WU01:FS01:Connecting to 171.64.65.93:8080
08:53:23:WU00:FS01:Starting
08:53:23:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" D:/temp/FoldingAtHomeData/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 11128 -checkpoint 10 -gpu 0 -gpu-vendor nvidia
08:53:23:WU00:FS01:Started FahCore on PID 10104
08:53:23:WU00:FS01:Core PID:4516
08:53:23:WU00:FS01:FahCore 0x18 started
08:53:24:WU00:FS01:0x18:*********************** Log Started 2015-08-20T08:53:23Z ***********************
08:53:24:WU00:FS01:0x18:Project: 10472 (Run 0, Clone 32, Gen 125)
08:53:24:WU00:FS01:0x18:Unit: 0x000000c3538b3dbb53beb411ea5b8f32
08:53:24:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
08:53:24:WU00:FS01:0x18:Machine: 1
08:53:24:WU00:FS01:0x18:Reading tar file state.xml
08:53:24:WU00:FS01:0x18:Reading tar file system.xml
08:53:25:WU00:FS01:0x18:Reading tar file integrator.xml
08:53:25:WU00:FS01:0x18:Reading tar file core.xml
08:53:25:WU00:FS01:0x18:Digital signatures verified
08:53:25:WU00:FS01:0x18:Folding@home GPU core18
08:53:25:WU00:FS01:0x18:Version 0.0.4
08:53:29:WU01:FS01:Upload 18.54%
08:53:35:WU01:FS01:Upload 40.02%
08:53:41:WU01:FS01:Upload 63.44%
08:53:47:WU01:FS01:Upload 84.92%
08:53:53:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
08:53:53:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:53:57:WU01:FS01:Upload complete
08:53:57:WU01:FS01:Server responded WORK_ACK (400)
08:53:57:WU01:FS01:Final credit estimate, 17097.00 points
08:53:57:WU01:FS01:Cleaning up
09:05:17:WU00:FS01:0x18:Completed 50000 out of 5000000 steps (1%)
09:16:31:WU00:FS01:0x18:Completed 100000 out of 5000000 steps (2%)
******************************* Date: 2015-08-20 *******************************
09:28:01:WU00:FS01:0x18:Completed 150000 out of 5000000 steps (3%)
09:39:15:WU00:FS01:0x18:Completed 200000 out of 5000000 steps (4%)
09:50:30:WU00:FS01:0x18:Completed 250000 out of 5000000 steps (5%)
09:51:45:FS01:Shutting core down
09:51:45:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 4516
09:51:45:WU00:FS01:0x18:Exiting, please wait. . .
09:51:45:WU00:FS01:0x18:Lost lifeline PID 10104, exiting
09:51:45:WU00:FS01:0x18:ERROR:103: Lost client lifeline
09:51:45:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
09:51:45:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
09:51:50:WU00:FS01:Starting
09:51:50:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" D:/temp/FoldingAtHomeData/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 11128 -checkpoint 10 -gpu 0 -gpu-vendor nvidia
09:51:50:WU00:FS01:Started FahCore on PID 3336
09:51:50:WU00:FS01:Core PID:7616
09:51:50:WU00:FS01:FahCore 0x18 started
09:51:50:WU00:FS01:0x18:*********************** Log Started 2015-08-20T09:51:50Z ***********************
09:51:50:WU00:FS01:0x18:Project: 10472 (Run 0, Clone 32, Gen 125)
09:51:50:WU00:FS01:0x18:Unit: 0x000000c3538b3dbb53beb411ea5b8f32
09:51:50:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
09:51:50:WU00:FS01:0x18:Machine: 1
09:51:50:WU00:FS01:0x18:Digital signatures verified
09:51:50:WU00:FS01:0x18:Folding@home GPU core18
09:51:50:WU00:FS01:0x18:Version 0.0.4
09:51:50:WU00:FS01:0x18:  Found a checkpoint file
09:52:15:WU00:FS01:0x18:Completed 250000 out of 5000000 steps (5%)
09:52:15:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:03:42:WU00:FS01:0x18:Completed 300000 out of 5000000 steps (6%)
10:15:00:WU00:FS01:0x18:Completed 350000 out of 5000000 steps (7%)
10:26:28:WU00:FS01:0x18:Completed 400000 out of 5000000 steps (8%)
10:37:45:WU00:FS01:0x18:Completed 450000 out of 5000000 steps (9%)
10:49:01:WU00:FS01:0x18:Completed 500000 out of 5000000 steps (10%)
11:00:29:WU00:FS01:0x18:Completed 550000 out of 5000000 steps (11%)
11:11:45:WU00:FS01:0x18:Completed 600000 out of 5000000 steps (12%)
11:23:16:WU00:FS01:0x18:Completed 650000 out of 5000000 steps (13%)
11:34:32:WU00:FS01:0x18:Completed 700000 out of 5000000 steps (14%)
11:45:48:WU00:FS01:0x18:Completed 750000 out of 5000000 steps (15%)
11:57:16:WU00:FS01:0x18:Completed 800000 out of 5000000 steps (16%)
12:08:33:WU00:FS01:0x18:Completed 850000 out of 5000000 steps (17%)
12:20:01:WU00:FS01:0x18:Completed 900000 out of 5000000 steps (18%)
12:31:17:WU00:FS01:0x18:Completed 950000 out of 5000000 steps (19%)
12:42:33:WU00:FS01:0x18:Completed 1000000 out of 5000000 steps (20%)
12:54:03:WU00:FS01:0x18:Completed 1050000 out of 5000000 steps (21%)
13:05:22:WU00:FS01:0x18:Completed 1100000 out of 5000000 steps (22%)
13:16:50:WU00:FS01:0x18:Completed 1150000 out of 5000000 steps (23%)
13:28:07:WU00:FS01:0x18:Completed 1200000 out of 5000000 steps (24%)
13:39:23:WU00:FS01:0x18:Completed 1250000 out of 5000000 steps (25%)
13:50:51:WU00:FS01:0x18:Completed 1300000 out of 5000000 steps (26%)
14:02:07:WU00:FS01:0x18:Completed 1350000 out of 5000000 steps (27%)
14:13:36:WU00:FS01:0x18:Completed 1400000 out of 5000000 steps (28%)
14:24:45:FS01:Shutting core down
14:24:45:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 7616
14:24:45:WU00:FS01:0x18:Exiting, please wait. . .
14:24:45:WU00:FS01:0x18:Lost lifeline PID 3336, exiting
14:24:45:WU00:FS01:0x18:ERROR:103: Lost client lifeline
14:24:45:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
14:24:46:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
14:24:50:WU00:FS01:Starting
14:24:50:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" D:/temp/FoldingAtHomeData/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 11128 -checkpoint 10 -gpu 0 -gpu-vendor nvidia
14:24:50:WU00:FS01:Started FahCore on PID 1468
14:24:50:WU00:FS01:Core PID:10452
14:24:50:WU00:FS01:FahCore 0x18 started
14:24:50:WU00:FS01:0x18:*********************** Log Started 2015-08-20T14:24:50Z ***********************
14:24:50:WU00:FS01:0x18:Project: 10472 (Run 0, Clone 32, Gen 125)
14:24:50:WU00:FS01:0x18:Unit: 0x000000c3538b3dbb53beb411ea5b8f32
14:24:50:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
14:24:50:WU00:FS01:0x18:Machine: 1
14:24:50:WU00:FS01:0x18:Digital signatures verified
14:24:50:WU00:FS01:0x18:Folding@home GPU core18
14:24:50:WU00:FS01:0x18:Version 0.0.4
14:24:50:WU00:FS01:0x18:  Found a checkpoint file
14:25:17:WU00:FS01:0x18:Completed 1375000 out of 5000000 steps (27%)
14:25:17:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:31:04:WU00:FS01:0x18:Completed 1400000 out of 5000000 steps (28%)
14:42:18:WU00:FS01:0x18:Completed 1450000 out of 5000000 steps (29%)
14:53:33:WU00:FS01:0x18:Completed 1500000 out of 5000000 steps (30%)
15:05:01:WU00:FS01:0x18:Completed 1550000 out of 5000000 steps (31%)
15:16:17:WU00:FS01:0x18:Completed 1600000 out of 5000000 steps (32%)
15:27:51:WU00:FS01:0x18:Completed 1650000 out of 5000000 steps (33%)
******************************* Date: 2015-08-20 *******************************
15:39:06:WU00:FS01:0x18:Completed 1700000 out of 5000000 steps (34%)
15:50:21:WU00:FS01:0x18:Completed 1750000 out of 5000000 steps (35%)
16:01:47:WU00:FS01:0x18:Completed 1800000 out of 5000000 steps (36%)
16:13:01:WU00:FS01:0x18:Completed 1850000 out of 5000000 steps (37%)
16:24:28:WU00:FS01:0x18:Completed 1900000 out of 5000000 steps (38%)
16:35:42:WU00:FS01:0x18:Completed 1950000 out of 5000000 steps (39%)
16:46:57:WU00:FS01:0x18:Completed 2000000 out of 5000000 steps (40%)

bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: GPU WU doesn't end

Post by bruce »

jabacrack wrote:I think last is the cause of problems. Can my activity cause errors?
Yes. {and an excellent question :!:]

I see you're running Win7. Microsoft prevented a service from using GPUs to fold. Ownership of the GPU device to the person at the keyboard. I'm not aware of a change to that policy, but they've radically changed the way the GPU is virtualized in WIndows X. Thus anything might have changed I doubt anybody has tested it in later versions of WIndows.
Post Reply