Folding Forum

Posted: **Tue Aug 13, 2013 8:52 pm**

Hi, I've completed a P8103 but after completing the unit the client downloaded a new one and stopped doing anything. Then I restarted the client and now it doesn't upload the unit

log.txt

Code: Select all

*********************** Log Started 2013-08-12T19:07:22Z ***********************
19:07:22:************************* Folding@home Client *************************
19:07:22:    Website: http://folding.stanford.edu/
19:07:22:  Copyright: (c) 2009-2013 Stanford University
19:07:22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:07:22:       Args: 
19:07:22:     Config: /home/tbm01/fahv7/v7/config.xml
19:07:22:******************************** Build ********************************
19:07:22:    Version: 7.3.6
19:07:22:       Date: Feb 18 2013
19:07:22:       Time: 07:24:09
19:07:22:    SVN Rev: 3923
19:07:22:     Branch: fah/trunk/client
19:07:22:   Compiler: GNU 4.1.2 20080704 (Red Hat 4.1.2-46)
19:07:22:    Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
19:07:22:             -fno-unsafe-math-optimizations -msse2
19:07:22:   Platform: linux2 2.6.18-164.11.1.el5
19:07:22:       Bits: 64
19:07:22:       Mode: Release
19:07:22:******************************* System ********************************
19:07:22:        CPU: Genuine Intel(R) CPU @ 2.30GHz
19:07:22:     CPU ID: GenuineIntel Family 6 Model 45 Stepping 2
19:07:22:       CPUs: 32
19:07:22:     Memory: 31.47GiB
19:07:22:Free Memory: 30.46GiB
19:07:22:    Threads: POSIX_THREADS
19:07:22:Has Battery: false
19:07:22: On Battery: false
19:07:22: UTC offset: 2
19:07:22:        PID: 1632
19:07:22:        CWD: /home/tbm01/fahv7/v7
19:07:22:         OS: Linux 3.7.10-1.16-desktop x86_64
19:07:22:    OS Arch: AMD64
19:07:22:       GPUs: 1
19:07:22:      GPU 0: NVIDIA:2 GF100 [GeForce GTX 470]
19:07:22:       CUDA: 2.0
19:07:22:CUDA Driver: 5050
19:07:22:***********************************************************************
19:07:22:<config>
19:07:22:  <!-- Folding Core -->
19:07:22:  <checkpoint v='3'/>
19:07:22:
19:07:22:  <!-- Folding Slot Configuration -->
19:07:22:  <client-type v='bigbeta'/>
19:07:22:  <max-packet-size v='big'/>
19:07:22:  <power v='full'/>
19:07:22:
19:07:22:  <!-- HTTP Server -->
19:07:22:  <allow v='127.0.0.1 192.168.1.0-192.168.2.149'/>
19:07:22:
19:07:22:  <!-- Remote Command Server -->
19:07:22:  <command-allow-no-pass v='127.0.0.1 192.168.1.0-192.168.2.149'/>
19:07:22:
19:07:22:  <!-- User Information -->
19:07:22:  <passkey v='********************************'/>
19:07:22:  <team v='37726'/>
19:07:22:  <user v='TheBlademaster01'/>
19:07:22:
19:07:22:  <!-- Folding Slots -->
19:07:22:</config>
19:07:22:Trying to access database...
19:07:22:Successfully acquired database lock
19:07:22:Enabled folding slot 00: READY cpu:32
19:07:22:WU01:FS00:Starting
19:07:22:WU01:FS00:Running FahCore: /home/tbm01/fahv7/v7/FAHCoreWrapper /home/tbm01/fahv7/v7/cores/www.stanford.edu/~pande/Linux/AMD64/beta/Core_a5.fah/FahCore_a5 -dir 01 -suffix 01 -version 703 -lifeline 1632 -checkpoint 3 -np 32
19:07:22:WU01:FS00:Started FahCore on PID 1639
19:07:22:WU01:FS00:Core PID:1643
19:07:22:WU01:FS00:FahCore 0xa5 started
19:07:23:WU01:FS00:0xa5:
19:07:23:WU01:FS00:0xa5:*------------------------------*
19:07:23:WU01:FS00:0xa5:Folding@Home Gromacs SMP Core
19:07:23:WU01:FS00:0xa5:Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
19:07:23:WU01:FS00:0xa5:
19:07:23:WU01:FS00:0xa5:Preparing to commence simulation
19:07:23:WU01:FS00:0xa5:- Looking at optimizations...
19:07:23:WU01:FS00:0xa5:- Files status OK
19:07:25:WU01:FS00:0xa5:- Expanded 30338688 -> 33163648 (decompressed 109.3 percent)
19:07:25:WU01:FS00:0xa5:Called DecompressByteArray: compressed_data_size=30338688 data_size=33163648, decompressed_data_size=33163648 diff=0
19:07:26:WU01:FS00:0xa5:- Digital signature verified
19:07:26:WU01:FS00:0xa5:
19:07:26:WU01:FS00:0xa5:Project: 8103 (Run 1, Clone 54, Gen 65)
19:07:26:WU01:FS00:0xa5:
19:07:26:WU01:FS00:0xa5:Assembly optimizations on if available.
19:07:26:WU01:FS00:0xa5:Entering M.D.
19:07:32:WU01:FS00:0xa5:Using Gromacs checkpoints
19:07:34:WU01:FS00:0xa5:Mapping NT from 32 to 32 
19:07:50:WU01:FS00:0xa5:Resuming from checkpoint
19:07:59:WU01:FS00:0xa5:Verified 01/wudata_01.log
19:07:59:WU01:FS00:0xa5:Verified 01/wudata_01.trr
19:07:59:WU01:FS00:0xa5:Verified 01/wudata_01.xtc
19:07:59:WU01:FS00:0xa5:Verified 01/wudata_01.edr
19:08:00:WU01:FS00:0xa5:Completed 24375 out of 250000 steps  (9%)
19:12:11:WU01:FS00:0xa5:Completed 25000 out of 250000 steps  (10%)
19:28:48:WU01:FS00:0xa5:Completed 27500 out of 250000 steps  (11%)
19:45:22:WU01:FS00:0xa5:Completed 30000 out of 250000 steps  (12%)
20:01:56:WU01:FS00:0xa5:Completed 32500 out of 250000 steps  (13%)
20:18:29:WU01:FS00:0xa5:Completed 35000 out of 250000 steps  (14%)
20:36:52:WU01:FS00:0xa5:Completed 37500 out of 250000 steps  (15%)
20:54:40:WU01:FS00:0xa5:Completed 40000 out of 250000 steps  (16%)
21:11:17:WU01:FS00:0xa5:Completed 42500 out of 250000 steps  (17%)
21:27:53:WU01:FS00:0xa5:Completed 45000 out of 250000 steps  (18%)
21:44:32:WU01:FS00:0xa5:Completed 47500 out of 250000 steps  (19%)
22:01:06:WU01:FS00:0xa5:Completed 50000 out of 250000 steps  (20%)
22:17:43:WU01:FS00:0xa5:Completed 52500 out of 250000 steps  (21%)
22:34:19:WU01:FS00:0xa5:Completed 55000 out of 250000 steps  (22%)
22:50:59:WU01:FS00:0xa5:Completed 57500 out of 250000 steps  (23%)
23:07:35:WU01:FS00:0xa5:Completed 60000 out of 250000 steps  (24%)
23:24:10:WU01:FS00:0xa5:Completed 62500 out of 250000 steps  (25%)
23:40:45:WU01:FS00:0xa5:Completed 65000 out of 250000 steps  (26%)
23:57:19:WU01:FS00:0xa5:Completed 67500 out of 250000 steps  (27%)
00:13:55:WU01:FS00:0xa5:Completed 70000 out of 250000 steps  (28%)
00:30:28:WU01:FS00:0xa5:Completed 72500 out of 250000 steps  (29%)
00:47:03:WU01:FS00:0xa5:Completed 75000 out of 250000 steps  (30%)
01:03:36:WU01:FS00:0xa5:Completed 77500 out of 250000 steps  (31%)
******************************* Date: 2013-08-13 *******************************
01:20:12:WU01:FS00:0xa5:Completed 80000 out of 250000 steps  (32%)
01:36:48:WU01:FS00:0xa5:Completed 82500 out of 250000 steps  (33%)
01:53:25:WU01:FS00:0xa5:Completed 85000 out of 250000 steps  (34%)
02:09:56:WU01:FS00:0xa5:Completed 87500 out of 250000 steps  (35%)
02:26:31:WU01:FS00:0xa5:Completed 90000 out of 250000 steps  (36%)
02:43:03:WU01:FS00:0xa5:Completed 92500 out of 250000 steps  (37%)
02:59:39:WU01:FS00:0xa5:Completed 95000 out of 250000 steps  (38%)
03:16:11:WU01:FS00:0xa5:Completed 97500 out of 250000 steps  (39%)
03:32:48:WU01:FS00:0xa5:Completed 100000 out of 250000 steps  (40%)
03:49:24:WU01:FS00:0xa5:Completed 102500 out of 250000 steps  (41%)
04:05:59:WU01:FS00:0xa5:Completed 105000 out of 250000 steps  (42%)
04:22:31:WU01:FS00:0xa5:Completed 107500 out of 250000 steps  (43%)
04:39:04:WU01:FS00:0xa5:Completed 110000 out of 250000 steps  (44%)
04:55:36:WU01:FS00:0xa5:Completed 112500 out of 250000 steps  (45%)
05:12:13:WU01:FS00:0xa5:Completed 115000 out of 250000 steps  (46%)
05:28:47:WU01:FS00:0xa5:Completed 117500 out of 250000 steps  (47%)
05:45:20:WU01:FS00:0xa5:Completed 120000 out of 250000 steps  (48%)
06:01:54:WU01:FS00:0xa5:Completed 122500 out of 250000 steps  (49%)
06:18:25:WU01:FS00:0xa5:Completed 125000 out of 250000 steps  (50%)
06:34:58:WU01:FS00:0xa5:Completed 127500 out of 250000 steps  (51%)
06:51:28:WU01:FS00:0xa5:Completed 130000 out of 250000 steps  (52%)
07:08:02:WU01:FS00:0xa5:Completed 132500 out of 250000 steps  (53%)
******************************* Date: 2013-08-13 *******************************
07:24:35:WU01:FS00:0xa5:Completed 135000 out of 250000 steps  (54%)
07:41:11:WU01:FS00:0xa5:Completed 137500 out of 250000 steps  (55%)
07:57:46:WU01:FS00:0xa5:Completed 140000 out of 250000 steps  (56%)
08:14:21:WU01:FS00:0xa5:Completed 142500 out of 250000 steps  (57%)
08:30:53:WU01:FS00:0xa5:Completed 145000 out of 250000 steps  (58%)
08:47:30:WU01:FS00:0xa5:Completed 147500 out of 250000 steps  (59%)
09:04:05:WU01:FS00:0xa5:Completed 150000 out of 250000 steps  (60%)
09:20:39:WU01:FS00:0xa5:Completed 152500 out of 250000 steps  (61%)
09:37:11:WU01:FS00:0xa5:Completed 155000 out of 250000 steps  (62%)
09:53:48:WU01:FS00:0xa5:Completed 157500 out of 250000 steps  (63%)
10:10:24:WU01:FS00:0xa5:Completed 160000 out of 250000 steps  (64%)
10:27:03:WU01:FS00:0xa5:Completed 162500 out of 250000 steps  (65%)
10:43:39:WU01:FS00:0xa5:Completed 165000 out of 250000 steps  (66%)
11:00:13:WU01:FS00:0xa5:Completed 167500 out of 250000 steps  (67%)
11:16:47:WU01:FS00:0xa5:Completed 170000 out of 250000 steps  (68%)
11:33:19:WU01:FS00:0xa5:Completed 172500 out of 250000 steps  (69%)
11:49:57:WU01:FS00:0xa5:Completed 175000 out of 250000 steps  (70%)
12:06:32:WU01:FS00:0xa5:Completed 177500 out of 250000 steps  (71%)
12:23:10:WU01:FS00:0xa5:Completed 180000 out of 250000 steps  (72%)
12:39:45:WU01:FS00:0xa5:Completed 182500 out of 250000 steps  (73%)
12:56:20:WU01:FS00:0xa5:Completed 185000 out of 250000 steps  (74%)
13:12:55:WU01:FS00:0xa5:Completed 187500 out of 250000 steps  (75%)
******************************* Date: 2013-08-13 *******************************
13:29:30:WU01:FS00:0xa5:Completed 190000 out of 250000 steps  (76%)
13:46:02:WU01:FS00:0xa5:Completed 192500 out of 250000 steps  (77%)
14:02:34:WU01:FS00:0xa5:Completed 195000 out of 250000 steps  (78%)
14:19:06:WU01:FS00:0xa5:Completed 197500 out of 250000 steps  (79%)
14:35:41:WU01:FS00:0xa5:Completed 200000 out of 250000 steps  (80%)
14:52:14:WU01:FS00:0xa5:Completed 202500 out of 250000 steps  (81%)
15:08:50:WU01:FS00:0xa5:Completed 205000 out of 250000 steps  (82%)
15:25:23:WU01:FS00:0xa5:Completed 207500 out of 250000 steps  (83%)
15:41:58:WU01:FS00:0xa5:Completed 210000 out of 250000 steps  (84%)
15:58:34:WU01:FS00:0xa5:Completed 212500 out of 250000 steps  (85%)
16:15:12:WU01:FS00:0xa5:Completed 215000 out of 250000 steps  (86%)
16:31:48:WU01:FS00:0xa5:Completed 217500 out of 250000 steps  (87%)
16:48:23:WU01:FS00:0xa5:Completed 220000 out of 250000 steps  (88%)
17:04:59:WU01:FS00:0xa5:Completed 222500 out of 250000 steps  (89%)
17:21:34:WU01:FS00:0xa5:Completed 225000 out of 250000 steps  (90%)
17:38:11:WU01:FS00:0xa5:Completed 227500 out of 250000 steps  (91%)
17:54:47:WU01:FS00:0xa5:Completed 230000 out of 250000 steps  (92%)
18:11:22:WU01:FS00:0xa5:Completed 232500 out of 250000 steps  (93%)
18:27:54:WU01:FS00:0xa5:Completed 235000 out of 250000 steps  (94%)
18:44:29:WU01:FS00:0xa5:Completed 237500 out of 250000 steps  (95%)
19:01:04:WU01:FS00:0xa5:Completed 240000 out of 250000 steps  (96%)
19:17:40:WU01:FS00:0xa5:Completed 242500 out of 250000 steps  (97%)
******************************* Date: 2013-08-13 *******************************
19:34:13:WU01:FS00:0xa5:Completed 245000 out of 250000 steps  (98%)
19:34:14:WU00:FS00:Connecting to assign3.stanford.edu:8080
19:34:15:WU00:FS00:News: Welcome to Folding@Home
19:34:15:WU00:FS00:Assigned to work server 128.143.231.201
19:34:15:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:32 from 128.143.231.201
19:34:15:WU00:FS00:Connecting to 128.143.231.201:8080
19:34:23:WU00:FS00:Downloading 28.93MiB
19:34:29:WU00:FS00:Download 12.96%
19:34:35:WU00:FS00:Download 27.86%
19:34:41:WU00:FS00:Download 42.77%
19:34:47:WU00:FS00:Download 60.26%
19:34:53:WU00:FS00:Download 81.43%
19:34:59:WU00:FS00:Download 95.90%
19:35:00:WU00:FS00:Download complete
19:35:00:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8103 run:0 clone:19 gen:137 core:0xa5 unit:0x000000a8088988e1511d1e6d97d67d74
19:50:49:WU01:FS00:0xa5:Completed 247500 out of 250000 steps  (99%)
20:07:21:WU01:FS00:0xa5:Completed 250000 out of 250000 steps  (100%)
20:07:36:WU01:FS00:0xa5:DynamicWrapper: Finished Work Unit: sleep=10000
20:07:46:WU01:FS00:0xa5:
20:07:46:WU01:FS00:0xa5:Finished Work Unit:
20:07:46:WU01:FS00:0xa5:- Reading up to 64407792 from "01/wudata_01.trr": Read 64407792
20:07:47:WU01:FS00:0xa5:trr file hash check passed.
20:07:47:WU01:FS00:0xa5:- Reading up to 31749456 from "01/wudata_01.xtc": Read 31749456
20:07:47:WU01:FS00:0xa5:xtc file hash check passed.
20:07:47:WU01:FS00:0xa5:edr file hash check passed.
20:07:47:WU01:FS00:0xa5:logfile size: 222512
20:07:47:WU01:FS00:0xa5:Leaving Run
20:07:49:WU01:FS00:0xa5:- Writing 96540636 bytes of core data to disk...
20:08:08:WU01:FS00:0xa5:Done: 96540124 -> 91762100 (compressed to 6.0 percent)
20:08:08:WU01:FS00:0xa5:  ... Done.
20:31:59:Caught signal SIGINT(2) on PID 1632
20:31:59:Exiting, please wait. . .
20:32:00:FS00:Shutting core down
20:32:19:Caught signal SIGINT(2) on PID 1632
[93m20:32:19:WARNING:Next signal will force exit[0m

Queue info

Code: Select all

Queue Info:
  id:01 state:READY error:NO_ERROR project:8103 run:1 clone:54 gen:65 core:0xa5 unit:0x0000004c088988e1513e874aa9e041ba percentdone:0.00% eta:"1.44 days" ppd:134295 creditestimate:193515 waitingon: nextattempt:"0.00 secs" totalframes:250 framesdone:0 assigned:"2013-08-12T14:36:40Z" timeout:"2013-08-15T00:12:40Z" deadline:"2013-08-16T14:36:40Z" ws:128.143.231.201 cs:128.143.199.97 attempts:0 slot:00 tpf:"20 mins 45 secs" basecredit:22607
  id:00 state:READY error:NO_ERROR project:8103 run:0 clone:19 gen:137 core:0xa5 unit:0x000000a8088988e1511d1e6d97d67d74 percentdone:0.00% eta:"1.44 days" ppd:180104 creditestimate:259525 waitingon: nextattempt:"0.00 secs" totalframes:0 framesdone:0 assigned:"2013-08-13T19:21:57Z" timeout:"2013-08-16T04:57:57Z" deadline:"2013-08-17T19:21:57Z" ws:128.143.231.201 cs:128.143.199.97 attempts:0 slot:00 tpf:"20 mins 45 secs" basecredit:22607

Posted: **Tue Aug 13, 2013 10:24 pm**

It looks like you may not have waited long enough for the WU to finish being packed up to be sent in. Recent versions of Linux by default turn on barriers for the ext3 and ext4 filesystems. The older file writing code in the A5 core does not work well with barriers, so can take up to an hour to write out the results file for a bigadv WU. Since you interrupted the file writing , the WU is gone and there is nothing to upload.

TheBlademaster01 wrote:20:08:08:WU01:FS00:0xa5: ... Done.
20:31:59:Caught signal SIGINT(2) on PID 1632
20:31:59:Exiting, please wait. . .
20:32:00:FS00:Shutting core down
20:32:19:Caught signal SIGINT(2) on PID 1632
[93m20:32:19:WARNING:Next signal will force exit[0m

That first SIGINT was in the log before the entry that would signify the core was done processing the results file. What you should see in the log file is a sequence like this:

01:02:46:WU01:FS00:0xa4: ... Done.
01:02:47:WU01:FS00:0xa4:- Shutting down core
01:02:47:WU01:FS00:0xa4:
01:02:47:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
01:02:47:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)

This is from one of my logs on a somewhat smaller WU.

If you do have barriers enabled, then you can speedup writing the results file by disabling barriers for that filesystem. Other options include setting up a RAM disk or using a SSD for the work directory. There are posts covering all of those options.

Posted: **Wed Aug 14, 2013 8:28 am**

It seems like it, bummer...

How do you disable barriers.

Thanks for your time btw

Posted: **Wed Aug 14, 2013 8:43 am**

Forum search: viewtopic.php?f=85&t=23245&p=232207&hilit=linux+barrier#p232207. You may want to take a backup copy of your /etc/fstab first, and compare before & after, but seems like an elegant solution. Better reboot after modifying /etc/fstab, just in case.

Posted: **Wed Aug 14, 2013 6:03 pm**

Had the same problem with Ubuntu Linux, it waited about 1 hour before it sent after it said it was saving to disk. Seems this is something about Linux and disk writes that take a long long time. There is a fix for the problem however.
viewtopic.php?f=55&t=24550
Where my question was asked and answered.
Rick

Posted: **Sun Sep 08, 2013 2:02 pm**

Sorry for not reporting back. The solution in post #4 worked perfectly.

I have a different question that is not really related to this problem.

A couple of members on the forum I fold for have had issues with TPF doubling on P7810/P7811 units and a restart fixes it. Are you familiar with this problem and if so, what causes this? One uses a GTX 680 and the other has this issue on 2 of his GTX 670s

Thanks for all the information so far btw

Posted: **Sun Sep 08, 2013 2:21 pm**

First report of such a thing. It would help if they posted their log on this forum.

Posted: **Sun Sep 08, 2013 6:32 pm**

Are they running 320.49 drivers? There's a known bug where the drivers fail after 36 hours and clockspeeds drastically slow down, and the only way I know of to get them working again is a reboot.

Posted: **Sun Sep 08, 2013 7:54 pm**

It is quite common for VRM resets to significantly drop the clock rate of a GPU causing a doubling of TPF's. The short-term solution is to reboot and that allows the clock rate to reset. Common causes of the VRM reset is overclocking or overheating but folding while gaming can also cause the resets. The longer-term solution is to add cooling, decrease overclocks, or pause the folding slot while gaming which ever is causing the VRM resets.

Posted: **Sun Sep 08, 2013 9:27 pm**

Zagen30 wrote:Are they running 320.49 drivers? There's a known bug where the drivers fail after 36 hours and clockspeeds drastically slow down, and the only way I know of to get them working again is a reboot.

I thought this only applied to 7xx series cards.

Posted: **Sun Sep 08, 2013 10:48 pm**

Driver 320.49 is generally known as buggy - with 5xx-series cards you will get BlueScreens, freeses and other "special features"

Posted: **Sun Sep 08, 2013 11:41 pm**

Opinions vary. That version runs just fine on my GT 430.

Folding Forum

P8103 not uploading

P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading

Re: P8103 not uploading