FAH will not run at 100%

[bruce]

I learn every day!

So do I.

I found the log interesting for another reason. It seems if you specify SMP on the restart with a Classic in the queue, it chokes on itself. It knew it still needed Core 78 to run the work unit in the queue, but it could not run it. I guess on a restart where we change from SMP we also need to specify either finish the work unit first (preferred) or delete the work directory and the queue file.

Some folks say adding -smp while a uniprocessor WU is in queue will cause the client to choke, necessitating dumping the WU. Others report that the client goes back to work as a uniprocessor client, successfully finishes the core_78 WU and downloads a SMP WU the next time it needs work making for an effortless transition after an initial mistake. These two are obviously in conflict and I've never sorted out what the difference is.

[HendricksSA]

Amaruk's log would indicate, with a small sample size of 1, that it does indeed choke. It even shows a call to mpiexec. I guess this one belongs on the SMP 1 heap. I for one will give the advice you seniors always give ... finish the work at hand before trying something new.

[Amaruk]

In the configuration dialog, it very clearly says that the [extra parameters] section do NOT apply to the current run. Since you ran the client without -smp in the command line (such as "fah6 -config" rather than "fah6 -smp -config") you got exactly what you asked for .... no smp.

Yes I did! My main curiosity was if this behavior (no smp) would persist, which it did. Knowing the difference between the client and core, this is exactly what I expected. But I think it might not be as obvious to a beginner, and the PPD of the smp is attractive to many.

@HendricksSA, thanks for the compliment! I've always liked to take things apart and figure out how they work. It all started when I attempted to take my mom's stove apart - I think I was about 4 years old at the time...


Speaking of breaking stuff, after finishing the smp WU I reloaded the files from that second classic project. Used -configonly to remove the -smp flag and then restarted.

Code: Select all

--- Opening Log file [March 5 06:57:50 UTC] 


# Windows CPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe


[06:57:50] Configuring Folding@Home...


[07:00:22] - Ask before connecting: No
[07:00:22] - User name: Amaruk (Team 50625)
[07:00:22] - User ID: 44FC6BDB66AFE781
[07:00:22] - Machine ID: 1
[07:00:22] 
[07:00:22] Work directory not found. Creating...
[07:00:22] Could not open work queue, generating new queue...
[07:00:22] - Preparing to get new work unit...
[07:00:22] Cleaning up work directory
[07:00:22] + Attempting to get work packet
[07:00:22] Passkey found
[07:00:22] - Autosending finished units... [March 5 07:00:22 UTC]
[07:00:22] - Will indicate memory of 4095 MB
[07:00:22] Trying to send all finished work units
[07:00:22] - Detect CPU.[07:00:22] + No unsent completed units remaining.
 Vendor: AuthenticAMD, Family: 15, Model: 2, Stepping: 3
[07:00:22] - Autosend completed
[07:00:22] - Connecting to assignment server
[07:00:22] Connecting to http://assign.stanford.edu:8080/
[07:00:22] Posted data.
[07:00:22] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[07:00:22] + News From Folding@Home: Welcome to Folding@Home
[07:00:22] Loaded queue successfully.
[07:00:22] Sent data
[07:00:22] Connecting to http://171.64.65.62:8080/
[07:00:23] Posted data.
[07:00:23] Initial: 0000; - Receiving payload (expected size: 684573)
[07:00:24] - Downloaded at ~668 kB/s
[07:00:24] - Averaged speed for that direction ~668 kB/s
[07:00:24] + Received work.
[07:00:24] + Closed connections
[07:00:24] 
[07:00:24] + Processing work unit
[07:00:24] Work type 78 not eligible for variable processors
[07:00:24] Core required: FahCore_78.exe
[07:00:24] Core not found.
[07:00:24] - Core is not present or corrupted.
[07:00:24] - Attempting to download new core...
[07:00:24] + Downloading new core: FahCore_78.exe
[07:00:24] Downloading core (/~pande/Win32/x86/Core_78.fah from www.stanford.edu)
[07:00:24] Initial: AFDE; + 10240 bytes downloaded
[07:00:24] Initial: 2993; + 20480 bytes downloaded
[07:00:24] Initial: 4590; + 30720 bytes downloaded
[07:00:24] Initial: 1F95; + 40960 bytes downloaded
[07:00:24] Initial: 6459; + 51200 bytes downloaded
[07:00:24] Initial: FD92; + 61440 bytes downloaded
[07:00:24] Initial: 62E6; + 71680 bytes downloaded
[07:00:24] Initial: 1F03; + 81920 bytes downloaded
[07:00:24] Initial: 1707; + 92160 bytes downloaded
[07:00:24] Initial: 8862; + 102400 bytes downloaded
[07:00:24] Initial: B1CE; + 112640 bytes downloaded
[07:00:24] Initial: D9DE; + 122880 bytes downloaded
[07:00:24] Initial: 5C0A; + 133120 bytes downloaded
[07:00:24] Initial: 3FF3; + 143360 bytes downloaded
[07:00:24] Initial: 4529; + 153600 bytes downloaded
[07:00:24] Initial: 635C; + 163840 bytes downloaded
[07:00:24] Initial: 869F; + 174080 bytes downloaded
[07:00:24] Initial: C8A8; + 184320 bytes downloaded
[07:00:24] Initial: 1A54; + 194560 bytes downloaded
[07:00:24] Initial: BDCB; + 204800 bytes downloaded
[07:00:24] Initial: CC8C; + 215040 bytes downloaded
[07:00:24] Initial: 12EB; + 225280 bytes downloaded
[07:00:24] Initial: 4886; + 235520 bytes downloaded
[07:00:24] Initial: 29D0; + 245760 bytes downloaded
[07:00:24] Initial: AF1F; + 256000 bytes downloaded
[07:00:24] Initial: 05BE; + 266240 bytes downloaded
[07:00:24] Initial: D366; + 276480 bytes downloaded
[07:00:24] Initial: A52F; + 286720 bytes downloaded
[07:00:24] Initial: 1E70; + 296960 bytes downloaded
[07:00:24] Initial: 7229; + 307200 bytes downloaded
[07:00:24] Initial: A7F6; + 317440 bytes downloaded
[07:00:24] Initial: 44C2; + 327680 bytes downloaded
[07:00:24] Initial: A72B; + 337920 bytes downloaded
[07:00:24] Initial: 9C10; + 348160 bytes downloaded
[07:00:24] Initial: 891C; + 358400 bytes downloaded
[07:00:24] Initial: F143; + 368640 bytes downloaded
[07:00:24] Initial: 795C; + 378880 bytes downloaded
[07:00:24] Initial: 8C2B; + 389120 bytes downloaded
[07:00:24] Initial: FC93; + 399360 bytes downloaded
[07:00:24] Initial: F24B; + 409600 bytes downloaded
[07:00:24] Initial: 9D83; + 419840 bytes downloaded
[07:00:24] Initial: 0F67; + 430080 bytes downloaded
[07:00:24] Initial: FB4A; + 440320 bytes downloaded
[07:00:24] Initial: F331; + 450560 bytes downloaded
[07:00:24] Initial: 5BF6; + 460800 bytes downloaded
[07:00:24] Initial: 240B; + 471040 bytes downloaded
[07:00:24] Initial: 47D4; + 481280 bytes downloaded
[07:00:24] Initial: 3AB2; + 491520 bytes downloaded
[07:00:24] Initial: 0F84; + 501760 bytes downloaded
[07:00:24] Initial: CA7A; + 512000 bytes downloaded
[07:00:24] Initial: 3B69; + 522240 bytes downloaded
[07:00:24] Initial: F0AA; + 532480 bytes downloaded
[07:00:24] Initial: 1B36; + 542720 bytes downloaded
[07:00:24] Initial: BCE4; + 552960 bytes downloaded
[07:00:24] Initial: 9BEA; + 563200 bytes downloaded
[07:00:24] Initial: E168; + 573440 bytes downloaded
[07:00:24] Initial: C3A1; + 583680 bytes downloaded
[07:00:24] Initial: 5920; + 593920 bytes downloaded
[07:00:24] Initial: 1D0F; + 604160 bytes downloaded
[07:00:24] Initial: E779; + 614400 bytes downloaded
[07:00:24] Initial: E6CE; + 624640 bytes downloaded
[07:00:24] Initial: 9E24; + 634880 bytes downloaded
[07:00:24] Initial: EB69; + 645120 bytes downloaded
[07:00:24] Initial: 38FC; + 655360 bytes downloaded
[07:00:24] Initial: 6F35; + 665600 bytes downloaded
[07:00:24] Initial: 8C15; + 675840 bytes downloaded
[07:00:24] Initial: 21FE; + 686080 bytes downloaded
[07:00:24] Initial: B05C; + 696320 bytes downloaded
[07:00:24] Initial: 1BD5; + 706560 bytes downloaded
[07:00:24] Initial: FD2D; + 716800 bytes downloaded
[07:00:24] Initial: 2210; + 727040 bytes downloaded
[07:00:24] Initial: BC67; + 737280 bytes downloaded
[07:00:24] Initial: C396; + 747520 bytes downloaded
[07:00:24] Initial: A39D; + 757760 bytes downloaded
[07:00:25] Initial: D988; + 768000 bytes downloaded
[07:00:25] Initial: 7358; + 778240 bytes downloaded
[07:00:25] Initial: 3F63; + 788480 bytes downloaded
[07:00:25] Initial: 7C28; + 798720 bytes downloaded
[07:00:25] Initial: A4B3; + 808960 bytes downloaded
[07:00:25] Initial: 9978; + 819200 bytes downloaded
[07:00:25] Initial: C1AC; + 825633 bytes downloaded
[07:00:25] Verifying core Core_78.fah...
[07:00:25] Signature is VALID
[07:00:25] 
[07:00:25] Trying to unzip core FahCore_78.exe
[07:00:25] Decompressed FahCore_78.exe (2338816 bytes) successfully
[07:00:30] + Core successfully engaged
[07:00:35] 
[07:00:35] + Processing work unit
[07:00:35] Work type 78 not eligible for variable processors
[07:00:35] Core required: FahCore_78.exe
[07:00:35] Core found.
[07:00:35] Working on queue slot 01 [March 5 07:00:35 UTC]
[07:00:35] + Working ...
[07:00:35] - Calling '.\FahCore_78.exe -dir work/ -suffix 01 -nice 19 -checkpoint 15 -verbose -lifeline 2236 -version 634'

[07:00:35] 
[07:00:35] *------------------------------*
[07:00:35] Folding@Home Gromacs Core
[07:00:35] Version 1.90 (March 8, 2006)
[07:00:35] 
[07:00:35] Preparing to commence simulation
[07:00:35] - Looking at optimizations...
[07:00:35] - Created dyn
[07:00:35] - Files status OK
[07:00:35] - Expanded 684061 -> 3407849 (decompressed 498.1 percent)
[07:00:35] - Starting from initial work packet
[07:00:35] 
[07:00:35] Project: 6526 (Run 1, Clone 73, Gen 56)
[07:00:35] 
[07:00:35] Assembly optimizations on if available.
[07:00:35] Entering M.D.
[07:00:42] Protein: proA_2 in water
[07:00:42] 
[07:00:42] Writing local files
[07:00:42] Extra SSE boost OK.
[07:00:42] Writing local files
[07:00:42] Completed 0 out of 250000 steps  (0%)
[07:09:55] Writing local files
[07:09:55] Completed 2500 out of 250000 steps  (1%)
[07:19:07] Writing local files
[07:19:07] Completed 5000 out of 250000 steps  (2%)
[07:28:19] Writing local files
[07:28:19] Completed 7500 out of 250000 steps  (3%)
[07:37:32] Writing local files
[07:37:32] Completed 10000 out of 250000 steps  (4%)
[07:46:44] Writing local files
[07:46:44] Completed 12500 out of 250000 steps  (5%)
[07:55:56] Writing local files
[07:55:56] Completed 15000 out of 250000 steps  (6%)
[08:05:09] Writing local files
[08:05:09] Completed 17500 out of 250000 steps  (7%)
[08:14:21] Writing local files
[08:14:21] Completed 20000 out of 250000 steps  (8%)
[08:23:33] Writing local files
[08:23:33] Completed 22500 out of 250000 steps  (9%)
[08:32:46] Writing local files
[08:32:46] Completed 25000 out of 250000 steps  (10%)
[08:41:59] Writing local files
[08:41:59] Completed 27500 out of 250000 steps  (11%)
[08:51:11] Writing local files
[08:51:11] Completed 30000 out of 250000 steps  (12%)
[09:00:24] Writing local files
[09:00:24] Completed 32500 out of 250000 steps  (13%)
[09:09:37] Writing local files
[09:09:37] Completed 35000 out of 250000 steps  (14%)
[09:18:50] Writing local files
[09:18:50] Completed 37500 out of 250000 steps  (15%)
[09:28:02] Writing local files
[09:28:02] Completed 40000 out of 250000 steps  (16%)
[09:37:16] Writing local files
[09:37:16] Completed 42500 out of 250000 steps  (17%)
[09:46:28] Writing local files
[09:46:28] Completed 45000 out of 250000 steps  (18%)
[09:55:41] Writing local files
[09:55:41] Completed 47500 out of 250000 steps  (19%)
[10:04:54] Writing local files
[10:04:54] Completed 50000 out of 250000 steps  (20%)
[10:14:07] Writing local files
[10:14:07] Completed 52500 out of 250000 steps  (21%)
[10:23:20] Writing local files
[10:23:20] Completed 55000 out of 250000 steps  (22%)
[10:32:33] Writing local files
[10:32:33] Completed 57500 out of 250000 steps  (23%)
[10:41:45] Writing local files
[10:41:45] Completed 60000 out of 250000 steps  (24%)
[10:50:58] Writing local files
[10:50:58] Completed 62500 out of 250000 steps  (25%)
[11:00:11] Writing local files
[11:00:11] Completed 65000 out of 250000 steps  (26%)
[11:09:24] Writing local files
[11:09:24] Completed 67500 out of 250000 steps  (27%)
[11:18:37] Writing local files
[11:18:37] Completed 70000 out of 250000 steps  (28%)
[11:27:50] Writing local files
[11:27:50] Completed 72500 out of 250000 steps  (29%)
[11:37:03] Writing local files
[11:37:03] Completed 75000 out of 250000 steps  (30%)
[11:46:16] Writing local files
[11:46:16] Completed 77500 out of 250000 steps  (31%)
[11:55:29] Writing local files
[11:55:29] Completed 80000 out of 250000 steps  (32%)
[12:04:41] Writing local files
[12:04:41] Completed 82500 out of 250000 steps  (33%)
[12:13:54] Writing local files
[12:13:54] Completed 85000 out of 250000 steps  (34%)
[12:23:07] Writing local files
[12:23:07] Completed 87500 out of 250000 steps  (35%)
[12:32:20] Writing local files
[12:32:20] Completed 90000 out of 250000 steps  (36%)
[12:41:33] Writing local files
[12:41:33] Completed 92500 out of 250000 steps  (37%)
[12:50:46] Writing local files
[12:50:46] Completed 95000 out of 250000 steps  (38%)
[12:59:59] Writing local files
[12:59:59] Completed 97500 out of 250000 steps  (39%)
[13:00:22] - Autosending finished units... [March 5 13:00:22 UTC]
[13:00:22] Trying to send all finished work units
[13:00:22] + No unsent completed units remaining.
[13:00:22] - Autosend completed
[13:09:11] Writing local files
[13:09:11] Completed 100000 out of 250000 steps  (40%)
[13:18:25] Writing local files
[13:18:25] Completed 102500 out of 250000 steps  (41%)
[13:27:38] Writing local files
[13:27:38] Completed 105000 out of 250000 steps  (42%)
[13:36:51] Writing local files
[13:36:51] Completed 107500 out of 250000 steps  (43%)
[13:46:04] Writing local files
[13:46:04] Completed 110000 out of 250000 steps  (44%)
[13:55:16] Writing local files
[13:55:16] Completed 112500 out of 250000 steps  (45%)
[14:04:29] Writing local files
[14:04:29] Completed 115000 out of 250000 steps  (46%)
[14:13:42] Writing local files
[14:13:42] Completed 117500 out of 250000 steps  (47%)
[14:22:55] Writing local files
[14:22:55] Completed 120000 out of 250000 steps  (48%)
[14:32:08] Writing local files
[14:32:08] Completed 122500 out of 250000 steps  (49%)
[14:41:21] Writing local files
[14:41:21] Completed 125000 out of 250000 steps  (50%)
[14:50:33] Writing local files
[14:50:33] Completed 127500 out of 250000 steps  (51%)
[14:59:46] Writing local files
[14:59:46] Completed 130000 out of 250000 steps  (52%)
[15:09:00] Writing local files
[15:09:00] Completed 132500 out of 250000 steps  (53%)
[15:18:13] Writing local files
[15:18:13] Completed 135000 out of 250000 steps  (54%)
[15:27:26] Writing local files
[15:27:26] Completed 137500 out of 250000 steps  (55%)
[15:36:39] Writing local files
[15:36:39] Completed 140000 out of 250000 steps  (56%)
[15:45:53] Writing local files
[15:45:53] Completed 142500 out of 250000 steps  (57%)
[15:55:05] Writing local files
[15:55:05] Completed 145000 out of 250000 steps  (58%)
[16:04:19] Writing local files
[16:04:19] Completed 147500 out of 250000 steps  (59%)
[16:13:32] Writing local files
[16:13:32] Completed 150000 out of 250000 steps  (60%)
[16:22:45] Writing local files
[16:22:45] Completed 152500 out of 250000 steps  (61%)
[16:31:58] Writing local files
[16:31:58] Completed 155000 out of 250000 steps  (62%)
[16:41:11] Writing local files
[16:41:11] Completed 157500 out of 250000 steps  (63%)
[16:50:24] Writing local files
[16:50:24] Completed 160000 out of 250000 steps  (64%)
[16:59:37] Writing local files
[16:59:38] Completed 162500 out of 250000 steps  (65%)
[17:08:50] Writing local files
[17:08:50] Completed 165000 out of 250000 steps  (66%)
[17:18:03] Writing local files
[17:18:03] Completed 167500 out of 250000 steps  (67%)
[17:27:15] Writing local files
[17:27:15] Completed 170000 out of 250000 steps  (68%)
[17:36:28] Writing local files
[17:36:28] Completed 172500 out of 250000 steps  (69%)
[17:45:41] Writing local files
[17:45:41] Completed 175000 out of 250000 steps  (70%)
[17:54:54] Writing local files
[17:54:54] Completed 177500 out of 250000 steps  (71%)
[18:04:07] Writing local files
[18:04:07] Completed 180000 out of 250000 steps  (72%)
[18:13:20] Writing local files
[18:13:20] Completed 182500 out of 250000 steps  (73%)
[18:22:32] Writing local files
[18:22:32] Completed 185000 out of 250000 steps  (74%)
[18:31:45] Writing local files
[18:31:45] Completed 187500 out of 250000 steps  (75%)
[18:40:58] Writing local files
[18:40:58] Completed 190000 out of 250000 steps  (76%)
[18:50:11] Writing local files
[18:50:11] Completed 192500 out of 250000 steps  (77%)
[18:59:23] Writing local files
[18:59:23] Completed 195000 out of 250000 steps  (78%)
[19:00:22] - Autosending finished units... [March 5 19:00:22 UTC]
[19:00:22] Trying to send all finished work units
[19:00:22] + No unsent completed units remaining.
[19:00:22] - Autosend completed
[19:08:35] Writing local files
[19:08:36] Completed 197500 out of 250000 steps  (79%)
[19:17:48] Writing local files
[19:17:48] Completed 200000 out of 250000 steps  (80%)
[19:27:01] Writing local files
[19:27:01] Completed 202500 out of 250000 steps  (81%)
[19:36:13] Writing local files
[19:36:13] Completed 205000 out of 250000 steps  (82%)
[19:45:26] Writing local files
[19:45:26] Completed 207500 out of 250000 steps  (83%)
[19:54:39] Writing local files
[19:54:39] Completed 210000 out of 250000 steps  (84%)
[20:03:52] Writing local files
[20:03:52] Completed 212500 out of 250000 steps  (85%)
[20:13:04] Writing local files
[20:13:04] Completed 215000 out of 250000 steps  (86%)
[20:22:17] Writing local files
[20:22:17] Completed 217500 out of 250000 steps  (87%)
[20:31:30] Writing local files
[20:31:30] Completed 220000 out of 250000 steps  (88%)
[20:40:44] Writing local files
[20:40:44] Completed 222500 out of 250000 steps  (89%)
[20:49:57] Writing local files
[20:49:57] Completed 225000 out of 250000 steps  (90%)
[20:59:10] Writing local files
[20:59:10] Completed 227500 out of 250000 steps  (91%)
[21:08:23] Writing local files
[21:08:23] Completed 230000 out of 250000 steps  (92%)
[21:17:36] Writing local files
[21:17:36] Completed 232500 out of 250000 steps  (93%)
[21:26:49] Writing local files
[21:26:49] Completed 235000 out of 250000 steps  (94%)
[21:36:02] Writing local files
[21:36:02] Completed 237500 out of 250000 steps  (95%)
[21:45:15] Writing local files
[21:45:15] Completed 240000 out of 250000 steps  (96%)
[21:54:28] Writing local files
[21:54:28] Completed 242500 out of 250000 steps  (97%)
[22:03:41] Writing local files
[22:03:41] Completed 245000 out of 250000 steps  (98%)
[22:12:55] Writing local files
[22:12:55] Completed 247500 out of 250000 steps  (99%)
[22:22:08] Writing local files
[22:22:08] Completed 250000 out of 250000 steps  (100%)
[22:22:08] Writing final coordinates.
[22:22:08] Past main M.D. loop
[22:23:08] 
[22:23:08] Finished Work Unit:
[22:23:08] - Reading up to 575352 from "work/wudata_01.arc": Read 575352
[22:23:08] - Reading up to 148652 from "work/wudata_01.xtc": Read 148652
[22:23:08] goefile size: 0
[22:23:08] logfile size: 53801
[22:23:08] Leaving Run
[22:23:09] - Writing 845801 bytes of core data to disk...
[22:23:09] Done: 845289 -> 734424 (compressed to 86.8 percent)
[22:23:09]   ... Done.
[22:23:09] - Shutting down core
[22:23:09] 
[22:23:09] Folding@home Core Shutdown: FINISHED_UNIT
[22:23:13] CoreStatus = 64 (100)
[22:23:13] Unit 1 finished with 98 percent of time to deadline remaining.
[22:23:13] Updated performance fraction: 0.979328
[22:23:13] Sending work to server
[22:23:13] Project: 6526 (Run 1, Clone 73, Gen 56)


[22:23:13] + Attempting to send results [March 5 22:23:13 UTC]
[22:23:13] - Reading file work/wuresults_01.dat from core
[22:23:13]   (Read 734936 bytes from disk)
[22:23:13] Connecting to http://171.64.65.62:8080/
[22:23:16] Posted data.
[22:23:17] Initial: 0000; - Uploaded at ~179 kB/s
[22:23:17] - Averaged speed for that direction ~179 kB/s
[22:23:17] + Results successfully sent
[22:23:17] Thank you for your contribution to Folding@Home.
[22:23:17] + Starting local stats count at 1
[22:23:21] Trying to send all finished work units
[22:23:21] + No unsent completed units remaining.
[22:23:21] - Preparing to get new work unit...
[22:23:21] Cleaning up work directory
[22:23:21] + Attempting to get work packet
[22:23:21] Passkey found
[22:23:21] - Will indicate memory of 4095 MB
[22:23:21] - Connecting to assignment server
[22:23:21] Connecting to http://assign.stanford.edu:8080/
[22:23:21] Posted data.
[22:23:21] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[22:23:21] + News From Folding@Home: Welcome to Folding@Home
[22:23:22] Loaded queue successfully.
[22:23:22] Sent data
[22:23:22] Connecting to http://171.64.65.62:8080/
[22:23:22] Posted data.
[22:23:22] Initial: 0000; - Receiving payload (expected size: 419230)
[22:23:23] - Downloaded at ~409 kB/s
[22:23:23] - Averaged speed for that direction ~538 kB/s
[22:23:23] + Received work.
[22:23:23] Trying to send all finished work units
[22:23:23] + No unsent completed units remaining.
[22:23:23] + Closed connections
[22:23:23] 
[22:23:23] + Processing work unit
[22:23:23] Work type 78 not eligible for variable processors
[22:23:23] Core required: FahCore_78.exe
[22:23:23] Core found.
[22:23:23] Working on queue slot 02 [March 5 22:23:23 UTC]
[22:23:23] + Working ...
[22:23:23] - Calling '.\FahCore_78.exe -dir work/ -suffix 02 -nice 19 -checkpoint 15 -verbose -lifeline 2236 -version 634'

[22:23:23] 
[22:23:23] *------------------------------*
[22:23:23] Folding@Home Gromacs Core
[22:23:23] Version 1.90 (March 8, 2006)
[22:23:23] 
[22:23:23] Preparing to commence simulation
[22:23:23] - Looking at optimizations...
[22:23:23] - Created dyn
[22:23:23] - Files status OK
[22:23:24] - Expanded 418718 -> 2022017 (decompressed 482.9 percent)
[22:23:24] - Starting from initial work packet
[22:23:24] 
[22:23:24] Project: 6512 (Run 8, Clone 264, Gen 30)
[22:23:24] 
[22:23:24] Assembly optimizations on if available.
[22:23:24] Entering M.D.
[22:23:30] Protein: TR462_A_9 in water
[22:23:30] 
[22:23:30] Writing local files
[22:23:30] Extra SSE boost OK.
[22:23:30] Writing local files
[22:23:30] Completed 0 out of 250000 steps  (0%)
[22:28:34] Writing local files
[22:28:34] Completed 2500 out of 250000 steps  (1%)
[22:33:39] Writing local files
[22:33:39] Completed 5000 out of 250000 steps  (2%)
[22:38:43] Writing local files
[22:38:43] Completed 7500 out of 250000 steps  (3%)
[22:43:47] Writing local files
[22:43:47] Completed 10000 out of 250000 steps  (4%)
[22:48:51] Writing local files
[22:48:51] Completed 12500 out of 250000 steps  (5%)
[22:53:54] Writing local files
[22:53:55] Completed 15000 out of 250000 steps  (6%)
[22:58:58] Writing local files
[22:58:58] Completed 17500 out of 250000 steps  (7%)
[23:04:02] Writing local files
[23:04:02] Completed 20000 out of 250000 steps  (8%)
[23:09:06] Writing local files
[23:09:06] Completed 22500 out of 250000 steps  (9%)
[23:14:10] Writing local files
[23:14:10] Completed 25000 out of 250000 steps  (10%)
[23:15:22] ***** Got a SIGTERM signal (2)
[23:15:22] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [March 5 23:15:45 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe
Arguments: -verbosity 9 -smp -advmethods 

[23:15:45] - Ask before connecting: No
[23:15:45] - User name: Amaruk (Team 50625)
[23:15:45] - User ID: 44FC6BDB66AFE781
[23:15:45] - Machine ID: 1
[23:15:45] 
[23:15:45] Loaded queue successfully.
[23:15:45] 
[23:15:45] + Processing work unit
[23:15:45] - Autosending finished units... [March 5 23:15:45 UTC]
[23:15:45] Work type 78 not eligible for variable processors
[23:15:45] Trying to send all finished work units
[23:15:45] Core required: FahCore_78.exe
[23:15:45] + No unsent completed units remaining.
[23:15:45] Core found.
[23:15:45] - Autosend completed
[23:15:45] Working on queue slot 02 [March 5 23:15:45 UTC]
[23:15:45] + Working ...
[23:15:45] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_78.exe -dir work/ -suffix 02 -checkpoint 15 -verbose -lifeline 2552 -version 634'

[23:15:45] 
[23:15:45] *------------------------------*
[23:15:45] Folding@Home Gromacs Core
[23:15:45] Version 1.90 (March 8, 2006)
[23:15:45] 
[23:15:45] Preparing to commence simulation
[23:15:45] - Ensuring status. Please wait.
[23:15:46] 
[23:15:46] Project: 6512 (Run 8, Clone 264, Gen 30)
[23:15:46] 
[23:15:46] Assembly optimizations on if available.
[23:15:46] Entering M.D.
[23:16:02] K
[23:16:03] - Expanded 418718 -> 2022017 (decompressed 482.9 percent)
[23:16:03] 
[23:16:03] Project: 65Entering M.D.
[23:16:03] ne 264, Gen 30)
[23:16:03] 
[23:16:03] Entering M.D.
[23:16:06] )
[23:16:06] Extra SSE boost OK.
[23:16:23] intWriting local files
[23:16:23] Size of work/wudata_02.bed not Size of work/wudata_02.bed not what saved.
[23:16:23] 
[23:16:23] Folding@home Core Shutdown: FILE_IO_ERROR
[23:18:47] Killing all core threads
[23:18:47] Killing 4 cores
[23:18:47] Killing core 0
[23:18:47] Killing core 1
[23:18:47] Killing core 2
[23:18:47] Killing core 3

Folding@Home Client Shutdown at user request.
[23:18:47] ***** Got a SIGTERM signal (2)
[23:18:47] Killing all core threads
[23:18:47] Killing 4 cores
[23:18:47] Killing core 0
[23:18:47] Killing core 1
[23:18:47] Killing core 2
[23:18:47] Killing core 3

Folding@Home Client Shutdown.


--- Opening Log file [March 7 09:36:06 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe
Arguments: -configonly -verbosity 9 -smp -advmethods 

[09:36:06] - Ask before connecting: No
[09:36:06] - User name: Amaruk (Team 50625)
[09:36:06] - User ID: 44FC6BDB66AFE781
[09:36:06] - Machine ID: 1
[09:36:06] 
[09:36:06] Configuring Folding@Home...


[09:36:46] - Ask before connecting: No
[09:36:46] - User name: Amaruk (Team 50625)
[09:36:46] - User ID: 44FC6BDB66AFE781
[09:36:46] - Machine ID: 1
[09:36:46] 
[09:36:46] -configonly flag given, so exiting.


--- Opening Log file [March 7 09:36:53 UTC] 


# Windows CPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe
Arguments: -oneunit -verbosity 9 -advmethods 

[09:36:53] - Ask before connecting: No
[09:36:53] - User name: Amaruk (Team 50625)
[09:36:53] - User ID: 44FC6BDB66AFE781
[09:36:53] - Machine ID: 1
[09:36:53] 
[09:36:53] Loaded queue successfully.
[09:36:53] 
[09:36:53] + Processing work unit
[09:36:53] Core required: FahCore_78.exe
[09:36:53] - Autosending finished units... [March 7 09:36:53 UTC]
[09:36:53] Trying to send all finished work units
[09:36:53] Core found.
[09:36:53] + No unsent completed units remaining.
[09:36:53] - Autosend completed
[09:36:53] Working on queue slot 02 [March 7 09:36:53 UTC]
[09:36:53] + Working ...
[09:36:53] - Calling '.\FahCore_78.exe -dir work/ -suffix 02 -nice 19 -checkpoint 15 -verbose -lifeline 3148 -version 634'

[09:36:53] 
[09:36:53] *------------------------------*
[09:36:53] Folding@Home Gromacs Core
[09:36:53] Version 1.90 (March 8, 2006)
[09:36:53] 
[09:36:53] Preparing to commence simulation
[09:36:53] - Looking at optimizations...
[09:36:53] - Files status OK
[09:36:54] - Expanded 418718 -> 2022017 (decompressed 482.9 percent)
[09:36:54] 
[09:36:54] Project: 6512 (Run 8, Clone 264, Gen 30)
[09:36:54] 
[09:36:54] Assembly optimizations on if available.
[09:36:54] Entering M.D.
[09:37:14] (Starting from checkpoint)
[09:37:14] Protein: TR462_A_9 in water
[09:37:14] 
[09:37:14] Writing local files
[09:37:14] Completed 25000 out of 250000 steps  (10%)
[09:37:14] Extra SSE boost OK.
[09:42:22] Writing local files
[09:42:22] Completed 27500 out of 250000 steps  (11%)
[09:47:27] Writing local files
[09:47:27] Completed 30000 out of 250000 steps  (12%)
[09:52:31] Writing local files
[09:52:31] Completed 32500 out of 250000 steps  (13%)
[09:57:35] Writing local files
[09:57:35] Completed 35000 out of 250000 steps  (14%)
[10:02:40] Writing local files
[10:02:40] Completed 37500 out of 250000 steps  (15%)
[10:07:44] Writing local files
[10:07:44] Completed 40000 out of 250000 steps  (16%)
[10:12:48] Writing local files
[10:12:48] Completed 42500 out of 250000 steps  (17%)
[10:17:53] Writing local files
[10:17:53] Completed 45000 out of 250000 steps  (18%)
[10:22:57] Writing local files
[10:22:57] Completed 47500 out of 250000 steps  (19%)
[10:28:02] Writing local files
[10:28:02] Completed 50000 out of 250000 steps  (20%)
[10:33:06] Writing local files
[10:33:06] Completed 52500 out of 250000 steps  (21%)
[10:38:10] Writing local files
[10:38:10] Completed 55000 out of 250000 steps  (22%)
[10:43:15] Writing local files
[10:43:15] Completed 57500 out of 250000 steps  (23%)
[10:48:20] Writing local files
[10:48:20] Completed 60000 out of 250000 steps  (24%)
[10:53:24] Writing local files
[10:53:24] Completed 62500 out of 250000 steps  (25%)
[10:58:28] Writing local files
[10:58:28] Completed 65000 out of 250000 steps  (26%)
[11:03:32] Writing local files
[11:03:32] Completed 67500 out of 250000 steps  (27%)
[11:08:37] Writing local files
[11:08:37] Completed 70000 out of 250000 steps  (28%)
[11:13:41] Writing local files
[11:13:41] Completed 72500 out of 250000 steps  (29%)
[11:18:45] Writing local files
[11:18:45] Completed 75000 out of 250000 steps  (30%)
[11:23:49] Writing local files
[11:23:50] Completed 77500 out of 250000 steps  (31%)
[11:28:54] Writing local files
[11:28:54] Completed 80000 out of 250000 steps  (32%)
[11:33:57] Writing local files
[11:33:57] Completed 82500 out of 250000 steps  (33%)
[11:39:01] Writing local files
[11:39:01] Completed 85000 out of 250000 steps  (34%)
[11:44:06] Writing local files
[11:44:06] Completed 87500 out of 250000 steps  (35%)
[11:49:10] Writing local files
[11:49:10] Completed 90000 out of 250000 steps  (36%)
[11:54:14] Writing local files
[11:54:14] Completed 92500 out of 250000 steps  (37%)
[11:59:18] Writing local files
[11:59:18] Completed 95000 out of 250000 steps  (38%)
[12:04:22] Writing local files
[12:04:22] Completed 97500 out of 250000 steps  (39%)
[12:09:26] Writing local files
[12:09:26] Completed 100000 out of 250000 steps  (40%)
[12:14:30] Writing local files
[12:14:30] Completed 102500 out of 250000 steps  (41%)
[12:19:35] Writing local files
[12:19:35] Completed 105000 out of 250000 steps  (42%)
[12:24:39] Writing local files
[12:24:39] Completed 107500 out of 250000 steps  (43%)
[12:29:43] Writing local files
[12:29:43] Completed 110000 out of 250000 steps  (44%)
[12:34:47] Writing local files
[12:34:47] Completed 112500 out of 250000 steps  (45%)
[12:39:51] Writing local files
[12:39:51] Completed 115000 out of 250000 steps  (46%)
[12:44:55] Writing local files
[12:44:55] Completed 117500 out of 250000 steps  (47%)
[12:49:59] Writing local files
[12:49:59] Completed 120000 out of 250000 steps  (48%)
[12:55:03] Writing local files
[12:55:03] Completed 122500 out of 250000 steps  (49%)
[13:00:07] Writing local files
[13:00:07] Completed 125000 out of 250000 steps  (50%)
[13:05:11] Writing local files
[13:05:11] Completed 127500 out of 250000 steps  (51%)
[13:10:15] Writing local files
[13:10:15] Completed 130000 out of 250000 steps  (52%)
[13:15:19] Writing local files
[13:15:19] Completed 132500 out of 250000 steps  (53%)
[13:20:23] Writing local files
[13:20:23] Completed 135000 out of 250000 steps  (54%)
[13:25:26] Writing local files
[13:25:26] Completed 137500 out of 250000 steps  (55%)
[13:30:30] Writing local files
[13:30:30] Completed 140000 out of 250000 steps  (56%)
[13:35:34] Writing local files
[13:35:34] Completed 142500 out of 250000 steps  (57%)
[13:40:38] Writing local files
[13:40:38] Completed 145000 out of 250000 steps  (58%)
[13:45:41] Writing local files
[13:45:42] Completed 147500 out of 250000 steps  (59%)
[13:50:45] Writing local files
[13:50:45] Completed 150000 out of 250000 steps  (60%)
[13:55:49] Writing local files
[13:55:49] Completed 152500 out of 250000 steps  (61%)
[14:00:53] Writing local files
[14:00:53] Completed 155000 out of 250000 steps  (62%)
[14:05:56] Writing local files
[14:05:56] Completed 157500 out of 250000 steps  (63%)
[14:11:01] Writing local files
[14:11:01] Completed 160000 out of 250000 steps  (64%)
[14:16:05] Writing local files
[14:16:05] Completed 162500 out of 250000 steps  (65%)
[14:21:09] Writing local files
[14:21:09] Completed 165000 out of 250000 steps  (66%)
[14:26:12] Writing local files
[14:26:12] Completed 167500 out of 250000 steps  (67%)
[14:31:16] Writing local files
[14:31:16] Completed 170000 out of 250000 steps  (68%)
[14:36:20] Writing local files
[14:36:20] Completed 172500 out of 250000 steps  (69%)
[14:41:24] Writing local files
[14:41:24] Completed 175000 out of 250000 steps  (70%)
[14:46:27] Writing local files
[14:46:27] Completed 177500 out of 250000 steps  (71%)
[14:51:31] Writing local files
[14:51:31] Completed 180000 out of 250000 steps  (72%)
[14:56:35] Writing local files
[14:56:35] Completed 182500 out of 250000 steps  (73%)
[15:01:39] Writing local files
[15:01:39] Completed 185000 out of 250000 steps  (74%)
[15:06:42] Writing local files
[15:06:42] Completed 187500 out of 250000 steps  (75%)
[15:11:46] Writing local files
[15:11:46] Completed 190000 out of 250000 steps  (76%)
[15:16:49] Writing local files
[15:16:49] Completed 192500 out of 250000 steps  (77%)
[15:21:53] Writing local files
[15:21:53] Completed 195000 out of 250000 steps  (78%)
[15:26:57] Writing local files
[15:26:57] Completed 197500 out of 250000 steps  (79%)
[15:32:01] Writing local files
[15:32:01] Completed 200000 out of 250000 steps  (80%)
[15:36:53] - Autosending finished units... [March 7 15:36:53 UTC]
[15:36:53] Trying to send all finished work units
[15:36:53] + No unsent completed units remaining.
[15:36:53] - Autosend completed
[15:37:04] Writing local files
[15:37:04] Completed 202500 out of 250000 steps  (81%)
[15:42:07] Writing local files
[15:42:07] Completed 205000 out of 250000 steps  (82%)
[15:47:11] Writing local files
[15:47:11] Completed 207500 out of 250000 steps  (83%)
[15:52:14] Writing local files
[15:52:14] Completed 210000 out of 250000 steps  (84%)
[15:57:18] Writing local files
[15:57:18] Completed 212500 out of 250000 steps  (85%)
[16:02:21] Writing local files
[16:02:21] Completed 215000 out of 250000 steps  (86%)
[16:07:24] Writing local files
[16:07:24] Completed 217500 out of 250000 steps  (87%)
[16:12:27] Writing local files
[16:12:27] Completed 220000 out of 250000 steps  (88%)
[16:17:30] Writing local files
[16:17:30] Completed 222500 out of 250000 steps  (89%)
[16:22:33] Writing local files
[16:22:33] Completed 225000 out of 250000 steps  (90%)
[16:27:37] Writing local files
[16:27:37] Completed 227500 out of 250000 steps  (91%)
[16:32:40] Writing local files
[16:32:40] Completed 230000 out of 250000 steps  (92%)
[16:37:43] Writing local files
[16:37:43] Completed 232500 out of 250000 steps  (93%)
[16:42:46] Writing local files
[16:42:46] Completed 235000 out of 250000 steps  (94%)
[16:47:49] Writing local files
[16:47:49] Completed 237500 out of 250000 steps  (95%)
[16:52:52] Writing local files
[16:52:52] Completed 240000 out of 250000 steps  (96%)
[16:57:55] Writing local files
[16:57:55] Completed 242500 out of 250000 steps  (97%)
[17:02:58] Writing local files
[17:02:58] Completed 245000 out of 250000 steps  (98%)
[17:08:02] Writing local files
[17:08:02] Completed 247500 out of 250000 steps  (99%)
[17:13:05] Writing local files
[17:13:05] Completed 250000 out of 250000 steps  (100%)
[17:13:05] Writing final coordinates.
[17:13:05] Past main M.D. loop
[17:14:05] 
[17:14:05] Finished Work Unit:
[17:14:05] - Reading up to 315144 from "work/wudata_02.arc": Read 315144
[17:14:05] - Reading up to 243520 from "work/wudata_02.xtc": Read 243520
[17:14:05] goefile size: 0
[17:14:05] logfile size: 123513
[17:14:05] Leaving Run
[17:14:08] - Writing 753621 bytes of core data to disk...
[17:14:08] Done: 753109 -> 590882 (compressed to 78.4 percent)
[17:14:08]   ... Done.
[17:14:08] - Shutting down core
[17:14:08] 
[17:14:08] Folding@home Core Shutdown: FINISHED_UNIT
[17:14:11] CoreStatus = 64 (100)
[17:14:11] Unit 2 finished with 89 percent of time to deadline remaining.
[17:14:11] Updated performance fraction: 0.933874
[17:14:11] Sending work to server
[17:14:11] Project: 6512 (Run 8, Clone 264, Gen 30)
[17:14:11] - Read packet limit of 540015616... Set to 524286976.


[17:14:11] + Attempting to send results [March 7 17:14:11 UTC]
[17:14:11] - Reading file work/wuresults_02.dat from core
[17:14:11]   (Read 591394 bytes from disk)
[17:14:11] Connecting to http://171.64.65.62:8080/
[17:14:14] Posted data.
[17:14:14] Initial: 0000; - Uploaded at ~144 kB/s
[17:14:15] - Averaged speed for that direction ~162 kB/s
[17:14:15] + Results successfully sent
[17:14:15] Thank you for your contribution to Folding@Home.
[17:14:15] + Number of Units Completed: 2

[17:14:19] Trying to send all finished work units
[17:14:19] + No unsent completed units remaining.
[17:14:19] + -oneunit flag given and have now finished a unit. Exiting.***** Got a SIGTERM signal (2)
[17:14:19] Killing all core threads

Folding@Home Client Shutdown.

The only difference was the -smp flag, and successful completion rules out checkpoint errors/file corruption.

[Amaruk]

It even shows a call to mpiexec.

HendricksSA, that turned out to be an awsome catch!

I set up the SMP client on this machine back when MPICH2 was required and never disabled the service.

Until now.

Reloaded the files for that second classic WU one more time.

Code: Select all

--- Opening Log file [March 5 06:57:50 UTC] 


# Windows CPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe


[06:57:50] Configuring Folding@Home...


[07:00:22] - Ask before connecting: No
[07:00:22] - User name: Amaruk (Team 50625)
[07:00:22] - User ID: 44FC6BDB66AFE781
[07:00:22] - Machine ID: 1
[07:00:22] 
[07:00:22] Work directory not found. Creating...
[07:00:22] Could not open work queue, generating new queue...
[07:00:22] - Preparing to get new work unit...
[07:00:22] Cleaning up work directory
[07:00:22] + Attempting to get work packet
[07:00:22] Passkey found
[07:00:22] - Autosending finished units... [March 5 07:00:22 UTC]
[07:00:22] - Will indicate memory of 4095 MB
[07:00:22] Trying to send all finished work units
[07:00:22] - Detect CPU.[07:00:22] + No unsent completed units remaining.
 Vendor: AuthenticAMD, Family: 15, Model: 2, Stepping: 3
[07:00:22] - Autosend completed
[07:00:22] - Connecting to assignment server
[07:00:22] Connecting to http://assign.stanford.edu:8080/
[07:00:22] Posted data.
[07:00:22] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[07:00:22] + News From Folding@Home: Welcome to Folding@Home
[07:00:22] Loaded queue successfully.
[07:00:22] Sent data
[07:00:22] Connecting to http://171.64.65.62:8080/
[07:00:23] Posted data.
[07:00:23] Initial: 0000; - Receiving payload (expected size: 684573)
[07:00:24] - Downloaded at ~668 kB/s
[07:00:24] - Averaged speed for that direction ~668 kB/s
[07:00:24] + Received work.
[07:00:24] + Closed connections
[07:00:24] 
[07:00:24] + Processing work unit
[07:00:24] Work type 78 not eligible for variable processors
[07:00:24] Core required: FahCore_78.exe
[07:00:24] Core not found.
[07:00:24] - Core is not present or corrupted.
[07:00:24] - Attempting to download new core...
[07:00:24] + Downloading new core: FahCore_78.exe
[07:00:24] Downloading core (/~pande/Win32/x86/Core_78.fah from www.stanford.edu)
[07:00:24] Initial: AFDE; + 10240 bytes downloaded
[07:00:24] Initial: 2993; + 20480 bytes downloaded
[07:00:24] Initial: 4590; + 30720 bytes downloaded
[07:00:24] Initial: 1F95; + 40960 bytes downloaded
[07:00:24] Initial: 6459; + 51200 bytes downloaded
[07:00:24] Initial: FD92; + 61440 bytes downloaded
[07:00:24] Initial: 62E6; + 71680 bytes downloaded
[07:00:24] Initial: 1F03; + 81920 bytes downloaded
[07:00:24] Initial: 1707; + 92160 bytes downloaded
[07:00:24] Initial: 8862; + 102400 bytes downloaded
[07:00:24] Initial: B1CE; + 112640 bytes downloaded
[07:00:24] Initial: D9DE; + 122880 bytes downloaded
[07:00:24] Initial: 5C0A; + 133120 bytes downloaded
[07:00:24] Initial: 3FF3; + 143360 bytes downloaded
[07:00:24] Initial: 4529; + 153600 bytes downloaded
[07:00:24] Initial: 635C; + 163840 bytes downloaded
[07:00:24] Initial: 869F; + 174080 bytes downloaded
[07:00:24] Initial: C8A8; + 184320 bytes downloaded
[07:00:24] Initial: 1A54; + 194560 bytes downloaded
[07:00:24] Initial: BDCB; + 204800 bytes downloaded
[07:00:24] Initial: CC8C; + 215040 bytes downloaded
[07:00:24] Initial: 12EB; + 225280 bytes downloaded
[07:00:24] Initial: 4886; + 235520 bytes downloaded
[07:00:24] Initial: 29D0; + 245760 bytes downloaded
[07:00:24] Initial: AF1F; + 256000 bytes downloaded
[07:00:24] Initial: 05BE; + 266240 bytes downloaded
[07:00:24] Initial: D366; + 276480 bytes downloaded
[07:00:24] Initial: A52F; + 286720 bytes downloaded
[07:00:24] Initial: 1E70; + 296960 bytes downloaded
[07:00:24] Initial: 7229; + 307200 bytes downloaded
[07:00:24] Initial: A7F6; + 317440 bytes downloaded
[07:00:24] Initial: 44C2; + 327680 bytes downloaded
[07:00:24] Initial: A72B; + 337920 bytes downloaded
[07:00:24] Initial: 9C10; + 348160 bytes downloaded
[07:00:24] Initial: 891C; + 358400 bytes downloaded
[07:00:24] Initial: F143; + 368640 bytes downloaded
[07:00:24] Initial: 795C; + 378880 bytes downloaded
[07:00:24] Initial: 8C2B; + 389120 bytes downloaded
[07:00:24] Initial: FC93; + 399360 bytes downloaded
[07:00:24] Initial: F24B; + 409600 bytes downloaded
[07:00:24] Initial: 9D83; + 419840 bytes downloaded
[07:00:24] Initial: 0F67; + 430080 bytes downloaded
[07:00:24] Initial: FB4A; + 440320 bytes downloaded
[07:00:24] Initial: F331; + 450560 bytes downloaded
[07:00:24] Initial: 5BF6; + 460800 bytes downloaded
[07:00:24] Initial: 240B; + 471040 bytes downloaded
[07:00:24] Initial: 47D4; + 481280 bytes downloaded
[07:00:24] Initial: 3AB2; + 491520 bytes downloaded
[07:00:24] Initial: 0F84; + 501760 bytes downloaded
[07:00:24] Initial: CA7A; + 512000 bytes downloaded
[07:00:24] Initial: 3B69; + 522240 bytes downloaded
[07:00:24] Initial: F0AA; + 532480 bytes downloaded
[07:00:24] Initial: 1B36; + 542720 bytes downloaded
[07:00:24] Initial: BCE4; + 552960 bytes downloaded
[07:00:24] Initial: 9BEA; + 563200 bytes downloaded
[07:00:24] Initial: E168; + 573440 bytes downloaded
[07:00:24] Initial: C3A1; + 583680 bytes downloaded
[07:00:24] Initial: 5920; + 593920 bytes downloaded
[07:00:24] Initial: 1D0F; + 604160 bytes downloaded
[07:00:24] Initial: E779; + 614400 bytes downloaded
[07:00:24] Initial: E6CE; + 624640 bytes downloaded
[07:00:24] Initial: 9E24; + 634880 bytes downloaded
[07:00:24] Initial: EB69; + 645120 bytes downloaded
[07:00:24] Initial: 38FC; + 655360 bytes downloaded
[07:00:24] Initial: 6F35; + 665600 bytes downloaded
[07:00:24] Initial: 8C15; + 675840 bytes downloaded
[07:00:24] Initial: 21FE; + 686080 bytes downloaded
[07:00:24] Initial: B05C; + 696320 bytes downloaded
[07:00:24] Initial: 1BD5; + 706560 bytes downloaded
[07:00:24] Initial: FD2D; + 716800 bytes downloaded
[07:00:24] Initial: 2210; + 727040 bytes downloaded
[07:00:24] Initial: BC67; + 737280 bytes downloaded
[07:00:24] Initial: C396; + 747520 bytes downloaded
[07:00:24] Initial: A39D; + 757760 bytes downloaded
[07:00:25] Initial: D988; + 768000 bytes downloaded
[07:00:25] Initial: 7358; + 778240 bytes downloaded
[07:00:25] Initial: 3F63; + 788480 bytes downloaded
[07:00:25] Initial: 7C28; + 798720 bytes downloaded
[07:00:25] Initial: A4B3; + 808960 bytes downloaded
[07:00:25] Initial: 9978; + 819200 bytes downloaded
[07:00:25] Initial: C1AC; + 825633 bytes downloaded
[07:00:25] Verifying core Core_78.fah...
[07:00:25] Signature is VALID
[07:00:25] 
[07:00:25] Trying to unzip core FahCore_78.exe
[07:00:25] Decompressed FahCore_78.exe (2338816 bytes) successfully
[07:00:30] + Core successfully engaged
[07:00:35] 
[07:00:35] + Processing work unit
[07:00:35] Work type 78 not eligible for variable processors
[07:00:35] Core required: FahCore_78.exe
[07:00:35] Core found.
[07:00:35] Working on queue slot 01 [March 5 07:00:35 UTC]
[07:00:35] + Working ...
[07:00:35] - Calling '.\FahCore_78.exe -dir work/ -suffix 01 -nice 19 -checkpoint 15 -verbose -lifeline 2236 -version 634'

[07:00:35] 
[07:00:35] *------------------------------*
[07:00:35] Folding@Home Gromacs Core
[07:00:35] Version 1.90 (March 8, 2006)
[07:00:35] 
[07:00:35] Preparing to commence simulation
[07:00:35] - Looking at optimizations...
[07:00:35] - Created dyn
[07:00:35] - Files status OK
[07:00:35] - Expanded 684061 -> 3407849 (decompressed 498.1 percent)
[07:00:35] - Starting from initial work packet
[07:00:35] 
[07:00:35] Project: 6526 (Run 1, Clone 73, Gen 56)
[07:00:35] 
[07:00:35] Assembly optimizations on if available.
[07:00:35] Entering M.D.
[07:00:42] Protein: proA_2 in water
[07:00:42] 
[07:00:42] Writing local files
[07:00:42] Extra SSE boost OK.
[07:00:42] Writing local files
[07:00:42] Completed 0 out of 250000 steps  (0%)
[07:09:55] Writing local files
[07:09:55] Completed 2500 out of 250000 steps  (1%)
[07:19:07] Writing local files
[07:19:07] Completed 5000 out of 250000 steps  (2%)
[07:28:19] Writing local files
[07:28:19] Completed 7500 out of 250000 steps  (3%)
[07:37:32] Writing local files
[07:37:32] Completed 10000 out of 250000 steps  (4%)
[07:46:44] Writing local files
[07:46:44] Completed 12500 out of 250000 steps  (5%)
[07:55:56] Writing local files
[07:55:56] Completed 15000 out of 250000 steps  (6%)
[08:05:09] Writing local files
[08:05:09] Completed 17500 out of 250000 steps  (7%)
[08:14:21] Writing local files
[08:14:21] Completed 20000 out of 250000 steps  (8%)
[08:23:33] Writing local files
[08:23:33] Completed 22500 out of 250000 steps  (9%)
[08:32:46] Writing local files
[08:32:46] Completed 25000 out of 250000 steps  (10%)
[08:41:59] Writing local files
[08:41:59] Completed 27500 out of 250000 steps  (11%)
[08:51:11] Writing local files
[08:51:11] Completed 30000 out of 250000 steps  (12%)
[09:00:24] Writing local files
[09:00:24] Completed 32500 out of 250000 steps  (13%)
[09:09:37] Writing local files
[09:09:37] Completed 35000 out of 250000 steps  (14%)
[09:18:50] Writing local files
[09:18:50] Completed 37500 out of 250000 steps  (15%)
[09:28:02] Writing local files
[09:28:02] Completed 40000 out of 250000 steps  (16%)
[09:37:16] Writing local files
[09:37:16] Completed 42500 out of 250000 steps  (17%)
[09:46:28] Writing local files
[09:46:28] Completed 45000 out of 250000 steps  (18%)
[09:55:41] Writing local files
[09:55:41] Completed 47500 out of 250000 steps  (19%)
[10:04:54] Writing local files
[10:04:54] Completed 50000 out of 250000 steps  (20%)
[10:14:07] Writing local files
[10:14:07] Completed 52500 out of 250000 steps  (21%)
[10:23:20] Writing local files
[10:23:20] Completed 55000 out of 250000 steps  (22%)
[10:32:33] Writing local files
[10:32:33] Completed 57500 out of 250000 steps  (23%)
[10:41:45] Writing local files
[10:41:45] Completed 60000 out of 250000 steps  (24%)
[10:50:58] Writing local files
[10:50:58] Completed 62500 out of 250000 steps  (25%)
[11:00:11] Writing local files
[11:00:11] Completed 65000 out of 250000 steps  (26%)
[11:09:24] Writing local files
[11:09:24] Completed 67500 out of 250000 steps  (27%)
[11:18:37] Writing local files
[11:18:37] Completed 70000 out of 250000 steps  (28%)
[11:27:50] Writing local files
[11:27:50] Completed 72500 out of 250000 steps  (29%)
[11:37:03] Writing local files
[11:37:03] Completed 75000 out of 250000 steps  (30%)
[11:46:16] Writing local files
[11:46:16] Completed 77500 out of 250000 steps  (31%)
[11:55:29] Writing local files
[11:55:29] Completed 80000 out of 250000 steps  (32%)
[12:04:41] Writing local files
[12:04:41] Completed 82500 out of 250000 steps  (33%)
[12:13:54] Writing local files
[12:13:54] Completed 85000 out of 250000 steps  (34%)
[12:23:07] Writing local files
[12:23:07] Completed 87500 out of 250000 steps  (35%)
[12:32:20] Writing local files
[12:32:20] Completed 90000 out of 250000 steps  (36%)
[12:41:33] Writing local files
[12:41:33] Completed 92500 out of 250000 steps  (37%)
[12:50:46] Writing local files
[12:50:46] Completed 95000 out of 250000 steps  (38%)
[12:59:59] Writing local files
[12:59:59] Completed 97500 out of 250000 steps  (39%)
[13:00:22] - Autosending finished units... [March 5 13:00:22 UTC]
[13:00:22] Trying to send all finished work units
[13:00:22] + No unsent completed units remaining.
[13:00:22] - Autosend completed
[13:09:11] Writing local files
[13:09:11] Completed 100000 out of 250000 steps  (40%)
[13:18:25] Writing local files
[13:18:25] Completed 102500 out of 250000 steps  (41%)
[13:27:38] Writing local files
[13:27:38] Completed 105000 out of 250000 steps  (42%)
[13:36:51] Writing local files
[13:36:51] Completed 107500 out of 250000 steps  (43%)
[13:46:04] Writing local files
[13:46:04] Completed 110000 out of 250000 steps  (44%)
[13:55:16] Writing local files
[13:55:16] Completed 112500 out of 250000 steps  (45%)
[14:04:29] Writing local files
[14:04:29] Completed 115000 out of 250000 steps  (46%)
[14:13:42] Writing local files
[14:13:42] Completed 117500 out of 250000 steps  (47%)
[14:22:55] Writing local files
[14:22:55] Completed 120000 out of 250000 steps  (48%)
[14:32:08] Writing local files
[14:32:08] Completed 122500 out of 250000 steps  (49%)
[14:41:21] Writing local files
[14:41:21] Completed 125000 out of 250000 steps  (50%)
[14:50:33] Writing local files
[14:50:33] Completed 127500 out of 250000 steps  (51%)
[14:59:46] Writing local files
[14:59:46] Completed 130000 out of 250000 steps  (52%)
[15:09:00] Writing local files
[15:09:00] Completed 132500 out of 250000 steps  (53%)
[15:18:13] Writing local files
[15:18:13] Completed 135000 out of 250000 steps  (54%)
[15:27:26] Writing local files
[15:27:26] Completed 137500 out of 250000 steps  (55%)
[15:36:39] Writing local files
[15:36:39] Completed 140000 out of 250000 steps  (56%)
[15:45:53] Writing local files
[15:45:53] Completed 142500 out of 250000 steps  (57%)
[15:55:05] Writing local files
[15:55:05] Completed 145000 out of 250000 steps  (58%)
[16:04:19] Writing local files
[16:04:19] Completed 147500 out of 250000 steps  (59%)
[16:13:32] Writing local files
[16:13:32] Completed 150000 out of 250000 steps  (60%)
[16:22:45] Writing local files
[16:22:45] Completed 152500 out of 250000 steps  (61%)
[16:31:58] Writing local files
[16:31:58] Completed 155000 out of 250000 steps  (62%)
[16:41:11] Writing local files
[16:41:11] Completed 157500 out of 250000 steps  (63%)
[16:50:24] Writing local files
[16:50:24] Completed 160000 out of 250000 steps  (64%)
[16:59:37] Writing local files
[16:59:38] Completed 162500 out of 250000 steps  (65%)
[17:08:50] Writing local files
[17:08:50] Completed 165000 out of 250000 steps  (66%)
[17:18:03] Writing local files
[17:18:03] Completed 167500 out of 250000 steps  (67%)
[17:27:15] Writing local files
[17:27:15] Completed 170000 out of 250000 steps  (68%)
[17:36:28] Writing local files
[17:36:28] Completed 172500 out of 250000 steps  (69%)
[17:45:41] Writing local files
[17:45:41] Completed 175000 out of 250000 steps  (70%)
[17:54:54] Writing local files
[17:54:54] Completed 177500 out of 250000 steps  (71%)
[18:04:07] Writing local files
[18:04:07] Completed 180000 out of 250000 steps  (72%)
[18:13:20] Writing local files
[18:13:20] Completed 182500 out of 250000 steps  (73%)
[18:22:32] Writing local files
[18:22:32] Completed 185000 out of 250000 steps  (74%)
[18:31:45] Writing local files
[18:31:45] Completed 187500 out of 250000 steps  (75%)
[18:40:58] Writing local files
[18:40:58] Completed 190000 out of 250000 steps  (76%)
[18:50:11] Writing local files
[18:50:11] Completed 192500 out of 250000 steps  (77%)
[18:59:23] Writing local files
[18:59:23] Completed 195000 out of 250000 steps  (78%)
[19:00:22] - Autosending finished units... [March 5 19:00:22 UTC]
[19:00:22] Trying to send all finished work units
[19:00:22] + No unsent completed units remaining.
[19:00:22] - Autosend completed
[19:08:35] Writing local files
[19:08:36] Completed 197500 out of 250000 steps  (79%)
[19:17:48] Writing local files
[19:17:48] Completed 200000 out of 250000 steps  (80%)
[19:27:01] Writing local files
[19:27:01] Completed 202500 out of 250000 steps  (81%)
[19:36:13] Writing local files
[19:36:13] Completed 205000 out of 250000 steps  (82%)
[19:45:26] Writing local files
[19:45:26] Completed 207500 out of 250000 steps  (83%)
[19:54:39] Writing local files
[19:54:39] Completed 210000 out of 250000 steps  (84%)
[20:03:52] Writing local files
[20:03:52] Completed 212500 out of 250000 steps  (85%)
[20:13:04] Writing local files
[20:13:04] Completed 215000 out of 250000 steps  (86%)
[20:22:17] Writing local files
[20:22:17] Completed 217500 out of 250000 steps  (87%)
[20:31:30] Writing local files
[20:31:30] Completed 220000 out of 250000 steps  (88%)
[20:40:44] Writing local files
[20:40:44] Completed 222500 out of 250000 steps  (89%)
[20:49:57] Writing local files
[20:49:57] Completed 225000 out of 250000 steps  (90%)
[20:59:10] Writing local files
[20:59:10] Completed 227500 out of 250000 steps  (91%)
[21:08:23] Writing local files
[21:08:23] Completed 230000 out of 250000 steps  (92%)
[21:17:36] Writing local files
[21:17:36] Completed 232500 out of 250000 steps  (93%)
[21:26:49] Writing local files
[21:26:49] Completed 235000 out of 250000 steps  (94%)
[21:36:02] Writing local files
[21:36:02] Completed 237500 out of 250000 steps  (95%)
[21:45:15] Writing local files
[21:45:15] Completed 240000 out of 250000 steps  (96%)
[21:54:28] Writing local files
[21:54:28] Completed 242500 out of 250000 steps  (97%)
[22:03:41] Writing local files
[22:03:41] Completed 245000 out of 250000 steps  (98%)
[22:12:55] Writing local files
[22:12:55] Completed 247500 out of 250000 steps  (99%)
[22:22:08] Writing local files
[22:22:08] Completed 250000 out of 250000 steps  (100%)
[22:22:08] Writing final coordinates.
[22:22:08] Past main M.D. loop
[22:23:08] 
[22:23:08] Finished Work Unit:
[22:23:08] - Reading up to 575352 from "work/wudata_01.arc": Read 575352
[22:23:08] - Reading up to 148652 from "work/wudata_01.xtc": Read 148652
[22:23:08] goefile size: 0
[22:23:08] logfile size: 53801
[22:23:08] Leaving Run
[22:23:09] - Writing 845801 bytes of core data to disk...
[22:23:09] Done: 845289 -> 734424 (compressed to 86.8 percent)
[22:23:09]   ... Done.
[22:23:09] - Shutting down core
[22:23:09] 
[22:23:09] Folding@home Core Shutdown: FINISHED_UNIT
[22:23:13] CoreStatus = 64 (100)
[22:23:13] Unit 1 finished with 98 percent of time to deadline remaining.
[22:23:13] Updated performance fraction: 0.979328
[22:23:13] Sending work to server
[22:23:13] Project: 6526 (Run 1, Clone 73, Gen 56)


[22:23:13] + Attempting to send results [March 5 22:23:13 UTC]
[22:23:13] - Reading file work/wuresults_01.dat from core
[22:23:13]   (Read 734936 bytes from disk)
[22:23:13] Connecting to http://171.64.65.62:8080/
[22:23:16] Posted data.
[22:23:17] Initial: 0000; - Uploaded at ~179 kB/s
[22:23:17] - Averaged speed for that direction ~179 kB/s
[22:23:17] + Results successfully sent
[22:23:17] Thank you for your contribution to Folding@Home.
[22:23:17] + Starting local stats count at 1
[22:23:21] Trying to send all finished work units
[22:23:21] + No unsent completed units remaining.
[22:23:21] - Preparing to get new work unit...
[22:23:21] Cleaning up work directory
[22:23:21] + Attempting to get work packet
[22:23:21] Passkey found
[22:23:21] - Will indicate memory of 4095 MB
[22:23:21] - Connecting to assignment server
[22:23:21] Connecting to http://assign.stanford.edu:8080/
[22:23:21] Posted data.
[22:23:21] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[22:23:21] + News From Folding@Home: Welcome to Folding@Home
[22:23:22] Loaded queue successfully.
[22:23:22] Sent data
[22:23:22] Connecting to http://171.64.65.62:8080/
[22:23:22] Posted data.
[22:23:22] Initial: 0000; - Receiving payload (expected size: 419230)
[22:23:23] - Downloaded at ~409 kB/s
[22:23:23] - Averaged speed for that direction ~538 kB/s
[22:23:23] + Received work.
[22:23:23] Trying to send all finished work units
[22:23:23] + No unsent completed units remaining.
[22:23:23] + Closed connections
[22:23:23] 
[22:23:23] + Processing work unit
[22:23:23] Work type 78 not eligible for variable processors
[22:23:23] Core required: FahCore_78.exe
[22:23:23] Core found.
[22:23:23] Working on queue slot 02 [March 5 22:23:23 UTC]
[22:23:23] + Working ...
[22:23:23] - Calling '.\FahCore_78.exe -dir work/ -suffix 02 -nice 19 -checkpoint 15 -verbose -lifeline 2236 -version 634'

[22:23:23] 
[22:23:23] *------------------------------*
[22:23:23] Folding@Home Gromacs Core
[22:23:23] Version 1.90 (March 8, 2006)
[22:23:23] 
[22:23:23] Preparing to commence simulation
[22:23:23] - Looking at optimizations...
[22:23:23] - Created dyn
[22:23:23] - Files status OK
[22:23:24] - Expanded 418718 -> 2022017 (decompressed 482.9 percent)
[22:23:24] - Starting from initial work packet
[22:23:24] 
[22:23:24] Project: 6512 (Run 8, Clone 264, Gen 30)
[22:23:24] 
[22:23:24] Assembly optimizations on if available.
[22:23:24] Entering M.D.
[22:23:30] Protein: TR462_A_9 in water
[22:23:30] 
[22:23:30] Writing local files
[22:23:30] Extra SSE boost OK.
[22:23:30] Writing local files
[22:23:30] Completed 0 out of 250000 steps  (0%)
[22:28:34] Writing local files
[22:28:34] Completed 2500 out of 250000 steps  (1%)
[22:33:39] Writing local files
[22:33:39] Completed 5000 out of 250000 steps  (2%)
[22:38:43] Writing local files
[22:38:43] Completed 7500 out of 250000 steps  (3%)
[22:43:47] Writing local files
[22:43:47] Completed 10000 out of 250000 steps  (4%)
[22:48:51] Writing local files
[22:48:51] Completed 12500 out of 250000 steps  (5%)
[22:53:54] Writing local files
[22:53:55] Completed 15000 out of 250000 steps  (6%)
[22:58:58] Writing local files
[22:58:58] Completed 17500 out of 250000 steps  (7%)
[23:04:02] Writing local files
[23:04:02] Completed 20000 out of 250000 steps  (8%)
[23:09:06] Writing local files
[23:09:06] Completed 22500 out of 250000 steps  (9%)
[23:14:10] Writing local files
[23:14:10] Completed 25000 out of 250000 steps  (10%)
[23:15:22] ***** Got a SIGTERM signal (2)
[23:15:22] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [March 5 23:15:45 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe
Arguments: -verbosity 9 -smp -advmethods 

[23:15:45] - Ask before connecting: No
[23:15:45] - User name: Amaruk (Team 50625)
[23:15:45] - User ID: 44FC6BDB66AFE781
[23:15:45] - Machine ID: 1
[23:15:45] 
[23:15:45] Loaded queue successfully.
[23:15:45] 
[23:15:45] + Processing work unit
[23:15:45] - Autosending finished units... [March 5 23:15:45 UTC]
[23:15:45] Work type 78 not eligible for variable processors
[23:15:45] Trying to send all finished work units
[23:15:45] Core required: FahCore_78.exe
[23:15:45] + No unsent completed units remaining.
[23:15:45] Core found.
[23:15:45] - Autosend completed
[23:15:45] Working on queue slot 02 [March 5 23:15:45 UTC]
[23:15:45] + Working ...
[23:15:45] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_78.exe -dir work/ -suffix 02 -checkpoint 15 -verbose -lifeline 2552 -version 634'

[23:15:45] 
[23:15:45] *------------------------------*
[23:15:45] Folding@Home Gromacs Core
[23:15:45] Version 1.90 (March 8, 2006)
[23:15:45] 
[23:15:45] Preparing to commence simulation
[23:15:45] - Ensuring status. Please wait.
[23:15:46] 
[23:15:46] Project: 6512 (Run 8, Clone 264, Gen 30)
[23:15:46] 
[23:15:46] Assembly optimizations on if available.
[23:15:46] Entering M.D.
[23:16:02] K
[23:16:03] - Expanded 418718 -> 2022017 (decompressed 482.9 percent)
[23:16:03] 
[23:16:03] Project: 65Entering M.D.
[23:16:03] ne 264, Gen 30)
[23:16:03] 
[23:16:03] Entering M.D.
[23:16:06] )
[23:16:06] Extra SSE boost OK.
[23:16:23] intWriting local files
[23:16:23] Size of work/wudata_02.bed not Size of work/wudata_02.bed not what saved.
[23:16:23] 
[23:16:23] Folding@home Core Shutdown: FILE_IO_ERROR
[23:18:47] Killing all core threads
[23:18:47] Killing 4 cores
[23:18:47] Killing core 0
[23:18:47] Killing core 1
[23:18:47] Killing core 2
[23:18:47] Killing core 3

Folding@Home Client Shutdown at user request.
[23:18:47] ***** Got a SIGTERM signal (2)
[23:18:47] Killing all core threads
[23:18:47] Killing 4 cores
[23:18:47] Killing core 0
[23:18:47] Killing core 1
[23:18:47] Killing core 2
[23:18:47] Killing core 3

Folding@Home Client Shutdown.


--- Opening Log file [March 9 04:50:20 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe
Arguments: -configonly -verbosity 9 -smp -advmethods 

[04:50:20] - Ask before connecting: No
[04:50:20] - User name: Amaruk (Team 50625)
[04:50:20] - User ID: 44FC6BDB66AFE781
[04:50:20] - Machine ID: 1
[04:50:20] 
[04:50:20] Configuring Folding@Home...


[04:51:31] - Ask before connecting: No
[04:51:31] - User name: Amaruk (Team 50625)
[04:51:31] - User ID: 44FC6BDB66AFE781
[04:51:31] - Machine ID: 1
[04:51:31] 
[04:51:31] -configonly flag given, so exiting.


--- Opening Log file [March 9 04:51:55 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: E:\Folding\WorkingFiles\SMP634
Executable: D:\SMP634\FAH6.34-win32-SMP.exe
Arguments: -verbosity 9 -smp -advmethods 

[04:51:55] - Ask before connecting: No
[04:51:55] - User name: Amaruk (Team 50625)
[04:51:55] - User ID: 44FC6BDB66AFE781
[04:51:55] - Machine ID: 1
[04:51:55] 
[04:51:56] Loaded queue successfully.
[04:51:56] 
[04:51:56] + Processing work unit
[04:51:56] - Autosending finished units... [March 9 04:51:56 UTC]
[04:51:56] Work type 78 not eligible for variable processors
[04:51:56] Trying to send all finished work units
[04:51:56] Core required: FahCore_78.exe
[04:51:56] + No unsent completed units remaining.
[04:51:56] Core found.
[04:51:56] - Autosend completed
[04:51:56] Working on queue slot 02 [March 9 04:51:56 UTC]
[04:51:56] + Working ...
[04:51:56] - Calling '.\FahCore_78.exe -dir work/ -suffix 02 -nice 19 -checkpoint 15 -verbose -lifeline 1368 -version 634'

[04:51:56] 
[04:51:56] *------------------------------*
[04:51:56] Folding@Home Gromacs Core
[04:51:56] Version 1.90 (March 8, 2006)
[04:51:56] 
[04:51:56] Preparing to commence simulation
[04:51:56] - Looking at optimizations...
[04:51:56] - Files status OK
[04:51:56] - Expanded 418718 -> 2022017 (decompressed 482.9 percent)
[04:51:56] 
[04:51:56] Project: 6512 (Run 8, Clone 264, Gen 30)
[04:51:56] 
[04:51:56] Assembly optimizations on if available.
[04:51:56] Entering M.D.
[04:52:16] (Starting from checkpoint)
[04:52:16] Protein: TR462_A_9 in water
[04:52:16] 
[04:52:16] Writing local files
[04:52:17] Completed 25000 out of 250000 steps  (10%)
[04:52:17] Extra SSE boost OK.
[04:57:31] Writing local files
[04:57:31] Completed 27500 out of 250000 steps  (11%)
[05:02:46] Writing local files
[05:02:46] Completed 30000 out of 250000 steps  (12%)
[05:07:59] Writing local files
[05:07:59] Completed 32500 out of 250000 steps  (13%)

Looks like MPICH2 may be the real killer.

I've got to test this on another machine...

[HendricksSA]

First case pulling the SMP flag and the work unit runs perfectly. Yep, it was not corrupted ... it just could not run the core.

Even more amazing was the second test where it ran perfectly with the SMP flag back in. I am assuming on the configuration pause you stopped your MPICH service. Bruce will find this very interesting ... because his observations about Classics in the queue chocking or not can now be explained.

You be the person! Bows continue. Noted for future reference ... learning continues. Note to self - thank goodness for smart people!

[bruce]

So what you're saying is that as long as you update to the current version of the client (which does not use MPI) adding the -smp flag while running a WU for a single core will finish the single-core WU and download a SMP WU. I can see how that might not have worked with the MPI version.

[HendricksSA]

Seems to be true ... after a restart of course. After the restart the Classic will finish with the variable processor warning and it should fetch an SMP (but Amaruk did not test that specifically). So you were correct about sometimes working/sometimes not. Having a running MPICH service may be the cause.

[Amaruk]

I've tested 6.29, 6.30 and 6.34 on 4 machines running 7 or XP. All of them call mpiexec when restarted with the -smp flag while a classic WU (FahCore_78) is in the queue. This starts four instances of FahCore_78 which all start working on the same WU. After that it's just a matter of time before 2 or more cores try writing a checkpoint at the same time. If one of the cores survives the WU will finish, otherwise the client stalls.

Here is a screenshot of 6.34 on an i7 running 7x64, MPI enabled.




Here is the log.

Code: Select all

--- Opening Log file [March 10 18:23:48 UTC] 


# Windows CPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\Fuzzy\SMP634-TEST
Executable: C:\Users\Fuzzy\SMP634-TEST\FAH6.34-win32-SMP.exe


[18:23:48] Configuring Folding@Home...


[18:25:06] - Ask before connecting: No
[18:25:06] - User name: Amaruk (Team 50625)
[18:25:06] - User ID: 425D5ECExxxxxxxx
[18:25:06] - Machine ID: 1
[18:25:06] 
[18:25:06] Work directory not found. Creating...
[18:25:06] Could not open work queue, generating new queue...
[18:25:06] - Preparing to get new work unit...
[18:25:06] - Autosending finished units... [March 10 18:25:06 UTC]
[18:25:06] Cleaning up work directory
[18:25:06] Trying to send all finished work units
[18:25:06] + Attempting to get work packet
[18:25:06] Passkey found
[18:25:06] + No unsent completed units remaining.
[18:25:06] - Will indicate memory of 6135 MB
[18:25:06] - Detect CPU.[18:25:06] - Autosend completed
 Vendor: GenuineIntel, Family: 6, Model: 10, Stepping: 5
[18:25:06] - Connecting to assignment server
[18:25:06] Connecting to http://assign.stanford.edu:8080/
[18:25:06] Posted data.
[18:25:06] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[18:25:06] + News From Folding@Home: Welcome to Folding@Home
[18:25:06] Loaded queue successfully.
[18:25:06] Sent data
[18:25:06] Connecting to http://171.64.65.62:8080/
[18:25:07] Posted data.
[18:25:07] Initial: 0000; - Receiving payload (expected size: 504908)
[18:25:08] - Downloaded at ~493 kB/s
[18:25:08] - Averaged speed for that direction ~493 kB/s
[18:25:08] + Received work.
[18:25:08] + Closed connections
[18:25:08] 
[18:25:08] + Processing work unit
[18:25:08] Work type 78 not eligible for variable processors
[18:25:08] Core required: FahCore_78.exe
[18:25:08] Core not found.
[18:25:08] - Core is not present or corrupted.
[18:25:08] - Attempting to download new core...
[18:25:08] + Downloading new core: FahCore_78.exe
[18:25:08] Downloading core (/~pande/Win32/x86/Core_78.fah from www.stanford.edu)
[18:25:08] Initial: AFDE; + 10240 bytes downloaded

<SNIP>

[18:25:09] Initial: C1AC; + 825633 bytes downloaded
[18:25:09] Verifying core Core_78.fah...
[18:25:09] Signature is VALID
[18:25:09] 
[18:25:09] Trying to unzip core FahCore_78.exe
[18:25:09] Decompressed FahCore_78.exe (2338816 bytes) successfully
[18:25:14] + Core successfully engaged
[18:25:19] 
[18:25:19] + Processing work unit
[18:25:19] Work type 78 not eligible for variable processors
[18:25:19] Core required: FahCore_78.exe
[18:25:19] Core found.
[18:25:19] Working on queue slot 01 [March 10 18:25:19 UTC]
[18:25:19] + Working ...
[18:25:19] - Calling '.\FahCore_78.exe -dir work/ -suffix 01 -nice 19 -checkpoint 15 -verbose -lifeline 9932 -version 634'

[18:25:19] 
[18:25:19] *------------------------------*
[18:25:19] Folding@Home Gromacs Core
[18:25:19] Version 1.90 (March 8, 2006)
[18:25:19] 
[18:25:19] Preparing to commence simulation
[18:25:19] - Looking at optimizations...
[18:25:19] - Created dyn
[18:25:19] - Files status OK
[18:25:19] - Expanded 504396 -> 2510713 (decompressed 497.7 percent)
[18:25:19] - Starting from initial work packet
[18:25:19] 
[18:25:19] Project: 6515 (Run 17, Clone 239, Gen 32)
[18:25:19] 
[18:25:19] Assembly optimizations on if available.
[18:25:19] Entering M.D.
[18:25:25] Protein: 1CFC_A_18 in water
[18:25:25] 
[18:25:25] Writing local files
[18:25:25] Extra SSE boost OK.
[18:25:26] Writing local files
[18:25:26] Completed 0 out of 250000 steps  (0%)
[18:28:28] Writing local files
[18:28:28] Completed 2500 out of 250000 steps  (1%)
[18:31:31] Writing local files
[18:31:31] Completed 5000 out of 250000 steps  (2%)
[18:34:33] Writing local files
[18:34:33] Completed 7500 out of 250000 steps  (3%)
[18:37:36] Writing local files
[18:37:36] Completed 10000 out of 250000 steps  (4%)
[18:40:39] Writing local files
[18:40:39] Completed 12500 out of 250000 steps  (5%)
[18:41:23] ***** Got a SIGTERM signal (2)
[18:41:23] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [March 10 18:42:09 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\Fuzzy\SMP634-TEST
Executable: C:\Users\Fuzzy\SMP634-TEST\FAH6.34-win32-SMP.exe
Arguments: -verbosity 9 -smp -advmethods 

[18:42:09] - Ask before connecting: No
[18:42:09] - User name: Amaruk (Team 50625)
[18:42:09] - User ID: 425D5ECExxxxxxxx
[18:42:09] - Machine ID: 1
[18:42:09] 
[18:42:09] Loaded queue successfully.
[18:42:09] 
[18:42:09] - Autosending finished units... [March 10 18:42:09 UTC]
[18:42:09] + Processing work unit
[18:42:09] Trying to send all finished work units
[18:42:09] Work type 78 not eligible for variable processors
[18:42:09] + No unsent completed units remaining.
[18:42:09] Core required: FahCore_78.exe
[18:42:09] - Autosend completed
[18:42:09] Core found.
[18:42:09] Working on queue slot 01 [March 10 18:42:09 UTC]
[18:42:09] + Working ...
[18:42:09] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_78.exe -dir work/ -suffix 01 -checkpoint 15 -verbose -lifeline 2916 -version 634'

[18:42:25] 
[18:42:25] *------------------------------*
[18:42:25] Folding@Home Gromacs Core
[18:42:25] Version 1.90 (March 8, 2006)
[18:42:25] 
[18:42:25] Preparing to commence simulation
[18:42:25] - Looking at optimizations...
[18:42:25] - Files status OK
[18:42:25] - Expanded 504396 -> 2510713 (decompressed 497.7 percent)
[18:42:25] 
[18:42:25] Project: 6515 (Run 17, Clone 239, Gen 32)
[18:42:25] 
[18:42:25] Assembly optimizations on if available.
[18:42:25] Entering M.D.
[18:42:45] (Starting from checkpoint)
[18:42:45] Protein: 1CFC_A_18 in water
[18:42:45] 
[18:42:45] Writing local files
[18:42:45] Completed 12500 out of 250000 steps  (5%)
[18:42:45] Extra SSE boost OK.
[18:43:11] er
[18:43:11] 
[18:43:11] Writing local files
[18:43:11] Completed 12500 out of 250000 steps  (5%)
[18:43:17] 2500 out of 250000 steps  (5%)
[18:49:11]  out of 250000 steps  (7%)
[18:49:49] 6%)
[18:49:56] 5000 out of 250000 steps  (6%)
[18:52:23]  out of 250000 steps  (8%)
[18:55:36] Writing local files
[18:55:36] Completed 22500 out of 250000 steps  (9%)
[18:58:49] Writing local files
[18:58:49] Completed 25000 out of 250000 steps  (10%)
[19:02:02] Writing local files
[19:02:02] Completed 27500 out of 250000 steps  (11%)
[19:05:16] Writing local files
[19:05:16] Completed 30000 out of 250000 steps  (12%)
[19:08:27] Writing local files
[19:08:27] Completed 32500 out of 250000 steps  (13%)
[19:10:11] Killing all core threads
[19:10:11] Could not get process id information.  Please kill core process manually

Folding@Home Client Shutdown at user request.
[19:10:11] ***** Got a SIGTERM signal (2)
[19:10:11] Killing all core threads
[19:10:11] Could not get process id information.  Please kill core process manually

Folding@Home Client Shutdown.


--- Opening Log file [March 10 19:11:14 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\Fuzzy\SMP634-TEST
Executable: C:\Users\Fuzzy\SMP634-TEST\FAH6.34-win32-SMP.exe
Arguments: -oneunit -verbosity 9 -smp -advmethods 

[19:11:14] - Ask before connecting: No
[19:11:14] - User name: Amaruk (Team 50625)
[19:11:14] - User ID: 425D5ECExxxxxxxx
[19:11:14] - Machine ID: 1
[19:11:14] 
[19:11:15] Loaded queue successfully.
[19:11:15] 
[19:11:15] - Autosending finished units... [March 10 19:11:15 UTC]
[19:11:15] + Processing work unit
[19:11:15] Trying to send all finished work units
[19:11:15] Work type 78 not eligible for variable processors
[19:11:15] + No unsent completed units remaining.
[19:11:15] Core required: FahCore_78.exe
[19:11:15] - Autosend completed
[19:11:15] Core found.
[19:11:15] Working on queue slot 01 [March 10 19:11:15 UTC]
[19:11:15] + Working ...
[19:11:15] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_78.exe -dir work/ -suffix 01 -checkpoint 15 -verbose -lifeline 8980 -version 634'

[19:11:30] 
[19:11:30] *------------------------------*
[19:11:30] Folding@Home Gromacs Core
[19:11:30] Version 1.90 (March 8, 2006)
[19:11:30] 
[19:11:30] Preparing to commence simulation
[19:11:30] - Looking at optimizations...
[19:11:30] - Files status OK
[19:11:30] - Expanded 504396 -> 2510713 (decompressed 497.7 percent)
[19:11:30] - Checksums don't match (work/wudata_01.xtc)
[19:11:30] - Starting from initial work packet
[19:11:30] 
[19:11:30] Project: 6515 (Run 17, Clone 239, Gen 32)
[19:11:30] 
[19:11:30] Assembly optimizations on if available.
[19:11:30] Entering M.D.
[19:11:36] Protein: 1CFC_A_18 in water
[19:11:36] 
[19:11:36] Writing local files
[19:11:36] Extra SSE boost OK.
[19:11:36] Writing local files
[19:11:36] Completed 0 out of 250000 steps  (0%)
[19:12:14] steps  (0%)
[19:12:22] not what saved.
[19:12:22] 
[19:12:22] Folding@home Core Shutdown: FILE_IO_ERROR
[19:13:04] Killing all core threads
[19:13:04] Could not get process id information.  Please kill core process manually

Folding@Home Client Shutdown at user request.
[19:13:04] ***** Got a SIGTERM signal (2)
[19:13:04] Killing all core threads
[19:13:04] Could not get process id information.  Please kill core process manually

Folding@Home Client Shutdown.

In this instance all four cores died, stalling the client.

If the classic WU is able to finish, the client will then switch to SMP projects.

[HendricksSA]

Interesting. The clients all appear to use the same set of files which is expected. The last run would indicate one client could not figure out what it saw in the data files and simply restarted. This is a great example of complete confusion. What a thorough set of tests! Hopefully, the version 7 client will get rid of the need to ever sort out something like this. Of course, among older folders there may be some MPICH process still not turned off. Surely the v7 folks will read this and see if it hurts the new client. I'm also surprised the call to mpiexec persisted through so many versions of the client but I guess the focus is now on v7. Thanks!

[bruce]

MPICH and DEINO are things of the past. You won't be running one of the V6 clients that installed them when V7 comes out -- unless you choose to.

[Amaruk]

...among older folders there may be some MPICH process still not turned off...

That's exactly what happened. 6.29 and earlier clients install MPI and set it to start automatically.

Have since disabled this service on all of my machines.

MPICH and DEINO are things of the past. You won't be running one of the V6 clients that installed them when V7 comes out -- unless you choose to.

True. And I doubt v7 will call mpiexec...

[bruce]

MPICH and DEINO are things of the past. You won't be running one of the V6 clients that installed them when V7 comes out -- unless you choose to.

True. And I doubt v7 will call mpiexec...

I agree, but you missed my point. After V7 comes out, you can still choose to run some deprecated version of v6 that DOES use mpiexec (though it won't run the new SMP FahCores so I don't know why you would want to) or you can choose to continue to run the latest V6 client.

[Amaruk]

If the MPICH service is running the version of v6 is irrelevant. All of them call mpiexec, including the latest. (6.34)

Terminal at startup:

Code: Select all

Note: Please read the license agreement (FAH6.34-win32-SMP.exe -license). Furthe
r
use of this software requires that you have read and accepted this agreement.

8 cores detected
If you see this twice, MPI is working
If you see this twice, MPI is working
[15:48:20] MPIexec present


--- Opening Log file [March 26 15:48:20 UTC]


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Excerpt from the log I posted last week:

Code: Select all

--- Opening Log file [March 10 18:42:09 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\Fuzzy\SMP634-TEST
Executable: C:\Users\Fuzzy\SMP634-TEST\FAH6.34-win32-SMP.exe
Arguments: -verbosity 9 -smp -advmethods 

[18:42:09] - Ask before connecting: No
[18:42:09] - User name: Amaruk (Team 50625)
[18:42:09] - User ID: 425D5ECExxxxxxxx
[18:42:09] - Machine ID: 1
[18:42:09] 
[18:42:09] Loaded queue successfully.
[18:42:09] 
[18:42:09] - Autosending finished units... [March 10 18:42:09 UTC]
[18:42:09] + Processing work unit
[18:42:09] Trying to send all finished work units
[18:42:09] Work type 78 not eligible for variable processors
[18:42:09] + No unsent completed units remaining.
[18:42:09] Core required: FahCore_78.exe
[18:42:09] - Autosend completed
[18:42:09] Core found.
[18:42:09] Working on queue slot 01 [March 10 18:42:09 UTC]
[18:42:09] + Working ...
[18:42:09] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_78.exe -dir work/ -suffix 01 -checkpoint 15 -verbose -lifeline 2916 -version 634'