Project: 8049 (Run 593, Clone 2, Gen 21)
Posted: Mon Nov 05, 2012 2:34 pm
This looks like a bad wu to me.? this hardware has been running without any errors. no overclock. running on 2x Xeon L5420's, 8GB ram
Code: Select all
12:38:18:WU01:FS00:Starting
12:38:18:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 702 -lifeline 1732 -checkpoint 15 -np 8
12:38:18:WU01:FS00:Started FahCore on PID 2685
12:38:18:Started thread 35 on PID 1732
12:38:18:WU01:FS00:Core PID:2689
12:38:18:WU01:FS00:FahCore 0xa4 started
12:38:18:WU01:FS00:0xa4:
12:38:18:WU01:FS00:0xa4:*------------------------------*
12:38:18:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
12:38:18:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
12:38:18:WU01:FS00:0xa4:
12:38:18:WU01:FS00:0xa4:Preparing to commence simulation
12:38:18:WU01:FS00:0xa4:- Looking at optimizations...
12:38:18:WU01:FS00:0xa4:- Created dyn
12:38:18:WU01:FS00:0xa4:- Files status OK
12:38:18:WU01:FS00:0xa4:- Expanded 967818 -> 2212988 (decompressed 228.6 percent)
12:38:18:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=967818 data_size=2212988, decompressed_data_size=2212988 diff=0
12:38:18:WU01:FS00:0xa4:- Digital signature verified
12:38:18:WU01:FS00:0xa4:
12:38:18:WU01:FS00:0xa4:Project: 8049 (Run 593, Clone 2, Gen 21)
12:38:18:WU01:FS00:0xa4:
12:38:18:WU01:FS00:0xa4:Assembly optimizations on if available.
12:38:18:WU01:FS00:0xa4:Entering M.D.
12:38:24:WU00:FS00:Upload 44.91%
12:38:24:WU01:FS00:0xa4:Completed 0 out of 250000 steps (0%)
12:38:33:WU00:FS00:Upload 89.82%
12:38:40:WU00:FS00:Upload complete
12:38:40:WU00:FS00:Server responded WORK_ACK (400)
12:38:40:WU00:FS00:Final credit estimate, 1776.00 points
12:38:40:WU00:FS00:Cleaning up
12:39:38:WU01:FS00:0xa4:Completed 2500 out of 250000 steps (1%)
12:40:21:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:40:21:WU01:FS00:Starting
12:40:21:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 702 -lifeline 1732 -checkpoint 15 -np 8
12:40:21:WU01:FS00:Started FahCore on PID 2701
12:40:21:Started thread 36 on PID 1732
12:40:21:WU01:FS00:Core PID:2705
12:40:21:WU01:FS00:FahCore 0xa4 started
12:40:21:WU01:FS00:0xa4:
12:40:21:WU01:FS00:0xa4:*------------------------------*
12:40:21:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
12:40:21:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
12:40:21:WU01:FS00:0xa4:
12:40:21:WU01:FS00:0xa4:Preparing to commence simulation
12:40:21:WU01:FS00:0xa4:- Ensuring status. Please wait.
12:40:31:WU01:FS00:0xa4:- Looking at optimizations...
12:40:31:WU01:FS00:0xa4:- Working with standard loops on this execution.
12:40:31:WU01:FS00:0xa4:- Previous termination of core was improper.
12:40:31:WU01:FS00:0xa4:- Files status OK
12:40:31:WU01:FS00:0xa4:- Expanded 967818 -> 2212988 (decompressed 228.6 percent)
12:40:31:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=967818 data_size=2212988, decompressed_data_size=2212988 diff=0
12:40:31:WU01:FS00:0xa4:- Digital signature verified
12:40:31:WU01:FS00:0xa4:
12:40:31:WU01:FS00:0xa4:Project: 8049 (Run 593, Clone 2, Gen 21)
12:40:31:WU01:FS00:0xa4:
12:40:31:WU01:FS00:0xa4:Entering M.D.
12:40:37:WU01:FS00:0xa4:Completed 0 out of 250000 steps (0%)
12:40:52:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:41:21:WU01:FS00:Starting
12:41:21:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 702 -lifeline 1732 -checkpoint 15 -np 8
12:41:21:WU01:FS00:Started FahCore on PID 2717
12:41:21:Started thread 37 on PID 1732
12:41:21:WU01:FS00:Core PID:2721
12:41:21:WU01:FS00:FahCore 0xa4 started
12:41:21:WU01:FS00:0xa4:
12:41:21:WU01:FS00:0xa4:*------------------------------*
12:41:21:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
12:41:21:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
12:41:21:WU01:FS00:0xa4:
12:41:21:WU01:FS00:0xa4:Preparing to commence simulation
12:41:21:WU01:FS00:0xa4:- Ensuring status. Please wait.
12:41:31:WU01:FS00:0xa4:- Looking at optimizations...
12:41:31:WU01:FS00:0xa4:- Working with standard loops on this execution.
12:41:31:WU01:FS00:0xa4:- Previous termination of core was improper.
12:41:31:WU01:FS00:0xa4:- Going to use standard loops.
12:41:31:WU01:FS00:0xa4:- Files status OK
12:41:31:WU01:FS00:0xa4:- Expanded 967818 -> 2212988 (decompressed 228.6 percent)
12:41:31:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=967818 data_size=2212988, decompressed_data_size=2212988 diff=0
12:41:31:WU01:FS00:0xa4:- Digital signature verified
12:41:31:WU01:FS00:0xa4:
12:41:31:WU01:FS00:0xa4:Project: 8049 (Run 593, Clone 2, Gen 21)
12:41:31:WU01:FS00:0xa4:
12:41:31:WU01:FS00:0xa4:Entering M.D.
12:41:37:WU01:FS00:0xa4:Completed 0 out of 250000 steps (0%)
12:42:50:WU01:FS00:0xa4:Completed 2500 out of 250000 steps (1%)
12:44:02:WU01:FS00:0xa4:Completed 5000 out of 250000 steps (2%)
12:45:15:WU01:FS00:0xa4:Completed 7500 out of 250000 steps (3%)
12:46:27:WU01:FS00:0xa4:Completed 10000 out of 250000 steps (4%)
12:47:40:WU01:FS00:0xa4:Completed 12500 out of 250000 steps (5%)
12:48:52:WU01:FS00:0xa4:Completed 15000 out of 250000 steps (6%)
12:50:05:WU01:FS00:0xa4:Completed 17500 out of 250000 steps (7%)
12:51:18:WU01:FS00:0xa4:Completed 20000 out of 250000 steps (8%)
12:52:30:WU01:FS00:0xa4:Completed 22500 out of 250000 steps (9%)
12:53:43:WU01:FS00:0xa4:Completed 25000 out of 250000 steps (10%)
12:54:56:WU01:FS00:0xa4:Completed 27500 out of 250000 steps (11%)
12:56:09:WU01:FS00:0xa4:Completed 30000 out of 250000 steps (12%)
12:57:22:WU01:FS00:0xa4:Completed 32500 out of 250000 steps (13%)
12:58:35:WU01:FS00:0xa4:Completed 35000 out of 250000 steps (14%)
12:59:47:WU01:FS00:0xa4:Completed 37500 out of 250000 steps (15%)
13:01:00:WU01:FS00:0xa4:Completed 40000 out of 250000 steps (16%)
13:02:13:WU01:FS00:0xa4:Completed 42500 out of 250000 steps (17%)
13:03:27:WU01:FS00:0xa4:Completed 45000 out of 250000 steps (18%)
13:04:40:WU01:FS00:0xa4:Completed 47500 out of 250000 steps (19%)
13:05:54:WU01:FS00:0xa4:Completed 50000 out of 250000 steps (20%)
13:07:07:WU01:FS00:0xa4:Completed 52500 out of 250000 steps (21%)
13:08:20:WU01:FS00:0xa4:Completed 55000 out of 250000 steps (22%)
13:09:32:WU01:FS00:0xa4:Completed 57500 out of 250000 steps (23%)
13:10:45:WU01:FS00:0xa4:Completed 60000 out of 250000 steps (24%)
13:11:58:WU01:FS00:0xa4:Completed 62500 out of 250000 steps (25%)
13:13:11:WU01:FS00:0xa4:Completed 65000 out of 250000 steps (26%)
13:14:24:WU01:FS00:0xa4:Completed 67500 out of 250000 steps (27%)
13:15:37:WU01:FS00:0xa4:Completed 70000 out of 250000 steps (28%)
13:16:50:WU01:FS00:0xa4:Completed 72500 out of 250000 steps (29%)
13:18:03:WU01:FS00:0xa4:Completed 75000 out of 250000 steps (30%)
13:19:16:WU01:FS00:0xa4:Completed 77500 out of 250000 steps (31%)
13:20:28:WU01:FS00:0xa4:Completed 80000 out of 250000 steps (32%)
13:21:42:WU01:FS00:0xa4:Completed 82500 out of 250000 steps (33%)
13:22:55:WU01:FS00:0xa4:Completed 85000 out of 250000 steps (34%)
13:24:08:WU01:FS00:0xa4:Completed 87500 out of 250000 steps (35%)
13:25:21:WU01:FS00:0xa4:Completed 90000 out of 250000 steps (36%)
13:26:34:WU01:FS00:0xa4:Completed 92500 out of 250000 steps (37%)
13:27:47:WU01:FS00:0xa4:Completed 95000 out of 250000 steps (38%)
13:29:01:WU01:FS00:0xa4:Completed 97500 out of 250000 steps (39%)
13:30:14:WU01:FS00:0xa4:Completed 100000 out of 250000 steps (40%)
13:31:27:WU01:FS00:0xa4:Completed 102500 out of 250000 steps (41%)
13:32:40:WU01:FS00:0xa4:Completed 105000 out of 250000 steps (42%)
13:33:53:WU01:FS00:0xa4:Completed 107500 out of 250000 steps (43%)
13:35:06:WU01:FS00:0xa4:Completed 110000 out of 250000 steps (44%)
13:36:19:WU01:FS00:0xa4:Completed 112500 out of 250000 steps (45%)
13:37:32:WU01:FS00:0xa4:Completed 115000 out of 250000 steps (46%)
13:38:45:WU01:FS00:0xa4:Completed 117500 out of 250000 steps (47%)
13:39:58:WU01:FS00:0xa4:Completed 120000 out of 250000 steps (48%)
13:41:11:WU01:FS00:0xa4:Completed 122500 out of 250000 steps (49%)
13:42:24:WU01:FS00:0xa4:Completed 125000 out of 250000 steps (50%)
13:43:36:WU01:FS00:0xa4:Completed 127500 out of 250000 steps (51%)
13:44:49:WU01:FS00:0xa4:Completed 130000 out of 250000 steps (52%)
13:46:02:WU01:FS00:0xa4:Completed 132500 out of 250000 steps (53%)
13:47:15:WU01:FS00:0xa4:Completed 135000 out of 250000 steps (54%)
13:47:44:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
13:47:44:WU01:FS00:Starting
13:47:44:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 702 -lifeline 1732 -checkpoint 15 -np 8
13:47:44:WU01:FS00:Started FahCore on PID 2736
13:47:44:Started thread 38 on PID 1732
13:47:44:WU01:FS00:Core PID:2740
13:47:44:WU01:FS00:FahCore 0xa4 started
13:47:44:WU01:FS00:0xa4:
13:47:44:WU01:FS00:0xa4:*------------------------------*
13:47:44:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
13:47:44:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
13:47:44:WU01:FS00:0xa4:
13:47:44:WU01:FS00:0xa4:Preparing to commence simulation
13:47:44:WU01:FS00:0xa4:- Ensuring status. Please wait.
13:47:54:WU01:FS00:0xa4:- Looking at optimizations...
13:47:54:WU01:FS00:0xa4:- Working with standard loops on this execution.
13:47:54:WU01:FS00:0xa4:- Previous termination of core was improper.
13:47:54:WU01:FS00:0xa4:- Going to use standard loops.
13:47:54:WU01:FS00:0xa4:- Files status OK
13:47:54:WU01:FS00:0xa4:- Expanded 967818 -> 2212988 (decompressed 228.6 percent)
13:47:54:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=967818 data_size=2212988, decompressed_data_size=2212988 diff=0
13:47:54:WU01:FS00:0xa4:- Digital signature verified
13:47:54:WU01:FS00:0xa4:
13:47:54:WU01:FS00:0xa4:Project: 8049 (Run 593, Clone 2, Gen 21)
13:47:54:WU01:FS00:0xa4:
13:47:54:WU01:FS00:0xa4:Entering M.D.
13:48:00:WU01:FS00:0xa4:Using Gromacs checkpoints
13:48:00:WU01:FS00:0xa4:Resuming from checkpoint
13:48:00:WU01:FS00:0xa4:Verified 01/wudata_01.log
13:48:00:WU01:FS00:0xa4:Verified 01/wudata_01.trr
13:48:00:WU01:FS00:0xa4:Verified 01/wudata_01.xtc
13:48:00:WU01:FS00:0xa4:Verified 01/wudata_01.edr
13:48:00:WU01:FS00:0xa4:Completed 123420 out of 250000 steps (49%)
13:48:47:WU01:FS00:0xa4:Completed 125000 out of 250000 steps (50%)
13:50:01:WU01:FS00:0xa4:Completed 127500 out of 250000 steps (51%)
13:51:14:WU01:FS00:0xa4:Completed 130000 out of 250000 steps (52%)
13:52:28:WU01:FS00:0xa4:Completed 132500 out of 250000 steps (53%)
13:53:42:WU01:FS00:0xa4:Completed 135000 out of 250000 steps (54%)
13:54:41:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
13:54:41:WU01:FS00:Starting
13:54:41:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/www.stanford.edu/~pande/Linux/AMD64/Core_a4.fah/FahCore_a4 -dir 01 -suffix 01 -version 702 -lifeline 1732 -checkpoint 15 -np 8
13:54:41:WU01:FS00:Started FahCore on PID 2752
13:54:41:Started thread 39 on PID 1732
13:54:41:WU01:FS00:Core PID:2756
13:54:41:WU01:FS00:FahCore 0xa4 started
13:54:42:WU01:FS00:0xa4:
13:54:42:WU01:FS00:0xa4:*------------------------------*
13:54:42:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
13:54:42:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
13:54:42:WU01:FS00:0xa4:
13:54:42:WU01:FS00:0xa4:Preparing to commence simulation
13:54:42:WU01:FS00:0xa4:- Ensuring status. Please wait.
13:54:51:WU01:FS00:0xa4:- Looking at optimizations...
13:54:51:WU01:FS00:0xa4:- Working with standard loops on this execution.
13:54:51:WU01:FS00:0xa4:- Previous termination of core was improper.
13:54:51:WU01:FS00:0xa4:- Going to use standard loops.
13:54:51:WU01:FS00:0xa4:- Files status OK
13:54:51:WU01:FS00:0xa4:- Expanded 967818 -> 2212988 (decompressed 228.6 percent)
13:54:51:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=967818 data_size=2212988, decompressed_data_size=2212988 diff=0
13:54:51:WU01:FS00:0xa4:- Digital signature verified
13:54:51:WU01:FS00:0xa4:
13:54:51:WU01:FS00:0xa4:Project: 8049 (Run 593, Clone 2, Gen 21)
13:54:51:WU01:FS00:0xa4:
13:54:51:WU01:FS00:0xa4:Entering M.D.
13:54:57:WU01:FS00:0xa4:Using Gromacs checkpoints
13:54:58:WU01:FS00:0xa4:Resuming from checkpoint
13:54:58:WU01:FS00:0xa4:Verified 01/wudata_01.log
13:54:58:WU01:FS00:0xa4:Verified 01/wudata_01.trr
13:54:58:WU01:FS00:0xa4:Verified 01/wudata_01.xtc
13:54:58:WU01:FS00:0xa4:Verified 01/wudata_01.edr
13:54:58:WU01:FS00:0xa4:Completed 123420 out of 250000 steps (49%)
13:55:44:WU01:FS00:0xa4:Completed 125000 out of 250000 steps (50%)
13:56:56:WU01:FS00:0xa4:Completed 127500 out of 250000 steps (51%)
13:58:09:WU01:FS00:0xa4:Completed 130000 out of 250000 steps (52%)
13:59:21:WU01:FS00:0xa4:Completed 132500 out of 250000 steps (53%)
14:00:34:WU01:FS00:0xa4:Completed 135000 out of 250000 steps (54%)
14:01:47:WU01:FS00:0xa4:Completed 137500 out of 250000 steps (55%)
14:02:56:WU01:FS00:0xa4:mdrun returned 255
14:02:56:WU01:FS00:0xa4:Going to send back what have done -- stepsTotalG=250000
14:02:56:WU01:FS00:0xa4:Work fraction=37.5281 steps=250000.
14:03:00:WU01:FS00:0xa4:logfile size=15131 infoLength=15131 edr=25 trr=1
14:03:00:WU01:FS00:0xa4:logfile size: 15131 info=15131 bed=25 hdr=1
14:03:00:WU01:FS00:0xa4:- Writing 15669 bytes of core data to disk...
14:03:00:WU01:FS00:0xa4:Done: 15157 -> 5021 (compressed to 33.1 percent)
14:03:00:WU01:FS00:0xa4: ... Done.
14:03:00:WU01:FS00:0xa4:
14:03:00:WU01:FS00:0xa4:Folding@home Core Shutdown: UNSTABLE_MACHINE
\x1b[93m14:03:00:WARNING:WU01:FS00:FahCore returned: UNSTABLE_MACHINE (122 = 0x7a)\x1b[0m
14:03:00:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:8049 run:593 clone:2 gen:21 core:0xa4 unit:0x0000002d6652edcc50133686bdf2642a
14:03:00:WU01:FS00:Uploading 5.40KiB to 171.67.108.60
14:03:00:WU01:FS00:Connecting to 171.67.108.60:8080
14:03:01:WU01:FS00:Upload complete
14:03:01:WU01:FS00:Server responded WORK_ACK (400)
14:03:01:WU01:FS00:Cleaning up