Page 3 of 4
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 3:51 pm
by 7im
Actually, there other possibilities. Not getting core_17s when others are reporting receiving them seems to contradict your assumptions.
And as I've already stated, you need to upgrade to V7.4.4 to be able to get work through the 2nd GPU assignment server. This may change the ratio of assignments.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 3:52 pm
by Kent Irwin
If core 16 projects reached EOL a year ago as I've read, why are they still being assigned? Is it just a 'make work' thing? If these projects reached EOL that to me means they were no longer of value to research. Please excuse my possible ignorance but I didn't make a rather considerable investment in resources and time to get 'make work' assignments nor do I imagine did others.
Having been folding for over a year it is becoming more and more apparent to me what a shoestring operation this must be. Add this to the fact that any REAL success will likely yield mostly huge profits for the pharmaceutical industry in the end has me rethinking my investment.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 4:04 pm
by 7im
This is the exact reason why Pande Group does not like to give out hard estimated dates for changes as the plans always change, so the estimates are always either too short, or too long, and almost always wrong.
Clearly the original estimate was wrong. And has been explained before, no work units are ever "make work" work units. Yes, some are higher priority than others, but that is how every project runs.
Core_16 work units are simply from older projects, using an older scoring system. They are not any less valuable to the science of the project than any other type of work unit.
Pande Group has always controlled the work units that get sent out, and in which order. They are making system adjustments now that may or may not be optimal for us donors. I've been folding a long time. These bumps in the road come and go, and always last a very short duration in the over all big picture of more than a decade of folding.
And if any company can cure Cancer or Alzheimer's using the research done by fah, and after having invested billions of dollars of their own money to develop those cures (which any company would need to do), they are welcomed to any profit they make in my opinion. My family has been hit by both diseases and I wouldn't begrudge Big Pharm a single dime if they had a cure. My grudge would be with any country that had a "for profit" medical system.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 5:03 pm
by bob_b
Several entries back i posted logs and configuration etc. I am folding 10-12 0X_15 Wu's a day on two GPU's and am still wondering am I stuck for some reason on x_15's ? I've done well over a 100 in a row ... it seems broken as i've always gotten random projects 100+ is not random
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 5:14 pm
by PS3EdOlkkola
@ 7im: Please re-read my post, then yours. Not getting Core 17 work units when others are getting them does not contradict my assumptions. I said there was a shortage: A shortage implies some limited availability, not complete unavailability as your implication of my statement concludes.
If upgrading to 7.4.4 is now a requirement with the new Assignment Server, then that should be communicated clearly. As I said in an earlier post, I don't upgrade 15 systems (comprising 37 folding slots) on speculation. There has to be factual evidence of why upgrading is necessary. I also like to see empirical evidence from others that said-problem was resolved through the same upgrade I may need to do.
I maintain that policy for two reasons: Protecting the progress of FAH by reducing, if not eliminating, the possibility of incomplete processing of work units by faulty drivers and/or configuration, and second, efficient allocation of time for maintenance and support of all my systems. When I know the upgrade works as advertised, I will upgrade, but not a moment sooner. If you can point me to where it is documented that 7.4.4 is superior to 7.2.9 in the specific case of the AS sending work units that distribute preferentially -- or only -- to 7.4.4 based clients when the client-type is set to "advanced", then I will begin the process of evaluating the upgrade cycle. Aside from the science itself, one source of pride in my contribution to FAH is knowing that researchers can always count on my systems to run properly, efficiently, reliably and predictably. I will not compromise on those objectives by upgrading anything unnecessarily.
Like you, I've been folding for a long time, going on 7 years now. I'm fine with any work that needs to get processed. However, in order to optimize my systems, I need to know if the situation we are in now with older Core 15 and 16 will continue to take precedence over new Core 17 will be the "new normal". If it is, there are significant changes I need to make in configurations regarding CPU core assignments, priorities, maintenance schedules, hardware upgrade cycles, driver loads and systems monitoring.
@Kent Irwin: "Real" success can be defined many ways. Success can range from helping a researcher launch his/her career on the basis of a new insight and published paper on a discovery my (and everyone's) systems contributed to finding, all the way to your definition of success by enabling huge profits for the pharmaceutical industry. The more that basic research is advanced by up-and-coming researchers using computational biology, the greater the likelihood of eliminating the scourge of diseases that plague mankind. Those are the researchers contributing their further insights in the pharma world where therapies can be developed. It takes big money to roll out a new drug or class of new drugs. Some of that cost could be reduced through reforming out-dated and stilted regulations still in place at the FDA, but until that happens, it's only Big Pharma and extremely well funded venture capital startups that can advance the state-of-the art in cutting-edge therapies. In the end, it doesn't matter who profits from our contributions. It only matters that the work gets done to get there.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 7:02 pm
by 7im
News Blog January 2014:
https://folding.stanford.edu/home/new-b ... er-update/
The use of backup GPU AS is new to the FAH infrastructure and we now see that to make it work, we’ll need to roll out a new client.
News Blog March 2014:
https://folding.stanford.edu/home/the-r ... op-client/
V7.4.4 Release Announcement Forum Post:
viewtopic.php?p=261024#p261024
v7.3.13:
• Added assign-gpu2.stanford.edu as backup GPU AS.
You can read about all the changes from V7.3.7 up through V7.4.4 in that post and make your own decision about upgrading or not.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 8:09 pm
by kimben777
I switched over to the advanced flag and just picked up a core 17 9406wu on a 780 ti running 7.4.4., another one finishes in an hour I'll let you know.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 8:18 pm
by SwingOp3
I just picked up a Core17 9406wu as well on my GTX 980.
Newest drivers and 7.4.4.
Here's to many more!!
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 8:20 pm
by VijayPande
Joseph has also been working today to improve the situation. I think we have a better understanding of what's going on (thanks for the reports) and the AS behavior should be better now for you guys to get core17/18 WUs.
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 9:06 pm
by Kjetil
I have to cards, one 750Ti and 980, driver are 344.11 and 7.4.4. Now it not fold. Now 2 more. AS not fixed?
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 9:15 pm
by SwingOp3
SwingOp3 wrote:I just picked up a Core17 9406wu as well on my GTX 980.
Newest drivers and 7.4.4.
Here's to many more!!
Spoke too soon. I'm at work and see that I've had 9 bad work units(114 =0x72)
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 9:44 pm
by bob_b
I just got assigned an x_17 WU on each GPU so my string of x_15 Wu's has ended
21:23:18:WARNING:WU03:FS01:Exception: Could not get IP address for assign-GPU.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server.
21:23:18:ERROR:WU03:FS01:Exception: Could not get an assignment
21:23:18:WU03:FS01:Connecting to 171.67.108.201:80
21:23:19:WU03:FS01:Assigned to work server 171.64.65.56
21:23:19:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:GK110 [GeForce GTX 780 Ti] from 171.64.65.56
21:23:19:WU03:FS01:Connecting to 171.64.65.56:8080
21:23:20:WU03:FS01:Downloading 4.85MiB
21:23:26:WU03:FS01:Download 85.10%
21:23:26:WU03:FS01:Download complete
21:23:27:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9406 run:1013 clone:0 gen:34 core:0x17 unit:0x000000430a3b1e5c533e5fe28d318014
Re: No more Core17 WU's?
Posted: Sat Oct 04, 2014 10:07 pm
by bruce
Kent Irwin wrote:If core 16 projects reached EOL a year ago as I've read, why are they still being assigned? Is it just a 'make work' thing?
Depending on the temperature, the atomic motions underlying FAH's analysis are partially random and partly deterministic. Results are statistical, and research can only conclude that there is a reasonable probability that X is true. (The numerical definition of "reasonable" may vary.) Research continues until that "reasonableness" is achieved and high priority tasks study conditions for which nothing is known. Even after "reasonable" is achieved, gathering additional statistics can be useful, but at a lower priority whenever the researcher thinks new information may be discovered. FAH does
not issue "make work" assignments which would simply reproduce results that are already known but they do issue assignments that discover less-likely scenarios or improve the degree of certainty of specific conclusions.
Even after a Clinical Trial has met all the requirements and a drug is released to the marketplace, sometimes unexpected results are reported from widespread commercial use. The same can be true when it's a computer-based trial.
EOL for a project is not the same as EOL for a method. From time-to-time, new analysis methods are developed. If FahCore_15 was used when a project was initiated and useful results have been obtained, those results can be improved by doing more research, but the scientific integrity of the would be invalidated if results from, say, FahCore_17 were intermixed, even though new projects are all being started using FahCore_17. Predicting when the EOL for FahCore_15 is impossible because it depends on the ending of all projects that depend on that method and the ending of specific projects depends on whether the researcher sees the possibility of learning new things by extending the study.
Please excuse my possible ignorance but I didn't make a rather considerable investment in resources and time to get 'make work' assignments nor do I imagine did others.
Having been folding for over a year it is becoming more and more apparent to me what a shoestring operation this must be. Add this to the fact that any REAL success will likely yield mostly huge profits for the pharmaceutical industry in the end has me rethinking my investment.
Stanford University does basic research. They are NOT a for-profit wing of the pharmaceutical industry. Their scientific results are published in the public domain and can be freely used by any of the for-profit pharmaceutical companies.
Some people donate resources to FAH and some people donate to, say, the Red Cross. There are many, many factors involved in deciding to whom you'll donate. You and I may agree or may not agree, but it's still your decision and your decision alone.
There's a place in this world for FAH, a place in this world for the Red Cross, and a place in this world for those who develop useful drugs. Personally, I choose NOT to donate to R&D being done by for-profit drug companies even if they successfully develop a useful drug that's partly based on the results from Stanford's "pure research." YMMV.
Re: No more Core17 WU's?
Posted: Sun Oct 05, 2014 5:11 am
by theory
Swing, what kind of PPD you getting with that GTX 980?
Re: No more Core17 WU's?
Posted: Sun Oct 05, 2014 6:43 am
by muffinxy
I get also bad work units on my GTX 980 .. with BETA flag i got some core 18 WU's but then also bad work units with core 17 .. no matter if core 0.0.52 or 0.0.55
Code: Select all
*********************** Log Started 2014-10-05T06:25:48Z ***********************
06:25:48:************************* Folding@home Client *************************
06:25:48: Website: http://folding.stanford.edu/
06:25:48: Copyright: (c) 2009-2014 Stanford University
06:25:48: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
06:25:48: Args:
06:25:48: Config: C:/Users/janus/AppData/Roaming/FAHClient/config.xml
06:25:48:******************************** Build ********************************
06:25:48: Version: 7.4.4
06:25:48: Date: Mar 4 2014
06:25:48: Time: 20:26:54
06:25:48: SVN Rev: 4130
06:25:48: Branch: fah/trunk/client
06:25:48: Compiler: Intel(R) C++ MSVC 1500 mode 1200
06:25:48: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
06:25:48: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
06:25:48: Platform: win32 XP
06:25:48: Bits: 32
06:25:48: Mode: Release
06:25:48:******************************* System ********************************
06:25:48: CPU: Intel(R) Xeon(R) CPU E3-1245 V2 @ 3.40GHz
06:25:48: CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
06:25:48: CPUs: 8
06:25:48: Memory: 7.89GiB
06:25:48: Free Memory: 6.51GiB
06:25:48: Threads: WINDOWS_THREADS
06:25:48: OS Version: 6.2
06:25:48: Has Battery: false
06:25:48: On Battery: false
06:25:48: UTC Offset: 2
06:25:48: PID: 4780
06:25:48: CWD: C:/Users/janus/AppData/Roaming/FAHClient
06:25:48: OS: Windows 8.1 Pro with Media Center
06:25:48: OS Arch: AMD64
06:25:48: GPUs: 1
06:25:48: GPU 0: NVIDIA:4 GM204 [GeForce GTX 980]
06:25:48: CUDA: 5.2
06:25:48: CUDA Driver: 6050
06:25:48:Win32 Service: false
06:25:48:***********************************************************************
06:25:48:<config>
06:25:48: <!-- Network -->
06:25:48: <proxy v=':8080'/>
06:25:48:
06:25:48: <!-- Slot Control -->
06:25:48: <power v='full'/>
06:25:48:
06:25:48: <!-- User Information -->
06:25:48: <passkey v='********************************'/>
06:25:48: <team v='34361'/>
06:25:48: <user v='muffinxy'/>
06:25:48:
06:25:48: <!-- Folding Slots -->
06:25:48: <slot id='1' type='GPU'>
06:25:48: <next-unit-percentage v='100'/>
06:25:48: </slot>
06:25:48:</config>
06:25:48:Trying to access database...
06:25:48:Successfully acquired database lock
06:25:48:Enabled folding slot 01: READY gpu:0:GM204 [GeForce GTX 980]
06:25:48:WU00:FS01:Starting
06:25:48:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:25:48:WU00:FS01:Started FahCore on PID 6568
06:25:49:WU00:FS01:Core PID:6580
06:25:49:WU00:FS01:FahCore 0x17 started
06:25:49:WU00:FS01:0x17:*********************** Log Started 2014-10-05T06:25:49Z ***********************
06:25:49:WU00:FS01:0x17:Project: 13001 (Run 109, Clone 8, Gen 11)
06:25:49:WU00:FS01:0x17:Unit: 0x0000001c538b3db753286eb9fe8ad8b4
06:25:49:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:25:49:WU00:FS01:0x17:Machine: 1
06:25:49:WU00:FS01:0x17:Reading tar file state.xml
06:25:50:WU00:FS01:0x17:Reading tar file system.xml
06:25:50:WU00:FS01:0x17:Reading tar file integrator.xml
06:25:50:WU00:FS01:0x17:Reading tar file core.xml
06:25:50:WU00:FS01:0x17:Digital signatures verified
06:25:50:WU00:FS01:0x17:Folding@home GPU core17
06:25:50:WU00:FS01:0x17:Version 0.0.52
06:27:56:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 452.694 with threshold of 5
06:27:56:WU00:FS01:0x17:Saving result file logfile_01.txt
06:27:56:WU00:FS01:0x17:Saving result file log.txt
06:27:56:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:27:56:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:27:56:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13001 run:109 clone:8 gen:11 core:0x17 unit:0x0000001c538b3db753286eb9fe8ad8b4
06:27:56:WU00:FS01:Uploading 2.81KiB to 140.163.4.231
06:27:56:WU00:FS01:Connecting to 140.163.4.231:8080
06:27:56:WU00:FS01:Upload complete
06:27:56:WU00:FS01:Server responded WORK_ACK (400)
06:27:56:WU00:FS01:Cleaning up
06:27:57:WU01:FS01:Connecting to 171.67.108.201:80
06:27:58:WU01:FS01:Assigned to work server 140.163.4.231
06:27:58:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:27:58:WU01:FS01:Connecting to 140.163.4.231:8080
06:27:59:WU01:FS01:Downloading 4.84MiB
06:28:02:WU01:FS01:Download complete
06:28:02:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:512 clone:7 gen:11 core:0x17 unit:0x00000023538b3db7532c8d7ac72a9483
06:28:02:WU01:FS01:Starting
06:28:02:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:28:02:WU01:FS01:Started FahCore on PID 1848
06:28:02:WU01:FS01:Core PID:3164
06:28:02:WU01:FS01:FahCore 0x17 started
06:28:03:WU01:FS01:0x17:*********************** Log Started 2014-10-05T06:28:02Z ***********************
06:28:03:WU01:FS01:0x17:Project: 13001 (Run 512, Clone 7, Gen 11)
06:28:03:WU01:FS01:0x17:Unit: 0x00000023538b3db7532c8d7ac72a9483
06:28:03:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:28:03:WU01:FS01:0x17:Machine: 1
06:28:03:WU01:FS01:0x17:Reading tar file state.xml
06:28:03:WU01:FS01:0x17:Reading tar file system.xml
06:28:04:WU01:FS01:0x17:Reading tar file integrator.xml
06:28:04:WU01:FS01:0x17:Reading tar file core.xml
06:28:04:WU01:FS01:0x17:Digital signatures verified
06:28:04:WU01:FS01:0x17:Folding@home GPU core17
06:28:04:WU01:FS01:0x17:Version 0.0.52
06:30:06:WU01:FS01:0x17:ERROR:exception: Force RMSE error of 454.304 with threshold of 5
06:30:06:WU01:FS01:0x17:Saving result file logfile_01.txt
06:30:06:WU01:FS01:0x17:Saving result file log.txt
06:30:06:WU01:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:30:06:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:30:06:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:512 clone:7 gen:11 core:0x17 unit:0x00000023538b3db7532c8d7ac72a9483
06:30:06:WU01:FS01:Uploading 2.33KiB to 140.163.4.231
06:30:06:WU01:FS01:Connecting to 140.163.4.231:8080
06:30:06:WU00:FS01:Connecting to 171.67.108.201:80
06:30:06:WU01:FS01:Upload complete
06:30:06:WU01:FS01:Server responded WORK_ACK (400)
06:30:06:WU01:FS01:Cleaning up
06:30:07:WU00:FS01:Assigned to work server 140.163.4.231
06:30:07:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:30:07:WU00:FS01:Connecting to 140.163.4.231:8080
06:30:08:WU00:FS01:Downloading 4.84MiB
06:30:11:WU00:FS01:Download complete
06:30:11:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13001 run:239 clone:8 gen:11 core:0x17 unit:0x00000013538b3db7532893a3d0aa2e2b
06:30:11:WU00:FS01:Starting
06:30:11:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:30:11:WU00:FS01:Started FahCore on PID 2136
06:30:11:WU00:FS01:Core PID:3956
06:30:11:WU00:FS01:FahCore 0x17 started
06:30:11:WU00:FS01:0x17:*********************** Log Started 2014-10-05T06:30:11Z ***********************
06:30:11:WU00:FS01:0x17:Project: 13001 (Run 239, Clone 8, Gen 11)
06:30:11:WU00:FS01:0x17:Unit: 0x00000013538b3db7532893a3d0aa2e2b
06:30:11:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:30:11:WU00:FS01:0x17:Machine: 1
06:30:11:WU00:FS01:0x17:Reading tar file state.xml
06:30:12:WU00:FS01:0x17:Reading tar file system.xml
06:30:12:WU00:FS01:0x17:Reading tar file integrator.xml
06:30:12:WU00:FS01:0x17:Reading tar file core.xml
06:30:12:WU00:FS01:0x17:Digital signatures verified
06:30:12:WU00:FS01:0x17:Folding@home GPU core17
06:30:12:WU00:FS01:0x17:Version 0.0.52
06:32:14:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 451.514 with threshold of 5
06:32:14:WU00:FS01:0x17:Saving result file logfile_01.txt
06:32:14:WU00:FS01:0x17:Saving result file log.txt
06:32:14:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:32:15:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:32:15:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13001 run:239 clone:8 gen:11 core:0x17 unit:0x00000013538b3db7532893a3d0aa2e2b
06:32:15:WU00:FS01:Uploading 2.33KiB to 140.163.4.231
06:32:15:WU00:FS01:Connecting to 140.163.4.231:8080
06:32:15:WU01:FS01:Connecting to 171.67.108.201:80
06:32:15:WU00:FS01:Upload complete
06:32:15:WU00:FS01:Server responded WORK_ACK (400)
06:32:15:WU00:FS01:Cleaning up
06:32:16:WU01:FS01:Assigned to work server 140.163.4.231
06:32:16:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:32:16:WU01:FS01:Connecting to 140.163.4.231:8080
06:32:16:WU01:FS01:Downloading 4.84MiB
06:32:20:WU01:FS01:Download complete
06:32:20:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:210 clone:2 gen:11 core:0x17 unit:0x00000014538b3db7530fd7413a797567
06:32:20:WU01:FS01:Starting
06:32:20:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:32:20:WU01:FS01:Started FahCore on PID 3120
06:32:20:WU01:FS01:Core PID:7156
06:32:20:WU01:FS01:FahCore 0x17 started
06:32:20:WU01:FS01:0x17:*********************** Log Started 2014-10-05T06:32:20Z ***********************
06:32:20:WU01:FS01:0x17:Project: 13000 (Run 210, Clone 2, Gen 11)
06:32:20:WU01:FS01:0x17:Unit: 0x00000014538b3db7530fd7413a797567
06:32:20:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:32:20:WU01:FS01:0x17:Machine: 1
06:32:20:WU01:FS01:0x17:Reading tar file state.xml
06:32:21:WU01:FS01:0x17:Reading tar file system.xml
06:32:21:WU01:FS01:0x17:Reading tar file integrator.xml
06:32:21:WU01:FS01:0x17:Reading tar file core.xml
06:32:21:WU01:FS01:0x17:Digital signatures verified
06:32:21:WU01:FS01:0x17:Folding@home GPU core17
06:32:21:WU01:FS01:0x17:Version 0.0.52
06:34:23:WU01:FS01:0x17:ERROR:exception: Force RMSE error of 452.788 with threshold of 5
06:34:23:WU01:FS01:0x17:Saving result file logfile_01.txt
06:34:23:WU01:FS01:0x17:Saving result file log.txt
06:34:23:WU01:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:34:23:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:34:23:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:210 clone:2 gen:11 core:0x17 unit:0x00000014538b3db7530fd7413a797567
06:34:23:WU01:FS01:Uploading 2.31KiB to 140.163.4.231
06:34:23:WU01:FS01:Connecting to 140.163.4.231:8080
06:34:24:WU01:FS01:Upload complete
06:34:24:WU01:FS01:Server responded WORK_ACK (400)
06:34:24:WU01:FS01:Cleaning up
06:34:24:WU00:FS01:Connecting to 171.67.108.201:80
06:34:24:WU00:FS01:Assigned to work server 140.163.4.231
06:34:24:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:34:24:WU00:FS01:Connecting to 140.163.4.231:8080
06:34:25:WU00:FS01:Downloading 4.84MiB
06:34:28:WU00:FS01:Download complete
06:34:29:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13001 run:213 clone:0 gen:24 core:0x17 unit:0x00000038538b3db753288c0bf0658f35
06:34:29:WU00:FS01:Starting
06:34:29:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:34:29:WU00:FS01:Started FahCore on PID 6584
06:34:29:WU00:FS01:Core PID:6572
06:34:29:WU00:FS01:FahCore 0x17 started
06:34:29:WU00:FS01:0x17:*********************** Log Started 2014-10-05T06:34:29Z ***********************
06:34:29:WU00:FS01:0x17:Project: 13001 (Run 213, Clone 0, Gen 24)
06:34:29:WU00:FS01:0x17:Unit: 0x00000038538b3db753288c0bf0658f35
06:34:29:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:34:29:WU00:FS01:0x17:Machine: 1
06:34:29:WU00:FS01:0x17:Reading tar file state.xml
06:34:29:WU00:FS01:0x17:Reading tar file system.xml
06:34:30:WU00:FS01:0x17:Reading tar file integrator.xml
06:34:30:WU00:FS01:0x17:Reading tar file core.xml
06:34:30:WU00:FS01:0x17:Digital signatures verified
06:34:30:WU00:FS01:0x17:Folding@home GPU core17
06:34:30:WU00:FS01:0x17:Version 0.0.52
06:36:42:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 452.918 with threshold of 5
06:36:42:WU00:FS01:0x17:Saving result file logfile_01.txt
06:36:42:WU00:FS01:0x17:Saving result file log.txt
06:36:42:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:36:42:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:36:42:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13001 run:213 clone:0 gen:24 core:0x17 unit:0x00000038538b3db753288c0bf0658f35
06:36:42:WU00:FS01:Uploading 2.32KiB to 140.163.4.231
06:36:42:WU00:FS01:Connecting to 140.163.4.231:8080
06:36:42:WU00:FS01:Upload complete
06:36:42:WU00:FS01:Server responded WORK_ACK (400)
06:36:42:WU00:FS01:Cleaning up
06:36:42:WU01:FS01:Connecting to 171.67.108.201:80
06:36:43:WU01:FS01:Assigned to work server 140.163.4.231
06:36:43:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:36:43:WU01:FS01:Connecting to 140.163.4.231:8080
06:36:44:WU01:FS01:Downloading 4.84MiB
06:36:47:WU01:FS01:Download complete
06:36:47:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:101 clone:2 gen:11 core:0x17 unit:0x00000014538b3db7530fb8977cb8e54d
06:36:47:WU01:FS01:Starting
06:36:47:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:36:47:WU01:FS01:Started FahCore on PID 2972
06:36:47:WU01:FS01:Core PID:2132
06:36:47:WU01:FS01:FahCore 0x17 started
06:36:48:WU01:FS01:0x17:*********************** Log Started 2014-10-05T06:36:47Z ***********************
06:36:48:WU01:FS01:0x17:Project: 13000 (Run 101, Clone 2, Gen 11)
06:36:48:WU01:FS01:0x17:Unit: 0x00000014538b3db7530fb8977cb8e54d
06:36:48:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:36:48:WU01:FS01:0x17:Machine: 1
06:36:48:WU01:FS01:0x17:Reading tar file state.xml
06:36:48:WU01:FS01:0x17:Reading tar file system.xml
06:36:48:WU01:FS01:0x17:Reading tar file integrator.xml
06:36:48:WU01:FS01:0x17:Reading tar file core.xml
06:36:48:WU01:FS01:0x17:Digital signatures verified
06:36:48:WU01:FS01:0x17:Folding@home GPU core17
06:36:48:WU01:FS01:0x17:Version 0.0.52
06:38:52:WU01:FS01:0x17:ERROR:exception: Force RMSE error of 450.797 with threshold of 5
06:38:52:WU01:FS01:0x17:Saving result file logfile_01.txt
06:38:52:WU01:FS01:0x17:Saving result file log.txt
06:38:52:WU01:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:38:53:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:38:53:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:101 clone:2 gen:11 core:0x17 unit:0x00000014538b3db7530fb8977cb8e54d
06:38:53:WU01:FS01:Uploading 2.32KiB to 140.163.4.231
06:38:53:WU01:FS01:Connecting to 140.163.4.231:8080
06:38:53:WU00:FS01:Connecting to 171.67.108.201:80
06:38:53:WU01:FS01:Upload complete
06:38:53:WU01:FS01:Server responded WORK_ACK (400)
06:38:53:WU01:FS01:Cleaning up
06:38:54:WU00:FS01:Assigned to work server 140.163.4.231
06:38:54:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:38:54:WU00:FS01:Connecting to 140.163.4.231:8080
06:38:54:WU00:FS01:Downloading 4.84MiB
06:38:57:WU00:FS01:Download complete
06:38:57:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:1760 clone:2 gen:11 core:0x17 unit:0x00000012538b3db753118d6bfc9ed17d
06:38:57:WU00:FS01:Starting
06:38:57:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:38:57:WU00:FS01:Started FahCore on PID 3988
06:38:57:WU00:FS01:Core PID:3476
06:38:57:WU00:FS01:FahCore 0x17 started
06:38:58:WU00:FS01:0x17:*********************** Log Started 2014-10-05T06:38:57Z ***********************
06:38:58:WU00:FS01:0x17:Project: 13000 (Run 1760, Clone 2, Gen 11)
06:38:58:WU00:FS01:0x17:Unit: 0x00000012538b3db753118d6bfc9ed17d
06:38:58:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:38:58:WU00:FS01:0x17:Machine: 1
06:38:58:WU00:FS01:0x17:Reading tar file state.xml
06:38:58:WU00:FS01:0x17:Reading tar file system.xml
06:38:59:WU00:FS01:0x17:Reading tar file integrator.xml
06:38:59:WU00:FS01:0x17:Reading tar file core.xml
06:38:59:WU00:FS01:0x17:Digital signatures verified
06:38:59:WU00:FS01:0x17:Folding@home GPU core17
06:38:59:WU00:FS01:0x17:Version 0.0.52
06:41:02:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 456.434 with threshold of 5
06:41:02:WU00:FS01:0x17:Saving result file logfile_01.txt
06:41:02:WU00:FS01:0x17:Saving result file log.txt
06:41:02:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
06:41:02:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
06:41:02:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13000 run:1760 clone:2 gen:11 core:0x17 unit:0x00000012538b3db753118d6bfc9ed17d
06:41:02:WU00:FS01:Uploading 2.32KiB to 140.163.4.231
06:41:02:WU00:FS01:Connecting to 140.163.4.231:8080
06:41:03:WU01:FS01:Connecting to 171.67.108.201:80
06:41:03:WU00:FS01:Upload complete
06:41:03:WU00:FS01:Server responded WORK_ACK (400)
06:41:03:WU00:FS01:Cleaning up
06:41:03:WU01:FS01:Assigned to work server 140.163.4.231
06:41:03:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 980] from 140.163.4.231
06:41:03:WU01:FS01:Connecting to 140.163.4.231:8080
06:41:04:WU01:FS01:Downloading 4.82MiB
06:41:07:WU01:FS01:Download complete
06:41:07:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:603 clone:2 gen:11 core:0x17 unit:0x00000018538b3db7531045ff64c0fb0a
06:41:07:WU01:FS01:Starting
06:41:07:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/janus/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4780 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
06:41:07:WU01:FS01:Started FahCore on PID 6980
06:41:07:WU01:FS01:Core PID:1384
06:41:07:WU01:FS01:FahCore 0x17 started
06:41:08:WU01:FS01:0x17:*********************** Log Started 2014-10-05T06:41:07Z ***********************
06:41:08:WU01:FS01:0x17:Project: 13000 (Run 603, Clone 2, Gen 11)
06:41:08:WU01:FS01:0x17:Unit: 0x00000018538b3db7531045ff64c0fb0a
06:41:08:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
06:41:08:WU01:FS01:0x17:Machine: 1
06:41:08:WU01:FS01:0x17:Reading tar file state.xml
06:41:08:WU01:FS01:0x17:Reading tar file system.xml
06:41:09:WU01:FS01:0x17:Reading tar file integrator.xml
06:41:09:WU01:FS01:0x17:Reading tar file core.xml
06:41:09:WU01:FS01:0x17:Digital signatures verified
06:41:09:WU01:FS01:0x17:Folding@home GPU core17
06:41:09:WU01:FS01:0x17:Version 0.0.52