FAULTY project:9441 Forces are blowing up! 33

Moderators: Site Moderators, FAHC Science Team

Post Reply
bcavnaugh
Posts: 147
Joined: Tue Apr 30, 2013 1:39 pm

FAULTY project:9441 Forces are blowing up! 33

Post by bcavnaugh »

Seems odd that all three rigs running with GTX 1080 Ti Cards all failing.

I guess

Code: Select all

is not working ATM.

Code: Select all

01:26:04:******************************** Build ********************************
01:26:04:      Version: 7.4.4
01:26:04:         Date: Mar 4 2014
01:26:04:         Time: 20:26:54
01:26:04:      SVN Rev: 4130
01:26:04:       Branch: fah/trunk/client
01:26:04:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
01:26:04:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
01:26:04:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
01:26:04:     Platform: win32 XP
01:26:04:         Bits: 32
01:26:04:         Mode: Release
01:26:04:******************************* System ********************************
01:26:04:          CPU: Intel(R) Core(TM) i7-4820K CPU @ 3.70GHz
01:26:04:       CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
01:26:04:         CPUs: 8
01:26:04:       Memory: 31.90GiB
01:26:04:  Free Memory: 29.21GiB
01:26:04:      Threads: WINDOWS_THREADS
01:26:04:   OS Version: 6.1
01:26:04:  Has Battery: false
01:26:04:   On Battery: false
01:26:04:   UTC Offset: -6
01:26:04:          PID: 5040
01:26:04:          CWD: D:/ProgramData/FAHClient
01:26:04:           OS: Windows 7 Ultimate
01:26:04:      OS Arch: AMD64
01:26:04:         GPUs: 2
01:26:04:        GPU 0: NVIDIA:7 GP102 [GeForce GTX 1080 Ti] 11380
01:26:04:        GPU 1: NVIDIA:7 GP102 [GeForce GTX 1080 Ti] 11380
01:26:04:         CUDA: 6.1
01:26:04:  CUDA Driver: 8000
01:26:04:Win32 Service: false
01:26:04:***********************************************************************
13:50:28:WU00:FS01:0x21:*********************** Log Started 2017-10-11T13:50:28Z ***********************
13:50:28:WU00:FS01:0x21:Project: 9441 (Run 23, Clone 43, Gen 0)
13:50:28:WU00:FS01:0x21:Unit: 0x00000004ab436c9d56af1b29e60357c8
13:50:28:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
13:50:28:WU00:FS01:0x21:Machine: 1
13:50:28:WU00:FS01:0x21:Reading tar file core.xml
13:50:28:WU00:FS01:0x21:Reading tar file integrator.xml
13:50:28:WU00:FS01:0x21:Reading tar file state.xml
13:50:28:WU00:FS01:0x21:Reading tar file system.xml
13:50:28:WU00:FS01:0x21:Digital signatures verified
13:50:28:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
13:50:28:WU00:FS01:0x21:Version 0.0.18
13:50:33:WU00:FS01:0x21:ERROR:Discrepancy: Forces are blowing up! 3170 0
13:50:33:WU00:FS01:0x21:Saving result file logfile_01.txt
13:50:33:WU00:FS01:0x21:Saving result file log.txt
13:50:33:WU00:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
13:50:33:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:50:33:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:9441 run:23 clone:43 gen:0 core:0x21 unit:0x00000004ab436c9d56af1b29e60357c8
13:50:33:WU00:FS01:Uploading 6.50KiB to 171.67.108.157
13:50:33:WU00:FS01:Connecting to 171.67.108.157:8080
13:50:33:WU00:FS01:Upload complete
13:50:33:WU00:FS01:Server responded WORK_ACK (400)
13:50:33:WU00:FS01:Cleaning up
////////////////////////////////////////////////////////////////////////////////
21:26:16:******************************** Build ********************************
21:26:16:      Version: 7.4.4
21:26:16:         Date: Mar 4 2014
21:26:16:         Time: 20:26:54
21:26:16:      SVN Rev: 4130
21:26:16:       Branch: fah/trunk/client
21:26:16:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
21:26:16:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
21:26:16:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
21:26:16:     Platform: win32 XP
21:26:16:         Bits: 32
21:26:16:         Mode: Release
21:26:16:******************************* System ********************************
21:26:16:          CPU: AMD Ryzen 7 1800X Eight-Core Processor
21:26:16:       CPU ID: AuthenticAMD Family 23 Model 1 Stepping 1
21:26:16:         CPUs: 8
21:26:16:       Memory: 31.95GiB
21:26:16:  Free Memory: 29.60GiB
21:26:16:      Threads: WINDOWS_THREADS
21:26:16:   OS Version: 6.2
21:26:16:  Has Battery: false
21:26:16:   On Battery: false
21:26:16:   UTC Offset: -6
21:26:16:          PID: 9104
21:26:16:          CWD: D:/ProgramData/FAHClient
21:26:16:           OS: Windows 10 Pro
21:26:16:      OS Arch: AMD64
21:26:16:         GPUs: 1
21:26:16:        GPU 0: NVIDIA:7 GP102 [GeForce GTX 1080 Ti] 11380
21:26:16:         CUDA: 6.1
21:26:16:  CUDA Driver: 8000
21:26:16:Win32 Service: false
21:26:16:***********************************************************************
14:50:14:WU00:FS00:0x21:*********************** Log Started 2017-10-11T14:50:14Z ***********************
14:50:14:WU00:FS00:0x21:Project: 9441 (Run 37, Clone 44, Gen 0)
14:50:14:WU00:FS00:0x21:Unit: 0x00000003ab436c9d56af1b2bd3ca4d2f
14:50:14:WU00:FS00:0x21:CPU: 0x00000000000000000000000000000000
14:50:14:WU00:FS00:0x21:Machine: 0
14:50:14:WU00:FS00:0x21:Reading tar file core.xml
14:50:14:WU00:FS00:0x21:Reading tar file integrator.xml
14:50:14:WU00:FS00:0x21:Reading tar file state.xml
14:50:14:WU00:FS00:0x21:Reading tar file system.xml
14:50:15:WU00:FS00:0x21:Digital signatures verified
14:50:15:WU00:FS00:0x21:Folding@home GPU Core21 Folding@home Core
14:50:15:WU00:FS00:0x21:Version 0.0.18
14:50:20:WU01:FS00:Upload 34.79%
14:50:21:WU00:FS00:0x21:ERROR:Discrepancy: Forces are blowing up! 33 0
14:50:21:WU00:FS00:0x21:Saving result file logfile_01.txt
14:50:21:WU00:FS00:0x21:Saving result file log.txt
14:50:21:WU00:FS00:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
14:50:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
14:50:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:9441 run:37 clone:44 gen:0 core:0x21 unit:0x00000003ab436c9d56af1b2bd3ca4d2f
14:50:21:WU00:FS00:Uploading 6.50KiB to 171.67.108.157
14:50:21:WU00:FS00:Connecting to 171.67.108.157:8080
14:50:22:WU02:FS00:Connecting to 171.67.108.45:80
14:50:26:WU00:FS00:Upload complete
14:50:27:WU00:FS00:Server responded WORK_ACK (400)
14:50:27:WU00:FS00:Cleaning up
////////////////////////////////////////////////////////////////////////////////
02:02:04:******************************** Build ********************************
02:02:04:      Version: 7.4.4
02:02:04:         Date: Mar 4 2014
02:02:04:         Time: 20:26:54
02:02:04:      SVN Rev: 4130
02:02:04:       Branch: fah/trunk/client
02:02:04:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
02:02:04:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
02:02:04:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
02:02:04:     Platform: win32 XP
02:02:04:         Bits: 32
02:02:04:         Mode: Release
02:02:04:******************************* System ********************************
02:02:04:          CPU: Intel(R) Core(TM) i7-3930K CPU @ 3.20GHz
02:02:04:       CPU ID: GenuineIntel Family 6 Model 45 Stepping 7
02:02:04:         CPUs: 12
02:02:04:       Memory: 15.92GiB
02:02:04:  Free Memory: 13.81GiB
02:02:04:      Threads: WINDOWS_THREADS
02:02:04:   OS Version: 6.2
02:02:04:  Has Battery: false
02:02:04:   On Battery: false
02:02:04:   UTC Offset: -6
02:02:04:          PID: 2948
02:02:04:          CWD: D:/ProgramData/FAHClient
02:02:04:           OS: Windows 10 Pro
02:02:04:      OS Arch: AMD64
02:02:04:         GPUs: 2
02:02:04:        GPU 0: NVIDIA:7 GP102 [GeForce GTX 1080 Ti] 11380
02:02:04:        GPU 1: NVIDIA:7 GP102 [GeForce GTX 1080 Ti] 11380
02:02:04:         CUDA: 6.1
02:02:04:  CUDA Driver: 8000
02:02:04:Win32 Service: false
02:02:04:***********************************************************************
11:59:34:WU01:FS00:0x21:*********************** Log Started 2017-10-11T11:59:33Z ***********************
11:59:34:WU01:FS00:0x21:Project: 9441 (Run 2, Clone 40, Gen 0)
11:59:34:WU01:FS00:0x21:Unit: 0x00000005ab436c9d56af1b286e2040f7
11:59:34:WU01:FS00:0x21:CPU: 0x00000000000000000000000000000000
11:59:34:WU01:FS00:0x21:Machine: 0
11:59:34:WU01:FS00:0x21:Reading tar file core.xml
11:59:34:WU01:FS00:0x21:Reading tar file integrator.xml
11:59:34:WU01:FS00:0x21:Reading tar file state.xml
11:59:34:WU01:FS00:0x21:Reading tar file system.xml
11:59:34:WU01:FS00:0x21:Digital signatures verified
11:59:34:WU01:FS00:0x21:Folding@home GPU Core21 Folding@home Core
11:59:34:WU01:FS00:0x21:Version 0.0.18
11:59:39:WU03:FS00:Upload 16.25%
11:59:43:WU01:FS00:0x21:ERROR:Discrepancy: Forces are blowing up! 1433 0
11:59:43:WU01:FS00:0x21:Saving result file logfile_01.txt
11:59:43:WU01:FS00:0x21:Saving result file log.txt
11:59:43:WU01:FS00:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
11:59:43:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
11:59:43:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:9441 run:2 clone:40 gen:0 core:0x21 unit:0x00000005ab436c9d56af1b286e2040f7
11:59:43:WU01:FS00:Uploading 6.50KiB to 171.67.108.157
11:59:43:WU01:FS00:Connecting to 171.67.108.157:8080
11:59:44:WU02:FS00:Connecting to 171.67.108.45:80
11:59:44:WU01:FS00:Upload complete
11:59:44:WU01:FS00:Server responded WORK_ACK (400)
11:59:44:WU01:FS00:Cleaning up

Code: Select all

ProjectID	ProjectRun	ProjectClone	ProjectGen	Name	FramesCompleted	FrameTime	Result	DownloadDateTime	CompletionDateTime
9441	12	3	386	Foldit-1-EVGA-1080Ti Slot 00	100	00:00:50	FINISHED_UNIT	10-10-17 19:38	10-10-17 21:06
9441	10	9	276	Foldit-2-EVGA-1080Ti-SC Slot 00	100	00:00:50	FINISHED_UNIT	10-11-17 02:45	10-11-17 04:13
9441	11	11	176	Foldit-2-EVGA-1080Ti Slot 00	100	00:00:51	FINISHED_UNIT	10-11-17 03:34	10-11-17 05:04
9441	2	40	0	Foldit-2-EVGA-1080Ti Slot 00	0	00:00:00	BAD_WORK_UNIT	10-11-17 11:58	10-11-17 12:02
9441	23	43	0	Foldit-2-EVGA-1080Ti-SC Slot 01	0	00:00:00	BAD_WORK_UNIT	10-11-17 13:46	10-11-17 13:50
9441	14	8	386	Foldit-2-EVGA-1080Ti Slot 01	100	00:00:51	FINISHED_UNIT	10-11-17 12:22	10-11-17 13:52
9441	37	44	0	Foldit-1-EVGA-1080Ti Slot 00	0	00:00:00	BAD_WORK_UNIT	10-11-17 14:48	10-11-17 14:53
Last edited by bcavnaugh on Wed Oct 11, 2017 7:27 pm, edited 1 time in total.
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: FAULTY project:9441 Forces are blowing up! 33

Post by bruce »

bcavnaugh wrote: I guess

Code: Select all

 {/code] is not working ATM.
[/quote]

Yes, it is, but you have turned it off in your user profile.

Uncheck the "Disable BBCode" setting.

You can unckeck that same setting for this particular post by editing the post and scrolling to the bottom.

Yes, Project: 9441 (Run 2, Clone 40, Gen 0) is a bad WU, but the only way to the servers to differentiate a bad WU from a good one running on an unstable system is to reassign it to someone else.  The trajectory will be suspended.

Edit: Project: 9441 (Run 37, Clone 44, Gen 0), too.
Top
bcavnaugh
Posts: 147
Joined: Tue Apr 30, 2013 1:39 pm

Re: FAULTY project:9441 Forces are blowing up! 33

Post by bcavnaugh »

bruce wrote:
bcavnaugh wrote: I guess {code][/code} is not working ATM.
Yes, it is, but you have turned it off in your user profile.

Uncheck the "Disable BBCode" setting.

You can unckeck that same setting for this particular post by editing the post and scrolling to the bottom.

Yes, Project: 9441 (Run 2, Clone 40, Gen 0) is a bad WU, but the only way to the servers to differentiate a bad WU from a good one running on an unstable system is to reassign it to someone else. The trajectory will be suspended.
My Systems are Very Stable to note, and I am not a Miner.
Thanks, it must be off by default then.
Good to Go now, Thanks.

Code: Select all

test
Top
Joe_H
Site Admin
Posts: 7943
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: FAULTY project:9441 Forces are blowing up! 33

Post by Joe_H »

The investigator running this project is aware of this and is looking into the problem.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Top
bcavnaugh
Posts: 147
Joined: Tue Apr 30, 2013 1:39 pm

Re: FAULTY project:9441 Forces are blowing up! 33

Post by bcavnaugh »

Joe_H wrote:The investigator running this project is aware of this and is looking into the problem.
Thank you,
Top
cxh
Pande Group Member
Posts: 126
Joined: Thu Jan 23, 2014 1:16 am
Location: Stanford, CA
Contact:
Contact cxh

Re: FAULTY project:9441 Forces are blowing up! 33

Post by cxh »

Sorry, this was my mistake! The project 9441 and 9442 were never meant to go live.
Top
Kougar
Posts: 61
Joined: Fri Apr 11, 2008 2:39 am
Hardware configuration: Core i7 920 @ 4.3GHz 1.42v (HT on)
Gigabyte GA-X58-UD5 (F10)
3 x 2GB OCZ Platinum 16400MHz 8-8-8-24 1T
EVGA GTX 260 w/ D-Tek Fuzion 2 GFX
ASUS Xonar DX | Cooler Master UCP 1kW
Intel X25-M 80GB SSD | Windows 7 x64
Swiftech Apogee GTZ + MCP655 Pump & Thermochill PA120.3 Radiator
Location: Texas

Re: FAULTY project:9441 Forces are blowing up! 33

Post by Kougar »

cxh wrote:Sorry, this was my mistake! The project 9441 and 9442 were never meant to go live.
No problem, stuff happens!

That being said, this makes the third time this year that I know of where one, or multiple projects were unintentionally released to general distribution. Perhaps Pande Group needs to add an additional safety check to the process. :eugeek:
Top
Post Reply

Return to “Issues with a specific WU”