issue with Work Server "171.64.65.103 vspg3v2"

Moderators: Site Moderators, FAHC Science Team

Post Reply
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

issue with Work Server "171.64.65.103 vspg3v2"

Post by GreyWhiskers »

I copied my previous post to a new thread re: the 171.64.65.103 server.

Latest Server Stats (Tue Mar 20 10:00:00 PST 2012) "

Code: Select all

#    Server IP    Name    Who    Client  Status Connect   CPU    Net   Fin   DL   Diff  WUs    WUs   WUs 
                                                          Load   Load  Wait       Time  Avail To Go  Wait  
31  171.64.65.10 vspg3v2 densign GPU     full   Accepting   1.54   13   0    109   0    277    168   9443        



% Ass  % Ass % Ass % Ass WUs  WU E S   CS  NMJ  80    OS_Weight_Program_Port
          80    G    PS  Rcv
               401       16    10  1       3325  1    W_2_I_8080G; 
                                                      W_1_B_8080G; 
                                                      W_1_A_8080G; 
                                                      W_1_F_8080G
Anomalies with some of the values:
401: % Assigned G - could this represent an extremely large number of unsuccessful hits on the WS based on assignments?
3325: NMJ, or No More Jobs flag. I've seen this before as either zero or one. What's 3325??


GreyWhiskers wrote:My guess is that it is still/again an issue with the Work Server "171.64.65.103 vspg3v2".

I posted Sunday nightthat I had been having similar issues with getting that work server to a) accept uploads of finished ATI GPU WUs; and b) download new WUs after being assigned by the Assignment server. Note that as far as I can tell (see end of this post), this is NOT and was not one of the servers announced by yslin on Saturday as being down.

Here's what is currently happening with my "Old Style" ATI GPU client.

I finally got an assignment for a new work unit on 2012-03-20 @ 02:56 GMT. project:4724 run:4 clone:466 gen:69. This completed in about 7.5 hours at 10:31 GMT. It is currently 17:01 GMT.

Initially, I got the following failure upon attempt to get a new WU - this happened repeatedly:
10:31:28:WU00:FS01:Connecting to assign-GPU.stanford.edu:80
10:31:28:WU00:FS01:News: Welcome to Folding@Home
10:31:28:WU00:FS01:Assigned to work server 171.64.65.103
10:31:28:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:"RV730 Pro AGP [Radeon HD 4600 Series]" from 171.64.65.103
10:31:28:WU00:FS01:Connecting to 171.64.65.103:8080
10:31:28:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
Then, it seems the Assignment Server quit banging 171.64.65.103, and has stopped handing out assignments.
13:58:22:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
13:58:22:WU01:FS01:News: Welcome to Folding@Home
13:58:22:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:80': Empty work server assignment
13:58:22:WU01:FS01:Connecting to assign-GPU.stanford.edu:8080
13:58:22:WU01:FS01:News: Welcome to Folding@Home
13:58:22:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:8080': Empty work server assignment
13:58:22:ERROR:WU01:FS01:Exception: Could not get an assignment
16:01:22:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
16:01:22:WU01:FS01:News: Welcome to Folding@Home
[EDIT] After almost two hours, I goosed the V7 client to retry a download (pause/fold the GPU slot). It's back to the assignment server assigning to work server 171.64.65.103 - but the work server seems to be sending a corrupt response (zero bytes).
17:57:24:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
17:57:24:WU01:FS01:News: Welcome to Folding@Home
17:57:24:WU01:FS01:Assigned to work server 171.64.65.103
17:57:24:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:"RV730 Pro AGP [Radeon HD 4600 Series]" from 171.64.65.103
17:57:24:WU01:FS01:Connecting to 171.64.65.103:8080
17:57:24:ERROR:WU01:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
==================================================
Server Stats Report initiated on Tue Mar 20 08:20:01 PST 2012.
31 171.64.65.103 vspg3v2 densign GPU full Accepting 1.28 14 0 109 0 173 64 9363 260 48 0 1 0 1 W_2_I_8080G; W_1_B_8080G; W_1_A_8080G; W_1_F_8080G

Translation of some of the status columns:
full/Accepting: Ostensibly completely normal mode
260: % Assigned G (??? how can a percentage be over 100?)
173: WUs Available.
vspg3v2: Server name. So far as I can tell, this was not one of those involved in the last "server offline" post by yslin on Saturday (which announcement has not been updated). BTW, I've listed the current status for the vsp11v and vsp05s servers. Interesting that the vsp05d seems "full/accepting" while the others are in reject.
vsp05's and vsp11v offline
by yslin » Sat Mar 17, 2012 10:04 am

Two drives failed on the vsp05 machine and we are working on getting it back online and restoring the data. Sorry and thanks!
40 171.67.108.20 vsp11v lin5 GPU full Reject 0.00 0 0 999 0 0 0 0 0 0 1 0 0 W_1000_B_8080G
41 171.67.108.31 vsp05a lin5 GPU full Reject 0.00 0 0 999 0 0 0 0 0 0 1 0 0 W_500_F_8080G
42 171.67.108.32 vsp05b lin5 GPU full Reject 0.00 0 0 999 0 0 0 0 0 0 1 0 0 W_1_F_8080G
44 171.67.108.44 vsp05d lin5 GPU full Accepting 0.00 0 0 999 0 14662 14662 14662 37 17 0 1 0 1 W_100_F_8080G; W_100_A_8080G
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

Re: issue with Work Server "171.64.65.103 vspg3v2"

Post by GreyWhiskers »

Update: the server seems to be back up now - it just downloaded a project:4756.
17:59:01:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
17:59:01:WU01:FS01:News: Welcome to Folding@Home
17:59:01:WU01:FS01:Assigned to work server 171.64.65.103
17:59:01:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:"RV730 Pro AGP [Radeon HD 4600 Series]" from 171.64.65.103
17:59:01:WU01:FS01:Connecting to 171.64.65.103:8080
17:59:01:WU01:FS01:Downloading 84.24KiB
17:59:01:WU01:FS01:Download complete
17:59:01:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:4756 run:7 clone:985 gen:56 core:0x11 unit:0x6638b9174f68c559003803d900071294
17:59:01:WU01:FS01:Starting
The server stats don't seem materially different in the Tue Mar 20 10:50:00 PST 2012 update, but it is now working. Miracles of miracles. (sorry I didn't format the server stats. That's really too much of a hassle to do properly like I did in the earlier post. )

1 171.64.65.103 vspg3v2 densign GPU full Accepting 1.33 6 0 109 0 181 72 9392 318 309 161 1 3951 1 W_2_I_8080G; W_1_B_8080G; W_1_A_8080G; W_1_F_8080G
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

Re: issue with Work Server "171.64.65.103 vspg3v2"

Post by GreyWhiskers »

It looks the work server for the old ATI pre-HD5xxx GPUs has run out of work - my slot for my HD4670 AGP GPU had just finished up a P4724, then ran into this string of inability to get assignments.

Code: Select all

23:47:13:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
23:47:14:WU01:FS01:News: Welcome to Folding@Home
23:47:14:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:80': Empty work server assignment
23:47:14:WU01:FS01:Connecting to assign-GPU.stanford.edu:8080
23:47:14:WU01:FS01:News: Welcome to Folding@Home
23:47:14:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:8080': Empty work server assignment
23:47:14:ERROR:WU01:FS01:Exception: Could not get an assignment
23:48:51:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
23:48:51:WU01:FS01:News: Welcome to Folding@Home
23:48:51:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:80': Empty work server assignment
23:48:51:WU01:FS01:Connecting to assign-GPU.stanford.edu:8080
23:48:51:WU01:FS01:News: Welcome to Folding@Home
23:48:51:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:8080': Empty work server assignment
23:48:51:ERROR:WU01:FS01:Exception: Could not get an assignment
23:51:28:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
23:51:28:WU01:FS01:News: Welcome to Folding@Home
23:51:28:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:80': Empty work server assignment
23:51:28:WU01:FS01:Connecting to assign-GPU.stanford.edu:8080
23:51:28:WU01:FS01:News: Welcome to Folding@Home
23:51:28:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:8080': Empty work server assignment
23:51:28:ERROR:WU01:FS01:Exception: Could not get an assignment
23:55:42:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
23:55:42:WU01:FS01:News: Welcome to Folding@Home
23:55:42:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:80': Empty work server assignment
23:55:42:WU01:FS01:Connecting to assign-GPU.stanford.edu:8080
23:55:42:WU01:FS01:News: Welcome to Folding@Home
23:55:42:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:8080': Empty work server assignment
23:55:42:ERROR:WU01:FS01:Exception: Could not get an assignment
00:02:34:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
00:02:34:WU01:FS01:News: Welcome to Folding@Home
00:02:34:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:80': Empty work server assignment
00:02:34:WU01:FS01:Connecting to assign-GPU.stanford.edu:8080
00:02:34:WU01:FS01:News: Welcome to Folding@Home
00:02:34:WARNING:WU01:FS01:Failed to get assignment from 'assign-GPU.stanford.edu:8080': Empty work server assignment
00:02:34:ERROR:WU01:FS01:Exception: Could not get an assignment
I looked at the Server status (see below) and see that the number of WUs available had shrunk from almost 1100 at Thu Apr 5 06:40:00 PDT 2012 to 85 on Thu Apr 12 16:40:00 PDT 2012.

We'll have to see what transpires.

Code: Select all

Report initiated on Thu Apr 12 16:40:00 PDT 2012.
                                                               # WUs    #WUs    %Assgned  WUs 
                                                                AVail   Waiting   G      Rcvd
171.64.65.103 vspg3v2 densign GPU full Accepting 1.28  3 0 62 0 85 85   15511    37       127		
GreyWhiskers
Posts: 660
Joined: Mon Oct 25, 2010 5:57 am
Hardware configuration: a) Main unit
Sandybridge in HAF922 w/200 mm side fan
--i7 2600K@4.2 GHz
--ASUS P8P67 DeluxeB3
--4GB ADATA 1600 RAM
--750W Corsair PS
--2Seagate Hyb 750&500 GB--WD Caviar Black 1TB
--EVGA 660GTX-Ti FTW - Signature 2 GPU@ 1241 Boost
--MSI GTX560Ti @900MHz
--Win7Home64; FAH V7.3.2; 327.23 drivers

b) 2004 HP a475c desktop, 1 core Pent 4 HT@3.2 GHz; Mem 2GB;HDD 160 GB;Zotac GT430PCI@900 MHz
WinXP SP3-32 FAH v7.3.6 301.42 drivers - GPU slot only

c) 2005 Toshiba M45-S551 laptop w/2 GB mem, 160GB HDD;Pent M 740 CPU @ 1.73 GHz
WinXP SP3-32 FAH v7.3.6 [Receiving Core A4 work units]
d) 2011 lappy-15.6"-1920x1080;i7-2860QM,2.5;IC Diamond Thermal Compound;GTX 560M 1,536MB u/c@700;16GB-1333MHz RAM;HDD:500GBHyb w/ 4GB SSD;Win7HomePrem64;320.18 drivers FAH 7.4.2ß
Location: Saratoga, California USA

Re: issue with Work Server "171.64.65.103 vspg3v2"

Post by GreyWhiskers »

Back up again - Server Stat shows 128 WUs available.

Code: Select all

00:31:36:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
00:31:36:WU01:FS01:News: Welcome to Folding@Home
00:31:36:WU01:FS01:Assigned to work server 171.64.65.103
00:31:36:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:"RV730 Pro AGP [Radeon HD 4600 Series]" from 171.64.65.103
00:31:36:WU01:FS01:Connecting to 171.64.65.103:8080
00:31:36:WU01:FS01:Downloading 84.20KiB
00:31:37:WU01:FS01:Download complete
00:31:37:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:4756 run:0 clone:999 gen:87 core:0x11 unit:0x1fbbb2014f8773d6005703e700001294
bruce
Posts: 20822
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: issue with Work Server "171.64.65.103 vspg3v2"

Post by bruce »

GreyWhiskers wrote:It looks the work server for the old ATI pre-HD5xxx GPUs has run out of work - my slot for my HD4670 AGP GPU had just finished up a P4724, then ran into this string of inability to get assignments. . . .
The projects for the old, old ATI pre-HD5xxx GPUs are winding down. In terms of GPU generations, that hardware is getting pretty old. At some point "soon," those projects will finish and that hardware will be deprecated in favor of newer, more powerful hardware. I think it's reasonable to predict that work-shortages for the brook-based ATI core will become more frequent and will be of longer and longer duration.

Reporting the problem is still worthwhile, but if somebody processing a WU returns it or a lost WU expires, it may resolve the issue, too.
Post Reply