Page 13 of 23

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Wed Dec 23, 2009 4:50 pm
by rhavern
Firstly, I'm a muppet. I put the fixed fci-update-xml-files.pl in the wrong place. :oops:
Secondly, no I hadn't done the 1.5.1 upgrade as I didn't have any team 0 issues. I didn't realize you had other fixes in that release. As a result I've done the 1.5.1, fci-update-xml-files.pl and fci-update-jmol-projects.pl updates, hopefully in the correct place this time :lol:

Thanks for your help and patience.

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Wed Dec 23, 2009 5:34 pm
by smoking2000
If you put the new fci-update-xml-files.pl in the same location where it was installed (/usr/local/bin by default) all should be well.

It's good to hear this problem was a PEBKAC, it saves me from making an fci-1.5.2 release backporting all relevant changes from the 1.6 branch. I hope to be able to work on this in the upcoming Christmas days :)

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Wed Dec 23, 2009 10:10 pm
by rhavern
Many thanks for your help and your software, you are my ShorDurPerSav. Looking forward to the next release! :-)

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 1:12 pm
by rhavern
I looked over the errors that I posted about a little while ago, and this one still exists on every update:

Code: Select all

Updating MacOS X Binary (bin_darwin_universal) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd ... Modified!
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd ... Failed!
Error: Failed to retrieve URL! (http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd)
Server returned: 500 read failed: Connection reset by peer
Seems unlikely to be your connection every time. Just FYI.

(Still looking forward to 1.6!)

I thought this might be useful as well:

Code: Select all

qd Files
Name	File	Size	Modified	Last Update
Data File	qdinfo.dat	63.92	KB	Mon Dec 28 22:05:02 2009	2009-12-28 22:05:02
Linux Binary	qd	99.53	KB	Mon Dec 28 22:05:06 2009	2009-12-28 22:05:06
Windows Binary	qd.exe	95.00	KB	Mon Dec 28 22:05:03 2009	2009-12-28 22:05:03
FreeBSD Binary	qd.freebsd	95.55	KB	Mon Dec 28 22:05:07 2009	2009-12-28 22:05:07
OpenBSD Binary	qd.openbsd	97.14	KB	Wed Dec 30 10:05:16 2009	2009-12-30 10:05:17
MacOS X Binary	qd.darwin	206.70	KB	Thu Sep 10 18:05:11 2009	2009-09-10 18:05:11

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 3:20 pm
by smoking2000
If you have a content filtering firewall it may choke on the Universal Mac OS X binary which contains two binaries instead of just a single one. This may trigger trojan detection.

What happens if you use wget to download the Universal binary manually? Does it break too, or is it only fci-update-qd-files.pl?

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 3:54 pm
by rhavern
I hope this is the correct URL:

Code: Select all

wget http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd
--2010-01-04 15:46:26--  http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd
Resolving linuxminded.xs4all.nl... 83.163.41.188
Connecting to linuxminded.xs4all.nl|83.163.41.188|:80... connected.
HTTP request sent, awaiting response... Read error (Connection reset by peer) in headers.
Retrying.

--2010-01-04 15:46:28--  (try: 2)  http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd
Connecting to linuxminded.xs4all.nl|83.163.41.188|:80... connected.
HTTP request sent, awaiting response... Read error (Connection reset by peer) in headers.
Retrying.
This repeats ad infinitum...

Unless something has changed my end that I'm not aware of, the FW is pretty basic.

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 9:11 pm
by smoking2000
There is something preventing you from downloading this binary, I cannot reproduce this problem on 3 external hosts.

You may want to try to force download all qd files using: fci-update-qd-files.pl -f -v

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 9:44 pm
by rhavern
I executed the command

Code: Select all

linux-1:/$ /usr/local/bin/fci-update-qd-files.pl -f -v
Updating Data File (data_file) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/source/qdinfo/qdinfo.dat ... Not Modified.
Parameter --force given, downloading anyway.
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/source/qdinfo/qdinfo.dat ... Success
Last-Modified       : Mon, 28 Dec 2009 21:33:50 GMT
Saving file to disk : /var/www/fci/qd-data/qdinfo.dat
Version             : 28 December 2009
Functional Revision : 077
Successfully updated the Data File.

Updating Windows Binary (bin_win32_i386) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/binaries/win32/x86/qd.exe ... Not Modified.
Parameter --force given, downloading anyway.
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/win32/x86/qd.exe ... Success
Last-Modified       : Mon, 28 Dec 2009 21:33:53 GMT
Saving file to disk : /var/www/fci/qd-data/qd.exe
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/win32/x86/version ... Success
Version             : 28 December 2009
Functional Revision : 077
Successfully updated the Windows Binary.

Updating OpenBSD Binary (bin_openbsd_i386) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/binaries/openbsd/x86/qd ... Not Modified.
Parameter --force given, downloading anyway.
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/openbsd/x86/qd ... Success
Last-Modified       : Mon, 28 Dec 2009 22:01:55 GMT
Saving file to disk : /var/www/fci/qd-data/qd.openbsd
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/openbsd/x86/version ... Success
Version             : 28 December 2009
Functional Revision : 077
Successfully updated the OpenBSD Binary.

Updating Linux Binary (bin_linux_i386) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/binaries/linux/x86/qd ... Not Modified.
Parameter --force given, downloading anyway.
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/linux/x86/qd ... Success
Last-Modified       : Mon, 28 Dec 2009 21:33:52 GMT
Saving file to disk : /var/www/fci/qd-data/qd
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/linux/x86/version ... Success
Version             : 28 December 2009
Functional Revision : 077
Successfully updated the Linux Binary.

Updating FreeBSD Binary (bin_freebsd_i386) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/binaries/freebsd/x86/qd ... Not Modified.
Parameter --force given, downloading anyway.
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/freebsd/x86/qd ... Success
Last-Modified       : Mon, 28 Dec 2009 22:02:26 GMT
Saving file to disk : /var/www/fci/qd-data/qd.freebsd
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/freebsd/x86/version ... Success
Version             : 28 December 2009
Functional Revision : 077
Successfully updated the FreeBSD Binary.

Updating MacOS X Binary (bin_darwin_universal) ...
Checking URL for modification: http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd ... Modified!
Downloading URL     : http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd ... Failed!
Error: Failed to retrieve URL! (http://linuxminded.xs4all.nl/software/qd-tools/binaries/darwin/universal/qd)
Server returned: 500 read failed: Connection reset by peer
Still no joy, how odd that just the one fails.

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 9:48 pm
by smoking2000
Do you know at what time your request for the universal binary failed?

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 9:56 pm
by rhavern
It would have been a minute or three before the timestamp on the post, so 2140-2145 GMT.

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Mon Jan 04, 2010 10:23 pm
by smoking2000
OK, then your download failure was after my DSL modem had resynced. Although I stay suspicious of the coincidence.

The version of the Mac OS X binary is very old, which makes me think that the update script never actually updated the binary, nor that it was updated with an FCI upgrade.

You can try copying the qd.darwin binary from the FCI 1.5.1 tarball and force updating the qd files again. A permission issue may have prevented the updates.

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Tue Jan 05, 2010 8:57 am
by rhavern
This is what the file structure looks like:

Code: Select all

rick@linux-1:/var/www/fci/qd-data$ ls -l
total 688
-rwxrwxr-- 1 rick www-data 101916 2010-01-04 21:37 qd
-rwxrwxr-- 1 rick www-data 211664 2009-09-10 18:05 qd.darwin
-rwxrwxr-- 1 rick www-data  97280 2010-01-04 21:37 qd.exe
-rwxrwxr-- 1 rick www-data  97840 2010-01-04 21:37 qd.freebsd
-rw-rw-r-- 1 rick www-data  65457 2010-01-04 21:37 qdinfo.dat
-rwxrwxr-- 1 rick www-data  99476 2010-01-04 21:37 qd.openbsd
The time correlates to the force update I did yesterday. I see no difference in the darwin file?

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Tue Jan 05, 2010 10:30 am
by smoking2000
The permissions look fine, but the modification date of the qd.darwin indicates that it hasn't been updated for months.

The file size matches the Mac OS X Universal binary released released 26 October 2009 (fr 074) and the one released 17 November 2009 (fr 075), but your FCI install shows that the last version it has was released 10 September 2009 (fr 073).

In my webserver logs I see that your last normal qd update was on 24/Sep/2009:06:05:02 +0200, from 24/Sep/2009:07:05:05 +0200 on it has been failing. The update script notices that the OSX qd binary is out of date, downloads it, but fails to save it, so the next update it sees that it needs to update the binary, downloads it, but fails to save it. This cycle repeats ever since.

You currently download 211576 bytes when requesting the Mac OS X Universal binary, which is the file size of the current binary. So you do download the full binary, but after this something goes wrong.

If you have AppArmor enabled, you may want to try to disable it, and try a forced qd update again. This is about the only thing I can think of which may prevent you from downloading the Mac OS X Universal binary, which I don't run into on the systems where I have tested (there, SE Linux and AppArmor are about the first to be disabled). See the Ubuntu AppArmor documentation for the procedure to disable AppArmor.

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Tue Jan 05, 2010 11:03 am
by rhavern
I've deactivated AppArmor and tried again to no avail. On a whim, I tried to get the file using a web browser, which worked fine. Using wget or curl at the CLI always fails. Is there a funky redirect for that URL on your server?

Re: FCI: Folding@Home Client Info (Web based client monitor)

Posted: Tue Jan 05, 2010 11:23 am
by smoking2000
There is no redirection for this site on my server. I saw your requests in my access.log, and the only incorrect ones were for the darwin/universal directory which is not viewable because I disallow Indexes.

I'm at a loss what's going wrong on your end, if you know how to work with wireshark you may want to sniff the requests to see if you can find anything on the network level that prevents wget/curl/LWP from downloading the binary where ELinks and Firefox work just fine.

As long as you don't need automatic qd updates on Mac OS X clients that you monitor with FCI this issue is not really a problem, so I think it's safe to ignore it.