Page 2 of 2
Re: Recent WUs are too large to upload
Posted: Thu Feb 25, 2021 6:30 pm
by Joe_H
I have checked my logs for Project 17219, the upload size has varied from about 83 MB to about 92 MB. This is without any errors showing up in the runs, and whether or not the WU was paused. In fact the WU processed on my laptop where it was paused during the daytime sent one of those 83 MB results files. The download size is just over 31 MB.
Re: Recent WUs are too large to upload
Posted: Thu Feb 25, 2021 8:57 pm
by comixgoddess
Neil-B wrote:I'd check what size my uploads for that project are but my server is down for rebuild at the moment so haven't got access to those logs ... If someone else spots this ad is running 17219 wus then perhaps they could confirm the upload sizes they are seeing?
My last 17219 unit downloaded at 31.24MiB; the upload was 83.58MiB and took just over two minutes to upload successfully. This unit was run on my laptop without pausing.
Re: Recent WUs are too large to upload
Posted: Thu Feb 25, 2021 9:43 pm
by Neil-B
... thanks both ... so yup - the OP is right and this project is just shipping large uploads as standard ... fingers crossed Joe_H's engagement with the researcher pays dividends (and the flag still works as hoped?)
Re: Recent WUs are too large to upload
Posted: Thu Feb 25, 2021 10:36 pm
by bruce
Neil-B wrote:I think what bruce was getting at wasn't the upload failing but questioning if during the course of processing these larger upload wus there were any errors that the client/core managed ... When an error occurs mid wu and the core can correct it then the error reports can significantly inflate the size of the final package ... Pausing a wu many times can sometimes have the same effect.
Right.
The upload package includes compressed versions of the logs as well as shapshots of the atoms. The researcher is responsible for the number of atoms and the number of snapshots.
The logs can grow quite significantly if there are a lot of errors reported or a lot of Pause/Unpause steps and that's something you might be able to manage.
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 12:33 am
by Markus_Laker
Thanks to everyone. I appreciate your engagement and help.
The most common reason I pause the folding process is if I have to reboot the PC in order to discard an over-sized WU. My workflow is:
Code: Select all
cd /var/lib/fahclient/work
sudo mv 02 hide-02 # or whichever number it happens to be
sudo shutdown -r now
If there's a way to interrupt an upload without rebooting, I haven't found it. In particular,
seems not to do it.
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 10:17 am
by bruce
Markus_Laker wrote:Thanks to everyone. I appreciate your engagement and help.
If there's a way to interrupt an upload without rebooting, I haven't found it. In particular,
seems not to do it.
Which version of Linux are you running?
Please post the top ~100 lines of FAH's log.txt
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 11:25 am
by bruce
We need a better way to manage big WUs for people who have an internet connections that uploads slower than most others. We still have a percentage of Donors on DSL or slower.
(I suffered with a slow connection for a long time.)
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 4:04 pm
by Joe_H
bruce wrote:We need a better way to manage big WUs for people who have an internet connections that uploads slower than most others. We still have a percentage of Donors on DSL or slower.
(I suffered with a slow connection for a long time.)
True, and it is not just DSL. There are residential cable internet connections still that haven low limits on upload speed, 25 mbps down but under 5 mbps up. There are also people on metered wireless services.
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 10:06 pm
by Markus_Laker
I wish! Right now, I have 14Mbps down and 444kbps up. But I have to share that with my wife, who does several hours a day of video conferences for her business, and I also need it for my work PC's connection to the office. And this is the fastest I can get from any ISP, at any price.
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 10:34 pm
by Neil-B
Daft question but have you checked out Starlink ... Still early days but they have beta up and running I think in some areas ... ours here in UK is slated for autumn this year .. and it might not work due to field of view reqs in your area but I mention it just in case you hadn't considered them - it was your "at any price" that made me think of them !!
Re: Recent WUs are too large to upload
Posted: Fri Feb 26, 2021 10:41 pm
by bruce
Most people send tiny bursts of responses at 0.44Mbps and it may be adequate for you to converse with web servers that can talk to you at 14Mbps.
For anybody who has better bandwidth UP you can get this project if you configure max-packet=big. Without that setting, you won't get that project ... which is only a problem for the project owner.
Re: Recent WUs are too large to upload
Posted: Sun Mar 21, 2021 4:53 pm
by Markus_Laker
Apologies for necroposting. Joe_H, would you mind having a word with the researcher behind project 17220, please?
Code: Select all
16:38:15:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:17220 run:6863 clone:0 gen:1 core:0xa7 unit:0x00000000000000010000434400001acf
16:38:15:WU03:FS01:Uploading 31.77MiB to 206.223.170.146
Many thanks!