Page 1 of 1
What, exactly, gets uploaded as a completed WU?
Posted: Thu Apr 09, 2020 6:10 pm
by kencl
I had a WU which would not upload for days (now successfully uploaded) so I made a copy of the entire FAHClient dir and was reading through some of the data files. That's just what coders do when they are told to stay home.
Is the data which is actually uploaded compressed either before upload or on the fly? I'm not finding any files which match the smaller upload size reported in the log.
I'd like to know exactly which file(s) is/are uploaded and what processing is done before they are transmitted because I see over 10% redundancy in the viewerFrame#.json files.
Thanks.
Re: What, exactly, gets uploaded as a completed WU?
Posted: Thu Apr 09, 2020 10:41 pm
by Joe_H
If you read the section of the log just after a WU reaches 100%, the client echoes that it is reading a series of files, those are packed up wit the wu data file. As I understand it, they are compressed before sending.
The downloaded WU is also compressed. Part of the logged messages in the client's log used to show the decompressed size, and the same for compressing the results. But that was removed form logging several versions ago.
Re: What, exactly, gets uploaded as a completed WU?
Posted: Thu Apr 09, 2020 11:16 pm
by PantherX
At the completion of the WU, everything is packed into a single file that's created called wuresult_XX.dat which is uploaded to the server. Here's the log snippet showing that:
Code: Select all
19:35:20:WU01:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
19:35:22:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
19:35:22:WU01:FS01:0x22:Saving result file checkpointState.xml
19:35:22:WU01:FS01:0x22:Saving result file checkpt.crc
19:35:22:WU01:FS01:0x22:Saving result file positions.xtc
19:35:22:WU01:FS01:0x22:Saving result file science.log
19:35:22:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
19:35:23:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:35:23:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11778 run:0 clone:8750 gen:19 core:0x22 unit:0x00000023287234c95e7432494a58a618
19:35:23:WU01:FS01:Uploading 23.04MiB to 40.114.52.201