What, exactly, gets uploaded as a completed WU?

Moderators: Site Moderators, FAHC Science Team

Post Reply
kencl
Posts: 3
Joined: Thu Apr 09, 2020 5:15 am

What, exactly, gets uploaded as a completed WU?

Post by kencl »

I had a WU which would not upload for days (now successfully uploaded) so I made a copy of the entire FAHClient dir and was reading through some of the data files. That's just what coders do when they are told to stay home. :)

Is the data which is actually uploaded compressed either before upload or on the fly? I'm not finding any files which match the smaller upload size reported in the log.

I'd like to know exactly which file(s) is/are uploaded and what processing is done before they are transmitted because I see over 10% redundancy in the viewerFrame#.json files.

Thanks.
Joe_H
Site Admin
Posts: 7937
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: What, exactly, gets uploaded as a completed WU?

Post by Joe_H »

If you read the section of the log just after a WU reaches 100%, the client echoes that it is reading a series of files, those are packed up wit the wu data file. As I understand it, they are compressed before sending.

The downloaded WU is also compressed. Part of the logged messages in the client's log used to show the decompressed size, and the same for compressing the results. But that was removed form logging several versions ago.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: What, exactly, gets uploaded as a completed WU?

Post by PantherX »

At the completion of the WU, everything is packed into a single file that's created called wuresult_XX.dat which is uploaded to the server. Here's the log snippet showing that:

Code: Select all

19:35:20:WU01:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
19:35:22:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
19:35:22:WU01:FS01:0x22:Saving result file checkpointState.xml
19:35:22:WU01:FS01:0x22:Saving result file checkpt.crc
19:35:22:WU01:FS01:0x22:Saving result file positions.xtc
19:35:22:WU01:FS01:0x22:Saving result file science.log
19:35:22:WU01:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
19:35:23:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:35:23:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11778 run:0 clone:8750 gen:19 core:0x22 unit:0x00000023287234c95e7432494a58a618
19:35:23:WU01:FS01:Uploading 23.04MiB to 40.114.52.201
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Post Reply