Folding is not fun right now - lots of trouble, no result

It seems that a lot of GPU problems revolve around specific versions of drivers. Though AMD has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by _r2w_ben »

ThWuensche wrote:Here is the output of rocm-smi -a. GPU 0 and GPU2 have been paused, GPU 1 and GPU 3 are each running 16918 WUs at a little over 110000PPD.
rocm-smi is a just moment in time but the reported numbers are interesting.
Temperature: GPU 1 and 3 are warmer
fclck/socclk: GPU 2 and 3 are higher
Average Graphics Package Power: GPU 1,2,3 are higher
GPU use: All 0s
GPU memory use: All 0s
Voltage: GPU 3 is active

If you pause the slot that should be GPU 1, do all the readings on GPU 3 stay higher than the other GPUs? How does 169818 perform when only one slot is active?
Top
muziqaz
Posts: 952
Joined: Sun Dec 16, 2007 6:22 pm
Hardware configuration: 9950x, 7950x3D, 5950x, 5800x3D
7900xtx, Radeon 7, 5700xt, 6900xt, RX 550 640SP
Location: London
Contact:
Contact muziqaz

Re: Folding is not fun right now - lots of trouble, no resul

Post by muziqaz »

OK, here is a theory and I might be off. I had some issues with fahcontrol mixing up the devices and opencl devices. I have 2 GPUs in one system, and for some reason one day fahcontrol decided that Device 0 is OpenCL device 1, and Device 1 is opencl device 0. So In turn I had to set
OpenCL Index to 1 on primary card (Device 0), and
OpenCL Index to 0 on second card (Device 1).
In reality it SHOULD be Device 0 has OpenCL Index set to 0, and Device 1 has OpenCL Index set to 1.

I'm not sure if that is the case here, but food for thought :)
FAH Omega tester
Top
ThWuensche
Posts: 79
Joined: Fri May 29, 2020 4:10 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by ThWuensche »

I paused everything besides one GPU slot running 16918. Attached is the output of rocm-smi, 100 runs with 1s sleep. It seems the GPU is idle most of the time. I have (after taking the rocm-smi log) reduced the configured GPU slots to two, since for now I have the impression that the other two boxes with only two GPUs run these WUs slightly above 1mPPD -> no change. The interesting thing is that other WU-types (besides the 13420s, which mostly have problems on all of the boxes) have been and are running without trouble.

As for the package temperatures, differences there might be a result of the physical setup.

Next step of debugging would be to physically take out two GPUs and see what happens. However the boxes are in Germany and I'm right now in Ukraine, 1250km away. So that is nothing I could do in the next time. So hope for WUs my systems do like.

Code: Select all

Sa 8. Aug 18:03:53 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  22.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:03:54 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  60.0W   1684Mhz  801Mhz  20.78%  auto  250.0W    0%   90%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    37.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:03:55 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:03:56 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  18.82%  auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:03:57 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  214.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   93%   
1    29.0c  22.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:03:58 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:03:59 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    30.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:00 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  49.0W   1802Mhz  801Mhz  20.78%  auto  250.0W    0%   99%   
1    28.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:01 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  100.0W  1802Mhz  801Mhz  20.78%  auto  250.0W    0%   92%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:02 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:03 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  82.0W   1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   88%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:04 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  25.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   31%   
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:05 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:06 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  217.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   96%   
1    29.0c  23.0W   809Mhz   351Mhz   18.82%  auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:07 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:08 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   2%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:09 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:10 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:12 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    40.0c  92.0W   1547Mhz  801Mhz  20.78%  auto  250.0W    0%   56%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:13 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    37.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:14 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:15 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:16 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:17 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  171.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   87%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:18 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    28.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:19 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  22.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:20 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  69.0W   1802Mhz  801Mhz  20.78%  auto  250.0W    0%   85%   
1    29.0c  22.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:21 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:22 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   4%    


Sa 8. Aug 18:04:23 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  187.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   91%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:24 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:25 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  18.82%  auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:26 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:27 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:28 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:29 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:30 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:31 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:33 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:34 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:35 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:36 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:37 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   1%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:38 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:39 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:40 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    40.0c  117.0W  1684Mhz  801Mhz  20.78%  auto  250.0W    0%   92%   
1    29.0c  24.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   10%   
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:41 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:42 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    28.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:43 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:44 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  103.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   93%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:45 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:46 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:47 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  106.0W  1802Mhz  801Mhz  20.78%  auto  250.0W    0%   96%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:48 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  184.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   93%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   1%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:49 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:50 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  198.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   93%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:51 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:52 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:53 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:55 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:56 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:57 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  197.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   88%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:58 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:04:59 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  133.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   93%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:00 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  20.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   12%   
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:01 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  25.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   19%   
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:02 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    40.0c  137.0W  1802Mhz  801Mhz  20.78%  auto  250.0W    0%   90%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:03 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  67.0W   1547Mhz  801Mhz  20.78%  auto  250.0W    0%   88%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:04 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  111.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   92%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:05 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:06 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  79.0W   1802Mhz  801Mhz  20.78%  auto  250.0W    0%   99%   
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:07 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:08 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:09 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  66.0W   1547Mhz  801Mhz  20.78%  auto  250.0W    0%   88%   
1    28.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:10 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  81.0W   1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   88%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   2%    


Sa 8. Aug 18:05:11 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:12 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:13 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  193.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   91%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:15 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  174.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   91%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:16 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  22.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:17 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:18 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:19 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:20 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:21 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  195.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   87%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   12%   
2    35.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:22 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:23 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   1547Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   1%    
3    30.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:24 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:25 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   1547Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:26 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:27 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:28 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  143.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   93%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:29 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    36.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:30 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:31 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  154.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   95%   
1    29.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:32 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  17.0W   701Mhz  801Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:33 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    30.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:34 CEST 2020
GPU  Temp   AvgPwr  SCLK     MCLK     Fan     Perf  PwrCap  VRAM%  GPU%  
0    42.0c  108.0W  1802Mhz  1001Mhz  20.78%  auto  250.0W    0%   90%   
1    28.0c  23.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz   351Mhz   20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz   351Mhz   20.0%   auto  250.0W    0%   0%    

Sa 8. Aug 18:05:35 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    


Sa 8. Aug 18:05:37 CEST 2020
GPU  Temp   AvgPwr  SCLK    MCLK    Fan     Perf  PwrCap  VRAM%  GPU%  
0    41.0c  17.0W   701Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
1    29.0c  23.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%    
2    35.0c  21.0W   809Mhz  351Mhz  20.78%  auto  250.0W    0%   0%    
3    31.0c  20.0W   809Mhz  351Mhz  20.0%   auto  250.0W    0%   0%
Top
ThWuensche
Posts: 79
Joined: Fri May 29, 2020 4:10 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by ThWuensche »

Things get even more confusing. In the moment I have four 16918 WUs on the system, two of them run at approx 105kPPD (16918,147,83,11 and 16918,84,91,5), one at 497kPPD (16918,133,23,14), one at 767kPPD (16918,64,21,11). So it can not be only the system setup with four Radeon VII, it somehow has to be related to the WUs (at least partially).
Top
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by _r2w_ben »

ThWuensche wrote:Things get even more confusing. In the moment I have four 16918 WUs on the system, two of them run at approx 105kPPD (16918,147,83,11 and 16918,84,91,5), one at 497kPPD (16918,133,23,14), one at 767kPPD (16918,64,21,11). So it can not be only the system setup with four Radeon VII, it somehow has to be related to the WUs (at least partially).
How does the CPU usage % compare between the various FahCore_22 processes when they're running fast or slow 16918s?
Top
ThWuensche
Posts: 79
Joined: Fri May 29, 2020 4:10 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by ThWuensche »

_r2w_ben wrote:How does the CPU usage % compare between the various FahCore_22 processes when they're running fast or slow 16918s?
At the moment I have two of these WUs, one standing at 110kPPD and using about 10% CPU, the second standing at 545kPPD and using about 26% CPU. I remember that also earlier WUs coming out at about 100kPPD took about 10% CPU (looked for that, since I wondered whether just CPU load is blocking, but doesn't seem so). However I can't say which effect some kworker processes have, for example kworker/22:1H-KFD IH has collected a lot of time. That probably is the interrupt handling for one of the GPUs. But the indicated load for them is low, around 1%.

Two other WUs currently running on that machine have 76% (one of the rare 13420 that do not fail, at 920kPPD) and 61% CPU (a 16915 at 525kPPD). So it seems low GPU usage is linked with low CPU usage, both are just idling (or waiting for something).
Top
ThWuensche
Posts: 79
Joined: Fri May 29, 2020 4:10 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by ThWuensche »

muziqaz wrote:OK, here is a theory and I might be off. I had some issues with fahcontrol mixing up the devices and opencl devices. I have 2 GPUs in one system, and for some reason one day fahcontrol decided that Device 0 is OpenCL device 1, and Device 1 is opencl device 0. So In turn I had to set
OpenCL Index to 1 on primary card (Device 0), and
OpenCL Index to 0 on second card (Device 1).
In reality it SHOULD be Device 0 has OpenCL Index set to 0, and Device 1 has OpenCL Index set to 1.

I'm not sure if that is the case here, but food for thought :)
Thanks for the idea, but it does not look like that. Cores are running, the command lines show the same openCL and GPU index. What is happening internally (communication between GPU and cores), whether it is always routed correct and instantly, I can't say. But as it looks, most other WUs are running well.
Top
_r2w_ben
Posts: 285
Joined: Wed Apr 23, 2008 3:11 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by _r2w_ben »

ThWuensche wrote:At the moment I have two of these WUs, one standing at 110kPPD and using about 10% CPU, the second standing at 545kPPD and using about 26% CPU. I remember that also earlier WUs coming out at about 100kPPD took about 10% CPU (looked for that, since I wondered whether just CPU load is blocking, but doesn't seem so). However I can't say which effect some kworker processes have, for example kworker/22:1H-KFD IH has collected a lot of time. That probably is the interrupt handling for one of the GPUs. But the indicated load for them is low, around 1%.
That's different than what I've observed on slow 13421s on an RX 460 on Windows. The lower the GPU usage, the higher the CPU usage.
Here you have low CPU usage and low GPU usage. 16918 must be bottlenecking somewhere else in OpenMM or GPU drivers.
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Folding is not fun right now - lots of trouble, no resul

Post by crimson1077 »

I agree, it is sucking right now.
Top
Post Reply

Return to “Problems with AMD/ATI drivers”