Open Air Dedicated Folder and Guide
Moderator: Site Moderators
Forum rules
Please read the forum rules before posting.
Please read the forum rules before posting.
-
- Posts: 69
- Joined: Sun Feb 28, 2016 10:06 pm
Open Air Dedicated Folder and Guide
I finally have a little time to post my dedicated folding server. This is a custom open air case built for $20 from wood at Home Depot. It is very easy to do. It is very solid and can handle up to 6 GPU's with the right motherboard combo. I am currently using the Gigabyte 990FXA-UD5 and AMD FX-8350 with no overclock. I am only folding on the GPU's.
These are 3/4" square 3ft long wood dowels found at Home Depot/Lowes and many other places. I used some nicer 1-1/2in white washer-head #8 cabinet screws that have the star driver with them. Be sure and screw them in so the head is flush and not pushing into the wood. They look nicer and clean.
The case is based off the Litecoin/Dogecoin design (Link below). I made some minor adjustments to give a little more room for the power supplies to sit. But the base configuration will work just fine. You can attach two power supplies to this setup if you need.
(Back View Above)
Motherboard and SSD attached to case. Be sure and align the motherboard so the PCIe slots are in the middle of the case as much as possible.
I used the standard motherboard case screws (gold posts) to hold the motherboard in place. I drilled a small hole and then screwed them in. Next time I would use a little gorilla glue to help hold them in place.
(Front View)
The two GTX 980 and Asus Strix 980 Ti video cards attached to the case. I am still testing the PCIe 1x to 16 adapter that you can see connected to the left card. So far I am seeing only minor PPD differences.
For the two additional GPU's I am using the EZDIY PCIe 16x extension cables (Black cable shown above and below). These are some of the best cables I have seen. Good solid solders. Completely shielded. And both ends have locking connectors. They are about 11 inches long which provides ample length to reach most of your GPUs.
To do more than one power supply you can use the Add2PSU Multiple Power Supply Adapter (Displayed Above). This connects the two power supplies in a way so when you power on/off the primary supply it will power on/off the secondary. This can be helpful with multi GPU systems and save some money as two 850 watt power supplies can be cheaper than a single 1200watt or even 1600 watt supply.
I am using a EVGA 1000GQ 1000watt 80+ Gold power supply. It can be found on Amazon for $130. This is a modular power supply that can handle, and has cables, for four GPUs. I am currently pulling 720watts from the wall at max output.
You can see there still is space for a second power supply. You can also increase the size of the open air case when you build it if you need more space.
And here is the system in action for the last month. The GPUs are running at around 52 celsius with fan speeds of 65% on the GTX 980 Ti and 70% on the GTX 980 reference cards. I am currently doing on average 1.45 million PPD. This is a mix of core 18 and 21. With all core 21 for the day I have seen upwards of 1.7 million PPD. From what I have read I can probably do more on a faster Intel machine. I will build one of those next along with the GTX 1080's when they become more available.
This open air case is cheap to make. Very solid. Offers a way to expand cheaper. And keeps your overclocked GPUs a lot cooler without requiring all the extra fans and water cooling. These run 24x7 without any issues.
Below are the links for how to build your own Open Air Case along with all the parts I used in my build.
Case & Adapters:
Wood Open Air case: http://highoncoins.com/litecoin-rig/how ... ecoin-rig/
EVGA 1000w Power supply: http://amzn.com/B017ICWP82
Add2PSU Multiple Power Supply Adapter: http://amzn.com/B009P98Q8U
EZDIY PCI Express 16x Extension Cable: https://amzn.com/B01EL4EAUG
PCIe 1x to 16x Extension Cable: http://amzn.com/B00EX627A8
PC:
Gigabyte 990FXA-UD5 Motherboard
AMD FX-8350 CPU
2 x Kingston 4GB DDR 1600
Samsung 850 EVO 120GB SSD
GPUs:
2 x Nvidia GTX 980 Reference (+200/+400mem overclock)
1 x Asus Strix GTX 980Ti OC (+20 overclock)
OS & drivers:
Ubuntu 14.04
Nvidia 361.42 (Need the newer driver for GTX 980Ti to control fan, overclock controls on Linux)
If you have any questions or need help with anything please feel free to ask away. I will be glad to help.
Brad
UPDATE: Updated the EZDIY extension cable Amazon link.
These are 3/4" square 3ft long wood dowels found at Home Depot/Lowes and many other places. I used some nicer 1-1/2in white washer-head #8 cabinet screws that have the star driver with them. Be sure and screw them in so the head is flush and not pushing into the wood. They look nicer and clean.
The case is based off the Litecoin/Dogecoin design (Link below). I made some minor adjustments to give a little more room for the power supplies to sit. But the base configuration will work just fine. You can attach two power supplies to this setup if you need.
(Back View Above)
Motherboard and SSD attached to case. Be sure and align the motherboard so the PCIe slots are in the middle of the case as much as possible.
I used the standard motherboard case screws (gold posts) to hold the motherboard in place. I drilled a small hole and then screwed them in. Next time I would use a little gorilla glue to help hold them in place.
(Front View)
The two GTX 980 and Asus Strix 980 Ti video cards attached to the case. I am still testing the PCIe 1x to 16 adapter that you can see connected to the left card. So far I am seeing only minor PPD differences.
For the two additional GPU's I am using the EZDIY PCIe 16x extension cables (Black cable shown above and below). These are some of the best cables I have seen. Good solid solders. Completely shielded. And both ends have locking connectors. They are about 11 inches long which provides ample length to reach most of your GPUs.
To do more than one power supply you can use the Add2PSU Multiple Power Supply Adapter (Displayed Above). This connects the two power supplies in a way so when you power on/off the primary supply it will power on/off the secondary. This can be helpful with multi GPU systems and save some money as two 850 watt power supplies can be cheaper than a single 1200watt or even 1600 watt supply.
I am using a EVGA 1000GQ 1000watt 80+ Gold power supply. It can be found on Amazon for $130. This is a modular power supply that can handle, and has cables, for four GPUs. I am currently pulling 720watts from the wall at max output.
You can see there still is space for a second power supply. You can also increase the size of the open air case when you build it if you need more space.
And here is the system in action for the last month. The GPUs are running at around 52 celsius with fan speeds of 65% on the GTX 980 Ti and 70% on the GTX 980 reference cards. I am currently doing on average 1.45 million PPD. This is a mix of core 18 and 21. With all core 21 for the day I have seen upwards of 1.7 million PPD. From what I have read I can probably do more on a faster Intel machine. I will build one of those next along with the GTX 1080's when they become more available.
This open air case is cheap to make. Very solid. Offers a way to expand cheaper. And keeps your overclocked GPUs a lot cooler without requiring all the extra fans and water cooling. These run 24x7 without any issues.
Below are the links for how to build your own Open Air Case along with all the parts I used in my build.
Case & Adapters:
Wood Open Air case: http://highoncoins.com/litecoin-rig/how ... ecoin-rig/
EVGA 1000w Power supply: http://amzn.com/B017ICWP82
Add2PSU Multiple Power Supply Adapter: http://amzn.com/B009P98Q8U
EZDIY PCI Express 16x Extension Cable: https://amzn.com/B01EL4EAUG
PCIe 1x to 16x Extension Cable: http://amzn.com/B00EX627A8
PC:
Gigabyte 990FXA-UD5 Motherboard
AMD FX-8350 CPU
2 x Kingston 4GB DDR 1600
Samsung 850 EVO 120GB SSD
GPUs:
2 x Nvidia GTX 980 Reference (+200/+400mem overclock)
1 x Asus Strix GTX 980Ti OC (+20 overclock)
OS & drivers:
Ubuntu 14.04
Nvidia 361.42 (Need the newer driver for GTX 980Ti to control fan, overclock controls on Linux)
If you have any questions or need help with anything please feel free to ask away. I will be glad to help.
Brad
UPDATE: Updated the EZDIY extension cable Amazon link.
Last edited by FldngForGrandparents on Sat Jun 18, 2016 9:55 pm, edited 1 time in total.
Dedicated to my grandparents who have passed away from Alzheimer's
Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
-
- Posts: 474
- Joined: Sat Aug 01, 2015 1:34 am
- Hardware configuration: 1. 2 each E5-2630 V3 processors, 64 GB RAM, GTX980SC GPU, and GTX980 GPU running on windows 8.1 operating system.
2. I7-6950X V3 processor, 32 GB RAM, 1 GTX980tiFTW, and 2 each GTX1080FTW GPUs running on windows 8.1 operating system. - Location: New Mexico
Re: Open Air Dedicated Folder and Guide
Brad,
You certainly are an 'out of the box' thinker. This is a most fascinating project. Well done!
The only concern I would have is RFI. Do you have any HAM radio operators in your area? If so, you could check to see if they have any reception issues.
You certainly are an 'out of the box' thinker. This is a most fascinating project. Well done!
The only concern I would have is RFI. Do you have any HAM radio operators in your area? If so, you could check to see if they have any reception issues.
-
- Posts: 2040
- Joined: Sat Dec 01, 2012 3:43 pm
- Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441
Re: Open Air Dedicated Folder and Guide
Hope you have no young kids or pets, they would also love such toy.
And don't drop anything on it or it will get easily damaged.
Maybe a cage around would solve the points
But dust will not be your friend.
And don't drop anything on it or it will get easily damaged.
Maybe a cage around would solve the points
But dust will not be your friend.
Re: Open Air Dedicated Folder and Guide
Switch to 346.96 in Linux and get a nice PPD increase. It can still control clocks, fan, voltage, etc. I am currently running a 980Ti in Ubuntu 14.04 with that driver. As are many others.
-
- Posts: 69
- Joined: Sun Feb 28, 2016 10:06 pm
Re: Open Air Dedicated Folder and Guide
Are you using nvidia-settings from the CLI to set these? I guess I need to dig into them. I had the CLI working for the newer driver but the commands are off on the older one.mmonnin wrote:Switch to 346.96 in Linux and get a nice PPD increase. It can still control clocks, fan, voltage, etc. I am currently running a 980Ti in Ubuntu 14.04 with that driver. As are many others.
Thanks!
Dedicated to my grandparents who have passed away from Alzheimer's
Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
Re: Open Air Dedicated Folder and Guide
sudo nvidia-xconfig --cool-bits=28
Guide I use.
http://www.overclock.net/t/1506137/ubun ... u-cpu/0_30
Guide I use.
http://www.overclock.net/t/1506137/ubun ... u-cpu/0_30
-
- Posts: 1576
- Joined: Tue May 28, 2013 12:14 pm
- Location: Tokyo
Re: Open Air Dedicated Folder and Guide
You can see my config file for a three-GPU-setup here: https://github.com/ChristianVirtual/fah-X11
You might need to adjust for PCI bus IDs
Also one script to control the fan speed on Linux for GPU:1
(My GPU:0 don't need fan-speed right now as on water; and GPU:2 is out of order; all nVidia)
You might need to adjust for PCI bus IDs
Also one script to control the fan speed on Linux for GPU:1
(My GPU:0 don't need fan-speed right now as on water; and GPU:2 is out of order; all nVidia)
Please contribute your logs to http://ppd.fahmm.net
-
- Pande Group Member
- Posts: 2058
- Joined: Fri Nov 30, 2007 6:25 am
- Location: Stanford
Re: Open Air Dedicated Folder and Guide
Wow, that’s all super impressive.
Prof. Vijay Pande, PhD
Departments of Chemistry, Structural Biology, and Computer Science
Chair, Biophysics
Director, Folding@home Distributed Computing Project
Stanford University
Departments of Chemistry, Structural Biology, and Computer Science
Chair, Biophysics
Director, Folding@home Distributed Computing Project
Stanford University
-
- Posts: 69
- Joined: Sun Feb 28, 2016 10:06 pm
Re: Open Air Dedicated Folder and Guide
Thanks but the 346.96 drivers fan control is broken. I have had to revert to the 361.42 driver.mmonnin wrote:sudo nvidia-xconfig --cool-bits=28
Guide I use.
http://www.overclock.net/t/1506137/ubun ... u-cpu/0_30
Dedicated to my grandparents who have passed away from Alzheimer's
Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
-
- Posts: 69
- Joined: Sun Feb 28, 2016 10:06 pm
Re: Open Air Dedicated Folder and Guide
Thanks Vijay! I am glad to help where I can. This is dear to my heart.VijayPande wrote:Wow, that’s all super impressive.
Brad
Dedicated to my grandparents who have passed away from Alzheimer's
Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
-
- Posts: 69
- Joined: Sun Feb 28, 2016 10:06 pm
Re: Open Air Dedicated Folder and Guide
Added a GTX 1070 to my folder. Doing about 2.2M PPD now. Pulling 912W from outlet.
Starting from left to right:
GTX 520 (For video) using a PCIe 16x to 1x adapter to use a 1x slot
Asus Strix 980Ti (OC +40)
Nvidia GTX 980 (OC +200/400)
Nvidia GTX 1070 (Can't seem to overclock on Linux yet)
Nvidia GTX 980 (OC +200/400)
Even this many cards using the PCIe seem to be performing just fine. I believe this is due to the little amount of memory that is actually used by F@H.
Starting from left to right:
GTX 520 (For video) using a PCIe 16x to 1x adapter to use a 1x slot
Asus Strix 980Ti (OC +40)
Nvidia GTX 980 (OC +200/400)
Nvidia GTX 1070 (Can't seem to overclock on Linux yet)
Nvidia GTX 980 (OC +200/400)
Even this many cards using the PCIe seem to be performing just fine. I believe this is due to the little amount of memory that is actually used by F@H.
Dedicated to my grandparents who have passed away from Alzheimer's
Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
-
- Posts: 10179
- Joined: Thu Nov 29, 2007 4:30 pm
- Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
- Location: Arizona
- Contact:
Re: Open Air Dedicated Folder and Guide
Please put something under the rig. A little static discharge from the carpet might be costly.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Tell me and I forget. Teach me and I remember. Involve me and I learn.
-
- Posts: 2040
- Joined: Sat Dec 01, 2012 3:43 pm
- Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441
Re: Open Air Dedicated Folder and Guide
There is the wood case between carpet and mainboard so it should be fine.
A plastic grid around your case would protect it against something touching the inside accidentally.
You could save some watts and noise by using a tool to limit gpu power target, e.g. limit to 75% TDP and only loose 10% PPD.
This is because the highest gpu boost states take much extra power.
Any difference in PPD between your gtx 980 running at pcie x8 and the other gtx 980 running at pcie x4 ?
A plastic grid around your case would protect it against something touching the inside accidentally.
You could save some watts and noise by using a tool to limit gpu power target, e.g. limit to 75% TDP and only loose 10% PPD.
This is because the highest gpu boost states take much extra power.
Any difference in PPD between your gtx 980 running at pcie x8 and the other gtx 980 running at pcie x4 ?
-
- Posts: 69
- Joined: Sun Feb 28, 2016 10:06 pm
Re: Open Air Dedicated Folder and Guide
I am seeing about 40-50k PPD difference on the 980 in the 4x slot. I'll have to work on a better MB/CPU combo next. Really wish I could OC the 1070. Hopefully soon.foldy wrote:There is the wood case between carpet and mainboard so it should be fine.
A plastic grid around your case would protect it against something touching the inside accidentally.
You could save some watts and noise by using a tool to limit gpu power target, e.g. limit to 75% TDP and only loose 10% PPD.
This is because the highest gpu boost states take much extra power.
Any difference in PPD between your gtx 980 running at pcie x8 and the other gtx 980 running at pcie x4 ?
Dedicated to my grandparents who have passed away from Alzheimer's
Dedicated folding rig on Linux Mint 19.1:
2 - GTX 980 OC +200
1 - GTX 980 Ti OC +20
4 - GTX 1070 FE OC +200
3 - GTX 1080 OC +140
1 - GTX 1080Ti OC +120
Re: Open Air Dedicated Folder and Guide
Man that's awesome!
Take Care
Rico
Take Care
Rico