Launch of new NVIDIA 3000 series GPU's
Moderators: Site Moderators, FAHC Science Team
Launch of new NVIDIA 3000 series GPU's
Just wanted to see if anyone else is aware, or seen today's launch of the new NVIDIA 3000 series GPU's (https://www.youtube.com/watch?v=E98hC9e__Xs). Only asking because PPD/WU count is about to get a whole lot more interesting!
For a bit of perspective, the current Titan RTX priced at ~$2500 has a CUDA core count of 4608. The new 3070 has 5888, at a price of $499. The new Titan replacement (3090) has .... wait for it.... 10496 CUDA cores, priced at $1499!
I've been folding since November last year on just my Ryzen 3400G CPU. I haven't bought a GPU for this new-build PC for budget reasons, and also because I knew these cards were coming out, and now I can afford one. I'm sure the lower spec/cheaper GPU's will be announced later in the year, but damn, I am just salivating at the prospect of folding with one of these!
I can't wait to participate to the COVID Moonshot project if it is still on-going by the time these are out on market!
For a bit of perspective, the current Titan RTX priced at ~$2500 has a CUDA core count of 4608. The new 3070 has 5888, at a price of $499. The new Titan replacement (3090) has .... wait for it.... 10496 CUDA cores, priced at $1499!
I've been folding since November last year on just my Ryzen 3400G CPU. I haven't bought a GPU for this new-build PC for budget reasons, and also because I knew these cards were coming out, and now I can afford one. I'm sure the lower spec/cheaper GPU's will be announced later in the year, but damn, I am just salivating at the prospect of folding with one of these!
I can't wait to participate to the COVID Moonshot project if it is still on-going by the time these are out on market!
-
- Posts: 1996
- Joined: Sun Mar 22, 2020 5:52 pm
- Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21 - Location: UK
Re: Launch of new NVIDIA 3000 series GPU's
I think the 3090 core count is a bit of an illusion - number of threads on various talking about it actually being half that but double accounted due to the extra FP32 units - but I am in o way an expert/
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
-
- Posts: 25
- Joined: Wed May 13, 2020 4:34 am
- Hardware configuration: I7 7700k, RTX 2080Ti
I3 9100F, 2x 5700XT - Location: Netherlands
Re: Launch of new NVIDIA 3000 series GPU's
It's interesting for sure, and I can't wait to see what the 3090 will do with folding at home.
But until we see it in action it's only speculation.
Let's hope we won't need it for the covid cause
But until we see it in action it's only speculation.
Let's hope we won't need it for the covid cause
-
- Posts: 1996
- Joined: Sun Mar 22, 2020 5:52 pm
- Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21 - Location: UK
Re: Launch of new NVIDIA 3000 series GPU's
For some work the count actually be half may be an issue/disappointment - but for FaH it might be that the extra FP32 units make a real difference - time will tell
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Re: Launch of new NVIDIA 3000 series GPU's
Seems that 3080 would be about 40% faster than 2080ti in compute:
https://videocardz.com/newz/nvidia-gefo ... benchmarks
Let's see how that translates for FAH.
https://videocardz.com/newz/nvidia-gefo ... benchmarks
Let's see how that translates for FAH.
Windows 11 x64 / 5800X@5Ghz / 32GB DDR4 3800 CL14 / 4090 FE / Creative Titanium HD / Sennheiser 650 / PSU Corsair AX1200i
Re: Launch of new NVIDIA 3000 series GPU's
It's really a question of scaling.
If everything was to scale 100% these new cards are terrific at fp32. The core counts are correct and They have dpublednup the fp32 performance per cuda core. Each core can do 2 fp32 and 1 int32 per clock. But splitting the workload and effectively using all those cores remains to be seen.
We might eventually need to run multiple WU per GPU to use them effectively.
If everything was to scale 100% these new cards are terrific at fp32. The core counts are correct and They have dpublednup the fp32 performance per cuda core. Each core can do 2 fp32 and 1 int32 per clock. But splitting the workload and effectively using all those cores remains to be seen.
We might eventually need to run multiple WU per GPU to use them effectively.
-
- Site Moderator
- Posts: 6986
- Joined: Wed Dec 23, 2009 9:33 am
- Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB
Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400 - Location: Land Of The Long White Cloud
- Contact:
Re: Launch of new NVIDIA 3000 series GPU's
That is under discussion by the development team and there are a few ideas floating around but nothing solid so far. Also, there's no ETA but I do know that it is something that will likely be addressed sooner rather than lateripkh wrote:...We might eventually need to run multiple WU per GPU to use them effectively.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
-
- Posts: 78
- Joined: Sun Apr 26, 2020 1:29 pm
Re: Launch of new NVIDIA 3000 series GPU's
Watching 2060s' choke on low atom count WU has always bothered me.ipkh wrote:It's really a question of scaling.
But splitting the workload and effectively using all those cores remains to be seen.
We might eventually need to run multiple WU per GPU to use them effectively.
Once I realized there was a corresponding drop in pwr used, it bothered me less, but I'd still prefer to see my folders used more effectively.
Having the option to enable multiple WU processing could be a good solution.
GPU Architecture also effects this... my 2060 KO runs great (nominal) on low atom count WU, but the 2060 supers turn into GTX 1660, with plots aligning in htm.
The mentioned change to CUDA from OpenCL will likely effect many of the patterns seen in the past.
So, I'm left wondering how long it will be until we see CUDA and truly efficient utilization of even our current gear & imagining the potential of a CUDA + 30780 architecture.
Like driving a Ferrari in downtown traffic analogy could easily apply to a Moonshot typ atom count, as is.
Of course, it's much better than waiting for a slot to load, right?
-
- Posts: 78
- Joined: Sun Apr 26, 2020 1:29 pm
Re: Launch of new NVIDIA 3000 series GPU's
Neil-B wrote:I think the 3090 core count is a bit of an illusion - number of threads on various talking about it actually being half that but double accounted due to the extra FP32 units - but I am in o way an expert/
I heard mention that Nvidia had bumped the CUDA executions per clock cycle in the 30X0 too, still looking for more on that, true??Tom's Hdwr wrote:just published 9/8.. It has shown a generational performance increase of roughly 2X when comparing RTX 3080 to RTX 2080, but if you look just at TFLOPS, the RTX 3080 is nearly triple the theoretical performance. But the reality is the RTX 2080 could do FP32 + INT at around 10 tera-OPS each, whereas the RTX 3080 has nearly 30 tera-OPS of FP32 available and only 15 tera-OPS of INT available
All good, but putting it to work efficiently will likely take some time.
With Nvidia being an active supporter & their talent pool a solution likely already exists in someone's brain.
-
- Site Moderator
- Posts: 6986
- Joined: Wed Dec 23, 2009 9:33 am
- Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB
Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400 - Location: Land Of The Long White Cloud
- Contact:
Re: Launch of new NVIDIA 3000 series GPU's
I would say that would fall in the "very soon" category (see my signature for reference).cine.chris wrote:...The mentioned change to CUDA from OpenCL will likely effect many of the patterns seen in the past.
So, I'm left wondering how long it will be until we see CUDA and truly efficient utilization of even our current gear & imagining the potential of a CUDA + 30780 architecture...
The announcement would happen here on the Forum and potentially on the Blog/Twitter too. Let's just wait and see what happens later this month
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
-
- Site Moderator
- Posts: 6349
- Joined: Sun Dec 02, 2007 10:38 am
- Location: Bordeaux, France
- Contact:
Re: Launch of new NVIDIA 3000 series GPU's
There's already a topic about the new GPUs : viewtopic.php?f=38&t=36010
-
- Pande Group Member
- Posts: 467
- Joined: Fri Feb 22, 2013 9:59 pm
Re: Launch of new NVIDIA 3000 series GPU's
> Having the option to enable multiple WU processing could be a good solution.
We're working on benchmarking/evaluating this approach right now! We'll find a way to take maximal advantage of these big GPUs, but it may not be ready right away.
> So, I'm left wondering how long it will be until we see CUDA and truly efficient utilization of even our current gear & imagining the potential of a CUDA + 30780 architecture...
You may not have to wait long...
~ John Chodera // MSKCC
We're working on benchmarking/evaluating this approach right now! We'll find a way to take maximal advantage of these big GPUs, but it may not be ready right away.
> So, I'm left wondering how long it will be until we see CUDA and truly efficient utilization of even our current gear & imagining the potential of a CUDA + 30780 architecture...
You may not have to wait long...
~ John Chodera // MSKCC
Re: Launch of new NVIDIA 3000 series GPU's
Don't you think it is staggering FAH has like 2 exaflops, while they have almost no users yet? They could have so many more! Imagine if there was gpu usage limit! I tried workaround: because 1 cpu core is still needed to give gpu the work. I used a stress test and assigned it to this core and i tried different amount stress - like 2-8% of cpu usage. So FAH gets the rest. It worked! Gpu usage was decreased by a lot! I could use my pc, while folding! Problem was: WU always crashed, except once i almost finished a project!!! But i tried that many times and it had always crashed at some point... I don't know if, because of instability, or to many errors piled up. And whether or no these data would be useful, even if WU finished! That was only on 780. I have 2070 super now - unfortunately, but i didn't test it yet. But on 3000 series something like 3080/90, one WU could take like 1-2 hours, or less. On 780 one wu took 6-8 hours! I think that could finish! Currently no new projects available, so i test it later...
Re: Launch of new NVIDIA 3000 series GPU's
Ordinarily, it fine to learn by testing, but it's not ok to intentionally crash perfectly good production WUs. Every WU is unique and is assigned to ONE person. If it crashes, it has to be assigned to someone else and if it it fails too many times, it is withdrawn from distribution. Such failure are costly to scientific research. WUs are not "free"empleat wrote:... Problem was: WU always crashed, except once i almost finished a project!!! But i tried that many times and it had always crashed at some point... I don't know if, because of instability, or to many errors piled up. And whether or no these data would be useful, even if WU finished! That was only on 780. I have 2070 super now - unfortunately, but i didn't test it yet. But on 3000 series something like 3080/90, one WU could take like 1-2 hours, or less. On 780 one wu took 6-8 hours! I think that could finish! Currently no new projects available, so i test it later...
Posting FAH's log:
How to provide enough info to get helpful support.
How to provide enough info to get helpful support.
-
- Posts: 1996
- Joined: Sun Mar 22, 2020 5:52 pm
- Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21 - Location: UK
Re: Launch of new NVIDIA 3000 series GPU's
Basically if one refuses to accept how GPUs manage load and try to force limitations on them getting lots of failures is not a great surprise ... it is a shame that experimentation like this damages the science when one can with a bit of knowledge run copies of a completed WU for testing and experimentation without impacting science ... but if one wants to make a point (in push it in many places in the forums) by failing to do something others have advised is not currently possible in a manageable way whilst damaging the science then I guess that is ones right ... for myself I accept there are limitations due go various sub optimal technical issues and focus on supporting FaH within the bounds it is currently able to operate
There are approaches to managing the heat/power loading on GPUs using various tweaking packages and for many this helps address their concerns/wishes ... but to try but until OS and GPU vendors change the way GPU work prioritisation and workload management then I am sorry but much of what I believe you wish to do is simply not doable in a manageable manner ... Yes Nvidia are starting to address this with some of their recent developments and I have no doubt that the FaH devs will be watching this closely but there is a huge inertia in the OS/GPU vendor space to overcome before allocation of jobs to %ages of GPU capacity becomes the norm ... when it does then folders will be able to "dial in" whatever GPU level of donation they wish - but until then working within the bounds of current technological implementations help the science best.
There are approaches to managing the heat/power loading on GPUs using various tweaking packages and for many this helps address their concerns/wishes ... but to try but until OS and GPU vendors change the way GPU work prioritisation and workload management then I am sorry but much of what I believe you wish to do is simply not doable in a manageable manner ... Yes Nvidia are starting to address this with some of their recent developments and I have no doubt that the FaH devs will be watching this closely but there is a huge inertia in the OS/GPU vendor space to overcome before allocation of jobs to %ages of GPU capacity becomes the norm ... when it does then folders will be able to "dial in" whatever GPU level of donation they wish - but until then working within the bounds of current technological implementations help the science best.
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)