I recently got hold of two RTX 3090 GPUs specifically for LLM inference and training. Everything seems to work well and I can finally fit a 70B model into the VRAM with 4 bit quantization. I am wondering if …

Nov 23, 2023 · Any ideas on how I can fit two air-cooled 3090s or 4090+3090 in O11 XL avoiding possible thermal throttling and affecting GPU lifespan? I am reluctantly open to buying a new case if …

Sep 7, 2020 · NVIDIA claims the 3080 has 238 ‘Tensor-TFLOPS’ of performance from their tensor cores, the 3090 has 285, and the 3070 has 163. As usual, these numbers are for 16-bit floating point. …

Jan 13, 2023 · My system: i7-12700k CPU msi gaming x trio 3090 32gb gskill ripjaws V 3200 mhz ram 760W Seasonic Platinum PSU from around 2015 (practically new from a usage standpoint) ASUS …

Jun 19, 2023 · 3090 is faster than 4070, especially at the 4K, plus more vram which matters at 4k. The only downside is the TDP, 3090 is a power hag. Reply reply kou07 •

Jul 7, 2023 · People seem to consider them both as about equal for the price / performance. I know 4090 doesn't have any more vram over 3090, but in terms of tensor compute according to the specs …

Dec 15, 2022 · Upgrade from RTX 3090 Hey guys, hope you are doing fine So, I bought a 3090 for a very good price a month ago to my new build with an i7-13700kf, the doubt is, I mainly play the new …

Jan 4, 2022 · I have a PNY 3090 Revel and I was never happy with the temps so I looked into undervolting. Didn’t realize how easy it is. I managed to settle with 1890mhz/850mv with a -270 core …

Oct 6, 2020 · So in my case, with the 3090 Trinity, I was able to flash the gigabyte bios, or the Palit bios. The gigabyte bios will make it so only two DP ports work, rather than the three, as that is what the …

The 3090 has about 5% better performance than the 4070 Super. With that said I would go with the newer card for all the new features. The 4070 Super can absolutely handle 4k. If you want higher …