Budget GPU for DL380 Gen10 for Deep Learning

[servertom]

I'm looking for a GPU that fits (and works) inside a DL380G10 for deep learning. https://www.hpe.com/psnow/doc/a00008180enw mentions NVIDIAs A40 and A30 at the higher end of the price range for suitable GPUs.

When it comes to consumer setups (desktop PCs) I frequently see recommendations for the RTX3090, but I have a feeling this one wouldn't fit inside a DL380 (dimension-wise and because of heat dissipation). Please correct me if I'm wrong and let me know which manufacturer/model you have experience with.

Can you otherwise recommend a reasonably priced GPU with 24+GB and tensor cores that would fit inside the DL380G10? Which riser cards and cables do I need?

Thank you very much!

[support_s]

System recommended content:

1. HPE ProLiant DL380 Gen10 Server - Spare Parts

2. HPE ProLiant DL380 Gen10 Plus Server - Option Parts | HPE Computation and Graphics Accelerators

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".

Thank you for being a HPE valuable community member.

[TVVJ]

Hello,

The QuickSpecs that you have referred to, lists all tested HPE options for this server. Any other option may or may not work optimally with the server.

Regards,

[shiva_jr]

Hi @servertom , 
    I suggest to contact HPE Support team for clear understanding and procuement of compatible GPU.
Regards,
Shiva_jr

[servertom]

Yeah, I'm aware of that. I was hoping for someone to descend upon this discussion and tell us about their experience trying to do so. Since that hasn't happened so far, I suppose it's on me to give it a shot.

I'll try to get a pre-owned ASUS TURBO-RTX3090-24G and see if I can get it to work.

I still appreciate every idea, comment, or experience regarding my experiment.

[Mr_Techie]

---

@servertom wrote:

Yeah, I'm aware of that. I was hoping for someone to descend upon this discussion and tell us about their experience trying to do so. Since that hasn't happened so far, I suppose it's on me to give it a shot.

I'll try to get a pre-owned ASUS TURBO-RTX3090-24G and see if I can get it to work.

I still appreciate every idea, comment, or experience regarding my experiment.

---

That sounds like an interesting experiment! The ASUS TURBO-RTX3090-24G has a blower-style cooler, which makes it one of the very few RTX 3090 models that could potentially work in a DL380 Gen10.

I didn't try anything but I would recommend NVIDIA A30/NVIDIA A40/ Tesla P40 or NVIDIA T4

Good luck

[support_s]

Hello,

Let us know if you were able to resolve the issue.

If you are satisfied with the answers then kindly click the "Accept As Solution" button for the most helpful response so that it is beneficial to all community members.

Please click on "Thumbs Up/Kudo" icon to give a "Kudo".