this post was submitted on 22 Nov 2023
1 points (100.0% liked)

Homelab

371 readers
9 users here now

Rules

founded 1 year ago
MODERATORS
 

I'm just getting into playing with Ollama and want to work to build some self-hosted AI applications. I don't need heavy duty cards because they probably won't ever be under too much load, so I'm mostly looking for power efficiency + decent price.

Any suggestions for cards I should look at? So far I've been browsing ebay and I was looking at Tesla M40 24GB DDR5's. They're reasonably priced, but I'm wondering if anyone has any specific recommendations.

you are viewing a single comment's thread
view the rest of the comments
[–] Jeremiah_K@alien.top 1 points 1 year ago

Good to know, I'll probably go for a P40 instead.