this post was submitted on 09 Jul 2025
45 points (84.6% liked)

Memes

4355 readers
111 users here now

Good memes, bad memes, unite towards a united front.

founded 5 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[โ€“] sudo_halt@lemmygrad.ml 2 points 1 week ago (1 children)

On another note Ollama is really shitty and they're trying to push their own API format, please consider using the one true community deriven gigachad Russian developed 'llama.cpp'. KoboldCPP even has a nice web UI for use.

[โ€“] yogthos@lemmygrad.ml 2 points 1 week ago

oh thanks for the heads up, I've heard of llama.cpp, but never bothered looking into taking it for a spin.