this post was submitted on 19 Jun 2025
30 points (96.9% liked)

Technology

1160 readers
40 users here now

A tech news sub for communists

founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] yogthos@lemmygrad.ml 2 points 3 weeks ago (6 children)

Not sure if anybody is hosting it online aside from the official instance. Running locally or using something like GCP to host your own private model is basically the way to go. Unfortunately, smaller sized models you can run locally aren't quite as good as the full blown version. Still can be quite useful though, and they are rapidly improving as well. I've found qwen 3 to be the best local option right now.

[–] darkernations@lemmygrad.ml 2 points 3 weeks ago* (last edited 3 weeks ago) (5 children)

Thanks for explaining. Is it easy to turn off censorship in qwen 3 ("non-coder" here but that doesn't matter as I will be starting that journey soon enough as I up my maths)? Also I thought the free version of deepseek r1 on the app is 7b?

[–] yogthos@lemmygrad.ml 1 points 3 weeks ago (4 children)

You don't have to do anything, the open source models that are published don't censor themselves. And the online version of deepseek is the full model. They charge for API level access for it.

[–] darkernations@lemmygrad.ml 2 points 3 weeks ago

Excellent, thank you!

load more comments (3 replies)
load more comments (3 replies)
load more comments (3 replies)