this post was submitted on 20 May 2024
65 points (98.5% liked)
Funhole
390 readers
15 users here now
Welcome to Funhole! The first and only hole on SDF exclusively for fun content! Are you a content creator? Then come post your content and join the fun!
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Kind of, it's a standalone system with the hardware integrated - kinda like Google Coral with a Raspberry Pi.
Not really, sorry - I haven't gone too deep into LLMs beyond simple use cases. I've only really used llama.cpp myself.