this post was submitted on 20 May 2024
65 points (98.5% liked)
Funhole
390 readers
60 users here now
Welcome to Funhole! The first and only hole on SDF exclusively for fun content! Are you a content creator? Then come post your content and join the fun!
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
is this an nvidia ad?
no, am i not supposed to mention nVidia?
Just saying that I never heard about nVidia Jetson up until today and now I have purchased it to upgrade my robowife.
Same, never heard of them, but I'm not seeing an obvious use case. What are they useful for?
It's pretty good for AI tasks at the edge, e.g. fully local image recognition.
I'm edging right now just thinking about it
Ahh gotcha, similar to Google's Coral? Neat.
I've recently been looking into locally hosting some LLMs for various purposes, I haven't specced out hardware yet. Any good resources you can recommend?
Kind of, it's a standalone system with the hardware integrated - kinda like Google Coral with a Raspberry Pi.
Not really, sorry - I haven't gone too deep into LLMs beyond simple use cases. I've only really used llama.cpp myself.
A dedicated NVIDIA GPU in a random x86 pc is a lot faster and more price efficient than a Jetson.
If it isn't about the form factor the Jetson is not a great contender.
Ah, gotcha - the Jetson devices are definitely robowife capable lol. I suspect it is mostly used for things like AI enabled electronic devices, but it is possible to use ROS for robotics!