Crafter72

Maybe this resources can help your local LLM project.

I see you seem fascinated by NPUs, here is probably one of the most recent publications that discuss performance comparison between NPU, GPU, and CPU for Edge computing case using YoloV5 model. And here's another benchmark provided by Google for its TPU product (Google Coral).

Given the circumstances, it's unlikely for current generation NPU to fulfill those heavy data tasks like upscaling video or generating video but for something like Edge computing they provide fairly performant solutions at affordable prices (in the case of NPU you can get them on Single Board Computer using Rockchip SoC especially RK3588 one). If you're using Raspberry Pi 5 or other SBC, you can get Google Coral (M.2 or USB version).

Lastly, as recent as July 28th 2024, Anandtech AI benchmark on the new Ryzen AI 9 HX 370 still using CPU because the software to benchmark the NPU modules isn't available yet for desktop environment to prevent any bias in result.

Imo NPU for average consumer usage is still niche (compared to something like CUDA/Tensor cores). Just like TPU, NPU is just another hardware acceleration for specific tasks that most of average user can be fulfilled with CPU/GPUs.

The key is the "density", activities and (player) engagements. I find it funny RGG is probably one of developers that can get away reusing assets so much that even can be traced back to ps2 assets on their newer games.

Woah, thanks for dropping the link. I did disable w10 update by modifying registry for each services which time consuming.

Probably they took what most avg user would see. Android? We have custom roms. AI Tools (assuming all of them?) Not even close.

But still find it hilarious that OP even have to post the correction.

Soldering is probably one of skill that opens up lot of possibility because most of time when dealing with pcbs (most electronic device overall) you have to desolder, replace the component, and solder new part in.

Next step is ID'ing unmarked component and understand datasheet so you know what you're dealing and how to deal with them.

They don't want to miss out the "hype" but also Valve deem the hardware jump is not that much to consider "Deck 2". If only these manufacturer also consider bringing software optimization rather than keep producing portable handheld with small performance jump.