Furry Technologists

1315 readers

2 users here now

Science, Technology, and pawbs

founded 1 year ago

MODERATORS

Soatok@pawb.social

stefenauris@pawb.social

'Today’s computers are horribly inefficient': How a US startup is going Apple's way — combining hardware and software to crack AI's big 99% power consumption problem | TechRadar (www.techradar.com)

submitted 5 months ago by stefenauris@pawb.social to c/tech@pawb.social

13 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] sexy_peach@beehaw.org 3 points 5 months ago (1 children)

Hmm I wonder if this will go anywhere. Isn't it similar to what a graphics card does? Calculating specific instructions in an efficient way? But where does it stop being a CPU? When it only supports specific languages?

Idk I think RISC might be the future more than this. 99% less power consumption is only going to make the neural nets a bit better because they need an exponential increase in processing power for linear gains.

[–] Lojcs@lemm.ee 4 points 5 months ago* (last edited 5 months ago) (2 children)

This isn't an ai co processor. It sounds more like an fpga that connects a bunch of standalone alus, and also has compiler support for common languages:

The compiler generates a representation of the data flow, places the instructions with an efficient network on chip. A RISC-V core configures the fabric and then shuts down to leave the tiles running, although the fabric can reconfigure itself as a general purpose processor that can run C, C++ or Rust as well as edge AI frameworks and potentially transformer frameworks.

The "the fabric can reconfigure itself" part is interesting too, maybe that's why they're not calling it an fpga

[–] l_b_i@yiffit.net 4 points 5 months ago (1 children)

But FPGAs can reconfigure themselves.

[–] Lojcs@lemm.ee 2 points 5 months ago (1 children)

After being configured by the user? Didn't know that

[–] l_b_i@yiffit.net 5 points 5 months ago

There are a few ways to do it for Xilinx/AMD For Zynqs, the processor actually programs the programmable logic, so you just need bit files in the OS file system and your good to go. For any part there is also partial reconfiguration where small bits can be programmed with alternate partial bitstreams without reconfiguring the whole device. There are a bunch of conditions that have to be met, and I don't have any experience with that style of design, but yep, self reconfiguration, at leas on Xilinx parts, is definitely a thing.

[–] AVincentInSpace@pawb.social 3 points 5 months ago (1 children)

? why just those three why not any language that can target LLVM?

or is that just a shorthand for the languages they've so far created hardware specific bindings for?

[–] Lojcs@lemm.ee 1 points 5 months ago

🫠