Depends on the size. I'm running a distilled version locally and it's pretty snappy, but output isn't quite as good as the full sized on. My expectation is that we'll see a lot more optimization happening in the coming years. It's also worth noting that the incentive for the government would be to reduce cost which creates further incentive to make this stuff more efficient.
Exactly, a lot of people have a knee jerk reaction when seeing LLMs mentioned, but the real question is the context this tech is used in. The incentives for government use would be completely different from those in private companies trying to monetize it. For example, it's easy to imagine how this could make a lot of government services a lot more accessible. It could provide a more natural interface for finding stuff people need online for example, help fill out forms, etc.
These are programs done by local governments, there's no capitalism happening here. Nobody is embracing capitalism here.
I think so, these being government initiatives means that the incentives are fundamentally different from ones we see when this tech is driven by vulture capital. I find a lot of the hate for LLMs stems from the capitalist context and people seem unable to separate these things.
I see very little problem with AI once its removed from capitalist context.
Russia pushing past Ukraine is pure nonsense. It's almost certain that Russia will not even want to hold all of Ukraine. However, the economic destruction of Europe over the past three years absolutely opens up the way for Russia to exert power over European politics now. People across Europe are now starting to realize what an utter debacle the war was, and that it has real consequences for them personally as they watch their standard of living collapse. This is naturally driving a backlash against the political establishment in Europe, and leading to parties that want to normalize relations with Russia becoming increasingly popular. So in a way this is becoming a self fulfilling prophecy, except Russia might be able to gain political capture of Europe without having to actually invade Europe.
But you see, Biden was supposed to win so that Germany could continue to hide behind America's skirts.
the enemy is both weak and strong
I guess Ukraine did end up with a partisan movement, it just happens to be one against the western backed regime.
Right, the reality is going to be nuanced. There will be niches where this tool will be helpful, and others where it doesn't really make sense. We're in a hype phase right now, and people are still figuring out good uses for it. It's also worth noting that people are already actively working on solutions for the hallucination problem and doing actual reasoning. The most interesting approach I've seen so far is neurosymbolics. It combines a deep neural net with a symbolic logic engine. The neural net does what it's good at which is parsing raw input data and classifying, and symbolic logic system operates on the classified data. This way you can have the system actually reason through a problem, explain the steps, correct it, etc. This is a fun read about it https://arxiv.org/abs/2305.00813
I do think the AI might present a problem for the capitalist system as a whole because if vast majority of work really can be automated going forward, then the whole model of working for a living will fall apart. It will be very interesting to see how the capitalist world grapples with this assuming it lasts that long to begin with.
oh yeah the image failed to upload
🤣