I once ran an LLM locally using Kobold AI. Said thing has an option to show the alternative tokens for each token it puts out, and what their probably for being chosen was. Seeing this shattered the illusion that these things are really intelligent for me. There's at least one more thing we need to figure out before we can build an AI that is actually intelligent.

It's cool what statistics can do, though.

[–] AlolanYoda@mander.xyz 1 points 9 months ago (2 children)

That's actually pretty neat. I tried Kobold AI a few months ago but the novelty wore off quickly. You made me curious, I'm going to check out that option once I get home. Is it just a toggleable opyiont option or do you have to mess with some hidden settings?

[–] Saledovil@sh.itjust.works 2 points 9 months ago

Just as I was about to give up, it somehow worked: https://imgchest.com/p/9p4ne9m9m4n I didn't really do anything different this time around, so no idea why it didn't work at first.

[–] Saledovil@sh.itjust.works 1 points 9 months ago

It's been about a year since I saw the probabilities. I took another look at it just now, and while I can find the toggle in the settings, I can't find the context menu where the probabilities are shown.