If AI is making the Turing test obsolete, what might be better? (arstechnica.com)

submitted 6 months ago by Greenpepper@beehaw.org to c/technology@beehaw.org

57 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] Pamasich@kbin.social 10 points 6 months ago

So, I asked this to the three different conversation styles of Bing Chat.

The Precise style actually tried to solve it, came to the conclusion the question might be of philosophical nature, including some potential meanings, and asked for clarification.

The Balanced style told me basically the same as the other reply by admiralteal, that the question makes no sense and I should give more context if I actually want it answered.

The Creative style told me it didn't understand the first part, but then answered the second part (the turtles being blue) seriously.

[-] Froyn@kbin.social 5 points 6 months ago

Would it be safe to say that all 3 answers would fail the test?

[-] Pamasich@kbin.social 7 points 6 months ago

Not sure, I'm not familiar with the test, just figured I'd tell the results from asking the AI.

I think based on what you said about it

AI will actually TRY to solve it.
Human nature would be to ask if the person asking the question is having a stroke or requires medical attention.

That the Balanced style didn't fail, because while it didn't ask about strokes or medical attention, it did point out I'm asking a nonsense question and refused to engage with it.

The Precise style did try to find an answer and the Creative style didn't realize I'm fucking with it, so I do think based on the criteria they'd fail the test.

Though, honestly, I'd fail the test too. When asked such a question, I'd think there has to be an answer and it's stupid of me not to see it and I'd look for it. I think the Precise style's answer is very much where I'd end up.