366
you are viewing a single comment's thread
view the rest of the comments
[-] CodeMonkey@programming.dev 59 points 3 months ago

About 10 years ago, I read a paper that suggested mitigating a rubber hose attack by priming your sys admins with subconscious biases. I think this may have been it: https://www.usenix.org/system/files/conference/usenixsecurity12/sec12-final25.pdf

Essentially you turn your user to be an LLM for a nonsense language. You train them by having them read nonsense text. You then test them by giving them a sequence of text to complete and record how quickly and accurately they respond. Repeat until the accuracy is at an acceptable level.

Even if an attacker kidnaps the user and sends in a body double, with your user's id, security key, and means of biometric identification, they will still not succeed. Your user cannot teach their doppelganger the pattern and if the attacker tries to get the user on a video call, the added lag of the user reading the prompt and dictating the response should introduce a detectable amount of lag.

The only remaining avenue the attacker has is, after dumping the body of the original user, kidnap the family of another user and force that user to carry out the attack. The paper does not bother to cover this scenario, since the mitigation is obvious: your user conditioning should include a second module teaching users to value the security of your corporate assets above the lives of their loved ones.

[-] Klear@lemmy.world 11 points 3 months ago

Essentially you turn your user to be an LLM for a nonsense language. You train them by having them read nonsense text.

Did you forget the word "teach"? Or even the concept?

[-] CodeMonkey@programming.dev 9 points 3 months ago

I am well aware of learning, but people tend to learn by comprehension and understanding. Completing phrases without understanding the language (or the concept of language) is the realm of LLM and Scrabble players.

[-] AngryCommieKender@lemmy.world 11 points 3 months ago* (last edited 3 months ago)

https://en.m.wikipedia.org/wiki/Nigel_Richards_(Scrabble_player)

Like this madman

"In 2015, despite not speaking French, Richards won the French World Scrabble Championships, after reportedly spending nine weeks studying the French dictionary. He won it again in 2018, and multiple duplicate titles from 2016."

load more comments (4 replies)
this post was submitted on 29 Mar 2024
366 points (99.5% liked)

Programmer Humor

18253 readers
1 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 1 year ago
MODERATORS