An AI reads the entire legal code – which no human can know or obey – and threatens to enforce it, via police reports and lawsuits, against anyone who doesn’t comply with its orders.

what. eliezer what in the fuck are you talking about? this is the same logic that sovereign citizens use to pretend the law and courts are bound by magic spells that can be undone if you know the right words

“[ignoring all other scary prospects like irreversible climate change or a third world war etc.] consider this scarier prospect: An AI” - AI doomers in a nutshell

Zapped from AI orbit for jaywalking.

If you're not worried about the utter extinction of humanity, consider this scarier prospect: An AI reads the entirety of AO3, which no human can comprehend, and threatens to leave scathing comments on your self-insert fic

Coincidence than this fear occurs the same day the Epstein list is released?

Both this new dumb shit and the extinction risk are predicated on the concept of omnipotent AI, which he just takes as a given. Now with just an added layer of dumb. Oh no, the God AI will not kill me outright, just subject me to inscrutable matrices of bureaucracy!

instead of utter destruction of humanity, consider this scarier prospect: me needing to get a real job

Xitter share and like numbers seem to be smaller and smaller lately.

Consider this, Yud m'lud: what if a dog had a square ass

When all you have is computer code, all mentions of code look like computer code. (see DNA, and now the law).

Anyway, the law isn't a video game, you cannot just go 'negative objection!' and cause an underflow in objections.

(An intelligent AGI would prob understand this, and if it doesnt it prob just sucks (and is more AI than AGI) and lawyers/judges would object. (I know for a fact that people in law have been thinking about subjects like this (automatization of the law) for 25 years at least. I have no idea where the discussions went but they prob have a lot higher quality than Yudkowskys writings about it, so I suggest anybody interested to try and contact the law profs of a local university).

this sounds net good because then we will simplify the law to one that makes sense and not one where literally everyone is a criminal

if humanity was capable of doing that we'd have done it already

AAAA (I also wonder about Godel here)

E: I also note that Yud and most of the thread have now given up on calling AGI AGI and are just calling it AI. Another point scored for learning to reason better using Rationalism. Vaguely related link (I only mention it here because I liked the term Epistemic Injustice and this is about our current AI innovation wave).

@Shitgenstein1 did he just watch Robocop?

"Well, here we are facing the utter extinction of humanity but at least we don't have to pay taxes or wear seatbelts".