this post was submitted on 06 Nov 2023
43 points (87.7% liked)

Asklemmy

43471 readers
1183 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago
MODERATORS
 

with the way AI is getting by the week,it just might be a reality

you are viewing a single comment's thread
view the rest of the comments
[โ€“] TheBananaKing@lemmy.world 6 points 11 months ago

Take a whole bunch of text.

For each word that appears, note down a list of all the words that ever directly follow it - including end-of-sentence.

Now pick a starting word, pick a following-word at random from the list, rinse and repeat.

You can make it fancier if you want by noting how many times each word follows its predecessor in the sample text, and weighting the random choice accordingly.

Either way, the string of almost-language this produces is called a Markov chain.

It's a bit like constantly picking the middle button in your phone's autocomplete.

It's a fun little exercise to knock together in your programming language of choice.

If you make a prompt-and-response bot out of it, learning from each input, it's like talking to an oracular teddy bear. You almost can't help being nice to it as you teach it to speak; humans will pack-bond with anything.

LLMs are the distant and very fancy descendants of these - but pack-bonding into an actual romantic relationship with one would be as sad as marrying a doll.