this post was submitted on 06 Nov 2023
35 points (85.7% liked)
Asklemmy
43899 readers
1200 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- [email protected]: a community for finding communities
~Icon~ ~by~ ~@Double_[email protected]~
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
whats a markov chain
Take a whole bunch of text.
For each word that appears, note down a list of all the words that ever directly follow it - including end-of-sentence.
Now pick a starting word, pick a following-word at random from the list, rinse and repeat.
You can make it fancier if you want by noting how many times each word follows its predecessor in the sample text, and weighting the random choice accordingly.
Either way, the string of almost-language this produces is called a Markov chain.
It's a bit like constantly picking the middle button in your phone's autocomplete.
It's a fun little exercise to knock together in your programming language of choice.
If you make a prompt-and-response bot out of it, learning from each input, it's like talking to an oracular teddy bear. You almost can't help being nice to it as you teach it to speak; humans will pack-bond with anything.
LLMs are the distant and very fancy descendants of these - but pack-bonding into an actual romantic relationship with one would be as sad as marrying a doll.
I believe a Markov chain is an old, old wooden ship.
If I replace all of its code line by line, will it be the same ship? If no, at which point does it become a different ship?
Trick question! Nothing is permanent and the person you were a moment ago is complete different than the person you are now.
Using this one simple trick I made millions on the stock market... I just held an apple in my hand for five minutes and then sold all the billions of different apple moments on the commodity market. Imagine how rich Theseus could've been with that one simple trick! (Smash that like button and hit subscribe!)
A chain of pseudorandom results.
It is memory-less random process.