this post was submitted on 18 Apr 2025
323 points (94.2% liked)
Technology
69156 readers
3043 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Anecdotally, I use it a lot and I feel like my responses are better when I'm polite. I have a couple of theories as to why.
More tokens in the context window of your question, and a clear separator between ideas in a conversation make it easier for the inference tokenizer to recognize disparate ideas.
Higher quality datasets contain american boomer/millennial notions of "politeness" and when responses are structured in kind, they're more likely to contain tokens from those higher quality datasets.
I haven't mathematically proven any of this within the llama.cpp tokenizer, but I strongly suspect that I could at least prove a correlation between polite token input and dataset representation output tokens
Honestly they were better until recently. GPT (at least) has gotten really good at de-escalation and providing (mostly) factual responses when you get irate
It FEEEEEEEEEEEELS better is what the authors said too. Both articles were completely worthless dreck about how they felt about the responses.
Yes they were, so I'm offering you an actual theory as to why this may actually be true, yet difficult to "prove".
Smoking was bad for your health long before anyone sat down and took the time to prove it. Autoregressive LLM tokenizer are a very new field of computer science and it's going to take a while for the community to collectively understand everything we're currently doing by trial and error.
And yet doctors saw the tar in the lungs and knew immediately.
Smoking was known to be bad for your health long before anyone did studies because it was easily correlated with coughing and other breathing issues and early death. The evidence was obvious and apparent.
🤦♂️
And you FEEEEEEEEL like it doesn't matter. What's the difference?