this post was submitted on 08 Dec 2024
55 points (84.0% liked)
Showerthoughts
30044 readers
873 users here now
A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. A showerthought should offer a unique perspective on an ordinary part of life.
Rules
- All posts must be showerthoughts
- The entire showerthought must be in the title
- Avoid politics
- 3.1) NEW RULE as of 5 Nov 2024, trying it out
- 3.2) Political posts often end up being circle jerks (not offering unique perspective) or enflaming (too much work for mods).
- 3.3) Try c/politicaldiscussion, volunteer as a mod here, or start your own community.
- Posts must be original/unique
- Adhere to Lemmy's Code of Conduct
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Sure maybe a really beastly one, but all the available models right now have relatively poor context windows. When assisting in complex setups, they let go of information frequently to keep the dialogue flowing. Suddenly it'll be giving you code snippets like
BASE_URL = [your base URL]
even when it should know my base URL.
So like, yeah, openai could probably show an AI create a fediverse instance. It'd take as much electricity as Manhattan uses in a day. But I doubt even OpenAIs new pro o1 model could achieve this, currently.
In fact, the context window was a significant weakness in the o1-preview. It was even worse than 4o.