Futurology

1695 readers

49 users here now

founded 1 year ago

MODERATORS

voidx@futurology.today

Lugh@futurology.today

Espiritdescali@futurology.today

AwesomeLowlander@futurology.today

190

AI Companies Running Out of Training Data After Burning Through Entire Internet (futurism.com)

submitted 6 months ago by voidx@futurology.today to c/futurology@futurology.today

53 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] CanadaPlus@lemmy.sdf.org 4 points 6 months ago* (last edited 6 months ago)

Well, it's established wisdom that the dataset size needs to scale with the number of model parameters. Quadratically, IIRC. If you don't have that much data the training basically won't work; it will overfit or just not progress.

permalink
fedilink
source
parent