This feels like a case where botanical science should just have picked a different name. If you invalidate everything people think of as a berry and then tell them a dozen things that are clearly not berries are, in fact, berries, you're just making the word berry meaningless.
Berry means a tiny, usually sweet, fruit-like growth from a plant. The kind that is usually picked in bunches. The kind that you use to make smoothies. That's a berry.
Botany did us all a disservice by choosing the word "berry" to mean "a specific thing which invalidates everything you think is a berry." Just call that plant structure something in Latin, ffs.